{"repo":"AndreCNF/polids","free":true,"listed":false,"github":"https://github.com/AndreCNF/polids","clone":"git clone https://github.com/AndreCNF/polids.git","description":"Analysis of electoral manifestos and output of it through apps.","language":"Python","stars":14,"topics":["nlp","natural-language-processing","sentiment-analysis","hate-speech","politics","data-science","data-visualization","dashboard"],"license":"MIT","category":"machine-learning","readme_excerpt":"Analysis of political data and output of it through apps. Setup Installation To install the package and its dependencies, use uv and: 1. Install dependencies: Just the basics: Including dev dependencies: 1. Install the package: Setting up Pre-commit Hooks To ensure code is formatted correctly before committing, set up pre-commit hooks: 1. Setup pre-commit by installing the dev dependencies: 2. Install the hooks: 3. Run the hooks manually on all files (optional): This will use ruff to format your code automatically. Modules - pdf processing : Convert PDFs to markdown or raw text using OpenAI and fallback processors. - text chunking : Split document text into semantic chunks with OpenAI and Markdown-based chunkers. - party name extraction : Extract full and short party names from text chunks using OpenAI. - structured analysis : Analyze chunks for policy proposals, sentiment, topic, hate speech, and political compass scores. - scientific validation : Validate extracted policy proposals with Perplexity and OpenAI scientific validators. - topic unification : Unify and map topics across multiple documents using OpenAI unification models. - word cloud : Generate word clouds to visualize term frequencies for each political party. - utils : Helper functions for pandas DataFrame conversion and data manipulation. - config : Centralized configuration settings for models and processing parameters. Pipeline Script The entrypoint for the end-to-end processing pipeline is: It exposes a proc","default_branch":null,"files":null,"tree":[],"storefront":"/r/AndreCNF","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/AndreCNF/polids/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}