{"repo":"RedhaWassim/Sentiment-Analysis","free":true,"listed":false,"github":"https://github.com/RedhaWassim/Sentiment-Analysis","clone":"git clone https://github.com/RedhaWassim/Sentiment-Analysis.git","description":"end-to-end Reddit posts / comments sentiment analysis project","language":"Python","stars":13,"topics":["aws","database","machine-learning","natural-language-processing","nlp","python","sentiment-analysis"],"license":null,"category":"machine-learning","readme_excerpt":"Reddit Data Engineering Pipeline A production-ready data engineering pipeline that ingests Reddit posts and comments with Python, delivers batches to AWS Kinesis Firehose, lands raw data in S3, publishes processing events with SNS, transforms with AWS Lambda, and stores curated datasets in Supabase. End-to-End Architecture Reddit → Python Ingestion → AWS Kinesis Firehose → AWS S3 → AWS SNS → AWS Lambda → Supabase - Reddit: data source (subreddits feed) - Python Ingestion: PRAW-based scrapers with batching and retry/backoff - Kinesis Firehose: reliable delivery stream to S3 - S3: raw data lake storage (partitioned) - SNS: event notifications to trigger downstream processing - Lambda: stateless validation, transformation, enrichment - Supabase: relational storage for curated posts and comments Repository Layout (actual) What Each Module Does - sentiment analysis/scrapping/data scrapping.py - Authenticates with Reddit using PRAW - Pulls posts/comments by topic (best/new/trending) - Batches and prepares payloads for delivery - sentiment analysis/AWS processing/kinesis firehose/kinesis firehose.py - Thin client around Firehose - Handles PutRecord/PutRecordBatch with basic retries - Expects JSON payloads (posts/comments) - sentiment analysis/AWS processing/lambda function/lambda function.py - SNS-triggered entrypoint - Reads new S3 objects (from Firehose) - Validates/cleans/transforms records - Upserts curated rows into Supabase - sentiment analysis/storage/db schema.sql - SQL sche","default_branch":null,"files":null,"tree":[],"storefront":"/r/RedhaWassim","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/RedhaWassim/Sentiment-Analysis/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}