{"repo":"Victor-Kipruto-Rop/Real_Time_Transaction_Streaming-MPESA-","free":true,"listed":false,"github":"https://github.com/Victor-Kipruto-Rop/Real_Time_Transaction_Streaming-MPESA-","clone":"git clone https://github.com/Victor-Kipruto-Rop/Real_Time_Transaction_Streaming-MPESA-.git","description":"Real-Time M-Pesa Transaction Streaming Pipeline built using modern data engineering technologies to ingest, process, stream, and analyze transaction data in real time. Demonstrates event-driven architecture, stream processing, data pipelines, and scalable analytics for fintech applications.","language":"Python","stars":28,"topics":["apache","apache-kafka","apache-spark","data-engineering","data-pipeline","data-pipeline-monitoring","etl","etl-pipeline","postgresql","real-time-streaming"],"license":null,"category":"data-pipelines","readme_excerpt":"M-Pesa Real-Time Transaction Streaming Pipeline Category: Real-Time Data Engineering / FinTech Analytics --- Overview This project demonstrates how modern financial transaction systems process real-time mobile money payments at scale using a production-style data engineering architecture. The pipeline receives M-Pesa transaction events from Safaricom Daraja API webhooks, streams them through Apache Kafka, processes and enriches the events in real time, stores them in PostgreSQL/BigQuery, and visualizes analytics using dashboards. The project simulates how real-world payment systems handle: - Real-time transaction ingestion - Event streaming - Data transformation - Fraud monitoring concepts - Analytics pipelines - Monitoring and observability - Scalable distributed systems --- Architecture Flow --- Technologies Used - Python - Apache Kafka - Apache Flink - PostgreSQL - Google BigQuery - dbt - Grafana - Docker - Airflow - Safaricom Daraja API --- Quick Start Clone Repository Start Services Health Check Send Sample Transaction --- Verified Features - Real-time Kafka streaming - Webhook ingestion - PostgreSQL insertion - dbt transformations - Dockerized infrastructure - Automated testing - Analytics-ready data models --- Author Victor Kipruto Rop GitHub: https://github.com/Victor-Kipruto-Rop Email: kiprutovictor39@gmail.com","default_branch":null,"files":null,"tree":[],"storefront":"/r/Victor-Kipruto-Rop","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Victor-Kipruto-Rop/Real_Time_Transaction_Streaming-MPESA-/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}