{"repo":"Victor-Kipruto-Rop/mpesa_safaricom-pipeline-","free":true,"listed":false,"github":"https://github.com/Victor-Kipruto-Rop/mpesa_safaricom-pipeline-","clone":"git clone https://github.com/Victor-Kipruto-Rop/mpesa_safaricom-pipeline-.git","description":"End-to-end M-Pesa data pipeline for extracting, transforming, validating, and storing transaction data using Python, SQL, Airflow, and PostgreSQL.","language":"Python","stars":26,"topics":["data-pipeline","data-processing","workflow-orchestration","mpesa","safaricom-mpesa","safaricom-mpesa-apis"],"license":null,"category":"data-pipelines","readme_excerpt":"🚀 M-Pesa Safaricom Data Pipeline An end-to-end Data Engineering project that ingests, processes, stores, and analyzes Safaricom M-Pesa transaction data using modern data engineering practices. This pipeline demonstrates scalable ETL workflows, workflow orchestration, data quality validation, and analytics-ready storage. M-Pesa integrations commonly involve Daraja APIs and asynchronous callback processing. :contentReference[oaicite:0]{index=0} --- 📌 Overview This project showcases a production-style data pipeline designed to: - Extract M-Pesa transaction data - Process and validate records - Transform raw data into analytics-ready datasets - Store structured data in a relational database - Automate workflows and scheduling - Monitor pipeline health and execution - Generate business insights from transaction activity --- 🏗️ Architecture text ┌──────────────┐ │ M-Pesa API │ └──────┬───────┘ │ ▼ ┌──────────────┐ │ Data Ingest │ └──────┬───────┘ │ ▼ ┌──────────────┐ │ ETL Process │ └──────┬───────┘ │ ▼ ┌──────────────┐ │ PostgreSQL │ └──────┬───────┘ │ ▼ ┌──────────────┐ │ Analytics │ └──────────────┘ 🛠️ Tech Stack Data Engineering Python Pandas SQL Apache Airflow Data Storage PostgreSQL CSV / JSON Infrastructure Docker Docker Compose Linux Development Git GitHub VS Code Monitoring Logging Data Quality Checks Pipeline Validation mpesa safaricom-pipeline/ │ ├── data/ │ ├── raw/ │ ├── processed/ │ └── curated/ │ ├── dags/ │ └── mpesa pipeline.py │ ├── scripts/ │ ├── extract.py │","default_branch":null,"files":null,"tree":[],"storefront":"/r/Victor-Kipruto-Rop","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Victor-Kipruto-Rop/mpesa_safaricom-pipeline-/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}