{"repo":"Victor-Kipruto-Rop/Data-Enginerring-full-project","free":true,"listed":false,"github":"https://github.com/Victor-Kipruto-Rop/Data-Enginerring-full-project","clone":"git clone https://github.com/Victor-Kipruto-Rop/Data-Enginerring-full-project.git","description":"Designed and implemented a full-scale Data Engineering solution, covering data ingestion, transformation, orchestration, storage, monitoring, and analytics using industry-standard tools and cloud technologies to deliver reliable, scalable, and business-ready data pipelines.","language":"Python","stars":26,"topics":["apache-airflow","apache-kafka","apache-spark","dbt","docker","git","github","github-actions","pandas","postegresql"],"license":null,"category":"data-pipelines","readme_excerpt":"Data Engineering Projects Portfolio A structured, hands-on repository of data engineering projects built with Python. It is designed as a progression from foundational ETL workflows to advanced orchestration and analytics pipelines. Highlights - 3 learning tracks with increasing complexity - 15 core projects covering ETL, APIs, SQL, warehousing, Airflow, and time-series data - CLI-driven scripts for reproducible local runs - Test suites with pytest - CI workflow in .github/workflows/ci.yml - Project-level docs in each docs/README.md Tracks Track Directory Focus Projects --- --- --- --- Beginner Beginner/ ETL foundations, cleaning, SQL aggregation, API ingestion 5 Intermediate Intermediate/ Warehousing, orchestration, resilient API integrations, IoT, social pipelines 5 Production Data-engineering-production/ Production-ready mirrors of beginner projects 5 Note: Data-engineering-beginner/ is an alternate beginner copy retained in the repo. Project Catalog Beginner ( Beginner/ ) 1. 01 Simple ETL CSV to DB - CSV to SQLite ETL, batching, retries, benchmarking 2. 02 CSV Excel Cleaning - Data cleaning and validation workflows 3. 03 SQL Data Aggregation - SQL-based aggregation and reporting patterns 4. 04 Weather Data API - API-style weather dataset ingestion and transformation 5. 05 Movie Dataset ETL - Movie dataset extraction and transformation pipeline Intermediate ( Intermediate/ ) 1. 01 Data Warehouse - Star-schema warehouse ETL with dimensional modeling 2. 02 Airflow ETL Pipeli","default_branch":null,"files":null,"tree":[],"storefront":"/r/Victor-Kipruto-Rop","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Victor-Kipruto-Rop/Data-Enginerring-full-project/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}