{"repo":"ChahiriAbderrahmane/modern-data-stack-nyc-taxi","free":true,"listed":false,"github":"https://github.com/ChahiriAbderrahmane/modern-data-stack-nyc-taxi","clone":"git clone https://github.com/ChahiriAbderrahmane/modern-data-stack-nyc-taxi.git","description":"Enterprise-grade Data Platform for NYC Taxi Analytics. Orchestrated with Airflow (Astro) & dbt, served via FastAPI & Power BI. Features Medallion Architecture, Data Quality Observability (Slack), and Star Schema modeling.","language":"Python","stars":10,"topics":["airflow","astro-airflow","cosmos","dbt","docker","postgresql","dbeaver","medallion-architecture","powerbi","slack-webhook"],"license":null,"category":"data-pipelines","readme_excerpt":"🚖 NYC Taxi Data Engineering Platform End-to-End ELT Pipeline Data Warehouse BI & API Microservices An enterprise-grade Data Engineering project transforming raw NYC Taxi data into actionable insights via a modern stack: Airflow, dbt, PostgreSQL, FastAPI, Power BI, and Slack . Project Architecture 📝 Table of Contents 1. Project Overview 2. Architecture & Data Modeling 3. Business Intelligence (Dashboards) 4. Orchestration (Airflow) 5. Data Products (API) 6. Observability & Alerting 7. Performance & Optimization 8. Installation 9. Contact 🔭 Project Overview This project simulates a real-world data platform for a Taxi company. It ingests high-volume trip data, cleanses it, models it into a Star Schema, and serves it to different stakeholders (Executives, Operations, Finance) via Dashboards and APIs. Key Features: ELT Pipeline: Ingestion of raw CSVs into Bronze/Silver/Gold layers using dbt and Postgres . Data Quality: Automated testing and \"Revenue at Risk\" calculation to detect anomalies (negative fares, time travel). Microservice API: A standalone FastAPI container serving Gold data to external apps. Observability: Slack alerting for data quality breaches. 🏗️ Architecture & Data Modeling The project follows the Medallion Architecture (Bronze - Silver - Gold). The Star Schema (Gold Layer) I transformed the data into a rigorous dimensional model optimized for BI performance. Entity Relationship Diagram (ERD) generated from the Gold Layer. Aggregations for BI To handle million","default_branch":null,"files":null,"tree":[],"storefront":"/r/ChahiriAbderrahmane","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ChahiriAbderrahmane/modern-data-stack-nyc-taxi/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}