{"repo":"richban/opendata-stack-platform","free":true,"listed":false,"github":"https://github.com/richban/opendata-stack-platform","clone":"git clone https://github.com/richban/opendata-stack-platform.git","description":"Open Data Stack Platform: a collection of projects and pipelines built with open data stack tools for scalable, observable data platform.","language":"Python","stars":22,"topics":["dagster-project","data-engineering","data-lake","data-warehousing","dbt","dlt","snowflake"],"license":null,"category":"data-pipelines","readme_excerpt":"Opendata Stack: 🚕🗽 📊 NYC TLC Trip Record Data Overview Objective Build a modern data analytics and machine learning platform that provides a scalable foundation for ingesting, transforming, and analyzing data. Using NYC taxi trip data as a practical example, this platform demonstrates how to build robust data pipelines with modern tooling. Scope The solution covers the full data lifecycle—from extraction of raw datasets available on NYC’s Open Data portal, through transformation and storage, to advanced analytics and visualization. The system is designed as a Work In Progress (WIP) that will evolve through iterative enhancements. Business Process Process Being Measured Taxi and For-Hire Vehicle trips in NYC, segmented by Yellow Taxi, Green Taxi, and FHV data. Goals - Build a scalable data platform that enables rapid analytics development - Implement robust data pipelines with built-in quality checks and monitoring - Demonstrate end-to-end ML workflows from data ingestion to model deployment - Create reproducible analytics that drive data-informed decision making - Showcase modern data stack integration patterns and best practices Platform Value - Technical Excellence : - Production-ready data pipeline architecture - Scalable infrastructure patterns - Modern data stack integration examples - CI/CD and testing best practices - Business Intelligence : - Advanced analytics workflows - ML-ready data foundations Target Audience - Engineering Leaders : - CTOs and Technical Direct","default_branch":null,"files":null,"tree":[],"storefront":"/r/richban","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/richban/opendata-stack-platform/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}