{"repo":"analyticsdurgesh/StreamCommerce-Lakehouse-360","free":true,"listed":false,"github":"https://github.com/analyticsdurgesh/StreamCommerce-Lakehouse-360","clone":"git clone https://github.com/analyticsdurgesh/StreamCommerce-Lakehouse-360.git","description":"Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraform, and Dash analytics.","language":"Python","stars":33,"topics":["airflow","data-engineering","data-quality","databricks","delta-lake","kafka","lakehouse","medallion-architecture","plotly-dash","terraform"],"license":null,"category":"data-pipelines","readme_excerpt":"StreamCommerce Lakehouse 360 Production-style e-commerce lakehouse platform that simulates real-time operational events, lands them in object storage, promotes data through Bronze, Silver, and Gold layers, applies reusable data quality checks, quarantines bad records, orchestrates the lifecycle with Airflow, and serves executive analytics through a Plotly Dash dashboard. This is a public portfolio project designed to demonstrate how a modern Data Engineering platform is designed end to end: ingestion, lake storage, medallion modeling, orchestration, quality, observability, infrastructure, dashboarding, and production migration thinking. Executive Summary StreamCommerce Lakehouse 360 models the analytics platform of a fictional e-commerce company. It receives events from six operational domains, writes immutable landing files, creates auditable Bronze records, produces trustworthy Silver tables, builds business-ready Gold KPI tables, and exposes insights to analytics users. Resume pitch: Built a production-style real-time e-commerce lakehouse using Kafka, AWS S3/MinIO, Airflow, Databricks, Delta Lake-style Medallion layers, reusable data quality checks, quarantine handling, Terraform infrastructure, and a Plotly Dash executive dashboard. What This Project Proves - Real-time event simulation across orders, payments, inventory, shipments, products, and customer behavior - Kafka topic design for multi-domain e-commerce event streams - S3/MinIO object-storage landing zone with rep","default_branch":null,"files":null,"tree":[],"storefront":"/r/analyticsdurgesh","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/analyticsdurgesh/StreamCommerce-Lakehouse-360/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}