{"repo":"ssp-data/practical-data-engineering","free":true,"listed":false,"github":"https://github.com/ssp-data/practical-data-engineering","clone":"git clone https://github.com/ssp-data/practical-data-engineering.git","description":"Practical Data Engineering: A Hands-On Real-Estate Project Guide","language":"Jupyter Notebook","stars":819,"topics":["dagster","data-engineering","data-pipeline"],"license":null,"category":"data-pipelines","readme_excerpt":"Practical Data Engineering: A Hands-On Real-Estate Project Guide This repository containts a practical implementation of a data engineering project that spans across web-scraping real-estates, processing with Spark and Delta Lake, adding data science with Jupyter Notebooks, ingesting data into Apache Druid, visualizing with Apache Superset, and managing workflows with Dagster—all orchestrated on Kubernetes. Built your own DE project or forked mine? Let me know in the comments; I'd be curious to know more about. 🌟 About This Project This Practical Data Engineering project addresses common data engineering challenges while exploring innovative technologies. It should serve as a learning project but incorporate comprehensive real-world use cases. It's a guide to building a data application that collects real-estate data, enriches it with various metrics, and offers insights through machine learning and data visualization. This application helps you find your dream properties in your area and showcases how to handle a full-fledged data engineering pipeline using modern tools and frameworks. Why this project? - Real-World Application : Tackling a genuine problem with real estate data to find the best properties. - Comprehensive Tech Stack : Utilizes a wide range of technologies from web scraping, S3 storage, data processing, machine learning, to data visualization and orchestration. - Hands-On Learning : Offers a hands-on approach to understanding how different technologies integ","default_branch":null,"files":null,"tree":[],"storefront":"/r/ssp-data","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ssp-data/practical-data-engineering/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}