{"repo":"Quocc1/OpenStack","free":true,"listed":false,"github":"https://github.com/Quocc1/OpenStack","clone":"git clone https://github.com/Quocc1/OpenStack.git","description":"An end-to-end open-source data stack for crawling and visualizing real estate data, facilitating insights into market trends.","language":"Python","stars":15,"topics":["dagster","dbt","iceberg","metabase","minio","notebook","postgresql","spark","trino","docker"],"license":null,"category":"data-pipelines","readme_excerpt":"Open Data Stack: Data-driven Real Estate Insights in Ho Chi Minh City An end-to-end open-source data stack for crawling and visualizing real estate data, to provide insights into market trends. Preview Table of Contents 1. Introduction - Technologies used 2. Prerequisites 3. Setup and Run 4. Architecture - Purpose 5. Components of the Data Stack - Data Crawling: Requests - Data Transformation: DBT, Apache Spark, Trino - Data Warehousing and Storage: Rustfs, Iceberg, PostgreSQL - Data Visualization and Analysis: Metabase, Jupyter Notebook - Project Orchestration: Dagster 6. Project Overview 7. Visualization 8. Acknowledgements Introduction This project is a holistic open-source data solution designed to systematically collect real estate data from Ho Chi Minh City and present it through interactive visualizations, enabling users to gain insights into market trends. By leveraging this data stack, users can efficiently collect and analyze real-time data from multiple sources within the local real estate market. The system provides capabilities for data acquisition, processing, storage, and visualization, allowing users to explore market dynamics, track property trends, and identify potential investment opportunities. Technologies Used Below is a list of technologies used in this project: Component Description URL ------------------------------------------------ --------------------------------------- ------------------------------------------------------------------- Docker Cont","default_branch":null,"files":null,"tree":[],"storefront":"/r/Quocc1","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Quocc1/OpenStack/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}