{"repo":"Geobatpo07/datahut-duckhouse","free":true,"listed":false,"github":"https://github.com/Geobatpo07/datahut-duckhouse","clone":"git clone https://github.com/Geobatpo07/datahut-duckhouse.git","description":"DataHut-DuckHouse is a modern, modular, and multi-tenant analytics platform that combines DuckDB, Apache Iceberg, Arrow Flight, dbt, and Trino to build a hybrid, lightweight, and scalable data stack ready for SaaS.","language":"Python","stars":12,"topics":["analytics-engineering","data-engineering","data-ingestion-and-infrastructure","data-lake","data-storage","data-visualization","docker","duckdb","minio","python"],"license":"MIT","category":"data-pipelines","readme_excerpt":"🏠 DataHut-DuckHouse DataHut-DuckHouse is a lightweight, hybrid, and open-source analytics platform that combines the simplicity of DuckDB , the scalability of Iceberg , the speed of Arrow Flight , the orchestration power of Xorq , and the modularity of dbt to create a modern, local or cloud-ready data stack. 🧱 Architecture SaaS hybride ✨ Features - 🔗 Fast ingestion via Arrow Flight - 🐤 Hybrid storage: local DuckDB & Iceberg (MinIO) - 🧠 Orchestration with Xorq (Flight + multi-backend support) - 🔄 Auto-synchronization with Trino (catalogs) - 📊 Declarative SQL transformations using dbt - 📦 Multi-tenancy: dynamic tenant creation/deletion - ☁️ S3 integration via MinIO ⚙️ Requirements - Python 3.11+ - Poetry - Docker - dbt CLI 🚀 Installation 1. Clone the repository 2. Install Python dependencies 3. Launch the full environment 4. Create a tenant 5. Ingest data Place a CSV file in ingestion/data/data.csv then run: 📂 Project Structure 🧠 Using dbt with DuckDB 🔎 Example Local Query 🔒 Delete a Tenant 📈 BI Interface with Trino Access Trino at http://localhost:8080 Use tenant acme as the Trino catalog in Superset or Metabase. 🛣️ Roadmap - ✅ Multi-tenant Iceberg + DuckDB - ✅ Dynamic registration with Xorq + Trino - 🔜 Flask/React management interface - 🔜 User authentication + role management - 🔜 Integration with Metabase or Superset - 🔜 SaaS deployment on public cloud 📄 License Project under MIT License. ✍️ Author Geovany Batista Polo LAGUERRE – lgeobatpo98@gmail.com Data","default_branch":null,"files":null,"tree":[],"storefront":"/r/Geobatpo07","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Geobatpo07/datahut-duckhouse/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}