{"repo":"cnstlungu/portable-data-stack-sqlmesh","free":true,"listed":false,"github":"https://github.com/cnstlungu/portable-data-stack-sqlmesh","clone":"git clone https://github.com/cnstlungu/portable-data-stack-sqlmesh.git","description":"A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset","language":"Dockerfile","stars":61,"topics":["dbt-core","duckdb","sqlmesh","superset"],"license":"MIT","category":"deployment-docker-iac","readme_excerpt":"Portable Data Stack with SQLMesh This application is a containerized Analytics suite for an imaginary company selling postcards. The company sells both directly but also through resellers in the majority of European countries. Stack - Docker (docker compose) - DuckDB - SQLMesh using dbt adapter - Superset Interested in the data model? Generation of example data and the underlying dbt-core model is available in the postcard-company-datamart project. For other stacks, check the below: - portable-data-stack-dagster - portable-data-stack-airflow - portable-data-stack-mage - portable-data-stack-bruin - postcard-company-dataform System requirements Docker Setup 1. Rename .env.example file to .env and set your desired Superset password. Remember to never commit files containing passwords or any other sensitive information. 2. Rename shared/db/datamart.duckdb.example to shared/db/datamart.duckdb or init an empty database file there with that name. 3. With Docker engine installed, change directory to the root folder of the project (also the one that contains docker-compose.yml) and run docker compose up --build 4. Once the Docker suite has finished starting, you will see the output of the SQLMesh plan & apply commands, which run the dbt core models against DuckDB. 5. To explore the data and build dashboards you can open the Superset interface Demo Credentials Demo credentials are set in the .env file mentioned above. Ports exposed locally SQLMesh: 8000 Superset: 8088 Generated parquet","default_branch":null,"files":null,"tree":[],"storefront":"/r/cnstlungu","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/cnstlungu/portable-data-stack-sqlmesh/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}