{"repo":"cnstlungu/portable-data-stack-dagster","free":true,"listed":false,"github":"https://github.com/cnstlungu/portable-data-stack-dagster","clone":"git clone https://github.com/cnstlungu/portable-data-stack-dagster.git","description":"A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset","language":"Dockerfile","stars":264,"topics":["business-intelligence","dagster","data-engineering","data-visualization","dbt","duckdb","python","superset"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Portable Data Stack This application is an Analytics suite for an imaginary company selling postcards. The company sells both directly but also through resellers in the majority of European countries. Stack - Dagster - Docker (Docker Compose) - DuckDB - dbt core - Superset Interested in the data model? Generation of example data and the underlying dbt-core model is available in the postcard-company-datamart project For other stacks using the same dbt-core model, check the below: - portable-data-stack-mage - portable-data-stack-airflow - portable-data-stack-sqlmesh Implementations with other tools with a different model: - portable-data-stack-bruin - postcard-company-dataform For the legacy version involving OLTP, CSV and JSON sources, check out the legacy-oltp branch. System requirements Docker Setup 1. Rename .env.example file to .env and set your desired password. Remember to never commit files containing passwords or any other sensitive information. 2. Rename shared/db/datamart.duckdb.example to shared/db/datamart.duckdb or init an empty database file there with that name. 3. With Docker Engine installed, change directory to the root folder of the project (also the one that contains docker-compose.yml) and run docker compose up --build Note that this may take several minutes to completed. Check out the console to see when the Dagster interface is ready. 4. Once the Docker suite has finished loading, open up Dagster (dagit) , go to Assets , select all and click Materialize ","default_branch":null,"files":null,"tree":[],"storefront":"/r/cnstlungu","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/cnstlungu/portable-data-stack-dagster/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}