{"repo":"C00ldudeNoonan/astrolabe","free":true,"listed":false,"github":"https://github.com/C00ldudeNoonan/astrolabe","clone":"git clone https://github.com/C00ldudeNoonan/astrolabe.git","description":"A personal data platform for U.S. economic and financial market data — Dagster, dbt, MotherDuck, DSPy. Queried over MCP.","language":"Python","stars":44,"topics":["dagster","data-engineering","dbt","dspy","duckdb","economic-data","fred","mcp","motherduck"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Economic Data Project An end-to-end data platform that ingests, transforms, and analyzes economic and financial market data. Pipelines run on self-hosted Dagster OSS (Docker). BigQuery is the primary warehouse for raw ingestion, dbt transformations, dbt-ML document extraction, signals, and analysis. Data is queried and explored via AI agents using the dbt-index MCP server's warehouse tools. Architecture Storage format All current warehouse relations use native BigQuery tables or views: Layer Format Why --- --- --- Dagster ingestion and Python-computed signals Native BigQuery tables Written through BigQuery load jobs and MERGE . dbt and dbt-ML models Native BigQuery tables All consumers query through BigQuery; no external Iceberg reader currently exists. Views n/a dbt ignores the catalog for views — nothing to store. The Iceberg-to-native migration and its final resource cleanup completed on August 11, 2026. No Iceberg catalog, bucket, or BigLake connection remains. See docs/dbt project/native-bigquery-migration.md for the validation record. Project Structure Quick Start (Local) Prerequisites - Docker Desktop - API keys (see .env.example ) - Google Cloud project with BigQuery enabled + a service account (see GOOGLE APPLICATION CREDENTIALS ) Setup Dagster UI: http://localhost:3000 Development (without Docker) Data Sources Source Data -------- ------ FRED 70+ economic series — GDP, inflation, employment, yield curve MarketStack S&P 500 / NASDAQ prices, ETFs, indices, commodities","default_branch":null,"files":null,"tree":[],"storefront":"/r/C00ldudeNoonan","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/C00ldudeNoonan/astrolabe/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}