{"repo":"cnstlungu/postcard-company-dataform","free":true,"listed":false,"github":"https://github.com/cnstlungu/postcard-company-dataform","clone":"git clone https://github.com/cnstlungu/postcard-company-dataform.git","description":"example BQ data model using Dataform","language":"Python","stars":17,"topics":["bigquery","data-engineering","dataform","google-cloud-platform","sql"],"license":"MIT","category":"databases-storage","readme_excerpt":"Postcard Company — Dataform A Dataform v3 example project for an imaginary postcard company that sells directly and through resellers across Europe. It demonstrates real-world patterns for building a data warehouse on BigQuery using Dataform. This project is the Dataform equivalent of postcard-company-datamart (dbt-core + DuckDB). Disclaimer: This is an example project provided for educational purposes only, made available as-is without any warranties or guarantees. All data is artificially generated using the Faker library — any resemblance to real persons, companies, or transactions is purely coincidental. The project is not intended for production use. --- What it demonstrates - Clear separation of concerns across four layers: source ingestion ( raw input ) is kept strictly separate from normalization ( raw ), business logic ( staging ), and consumption ( core ) - GCS external tables defined in SQL — source ingestion is part of the Dataform DAG, not a separate pipeline step. Includes both explicit schema and auto-detect patterns, with an explanation of when each applies - Multi-source customer unification — direct customers and two reseller types with different column schemas are merged and deduplicated into a single dim customer , with surrogate keys derived from the appropriate source identifiers - Incremental models done right — uniqueKey , watermark-based filtering, QUALIFY ROW NUMBER() deduplication to handle late-arriving duplicates, BigQuery partitioning and cluster","default_branch":null,"files":null,"tree":[],"storefront":"/r/cnstlungu","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/cnstlungu/postcard-company-dataform/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}