{"repo":"autotraderuk/dbt-dry-run","free":true,"listed":false,"github":"https://github.com/autotraderuk/dbt-dry-run","clone":"git clone https://github.com/autotraderuk/dbt-dry-run.git","description":"Dry run capability for dbt projects using BigQuery","language":"Python","stars":102,"topics":["dbt","testing","bigquery"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"dbt-dry-run [dbt][dbt-home] is a tool that helps manage data transformations using templated SQL queries. These SQL queries are executed against a target data warehouse. It doesn't check the validity of SQL queries before it executes your project. This dry runner uses BigQuery's [dry run][bq-dry-run] capability to allow you to check that SQL queries are valid before trying to execute them. See the [blog post][blog-post] for more information on how the dry runner works. Quickstart Installation The dry runner can be installed via pip: pip install dbt-dry-run Running The dry runner has a single command called dbt-dry-run in order for it to run you must first compile a dbt manifest using dbt compile . How much of the project should I compile? It is best practice to compile the entire dbt project when supplying a manifest for dry run. The dry run loops through your project in the DAG order (staging - intermediate - mart) based on ref and predicts the schema of each model as it progresses. If you dry run marts but have not compiled staging then it cannot determine if marts will run as it does not know the predicted schema of the upstream models and you will see NotCompiledException in the dry run output. Then on the same machine (So that the dry runner has access to your dbt project source and the manifest.yml ) you can run the dry-runner in the same directory as our dbt project.yml : Like dbt it will search for profiles.yml in /.dbt/ and use the default target specified. Just like","default_branch":null,"files":null,"tree":[],"storefront":"/r/autotraderuk","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/autotraderuk/dbt-dry-run/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}