{"repo":"data-mie/dbt-profiler","free":true,"listed":false,"github":"https://github.com/data-mie/dbt-profiler","clone":"git clone https://github.com/data-mie/dbt-profiler.git","description":"Add data profiling to your dbt project.","language":"Shell","stars":100,"topics":["dbt","dbt-packages"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"dbt-profiler Add data profiling to your dbt project. Get null rates, distinct counts, min/max and more for any model or source. Contents - Installation - Supported adapters - Quick start - Profile measures - Macros - get profile - get profile table - print profile - print profile schema - print profile docs - Using profiles in dbt docs - Automating profile updates with CI - Contributing - License Installation dbt-profiler requires dbt =1.10.0 . Check dbt Hub for the latest installation instructions. Supported adapters Adapter Supported --- --- AWS Athena ✅ BigQuery ✅ Databricks ✅ PostgreSQL ✅ Redshift ✅ Snowflake ✅ Oracle ✅ SQL Server ✅ Apache Spark ❌ Presto ❌ dbt-profiler may work with unsupported adapters but they haven't been tested. If you've used dbt-profiler with an unsupported adapter, feedback is very welcome: open an issue, a PR, or reach out in the #tools-dbt-profiler channel on dbt Slack. Quick start Profile a relation and print the result to stdout: Use a relation profile as a dbt model: Generate a schema.yml skeleton with profile data embedded in column meta properties: Profile measures A calculated profile contains the following measures for each column: Measure Description Columns --- --- --- column name Name of the column all data type Data type of the column all not null proportion † Proportion of non- NULL values (e.g. 0.62 = 62% populated) all distinct proportion † Proportion of unique values all distinct count † Count of unique values all is unique † true ","default_branch":null,"files":null,"tree":[],"storefront":"/r/data-mie","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/data-mie/dbt-profiler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}