{"repo":"databricks/dbt-databricks","free":true,"listed":false,"github":"https://github.com/databricks/dbt-databricks","clone":"git clone https://github.com/databricks/dbt-databricks.git","description":"A dbt adapter for Databricks.","language":"Python","stars":374,"topics":["dbt","sql","etl","databricks"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications. The Databricks Lakehouse provides one simple platform to unify all your data, analytics and AI workloads. dbt-databricks The dbt-databricks adapter contains all of the code enabling dbt to work with Databricks. This adapter is based off the amazing work done in dbt-spark. Some key features include: - Easy setup . No need to install an ODBC driver as the adapter uses pure Python APIs. - Open by default . For example, it uses the the open and performant Delta table format by default. This has many benefits, including letting you use MERGE as the the default incremental materialization strategy. - Support for Unity Catalog . dbt-databricks supports the 3-level namespace of Unity Catalog (catalog / schema / relations) so you can organize and secure your data the way you like. - Performance . The adapter generates SQL expressions that are automatically accelerated by the native, vectorized Photon execution engine. Choosing between dbt-databricks and dbt-spark If you are developing a dbt project on Databricks, we recommend using dbt-databricks for the reasons noted above. dbt-spark is an actively developed adapter which works with Databricks as well as Apache Spark anywhere it is hosted e.g. on AWS EMR. Getting started Installation Install using pip: Upgrade to the latest version Profile Setup Documentation For documentation on Databricks-speci","default_branch":null,"files":null,"tree":[],"storefront":"/r/databricks","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/databricks/dbt-databricks/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}