{"repo":"fabricks-framework/fabricks","free":true,"listed":false,"github":"https://github.com/fabricks-framework/fabricks","clone":"git clone https://github.com/fabricks-framework/fabricks.git","description":null,"language":"Python","stars":10,"topics":["databricks","datawarehouse","delta-lake","etl","etl-framework","framework","lakehouse","pyspark","sql","config-driven-etl"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Welcome to Fabricks 🏗️🧱 Framework for Databricks Fabricks is a Python framework developed to help create a Lakehouse in Databricks . It simplifies the process of building and maintaining data pipelines by providing a standardized approach to defining and managing data processing workflows. Fabricks is battle-proven, used in production environments running thousands of jobs. 💪🚀 Currently, Fabricks is based on Azure Databricks and runs on Azure, utilizing Azure Blob Storage, Azure Table Storage, and Azure Queue Storage. Porting it to AWS or Google Cloud should not be a significant challenge. ☁️🔄 Although Fabricks is primarily designed to run on Databricks , the code using Fabricks is highly portable. You'll predominantly write SQL-Select code, eliminating the need to manually write DDL/DML/Merge queries. In the future, we may add support for other platforms such as DuckDB or Open Source Spark. 🐍📊 Use Cases 🛠️ - Data Ingestion using Python Notebooks, Jupyter-style - ETL using SQL-queries (should cover 99% of cases) or Notebooks - Data Distribution using Python Notebooks No need for magic here. It's all your Data Lakehouse/Data Warehouse code in one place. Simple and great! ✨ You don't need expensive Delta Live Tables, ETL Tools, or DBT. It's basically just writing SQL Queries and letting Fabricks do the magic 🧙‍♂️. About this repo 🕵️‍♂️ We're just getting started with open-sourcing Fabricks! There are many areas where we want to improve: - Implement testing in GitHub A","default_branch":null,"files":null,"tree":[],"storefront":"/r/fabricks-framework","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/fabricks-framework/fabricks/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}