{"repo":"mrjsj/msfabricutils","free":true,"listed":false,"github":"https://github.com/mrjsj/msfabricutils","clone":"git clone https://github.com/mrjsj/msfabricutils.git","description":"Spark-free Python utilities for Microsoft Fabric focused on Data Engineering using Polars and delta-rs","language":"Python","stars":45,"topics":["dataframe","deltalake","duckdb","python","fabric","microsoft-fabric","delta-rs","polars","data-engineering"],"license":"MIT","category":"data-pipelines","readme_excerpt":"MSFabricUtils A collection of Spark-free Python utilities for working with Microsoft Fabric in Python Notebooks. Mainly focused on Data Engineering tasks utilising Polars and delta-rs. Installation Features Local development first - Aim to provide a local development \"within\" Fabric. This means you can develop and run code locally, but reading and writing to Fabric Lakehouses. You can also read and write to Azure Data Lake, or even locally. ETL - Read from delta tables or parquet files with automatic authentication to Azure Data Lake or OneLake - Common transformations (add audit columns, reorder columns, deduplicate etc.) - Load delta tables with one of the provided load methods (upsert, overwrite, append etc.) Thin Fabric API wrapper Intregate functions to manage workspaces, lakehouses, notebooks, environments, libraries, etc. For more details, see the Fabric API Reference Fabric API as CLI CLI for managing workspaces, lakehouses, notebooks, environments, libraries, etc. To get started, run: Fabric DuckDB Connection Seamless integration between DuckDB and Microsoft Fabric Lakehouses for data exploration and analysis. - Cross-workspace and cross-lakehouse querying capabilities - Automatic table registration - Reading and writing to Onelake outside and inside Fabric - Support for Delta Lake tables - Flexible table name referencing (1-part to 4-part names) Documentation For quick start and detailed documentation, examples, and API reference, visit our GitHub Pages documentatio","default_branch":null,"files":null,"tree":[],"storefront":"/r/mrjsj","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mrjsj/msfabricutils/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}