{"repo":"Agazoth/PSParquet","free":true,"listed":false,"github":"https://github.com/Agazoth/PSParquet","clone":"git clone https://github.com/Agazoth/PSParquet.git","description":"Read and write parquet files from the PowerShell commandline","language":"PowerShell","stars":21,"topics":["big-data","etl","powershell","onelake"],"license":"MIT","category":"data-pipelines","readme_excerpt":"PSParquet Import and Export Data to and from Parquet Files This PowerShell module is a free and open source tool that allows you to easily import and export data to and from Parquet files directly from the command line. It's built on the Parquet.Net library developed by https://github.com/aloneguid Advantages of Using this Module - Efficient Storage: Parquet is a columnar storage format that is highly optimized for performance and space efficiency. This module makes it easy to store and retrieve very large datasets efficiently. - Open Source and Free: The module is free and open source, making it accessible to everyone and giving users the ability to contribute and improve the code. - Easy to Use: With this module, you can easily import and export data to and from Parquet files directly from the command line. This makes it an ideal tool for ETL. - Works with Microsoft Fabric's OneLake Client: This module is perfect for modern big data implementations using Microsoft products like Microsoft Fabric's OneLake client, as well as other Cloud native tools in Azure. How to Use To get started, simply install the module from the PowerShell Gallery: Once installed, you can use the Import-Parquet and Export-Parquet cmdlets to import and export data to and from Parquet files. For example, to import data from a Parquet file: And to export data to a Parquet file: Use the Get-Help cmdlet for more help. Contributions Contributions to this open source module are always welcome! If you find a ","default_branch":null,"files":null,"tree":[],"storefront":"/r/Agazoth","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Agazoth/PSParquet/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}