{"repo":"MiguelElGallo/iparq","free":true,"listed":false,"github":"https://github.com/MiguelElGallo/iparq","clone":"git clone https://github.com/MiguelElGallo/iparq.git","description":"Inspect Parquet metadata, encodings, compression, indexes, and Bloom filters locally","language":"Python","stars":25,"topics":["agent-skills","agentic-resource-discovery","bloom-filter","cli","data-engineering","metadata","parquet","python"],"license":"MIT","category":"data-pipelines","readme_excerpt":"iparq After reading this blog, I began to wonder which Parquet version and compression methods the everyday tools we rely on actually use, only to find that there's no straightforward way to determine this. That curiosity and the difficulty of quickly discovering such details motivated me to create iparq (Information Parquet). My goal with iparq is to help users easily identify the specifics of the Parquet files generated by different engines, making it clear which features—like newer encodings or certain compression algorithms—the creator of the parquet is using. Features - Bloom filters : Detects real Bloom-filter metadata and reports its size. Read more in this great article. - Encodings and types : Shows physical and logical types plus encodings such as RLE DICTIONARY , DELTA BINARY PACKED , and BYTE STREAM SPLIT . - Indexes and dictionary pages : Reports dictionary pages, column indexes, and offset indexes. - Statistics : Displays min/max values and available null and distinct counts. - Row groups and sort order : Shows row-group sizes, row counts, and declared sorting columns. - Page locations : Reports column-chunk, dictionary-page, data-page, and Bloom-filter offsets. - Schema details : Includes legacy converted types, decimal precision/scale, nesting levels, and GeoParquet statistics availability. - Compression : Shows codecs with optional column sizes and compression ratios. - Machine-readable output : Emits JSON for scripts and agent workflows. iParq requires Pytho","default_branch":null,"files":null,"tree":[],"storefront":"/r/MiguelElGallo","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/MiguelElGallo/iparq/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}