{"repo":"polardb/duckdb-paimon","free":true,"listed":false,"github":"https://github.com/polardb/duckdb-paimon","clone":"git clone https://github.com/polardb/duckdb-paimon.git","description":"DuckDB extension for accessing Apache Paimon. 🦆","language":"C++","stars":44,"topics":["datalake","duckdb","paimon"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"DuckDB Paimon Extension 🦆 This extension enables DuckDB to read and query Apache Paimon format data directly — no ETL pipelines, no Flink/Spark clusters required. Just open a DuckDB shell and run SQL against your Paimon tables. Similar to other extensions, duckdb-paimon brings DuckDB's powerful local analytics to the Paimon data lake ecosystem. About Apache Paimon Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations. It innovatively combines lake format and LSM structure, bringing realtime streaming updates into the lake architecture. Implementation This extension is built on top of paimon-cpp, an open-source C++ library that provides native access to Paimon format data. It is the first library that brings native Paimon read/write capabilities to the C++ ecosystem. - Zero JVM dependency — No Java runtime required. Pure C++ implementation means minimal memory footprint and instant startup. - Apache Arrow data exchange — Data flows between paimon-cpp and DuckDB via Apache Arrow, the industry standard for columnar in-memory data, enabling zero-copy transfers with no serialization overhead. - Parallel scan architecture — Paimon tables are split into independent Splits, and DuckDB's multi-threaded execution engine reads them in parallel to fully utilize multi-core CPUs. - Secure credential management — OSS credentials are managed through DuckDB's native Secret Manager with scope isolati","default_branch":null,"files":null,"tree":[],"storefront":"/r/polardb","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/polardb/duckdb-paimon/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}