{"repo":"nssalian/floe","free":true,"listed":false,"github":"https://github.com/nssalian/floe","clone":"git clone https://github.com/nssalian/floe.git","description":"Floe: Policy-based table maintenance for Apache Iceberg","language":"Java","stars":44,"topics":["apache-iceberg","apache-spark","data-lakehouse","trino","table-maintenance-system"],"license":"Apache-2.0","category":"workflow-automation","readme_excerpt":"Floe Floe is a policy-based table maintenance system for Apache Iceberg. (A floe is a sheet of floating ice.) Floe automates compaction, snapshot expiration, orphan cleanup, and manifest optimization through declarative policies. It orchestrates maintenance using Iceberg's built-in procedures via Spark or Trino. High Level Architecture Quick Start Open http://localhost:9091 and explore the API or UI. Full Example Setups Features - Policy-driven - Define maintenance rules that match tables by glob pattern - Scheduled - Cron-based scheduling support as well as manual triggering - Multi-catalog - Iceberg REST Catalogs (Polaris, Lakekeeper, Gravitino, DataHub), Hive, and Nessie are supported - Multi-engine - Spark (via Livy), Trino - Pluggable - Swap catalogs, engines, and storage backends Supported Operations Operation Description ----------- ------------- REWRITE DATA FILES Compact small files EXPIRE SNAPSHOTS Remove old snapshots REMOVE ORPHAN FILES Delete unreferenced files REWRITE MANIFESTS Optimize manifest files Create a Policy in any of the Example Setups Run a Maintenance Operation in any of the Example Setups Documentation - Policy Guide - Complete guide to configuring maintenance policies - Full Documentation - Architecture, configuration, and API reference Project Status Floe works as documented. Forks are welcome. License Apache License 2.0","default_branch":null,"files":null,"tree":[],"storefront":"/r/nssalian","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/nssalian/floe/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}