{"repo":"earth-mover/icechunk","free":true,"listed":false,"github":"https://github.com/earth-mover/icechunk","clone":"git clone https://github.com/earth-mover/icechunk.git","description":"Open-source, cloud-native transactional tensor storage engine","language":"Rust","stars":659,"topics":["cloud","database","xarray","zarr"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"Icechunk --- [!TIP] Icechunk 2.0 is released! Better consistency, performance, and reliability for tensor storage --- Icechunk is an open-source (Apache 2.0), transactional storage engine for tensor / ND-array data designed for use on cloud object storage. Icechunk works together with Zarr , augmenting the Zarr core data model with features that enhance performance, collaboration, and safety in a cloud-computing context. Documentation and Resources - This page: a general overview of the project's goals and components. - Icechunk Launch Blog Post - Frequently Asked Questions - Documentation for Icechunk Python, the main user-facing library - Documentation for the Icechunk Rust Crate - The Contributor Guide - The Icechunk Spec Crate Structure The Rust workspace is organized into layered crates: Crate Description ------- ------------- icechunk-macros Procedural macro helpers for tests and internal use icechunk-types Shared foundational types ( Path , ETag , Move , error wrappers) used across all crates icechunk-format Binary format types and serialization (snapshots, manifests, transaction logs, repo info) icechunk-storage Storage trait definitions and common storage utilities icechunk-arrow-object-store Storage backend using Apache Arrow's object store (in-memory, local, GCS, Azure, etc.) icechunk-s3 Native AWS S3 storage backend (optional feature) icechunk Core storage engine: transactions, version control, repositories icechunk-python PyO3 bindings exposing the engine to Pyth","default_branch":null,"files":null,"tree":[],"storefront":"/r/earth-mover","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/earth-mover/icechunk/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}