{"repo":"openlake-project/openlake","free":true,"listed":false,"github":"https://github.com/openlake-project/openlake","clone":"git clone https://github.com/openlake-project/openlake.git","description":"OpenLake is a high performance storage engine for efficient LLM inference and GPU Training","language":"Rust","stars":2330,"topics":["gpu","high-performance","rdma","rust","storage","throughput","blackwell","gpt","llm","llm-training"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"Fast, easy and efficient storage for LLM Inference and Training Blog Documentation Comparision Discord/X Website 🔥 Distributed storage for GPU workloads. Built on Rust on io uring , OpenLake is a state of the art storage engine delivering million+ iops within 1ms. --- Updates - [2026/08] 🔥 ExANS : a lossless GPU codec for BF16 KV cache: 1.51× cost savings, now available in OpenLake v0.8 (blog). - [2026/07] Introducing OpenLake: open source storage that saturates the GPUs: 8× throughput and 600 µs reads (blog). - [2026/07] Breaking the KV Wall: managing 100 TB of KV cache and 8× inference throughput with deferred materialization (blog). Why OpenLake? OpenLake is a storage engine for AI infrastructure. With OpenLake you get high throughput for small I/O and cache like performance while being fully persistent and durable. Keep GPUs fed during training and inference reducing idle time and getting more from your accelerators. OpenLake is fast with: - KV Cache Offload . Reduced LLM Inference costs by having Petabyte scale KV cache store co-located on GPU hosts. - VectorDB : Fast index building and vector serving. - Checkpointing : Ultra fast checkpoint storage and retrieval for RL and ML workloads. - Model Training : Small file I/O and fast random reads, reduced GPU costs/training time. - Context Storage : Store massive conversations, memories and context for fast agentic retrieval. Learn more: Blogs → Benchmarks → KV Offload Object Store 66× speedup on time to first token first ","default_branch":null,"files":null,"tree":[],"storefront":"/r/openlake-project","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/openlake-project/openlake/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}