{"repo":"thustorage/PipeANN","free":true,"listed":false,"github":"https://github.com/thustorage/PipeANN","clone":"git clone https://github.com/thustorage/PipeANN.git","description":"A low-latency, billion-scale, and updatable graph-based vector store on SSD.","language":"C++","stars":146,"topics":["anns","approximate-nearest-neighbor-search","billion-scale","diskann","vector-database","vector-search","vector-store","osdi","vector-update","fast"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"A low-latency, billion-scale, and updatable graph-based vector store on SSD. ✨ Key Features Feature Description --------- ------------- ⚡ Ultra-Low Latency 10x less memory than in-memory indexes ( 40GB for 1B vectors) 🐍 Easy-to-Use Both Python ( faiss -like) and C++ interfaces supported 🔌 Seamless Integration Milvus-compatible API (drop-in MilvusClient + gRPC server) 🗄️ Multi-SSD Scaling Scales to 70K QPS & 2ms tail latency on 1B vectors (4 SSDs, SPDK backend) 📊 Performance Comparison PipeANN is suitable for both large-scale and memory-constraint scenarios. Dataset Dimension Memory Latency QPS PipeANN HNSW DiskANN --------- ----- -------- --------- ----- --------- ------------- -------- 1B (SPACEV) 100 40GB 2ms 5K ✅ ❌ 1TB mem ❌ 6ms 80M (Wiki) 768 10GB 1.5ms 5K ✅ ❌ 300GB mem ❌ 4ms 10M (SIFT) 128 550MB Recall@10 = 0.99, Samsung PM9A3 SSD, 32B PQ-compressed vectors (128B for Wiki). 🔌 Already on Milvus? Switch in one line PipeANN speaks the Milvus API . Point your existing code at PipeANN and keep everything else the same — no rewrite, no new SDK. You get PipeANN's on-disk, larger-than-RAM index and speculative filtering behind the API you already use. See Application Integrations for the full guide and Milvus-vs-PipeANN benchmarks. --- 🚀 Quick Start For best performance , we recommend Linux with io uring support (e.g., Ubuntu 22.04 with Kernel 6.8). 🏗️ Build Install dependencies: Build PipeANN: Milvus-compatible gRPC server pip install -e . already builds and bundles the ","default_branch":null,"files":null,"tree":[],"storefront":"/r/thustorage","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/thustorage/PipeANN/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}