{"repo":"emmyoh/zebra","free":true,"listed":false,"github":"https://github.com/emmyoh/zebra","clone":"git clone https://github.com/emmyoh/zebra.git","description":"A vector database for querying meaningfully similar data.","language":"Rust","stars":16,"topics":["embeddings","vector-database","candidate-generation","multi-modal-search","retrieval-augmented-generation","semantic-search","machine-learning","rust"],"license":"AGPL-3.0","category":"databases-storage","readme_excerpt":"Zebra A vector database for querying meaningfully similar data. Features On-disk database index , minimising memory impact for large datasets Distance metrics and embedding models are provided, though external implementations can be supplied Inserting, deleting , and querying vectors No memory-mapped (MMAP) file IO Parallelised database operations; multithreaded reads & writes are safe Motivation Approximate nearest neighbour search for finding semantically-similar documents is a common use case, and a variety of existing solutions exist that are often described as 'vector databases'. Many of these solutions are offered as services, and some exist as libraries. While designing a content recommendation system for Oku, several requirements became clear: Safe multithreaded database access Inserting, deleting, and querying records On-disk storage of database contents Support for multiple modalities) of information Oku enables distributed storage & distribution of mutable user-generated data; therefore, any embedded database used for semantic search needed to be: Capable of asynchronous read & write access Capable of creating, reading, updating, and deleting ( CRUD ) records without downtime or excessive resource usage Capable of scaling in dataset size without excessively impacting memory usage for an individual node Capable of acceptable recall with multiple distance metrics Despite the common need—a scalable CRUD database—existing solutions often fell short. Distribution & CRUD","default_branch":null,"files":null,"tree":[],"storefront":"/r/emmyoh","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/emmyoh/zebra/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}