{"repo":"AI-Northstar-Tech/vector-io","free":true,"listed":false,"github":"https://github.com/AI-Northstar-Tech/vector-io","clone":"git clone https://github.com/AI-Northstar-Tech/vector-io.git","description":"Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, backup, re-embed (using any model) or access your vector data from any vector databases or repository.","language":"Jupyter Notebook","stars":270,"topics":["parquet","vector-database","vector-search-engine","chromadb","data-backup","data-export","data-import","datastax","huggingface","huggingface-datasets"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"This library uses a universal format for vector datasets to easily export and import data from all vector databases. Request support for a VectorDB by voting/commenting on this poll See the Contributing section to add support for your favorite vector database. Supported Vector Databases Fully Supported Vector Database Import Export -------------------------------- -------- -------- Pinecone ✅ ✅ Qdrant ✅ ✅ Milvus ✅ ✅ GCP Vertex AI Vector Search ✅ ✅ KDB.AI ✅ ✅ LanceDB ✅ ✅ DataStax Astra DB ✅ ✅ Chroma ✅ ✅ Turbopuffer ✅ ✅ ----- Partial Vector Database Import Export -------------------------------- -------- -------- ----- In Progress Vector Database Import Export -------------------------------- -------- -------- Azure AI Search ❌ ❌ Weaviate ❌ ❌ MongoDB Atlas ❌ ❌ OpenSearch ❌ ❌ Apache Cassandra ❌ ❌ txtai ❌ ❌ pgvector ❌ ❌ SQLite-VSS ❌ ❌ ----- Not Supported Vector Database Import Export -------------------------------- -------- -------- Vespa ❌ ❌ Marqo ❌ ❌ Elasticsearch ❌ ❌ Redis Search ❌ ❌ ClickHouse ❌ ❌ USearch ❌ ❌ Rockset ❌ ❌ Epsilla ❌ ❌ Activeloop Deep Lake ❌ ❌ ApertureDB ❌ ❌ CrateDB ❌ ❌ Meilisearch ❌ ❌ MyScale ❌ ❌ Neo4j ❌ ❌ Nuclia DB ❌ ❌ OramaSearch ❌ ❌ Typesense ❌ ❌ Anari AI ❌ ❌ Vald ❌ ❌ Apache Solr ❌ ❌ Installation Using pip From source Universal Vector Dataset Format (VDF) specification 1. VDF META.json: It is a json file with the following schema VDFMeta defined in src/vdf io/meta types.py: 2. Parquet files/folders for metadata and vectors. Export Script Import script Re-em","default_branch":null,"files":null,"tree":[],"storefront":"/r/AI-Northstar-Tech","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/AI-Northstar-Tech/vector-io/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}