{"repo":"datastax/astra-assistants-api","free":true,"listed":false,"github":"https://github.com/datastax/astra-assistants-api","clone":"git clone https://github.com/datastax/astra-assistants-api.git","description":"Drop in replacement for the OpenAI Assistants API","language":"Python","stars":205,"topics":["cohere","gemini","gpt-4","groq","openai-assistants","vector","assistants-api","openai-assistants-api","assistants","claude"],"license":"Apache-2.0","category":"api-integrations-sdks","readme_excerpt":"Astra Assistant API Service An Open Source drop-in compatible service for the OpenAI Assistants API v2 Astra Assistants supports streaming, persistent threads, files, vector stores, assistants, retrieval, function calling and more using AstraDB (DataStax's db as a service offering powered by Apache Cassandra and jvector). Supports dozens of third party LLM providers (or even local models) for both completion and embeddings (powered by LiteLLM). You can use our hosted Astra Assistants service, or host the open source API server yourself. Client Getting Started To build an app that uses the Astra Asistants service install the astra-assistants python library with your favorite package manager. The code for astra-assistants can be found under (clients/)[./clients/]: Signup for Astra and get an Admin API token: Set your environment variables (depending on what LLMs you want to use), see the .env.bkp file for an example: Then import and patch your client: The system will create a db on your behalf and name it assistant api db using your token. Note, this means that the first request will hang until your db is ready (could be a couple of minutes). This will only happen once. Now you're ready to create an assistant By default, the service uses AstraDB as the database/vector store and OpenAI for embeddings and chat completion. Third party LLM Support We now support many third party models for both embeddings and completion thanks to litellm. Pass the api key of your service using api-","default_branch":null,"files":null,"tree":[],"storefront":"/r/datastax","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/datastax/astra-assistants-api/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}