{"repo":"lunary-ai/abso","free":true,"listed":false,"github":"https://github.com/lunary-ai/abso","clone":"git clone https://github.com/lunary-ai/abso.git","description":"TypeScript SDK to call 100+ LLM Providers in OpenAI format.","language":"TypeScript","stars":56,"topics":["llm","openai","ai","anthropic","azure-openai","bedrock","gemini","grok","groq","mistral"],"license":"MIT","category":"ai-agents","readme_excerpt":"Drop-in replacement for OpenAI Abso provides a unified interface for calling various LLMs while maintaining full type safety. Features - OpenAI-compatible API 🔁 (drop in replacement) - Call any LLM provider (OpenAI, Anthropic, Groq, Ollama, etc.) - Lightweight & Fast ⚡ - Embeddings support 🧮 - Unified tool calling 🛠️ - Tokenizer and cost calculation (soon) 🔢 - Smart routing (soon) Providers Provider Chat Streaming Tool Calling Embeddings Tokenizer Cost Calculation ---------- ---- --------- ------------ ---------- --------- ---------------- OpenAI ✅ ✅ ✅ ✅ 🚧 🚧 Anthropic ✅ ✅ ✅ ❌ 🚧 🚧 xAI Grok ✅ ✅ ✅ ❌ 🚧 🚧 Mistral ✅ ✅ ✅ ❌ 🚧 🚧 Groq ✅ ✅ ✅ ❌ ❌ 🚧 Ollama ✅ ✅ ✅ ❌ ❌ 🚧 OpenRouter ✅ ✅ ✅ ❌ ❌ 🚧 Voyage ❌ ❌ ❌ ✅ ❌ ❌ Azure 🚧 🚧 🚧 🚧 ❌ 🚧 Bedrock 🚧 🚧 🚧 🚧 ❌ 🚧 Gemini ✅ ✅ ✅ ❌ 🚧 ❌ DeepSeek ✅ ✅ ✅ ❌ 🚧 ❌ Perplexity ✅ ✅ ❌ ❌ 🚧 ❌ Installation Usage Manually selecting a provider Abso tries to infer the correct provider for a given model, but you can also manually select a provider. Streaming Embeddings Tokenizers (soon) Custom Providers You can also configure built-in providers directly by passing a configuration object with provider names as keys when instantiating Abso: Alternatively, you can also change the providers that are loaded by passing a custom providers array to the constructor. Observability You can use Abso with Lunary to get instant observability into your LLM usage. First signup to Lunary and get your public key. Then simply set the LUNARY PUBLIC KEY environment varia","default_branch":null,"files":null,"tree":[],"storefront":"/r/lunary-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lunary-ai/abso/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}