{"repo":"sno-ai/llmix","free":true,"listed":false,"github":"https://github.com/sno-ai/llmix","clone":"git clone https://github.com/sno-ai/llmix.git","description":"Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.","language":"Python","stars":131,"topics":["ai-agents","ai-sdk","ai-tools","anthropic","circuit-breaker","gemini","key-rotation","litellm","llm","llm-cache"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"LLMix Read in other languages: English · 中文 · Deutsch · Español · Français · Русский · 한국어 · 日本語 · हिन्दी Config-driven LLM calls for Python, TypeScript, and Rust. Keep your SDK. Move model behavior into MDA presets. Put cache, retries, key rotation, and rollout control around the call. LLMix is the layer between your product and the provider SDK. It does not ask you to rewrite your OpenAI, Anthropic, Gemini, LiteLLM, AI SDK, or custom client code. It wraps the call. The boring parts go around it: response cache, circuit breaker, key pools, singleflight, retry policy, adaptive concurrency, provider kwargs, and MDA config loading. The model stops being a hard-coded string buried in application code. It becomes data. Change a preset, publish a compiled registry release, reload the service, and the next request can run a different provider or model. No redeploy for the usual model swap dance. That is the whole thing. Small layer. Sharp edges filed down. --- Why It Exists AI products in 2026 do not usually fail because one SDK call is hard. They fail in the spaces around the call. A key gets rate limited. A provider gets slow. Two hundred users ask the same thing at once. A model swap needs a deploy. A cache key differs by one invisible parameter. One service is in Python, another is in TypeScript, and the Rust worker has to follow the same contract. LLMix is for that part of the system. The signal chain between your app and the model. You still own the prompt. You still own the ","default_branch":null,"files":null,"tree":[],"storefront":"/r/sno-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/sno-ai/llmix/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}