{"repo":"deltawi/deltallm","free":true,"listed":false,"github":"https://github.com/deltawi/deltallm","clone":"git clone https://github.com/deltawi/deltallm.git","description":"Route, manage, and analyze your LLM requests across multiple providers with a unified API interface","language":"Python","stars":19,"topics":["ai-gateway","llm-proxy","ai-infrastructure","api-gateway","kubernetes","llm-gateway","llm-routing","mcp","model-context-protocol","multi-llm"],"license":"MIT","category":"mcp-servers","readme_excerpt":"DeltaLLM DeltaLLM is a self-hosted LLM gateway. Point OpenAI-compatible clients at one endpoint, then manage model deployments, routing, scoped API keys, budgets, guardrails, MCP tools, and usage from one control plane. One Endpoint For Your Apps Your application keeps its OpenAI request format. DeltaLLM handles provider credentials, routing, policy checks, caching, failover, and spend tracking. What It Handles - Unified API - Use one OpenAI-compatible endpoint across OpenAI, Anthropic, Azure OpenAI, Bedrock, Gemini, Groq, and other providers. - Scoped API keys - Issue virtual keys with model allowlists, rate limits, budgets, owners, and expiry. - Routing and failover - Route by strategy, retry failed deployments, and separate provider credentials from application code. - Batch API - Run embeddings and non-streaming chat completions asynchronously through OpenAI-compatible files and batches, even when upstream providers are synchronous. - MCP gateway - Register external MCP servers and expose approved tools through controlled gateway flows. - Guardrails - Detect PII and prompt injection before provider calls. - Spend and usage - Attribute cost by key, team, organization, model, and provider. - Admin UI - Manage models, credentials, route groups, teams, users, usage, audit logs, and settings in the browser. - Operations - Export Prometheus metrics, request logs, audit events, cache behavior, and health checks. Admin UI The UI is the control plane for model deployments, route g","default_branch":null,"files":null,"tree":[],"storefront":"/r/deltawi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/deltawi/deltallm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}