{"repo":"atopos31/llmio","free":true,"listed":false,"github":"https://github.com/atopos31/llmio","clone":"git clone https://github.com/atopos31/llmio.git","description":"Unified LLM gateway with weighted load balancing, observability & cost tracking. 统一的 LLM 网关，提供权重负载均衡、可观测性与费用追踪。","language":"TypeScript","stars":313,"topics":["newapi","openai","go","golang","codex","claude","claude-code","gemini-cli","ai","ai-gateway"],"license":"MIT","category":"ai-agents","readme_excerpt":"LLMIO English 中文 LLMIO is a Go-based LLM load‑balancing gateway that provides a unified REST API, weighted scheduling, observability, and a modern admin UI for LLM clients (openclaw / claude code / codex / gemini cli / cherry studio / open webui). It helps you integrate OpenAI, Anthropic, Gemini, and other model capabilities in a single service. QQ group: 1083599685 Architecture Features - Unified API : Compatible with OpenAI Chat Completions, OpenAI Responses, Gemini Native, and Anthropic Messages. Supports both streaming and non‑streaming passthrough. - Weighted scheduling : balancers/ provides two strategies (random by weight / priority by weight). You can route based on tool calling, structured output, and multimodal capability. - Admin Web UI : React + TypeScript + Tailwind + Vite console for providers, models, associations, logs, and metrics. - Rate limiting & failure handling : Built‑in rate‑limit fallback and provider connectivity checks for fault isolation. - Local persistence : Pure Go SQLite ( db/llmio.db ) for config and request logs, ready to use out of the box. - Session tracking : Pass session id in any request body (works with extra body in OpenAI SDK) to tag logs with a session identifier. Filter and search by session id in the admin UI or via GET /api/logs?session id= . - Observability : Every request is recorded with TraceID, latency breakdown (proxy / first-chunk / completion time), TPS, token usage (input / cached / output), and optional full IO logging. ","default_branch":null,"files":null,"tree":[],"storefront":"/r/atopos31","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/atopos31/llmio/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}