{"repo":"MiXaiLL76/auto_ai_router","free":true,"listed":false,"github":"https://github.com/MiXaiLL76/auto_ai_router","clone":"git clone https://github.com/MiXaiLL76/auto_ai_router.git","description":"High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection","language":"Go","stars":48,"topics":["ai","gateway","golang","google","litellm","load-balancer","openai","openai-api","vertex-ai","air"],"license":"Apache-2.0","category":"networking-infra","readme_excerpt":"Auto AI Router High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection. Routes requests to OpenAI, Vertex AI, Gemini AI Studio, Anthropic, Comet API, and other Auto AI Router instances. Key Features - Multi-provider support — OpenAI, Vertex AI, Gemini, Anthropic, Comet API, Proxy chains - Round-robin load balancing — across multiple credentials per model - Rate limiting — per-credential and per-model RPM/TPM controls - Fail2ban — automatic provider banning on repeated errors - Prometheus metrics — request counts, latency, credential status - LiteLLM DB integration — spend logging and API key authentication - Streaming — full SSE support for all providers - Environment variables — secure credential management via os.environ/VAR NAME Quick Start Or with Docker: Documentation Full documentation is available at mixaill76.github.io/auto ai router . License Apache License 2.0 — see LICENSE file.","default_branch":null,"files":null,"tree":[],"storefront":"/r/MiXaiLL76","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/MiXaiLL76/auto_ai_router/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}