{"repo":"GetBusbar/busbar","free":true,"listed":false,"github":"https://github.com/GetBusbar/busbar","clone":"git clone https://github.com/GetBusbar/busbar.git","description":"Point your existing SDK at one URL and reach every LLM vendor — with real failover, not a try/except. One static Rust binary.","language":"Rust","stars":116,"topics":["ai-gateway","anthropic","bedrock","circuit-breaker","claude","failover","gemini","litellm-alternative","llm","llm-gateway"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"Busbar Your AI control plane, in one static Rust binary. Point any SDK at one URL, reach any provider, and keep serving when a provider does not. Six wire protocols, first class on both sides: OpenAI, OpenAI Responses, Anthropic, Gemini, Cohere and Bedrock Converse. Same-protocol routes are byte-for-byte identical to calling the provider directly, because Busbar forwards your original bytes rather than re-serializing them. Cross-protocol, every modelled field arrives in the target's native shape. Self-hosted, always. No hosted service, no signup, nothing phones home. Your provider keys stay in your config on your machine. --- The numbers Busbar 1.5.1, AWS m7g.4xlarge (Graviton3), 4-core pin, measured 2026-08-03. Same-protocol OpenAI cell. Across all 36 cells idle stayed between 7.32 and 7.42 MiB. --- Why not LiteLLM, Kong or Portkey Busbar LiteLLM Py LiteLLM Rust Kong Portkey --- --- --- --- --- --- Wire protocol pairs served, of 36 36 8 1 4 8 Added latency p99, µs 82 8,221 106 389 3,720 CPU per request at c=8, µs 65 6,775 89 210 1,486 Requests/sec, zero failures 67,837 170 48,354 22,418 855 Time to first token p50, µs 129 9,088 181 105,907 27,908 Idle resident memory 7.3 MiB 1,080 MiB 253 MiB 403 MiB 124 MiB Container image Install --- --- --- Busbar 5.74 MiB , 3 layers one 12.39 MiB static binary LiteLLM 360.77 MiB, 21 layers 558 MiB across 107 packages Measured 2026-08-03 on an m7g.4xlarge pinned to 4 cores. Image sizes are compressed registry layers for getbusba","default_branch":null,"files":null,"tree":[],"storefront":"/r/GetBusbar","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/GetBusbar/busbar/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}