{"repo":"wyolet/relay","free":true,"listed":false,"github":"https://github.com/wyolet/relay","clone":"git clone https://github.com/wyolet/relay.git","description":"High-throughput, self-hostable LLM router in Go. BYO provider keys, k8s-native, key pooling + batch + usage observability.","language":"Go","stars":28,"topics":["ai-infrastructure","anthropic","golang","kubernetes","llm","llm-gateway","llm-router","openai","openrouter","self-hosted"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"Wyolet Relay One endpoint in front of every LLM provider. Self-hosted, bring-your-own-keys, built for scale. Quickstart · Docs · Discord · X · LinkedIn · Bluesky · Reddit --- Wyolet Relay puts a single OpenAI- and Anthropic-compatible endpoint in front of every provider you use. Pool your own API keys for automatic failover and higher effective rate limits, see exactly what every request costs, and run the whole thing on your own infrastructure — a drop-in for the SDK code you already have. Quickstart Start a full relay — API, admin UI, database, and a pre-seeded model catalog — in one command: Open the admin UI at http://localhost:8081 , then let the setup wizard walk you through adding a provider key and minting a relay key. Now call it like the OpenAI API: That's it. The full walkthrough, configuration, and production deployment guides live at docs.wyolet.com . Features - One API, every provider. OpenAI- and Anthropic-shape endpoints in front of OpenAI, Anthropic, Bedrock, Vertex, Azure, Ollama, Groq — anything speaking either wire format. No code changes to switch upstreams. - Disposable, rate-limited keys. Mint relay keys scoped to whatever limits you set. Hand them out freely — even if one leaks, the damage is capped at those limits and your real provider keys are never exposed. - Pool accounts and providers. Combine many keys, accounts, or providers into one pool behind a single endpoint. Relay load-balances and fails over across them, so per-account rate limits stop b","default_branch":null,"files":null,"tree":[],"storefront":"/r/wyolet","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/wyolet/relay/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}