{"repo":"voidmind-io/voidllm","free":true,"listed":false,"github":"https://github.com/voidmind-io/voidllm","clone":"git clone https://github.com/voidmind-io/voidllm.git","description":"Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.","language":"Go","stars":125,"topics":["ai","anthropic","api-gateway","docker","golang","helm","kubernetes","llm","llm-proxy","ollama"],"license":null,"category":"deployment-docker-iac","readme_excerpt":"VoidLLM A privacy-first LLM proxy and AI gateway for teams that take control seriously. VoidLLM is a self-hosted LLM proxy that sits between your applications and LLM providers - OpenAI, Anthropic, Azure, Ollama, vLLM, or any custom endpoint. It gives you organization-wide access control, API key management, usage tracking, rate limiting, and multi-deployment load balancing. One Go binary, sub-2ms proxy overhead, zero knowledge of your prompts. More screenshots Privacy-First by Design: VoidLLM is a zero-knowledge LLM proxy - it never stores, logs, or persists any prompt or response content. Not as a setting you can toggle - by architecture. Only metadata is tracked: who made the request, which model, how many tokens, how long it took. Your data stays yours. --- Why VoidLLM? Problem How VoidLLM solves it --- --- Teams share raw API keys in Slack Virtual keys with org/team/user scoping and RBAC No visibility into who's spending what Per-key, per-team, per-org usage tracking + cost estimation One runaway script burns the monthly budget Rate limits + token budgets enforced by the proxy at every level Switching providers means changing every app Model aliases - clients call default , the proxy routes it anywhere Provider goes down, everything breaks Multi-deployment load balancing with automatic failover Existing proxies log your prompts Zero-knowledge proxy architecture - content never touches disk How it works Your apps speak the OpenAI API to VoidLLM. It authenticates the key, ","default_branch":null,"files":null,"tree":[],"storefront":"/r/voidmind-io","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/voidmind-io/voidllm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}