{"repo":"hkdb/lmgate","free":true,"listed":false,"github":"https://github.com/hkdb/lmgate","clone":"git clone https://github.com/hkdb/lmgate.git","description":"A high performance authentication and access-control gateway for LLM API backends","language":"Go","stars":16,"topics":["ai","ai-security","api-gateway","authentication","devops","llamacpp","llm","llm-security","lmstudio","mlops"],"license":"Apache-2.0","category":"auth-billing-email","readme_excerpt":"LM Gate maintained by: @hkdb A high performance authentication and access-control gateway for LLM API backends such as Ollama. LM Gate sits in front of your upstream model server and adds identity, authorization, rate limiting, and observability — without modifying the upstream service. 💡 Why --- Most of the self-hosted LLM frameworks are designed to be run on localhost with no authentication or rate limiting. However, the machine a user directly interacts with often lacks the GPU power their use cases demand. The result is a quiet but growing crisis: infrastructure built for the desktop, quietly bleeding onto the open internet. A joint investigation between SentinelOne SentinelLABS and Censys revealed 175,000 unique Ollama hosts across 130 countries operating without authentication, forming an \"unmanaged, publicly accessible layer of AI compute infrastructure.\" - source The implications are serious. Security should be the default, not an afterthought requiring installation of multiple 3rd party components and expert configuration. The current makeshift band-aid — adopted only by the more security-conscious and DevOps savvy — is to put self-hosted LLM frameworks behind an NGINX reverse proxy with basic auth. This is still not enough. In practice, credentials are often embedded directly in the URL — readable in plaintext by packet sniffers regardless of whether TLS is in use. LM Gate is an attempt to change that — a single component to plug into your existing infrastructure t","default_branch":null,"files":null,"tree":[],"storefront":"/r/hkdb","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/hkdb/lmgate/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}