{"repo":"etalab-ia/OpenGateLLM","free":true,"listed":false,"github":"https://github.com/etalab-ia/OpenGateLLM","clone":"git clone https://github.com/etalab-ia/OpenGateLLM.git","description":"An open-source, unified interface for running and managing self-hosted LLMs.","language":"Python","stars":180,"topics":["api","llm","self-hosted"],"license":"MIT","category":"self-hosted-apps","readme_excerpt":"OpenGateLLM Documentation API Reference [!WARNING] The API is still under beta version, major breaking changes may occur. OpenGateLLM is an open-source , production-ready API gateway for Generative AI. It centralizes, secures, and governs access to AI models across your organization, enabling teams to focus on building high-value AI applications instead of managing infrastructure complexity and data security risks. Designed for organizations that require full control over their data and infrastructure, OpenGateLLM is optimized for self-hosted models . It provides a sovereign and cost-effective foundation to deploy, manage, and scale Generative AI securely — without vendor lock-in. [!TIP] OpenGateLLM, as API gateway, is an alternative to LiteLLM, TensorZero, OpenRouter and others, dedicated to self-hosted IA infrastructure. 🔥 Challenges OpenGateLLM addresses three critical challenges for organizations: 1. Accelerate AI adoption – Remove barriers to integrating AI within your organization 2. Cost control - Reduce expenses of commercial APIs and GPU infrastructure by using self-hosted models and build a mutualized infrastructure with your peers without vendor lock-in. 3. Data sovereignty - Keep sensitive data under your control 4. Privacy & security - No chat history storage, robust access control ⚡️ Core principles - Open source and free forever - All features available without commercial licensing - High code quality - Built with maintainability and reliability in mind - Ligh","default_branch":null,"files":null,"tree":[],"storefront":"/r/etalab-ia","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/etalab-ia/OpenGateLLM/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}