{"repo":"Nayjest/lm-proxy","free":true,"listed":false,"github":"https://github.com/Nayjest/lm-proxy","clone":"git clone https://github.com/Nayjest/lm-proxy.git","description":"OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.","language":"Python","stars":149,"topics":["ai","anthropic","api-proxy","fastapi","google-ai","language-models","llm","llm-api","llm-inference","llm-proxy"],"license":"MIT","category":"ai-agents","readme_excerpt":"LM-Proxy Lightweight, OpenAI-compatible HTTP proxy server / gateway unifying access to multiple Large Language Model providers and local inference through a single, standardized API endpoint. Built with Python, FastAPI and MicroCore, LM-Proxy seamlessly integrates cloud providers like Google, Anthropic, and OpenAI, as well as local PyTorch-based inference, while maintaining full compatibility with OpenAI's API format. It works as a drop-in replacement for OpenAI's API, allowing you to switch between cloud providers and local models without modifying your existing client code. LM-Proxy supports real-time token streaming , secure Virtual API key management , and can be used both as an importable Python library and as a standalone HTTP service. Whether you're building production applications or experimenting with different models, LM-Proxy eliminates integration complexity and keeps your codebase provider-agnostic . Table of Contents - Overview - Features - Getting Started - Installation - Quick Start - Run with Docker - Configuration - Basic Structure - Environment Variables - Proxy API Keys vs. Provider API Keys - API Usage - Chat Completions Endpoint - Models List Endpoint - User Groups Configuration - Basic Group Definition - Group-based Access Control - Connection Restrictions - Virtual API Key Validation - Advanced Usage - Dynamic Model Routing - Load Balancing Example - Google Vertex AI Example - Using Tokens from OIDC Provider as Virtual/Client API Keys - Add-on Componen","default_branch":null,"files":null,"tree":[],"storefront":"/r/Nayjest","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Nayjest/lm-proxy/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}