{"repo":"Helicone/ai-gateway","free":true,"listed":false,"github":"https://github.com/Helicone/ai-gateway","clone":"git clone https://github.com/Helicone/ai-gateway.git","description":"The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.","language":"Rust","stars":622,"topics":["ai","cache","gateway","llm","llms","load-balancing","observability","rate-limiting"],"license":"GPL-3.0","category":"ai-agents","readme_excerpt":"Helicone AI Gateway The fastest, lightest, and easiest-to-integrate AI Gateway on the market. Built by the team at Helicone, open-sourced for the community. 🚀 Quick Start • 📖 Docs • 💬 Discord • 🌐 Website --- 🚆 1 API. 100+ models. Open-source, lightweight, and built on Rust. Handle hundreds of models and millions of LLM requests with minimal latency and maximum reliability. The NGINX of LLMs. --- 👩🏻‍💻 Set up in seconds With the cloud hosted AI Gateway -- For custom config, check out our configuration guide and the providers we support. --- Why Helicone AI Gateway? 🌐 Unified interface Request any LLM provider using familiar OpenAI syntax. Stop rewriting integrations—use one API for OpenAI, Anthropic, Google, AWS Bedrock, and 20+ more providers. ⚡ Smart provider selection Smart Routing to always hit the fastest, cheapest, or most reliable option, and always aware of provider uptimes and your rate limits. Built-in strategies include model-based latency routing (fastest model), provider latency-based P2C + PeakEWMA (fastest provider), weighted distribution (based on model weight), and cost optimization (cheapest option). 💰 Control your spending Rate limit to prevent runaway costs and usage abuse. Set limits per user, team, or globally with support for request counts, token usage, and dollar amounts. 🚀 Improve performance Cache responses to reduce costs and latency by up to 95%. Supports Redis and S3 backends with intelligent cache invalidation. 📊 Simplified tracing Mon","default_branch":null,"files":null,"tree":[],"storefront":"/r/Helicone","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Helicone/ai-gateway/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}