{"repo":"Noveum/ai-gateway","free":true,"listed":false,"github":"https://github.com/Noveum/ai-gateway","clone":"git clone https://github.com/Noveum/ai-gateway.git","description":"Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.","language":"Rust","stars":96,"topics":["ai","ai-gateway","api","gateway"],"license":"Apache-2.0","category":"api-integrations-sdks","readme_excerpt":"Noveum AI Gateway 🚀 The world's fastest AI Gateway proxy, written in Rust and optimized for maximum performance. This high-performance API gateway routes requests to various AI providers (OpenAI, Anthropic, GROQ, Fireworks, Together, AWS Bedrock) with streaming support, making it perfect for developers who need reliable and blazing-fast AI API access. Quick Start • Documentation • Pricing • Docker • Contributing ✨ Features - 🚀 Blazing fast performance : Built in Rust with zero-cost abstractions - ⚡ Optimized for low latency and high throughput - 🔄 Unified API interface for multiple AI providers : - OpenAI — guide - AWS Bedrock — guide - Anthropic — guide - GROQ — guide - Fireworks — guide - Together AI — guide - Mistral, Cohere, Google Gemini, DeepSeek, xAI (Grok), OpenRouter, Perplexity — OpenAI-compatible providers guide - 💰 Per-request cost tracking across all providers from a built-in, single-sourced model pricing table — see docs/PRICING.md. - 📡 Real-time Streaming : Optimized for minimal latency - 🛡️ Nova Guard policy enforcement : In-process guardrails — model allow/deny, regex, banned substrings, PII & secrets detection, JSON-schema validation, token caps — that block, redact, or flag requests and responses, loaded from a local policy bundle (file or inline). See docs/NOVA GUARD.md. - 🛡️ Production Ready : Battle-tested in high-load environments - 🔍 Health Checking : Built-in monitoring - 📊 Telemetry & Metrics : Per-request token usage and cost tracking with ","default_branch":null,"files":null,"tree":[],"storefront":"/r/Noveum","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Noveum/ai-gateway/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}