{"repo":"ozanunal0/Prometheus-Gateway","free":true,"listed":false,"github":"https://github.com/ozanunal0/Prometheus-Gateway","clone":"git clone https://github.com/ozanunal0/Prometheus-Gateway.git","description":"An open-source, security-first LLM Gateway designed to provide a unified, secure, and observable entry point to any Large Language Model.","language":"Python","stars":11,"topics":["api-gateway","cybersecurity","fastapi","llm","llm-gateway","prometheus","python","security","genai"],"license":"GPL-3.0","category":"ai-agents","readme_excerpt":"🚀 Prometheus GENAI API Gateway Enterprise-grade LLM API Gateway with built-in privacy protection, caching, and observability ✨ Features - 🔒 Privacy First : Automatic PII detection and anonymization using Microsoft Presidio - ⚡ Smart Caching : Redis-powered response caching to reduce API costs - 📊 Full Observability : Comprehensive Prometheus metrics + Grafana dashboards - 🛡️ Enterprise Security : API key authentication with rate limiting - 🔌 Multi-Provider Ready : Extensible architecture for multiple LLM providers - 🚀 OpenAI Compatible : Drop-in replacement for OpenAI API endpoints 🏗️ Architecture 🚀 Quick Start Docker Compose (Recommended) Manual Setup 🎯 Usage 📊 Monitoring Access your monitoring stack: - Gateway : http://localhost:8000 - Prometheus : http://localhost:9090 - Grafana : http://localhost:3000 (admin/admin) 🔧 Configuration Environment Variable Description Default --------------------- ------------- --------- OPENAI API KEY OpenAI API key Required REDIS HOST Redis hostname localhost REDIS PORT Redis port 6379 REDIS PASSWORD Redis password None 🛡️ Privacy & Security - PII Detection : Automatically detects and anonymizes emails, phone numbers, SSNs, credit cards - Secure API Keys : SHA-256 hashed storage, never logged in plaintext - Rate Limiting : Configurable per-key rate limits (default: 10/minute) - Request Isolation : Each request is processed independently 📈 Metrics Track your usage with built-in metrics: - Request counts by owner, model, and statu","default_branch":null,"files":null,"tree":[],"storefront":"/r/ozanunal0","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ozanunal0/Prometheus-Gateway/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}