{"repo":"GJBarhate/neuralproxy","free":true,"listed":false,"github":"https://github.com/GJBarhate/neuralproxy","clone":"git clone https://github.com/GJBarhate/neuralproxy.git","description":"Self-hosted AI gateway for Gemini — key rotation, semantic cache, rate limiting & live analytics, all in one place.","language":"JavaScript","stars":10,"topics":[],"license":null,"category":"self-hosted-apps","readme_excerpt":"🧠 NeuralProxy 🧠 A Premium Multi-Tenant AI Gateway for Gemini Route, cache, and monitor your Gemini API calls — across multiple keys, tenants, and teams. 🚀 Quick Start · 📐 Architecture · 📡 API Reference · ⚙️ Configuration --- ✨ What is NeuralProxy? NeuralProxy is a self-hosted AI gateway that sits between your applications and Google Gemini. It manages API key rotation, caches semantically similar prompts, enforces rate limits per tenant, and gives you a live analytics dashboard — all out of the box. --- 🌟 Features Category What you get --- --- 🔑 Key Rotation Up to 6 Gemini API keys with round-robin + 60s auto-failover on 401/429/5xx 🧩 User Keys Validate and pass through user-provided keys — never stored server-side 🧠 Semantic Cache pgvector cosine similarity (threshold 0.08 ) — targets 60%+ cost reduction ⚡ Redis L1 Cache Exact-match cache with 24h TTL for instant repeated responses 🪣 Rate Limiting Bucket4j per-tenant limiting — 100 req/min per tenant 🔐 Dual Auth JWT Bearer tokens + X-API-Key header with SHA-256 hashing 👥 RBAC ADMIN , USER , and API CLIENT roles 📊 Live Analytics Real-time STOMP/WebSocket dashboard — pushes summary on every request 🛡️ Circuit Breaker Resilience4j wraps Gemini calls — opens at 50% failure in 10-call window 🗄️ Partitioned Logs request logs table partitioned by month (2025–2028) 🎮 Prompt Playground Key source toggle, validate, send, and copy responses in the UI 🏢 Tenant Management Create tenants, generate & reveal API keys (30s r","default_branch":null,"files":null,"tree":[],"storefront":"/r/GJBarhate","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/GJBarhate/neuralproxy/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}