{"repo":"peva3/SmarterRouter","free":true,"listed":false,"github":"https://github.com/peva3/SmarterRouter","clone":"git clone https://github.com/peva3/SmarterRouter.git","description":"SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.","language":"Python","stars":148,"topics":["ai-gateway","docker","fastapi","gpu-monitoring","llm","llm-proxy","llm-router","local-llm","model-serving","ollama"],"license":"MIT","category":"ai-agents","readme_excerpt":"SmarterRouter Intelligent, multi-backend AI router that sits between your application and various LLM providers. It profiles your models, aggregates benchmark data, and intelligently routes each query to the best available model for the task—all locally, all free. Key Benefits: - Zero manual model selection - AI automatically picks the right model for each prompt - All local, zero cost - No cloud API fees, works with your existing models - Production-ready - Monitoring, metrics, and error handling built-in - Drop-in replacement - Works with any OpenAI-compatible client Why SmarterRouter? (vs other LLM proxies) Feature SmarterRouter OptiLLM ClewdR LLM-API-Proxy Reader --------- --------------- --------- -------- --------------- --------- Intelligent Routing ✅ Auto-selects best model ❌ Manual config ❌ Claude-only ❌ Manual routing ❌ URL-only Multi-Backend Support ✅ Ollama + llama.cpp + OpenAI ❌ OpenAI-only ❌ Claude-only ✅ 100+ providers ❌ URL proxy Local-first ✅ All local models ⚠️ Cloud proxy ⚠️ Cloud proxy ⚠️ Cloud proxy ⚠️ Cloud proxy Zero Code Changes ✅ OpenAI-compatible ✅ OpenAI-compatible ✅ OpenAI-compatible ✅ OpenAI-compatible ✅ URL proxy Production Features ✅ Monitoring + Metrics ✅ Metrics ✅ Dashboard ✅ Resilience ✅ Simple Learning Capability ✅ Profiles models over time ❌ Static config ❌ Static config ❌ Static config ❌ Static config --- Quick Start (5 minutes) Get up and running with Docker in three commands: That's it! SmarterRouter will: - ✅ Discover all your Ollama mo","default_branch":null,"files":null,"tree":[],"storefront":"/r/peva3","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/peva3/SmarterRouter/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}