{"repo":"krevas/local-model-provider","free":true,"listed":false,"github":"https://github.com/krevas/local-model-provider","clone":"git clone https://github.com/krevas/local-model-provider.git","description":"VS Code extension to connect to local LLM inference servers (Ollama, llama.cpp, LocalAI) via OpenAI API compatible endpoints.","language":"TypeScript","stars":10,"topics":["copilot","llama-cpp","llm","local-llm","model-provider","ollama","openai-compatible","productivity","self-hosted","vllm"],"license":"MIT","category":"ai-agents","readme_excerpt":"Local Model Provider Connect your local LLMs directly to VS Code for a private and powerful AI coding experience. A VS Code extension that connects your editor to self‑hosted or local LLMs via any OpenAI‑compatible server (vLLM, Ollama, TGI, llama.cpp, LocalAI, etc.). Keep source code on your infrastructure while using AI for coding, refactoring, analysis, and more. ✨ Highlights - Works with any OpenAI Chat Completions–compatible endpoint - Function calling tools with optional parallel execution - Safe token budgeting based on model context window - Built‑in retries with exponential backoff and detailed logging - Model list caching for fewer network calls - API keys securely stored in VS Code SecretStorage - Status bar health monitor with quick actions - Server presets for quick switching between endpoints - Usage statistics tracking (requests, tokens, response times) - Default model selection for consistent workflow 🔌 Compatible Inference Servers - vLLM (recommended) - LM Studio - Ollama - llama.cpp - Text Generation Inference (Hugging Face) - LocalAI - Any other OpenAI‑compatible server 📥 Installation 1) Install “Local Model Provider” from the VS Code Marketplace. 2) Reload VS Code if prompted. 🚀 Quick Start 1) Start a server - vLLM example (gpt-oss-120b) Options explained (brief): - --trust-remote-code : allow custom model repo code to run (required by some model repos) - --enable-auto-tool-choice : let the model/server automatically pick and call tools - --tool-call-pa","default_branch":null,"files":null,"tree":[],"storefront":"/r/krevas","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/krevas/local-model-provider/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}