{"repo":"varunvasudeva1/llm-server-docs","free":true,"listed":false,"github":"https://github.com/varunvasudeva1/llm-server-docs","clone":"git clone https://github.com/varunvasudeva1/llm-server-docs.git","description":"End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.","language":null,"stars":831,"topics":["linux","llm","ollama","open-webui","debian","comfyui","vllm","llama-swap","llamacpp","mcp-proxy"],"license":"MIT","category":"ai-agents","readme_excerpt":"Local LLaMA Server Setup Documentation TL;DR : End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS, along with steps for configuring SSH, firewall, and secure remote access via Tailscale. Software Stack: - Inference Engine (Ollama, llama.cpp, vLLM) - Search Engine (SearXNG) - Model Server (llama-swap, systemd service) - Chat Platform (Open WebUI) - MCP Proxy Server (mcp-proxy, MCPJungle) - Text-to-Speech Server (Kokoro FastAPI) - Image Generation Server (ComfyUI) - VPN/Remote Access (Tailscale) - Reverse Proxy (Caddy) - DNS Provider (Cloudflare) Table of Contents - Local LLaMA Server Setup Documentation - Table of Contents - About - Priorities - Prerequisites - General - Allow sudo Permissions - Update System Packages - Schedule Startup Script - Configure Script Permissions - Configure Auto-Login (optional) - Docker - Add User to Docker Group - Nvidia Container Toolkit - Create a Network - Harden Docker Containers - Helpful Commands - HuggingFace CLI - Manage Models - Download Models - Delete Models - Search Engine - SearXNG - Open WebUI Integration - Inference Engine - Ollama - llama.cpp - vLLM - Model Server - llama-swap - systemd Service - Open WebUI Integration - llama-swap - systemd Service - Chat Platform - Open WebUI - MCP Proxy Server - mcp-proxy - MCPJungle - Comparison - Open WebUI Integration - mcp-proxy - MCPJungle - VS Code/Claude Desk","default_branch":null,"files":null,"tree":[],"storefront":"/r/varunvasudeva1","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/varunvasudeva1/llm-server-docs/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}