{"repo":"TheFozid/go-llama","free":true,"listed":false,"github":"https://github.com/TheFozid/go-llama","clone":"git clone https://github.com/TheFozid/go-llama.git","description":"Modern chat UI for local LLMs with streaming, user management, and web search. Self-hosted.","language":"Go","stars":13,"topics":[],"license":"MIT","category":"self-hosted-apps","readme_excerpt":"Go-LLama Local, private, and fast LLM chat interface and orchestrator — with optional intelligent web search via SearxNG. Built for self-hosting on everything from Raspberry Pi and low-power mini-PCs to full servers. Lightweight, secure, and purpose-built to outperform bloated open-web UI stacks.1 --- Overview Go-LLama is a modern, high-performance chat interface for local LLM backends such as vLLM , llama.cpp , and llamafile . It provides user accounts, persistent chat history, streaming responses, and context-aware web search for real-time information. This project prioritizes: Low resource usage ( 50 MB RAM typical) Fast response times , even on low-end hardware Privacy , simplicity , and stability Complete offline operation when web search is disabled --- Key Features LLM Interaction Connects to local LLM APIs (vLLM, llama.cpp, llamafile, etc.) True streaming output with tokens-per-second metrics Session reuse for models that support incremental conversation memory Automatic context trimming to stay within model limits Per-user chat isolation and persistent history --- Intelligent Web Search (SearxNG Integration) Go-LLama's search pipeline is more than a simple fetch-and-dump of results: 1. Smart Auto-Search Trigger - Searches the web automatically when the user's question implies a need for current or factual data (dates, tickers, \"latest\", etc.) - User can force or block searches naturally via phrases like \"search the web for…\" or \"don't search online\" . 2. Result Ranki","default_branch":null,"files":null,"tree":[],"storefront":"/r/TheFozid","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/TheFozid/go-llama/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}