{"repo":"Sentdex/minion","free":true,"listed":false,"github":"https://github.com/Sentdex/minion","clone":"git clone https://github.com/Sentdex/minion.git","description":"A tiny single-file coding agent for self-hosted models (llama.cpp / vLLM / SGLang).","language":"Python","stars":319,"topics":[],"license":"MIT","category":"self-hosted-apps","readme_excerpt":"minion A no-nonsense coding agent that doesn't use 50K tokens of context to say \"hello.\" Minion is a purpose built coding agent aimed at removing and keeping out context bloat. Many agent frameworks use 20K-50K+ tokens when you've just said \"hey.\" This is caused by having a lot of features and tools that need to be loaded into the context of the LLM. This presents real challenges to running coding agents on local models, where you're often hosting the best AI you can, and you don't have much room for context. Why do we care about this context? 1. That first 50K of context is your fastest context for your model. We want that speed. 2. That first 50K of context is where your model's attention mechanism is likely the best. We want that intelligence. 3. That first 50K of context riding along every single message you send adds to cost over time, even if you're on some API. On a bare hey , the entire prompt minion sends is about 625 tokens: The variance is in the last line: every server's chat template wraps the tool section differently (Qwen/Hermes add per-tool tags, llama.cpp adds a functions header, OpenAI injects its own), so the real total lands somewhere in the low 600s. The point is the floor — not the exact figure. That's two orders of magnitude less than the harnesses that spend the first 20K–50K of your context before you've said anything, and it's paid on every single turn. You don't have to take our word for it. Point any harness at a local server and say hey . Most pri","default_branch":null,"files":null,"tree":[],"storefront":"/r/Sentdex","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Sentdex/minion/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}