{"repo":"raiyanyahya/llmaker","free":true,"listed":false,"github":"https://github.com/raiyanyahya/llmaker","clone":"git clone https://github.com/raiyanyahya/llmaker.git","description":"Selfhost modern LLM stacks. Run the whole fleet from your terminal","language":"Go","stars":97,"topics":["ai-agents","bubbletea","cli","docker","fastapi","golang","langchain","langgraph","llama-cpp","llm"],"license":null,"category":"ai-agents","readme_excerpt":"🦙 llmaker Self-host the modern LLM stack. llmaker is an open-source platform for running the complete modern LLM stack on your own infrastructure — large language models, vector databases, embeddings, caching, observability, and a built-in retrieval & agent layer — provisioned, networked, and production-shaped from a single command. Build private retrieval-augmented chatbots, FAQ assistants, and recommendation engines locally. No third-party API keys. No data leaving your machine. Quickstart · Why llmaker · Stacks · The agent · Architecture · CLI · Roadmap --- Overview Running a model locally is easy. Shipping an application is not. A production retrieval system needs a vector database, an embeddings service, a caching layer, an orchestration layer, and observability — each containerized, networked, and configured to discover the others. Assembling that is a recurring tax: a sprawl of docker run flags, a brittle Compose file, and hundreds of lines of framework glue. llmaker removes that tax. One CLI provisions the entire stack on a private network and operates it as a single fleet — live status, logs, and a resource dashboard across every model and service. Stacks are declarative and reconcilable ( apply --prune ), models are OpenAI-compatible , and retrieval is traced out of the box . From a single model to a complete application: Everything lands on a private network where each container discovers the others by name — no Compose file and no glue code. --- Highlights --- --","default_branch":null,"files":null,"tree":[],"storefront":"/r/raiyanyahya","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/raiyanyahya/llmaker/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}