{"repo":"vortico/flama","free":true,"listed":false,"github":"https://github.com/vortico/flama","clone":"git clone https://github.com/vortico/flama.git","description":"The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.","language":"Python","stars":296,"topics":["machine-learning","anthropic","asgi","chatbot","domain-driven-design","generative-ai","inference","llm","llm-serving","mcp"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"Light up your models 🔥 --- Flama The production framework for Predictive and Generative AI. Turn any model into a production API in a single line of code. Serve predictive and generative models on a Rust-powered core, and expose your tools to AI agents over the Model Context Protocol (MCP). Flama is the F ramework for L ightweight A pplications, artificial intelligence M odels, and A utomation. It packages a model from any of the mainstream frameworks into a single portable format (the .flm file), so every model looks the same to your API no matter where it came from, and serves it over HTTP in seconds. - 📦 Any framework, one format. Package scikit-learn, TensorFlow, PyTorch, or an LLM into a single portable .flm artifact. - ⬇️ Models on demand. Download and package any model from the HuggingFace Hub with one command. - 🤖 Generative AI serving. Serve LLMs with OpenAI-, Anthropic-, and Ollama-compatible endpoints, side by side. - 💬 Chatbot out of the box. Every served model ships a polished streaming chat UI at /chat/ , with Markdown, LaTeX, and Mermaid. - 🔌 Native MCP. Expose tools, resources, and prompts to AI agents with a single decorator, schemas derived from your type hints. - ⚡ Rust-powered core. Routing, JSON encoding, request parsing, and compression compiled to native code, shipped as plain wheels. - 🚀 Production-ready first. Go from a packaged model to a running service over the CLI, in Python, with a spec file, or inside a container. Installation Flama","default_branch":null,"files":null,"tree":[],"storefront":"/r/vortico","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vortico/flama/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}