{"repo":"graniet/rllm","free":true,"listed":false,"github":"https://github.com/graniet/rllm","clone":"git clone https://github.com/graniet/rllm.git","description":"Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.","language":"Rust","stars":138,"topics":["ai","anthropic","builder-pattern","chatbot","llm","nlp","ollama","openai","prompt-engineering","rust"],"license":null,"category":"ai-agents","readme_excerpt":"RLLM Note: Starting with version 1.x, RLLM has become a simple wrapper around llm. Both crates will be actively maintained and kept in sync. If you are new to this ecosystem, you can use either llm directly or rllm - they provide the same features. RLLM is a Rust library that lets you use multiple LLM backends in a single project: OpenAI, Anthropic (Claude), Ollama, DeepSeek, xAI, Phind, Groq and Google. With a unified API and builder style - similar to the Stripe experience - you can easily create chat or text completion requests without multiplying structures and crates. Base crate is : LLM Key Features - Multi-backend : Manage OpenAI, Anthropic, Ollama, DeepSeek, xAI, Phind, Groq and Google through a single entry point. - Multi-step chains : Create multi-step chains with different backends at each step. - Templates : Use templates to create complex prompts with variables. - Builder pattern : Configure your LLM (model, temperature, max tokens, timeouts...) with a few simple calls. - Chat & Completions : Two unified traits ( ChatProvider and CompletionProvider ) to cover most use cases. - Extensible : Easily add new backends. - Rust-friendly : Designed with clear traits, unified error handling, and conditional compilation via features . - Validation : Add validation to your requests to ensure the output is what you expect. - Evaluation : Add evaluation to your requests to score the output of LLMs. - Parallel Evaluation : Evaluate multiple LLM providers in parallel and select","default_branch":null,"files":null,"tree":[],"storefront":"/r/graniet","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/graniet/rllm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}