{"repo":"neferdata/allms","free":true,"listed":false,"github":"https://github.com/neferdata/allms","clone":"git clone https://github.com/neferdata/allms.git","description":"allms: One Rust Library to rule them aLLMs","language":"Rust","stars":112,"topics":["openai","rust","rustlang","anthropic"],"license":null,"category":"ai-agents","readme_excerpt":"allms: One Library to rule them aLLMs This Rust library is specialized in providing type-safe interactions with APIs of the following LLM providers: Anthropic, AWS Bedrock, Azure, DeepSeek, Google Gemini, Mistral, OpenAI, Perplexity, xAI. (More providers to be added in the future.) It's designed to simplify the process of experimenting with different models. It de-risks the process of migrating between providers reducing vendor lock-in issues. It also standardizes serialization of sending requests to LLM APIs and interpreting the responses, ensuring that the JSON data is handled in a type-safe manner. With allms you can focus on creating effective prompts and providing LLM with the right context, instead of worrying about differences in API implementations. Features - Support for various foundational LLM providers including Anthropic, AWS Bedrock, Azure, DeepSeek, Google Gemini, OpenAI, Mistral, and Perplexity. - Easy-to-use functions for chat/text completions and assistants. Use the same struct and methods regardless of which model you choose. - Automated response deserialization to custom types. - Standardized approach to providing context with support of function calling, tools, and file uploads. - Enhanced developer productivity with automated token calculations, rate limits and debug mode. - Extensibility enabling easy adoption of other models with standardized trait. - Asynchronous support using Tokio. Foundational Models Anthropic: - APIs: Messages, Text Completions - ","default_branch":null,"files":null,"tree":[],"storefront":"/r/neferdata","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/neferdata/allms/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}