{"repo":"majiayu000/litellm-rs","free":true,"listed":false,"github":"https://github.com/majiayu000/litellm-rs","clone":"git clone https://github.com/majiayu000/litellm-rs.git","description":"A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format","language":"Rust","stars":105,"topics":["ai-gateway","anthropic","api-client","async-rust","aws-bedrock","embeddings","gemini","llm","load-balancing","multi-provider"],"license":"MIT","category":"ai-agents","readme_excerpt":"litellm-rs A high-performance Rust library and gateway for calling LLM APIs in an OpenAI-compatible format. Ships with 50+ built-in OpenAI-compatible providers plus first-class adapters for OpenAI, Anthropic, AWS Bedrock, Mistral, and Cloudflare. Features - 60+ runtime-wired providers - OpenAI, Anthropic, AWS Bedrock, Mistral, Cloudflare, plus 50+ OpenAI-compatible providers via the Tier 1 catalog. See Provider Support for the full matrix. - OpenAI-Compatible API - Drop-in replacement for OpenAI SDK - High Performance - 10,000+ requests/second, The provider and route-surface matrices below are validated against the provider registry and Tier 1 catalog. The source of truth for Tier 1 entries is catalog.rs ; Tier 2 identity and dispatch metadata lives in src/core/providers/registry/types.rs , with construction branches in src/core/providers/factory/registry.rs . Cross-surface support lives in src/core/providers/registry/support matrix.rs . Capability columns describe which endpoints this crate exposes for the provider — passthrough means an implemented crate endpoint forwards the call to the upstream OpenAI-compatible endpoint without per-provider transformation. Route-surface matrix Selector class HTTP chat / stream HTTP embeddings / image SDK chat / stream / embeddings completion() chat / stream Notes ---------------- -------------------- -------------------------- -------------------------------- ------------------------------- ------- openai ✅ / ✅ ✅ / ✅ ✅ / ✅ / ✅ ✅ / ✅ Refe","default_branch":null,"files":null,"tree":[],"storefront":"/r/majiayu000","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/majiayu000/litellm-rs/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}