{"repo":"Tele-AI/Fluxon","free":true,"listed":false,"github":"https://github.com/Tele-AI/Fluxon","clone":"git clone https://github.com/Tele-AI/Fluxon.git","description":"An AI-native distributed data plane built in Rust that supports high performance RPC, KV Cache, Message Queue, and File & Object Acceleration","language":"Rust","stars":122,"topics":["ai-native","memory-pool","message-queue","nosql","rpc","mooncake","distributed-cache","inference","redis","training"],"license":null,"category":"databases-storage","readme_excerpt":"Fluxon An AI-native distributed data plane that supports high performance RPC, KV Cache, Message Queue, and File & Object Acceleration. Add the project administrator on WeChat to join the open-source community group. English 中文 Docs 中文文档 Built on the unified Rust-based transport and caching foundation, Fluxon exposes three standardized interfaces that target the core bottlenecks in AI systems: - KV/RPC (Unified key-value and RPC) : Breaks data silos and enables efficient cross-process, cross-node reuse of inference-side KV Cache and latent cache - MQ (Elastic message queue) : Decouples system dependencies and supports elastic message transport across heterogeneous resource pools - FS ( S3 -compatible file, object, and cache acceleration system) : Unifies multi-form storage so one system can cache key-value, file, and object data, while supporting remote access, S3 forwarding, and large-scale cross-cluster migration for AI data and model files 🧭 Contents - Benchmark - Background - Foundation Capabilities - Interface Capabilities - Runtime Requirements - Quick Start - Repository Structure - Contributing - Contributors - Acknowledgements - License - Stargazers over time 📊 Benchmark The benchmark section mainly covers the RPC , KV , and FS data planes, and the related scripts and configurations are primarily under fluxon test stack/ . Fluxon RPC Benchmark The RPC benchmark mainly shows call latency and throughput across different message sizes and concurrency levels, to observe","default_branch":null,"files":null,"tree":[],"storefront":"/r/Tele-AI","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Tele-AI/Fluxon/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}