{"repo":"GradientHQ/parallax","free":true,"listed":false,"github":"https://github.com/GradientHQ/parallax","clone":"git clone https://github.com/GradientHQ/parallax.git","description":"Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere","language":"Python","stars":1367,"topics":["chatbot","distributed-systems","kimi","llama","llm","qwen","oss-gpt","large-language-models","python","pytorch"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"Trusted by Partners Gradient Blog X/Twitter (Gradient) X/Twitter (Parallax) Discord Arxiv News - [2026/02] 🦞 Parallax now supports OpenClaw integration! See Docs - [2025/10] 🔥 Parallax won #1 Product of The Day on Product Hunt! - [2025/10] 🔥 Parallax version 0.0.1 has been released! About A fully decentralized inference engine developed by Gradient. Parallax lets you build your own AI cluster for model inference onto a set of distributed nodes despite their varying configuration and physical location. Its core features include: - Host local LLM on personal devices - Cross-platform support - Pipeline parallel model sharding - Paged KV cache management & continuous batching for Mac - Dynamic request scheduling and routing for high performance The backend architecture: P2P communication powered by Lattica GPU backend powered by SGLang and vLLM Mac backend powered by MLX LM User Guide - Installation - Getting Started - Working with OpenClaw 🦞 Quick Install Contributing We warmly welcome contributions of all kinds! For guidelines on how to get involved, please refer to our Contributing Guide. Supported Models Provider HuggingFace Collection Blog Description :------------- :------------- :----------------------------: :----------------------------: :---------------------------- DeepSeek Deepseek DeepSeek-V3.2 DeepSeek-R1 DeepSeek-V3.2 Release DeepSeek-V3.2 is built for stronger reasoning and agent workflows, adding thinking-aware tool use while keeping both thinking and non-thi","default_branch":null,"files":null,"tree":[],"storefront":"/r/GradientHQ","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/GradientHQ/parallax/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}