{"repo":"kalavai-net/kalavai-client","free":true,"listed":false,"github":"https://github.com/kalavai-net/kalavai-client","clone":"git clone https://github.com/kalavai-net/kalavai-client.git","description":"Aggregates compute from spare GPU capacity","language":"TypeScript","stars":221,"topics":["ai","free","infrastructure","llm-inference","self-hosted","open-source","llm"],"license":"Apache-2.0","category":"self-hosted-apps","readme_excerpt":"⭐⭐⭐ Kalavai platform is open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by giving a star to our GitHub project, joining our discord channel and follow our Substack. Kalavai aggregates and coordinates spare GPU capacity Kalavai is an open source platform that unlocks computing from spare capacity . It aggregates resources from multiple sources to increase your computing budget and run large AI workloads. Core features Kalavai helps teams use computing resources more efficiently. It acts as a control plane for all your computing resources , wherever they are: local, on prem and multi-cloud. - Leverage multi-platform computing resources : ARM64 / AMD64 CPUs, GPUs (NVIDIA, AMD). - Increase GPU utilisation from your devices (fractional GPU). - Multi-node, multi-GPU deployments. - Ready-made templates to deploy common AI building blocks : model inference (vLLM, llama.cpp, SGLang), GPU clusters (Ray, GPUStack), automation workflows (n8n and Flowise), evaluation and monitoring tools (Langfuse), production dev tools (LiteLLM, OpenWebUI) and more. - Easy to expand to custom workloads Support for AI engines We currently support out of the box the following AI engines: - vLLM: most popular GPU-based model inference. - llama.cpp: CPU-based GGUF model inference. - Ray Clusters inference. Coming soon: - GPUstack (experimental) - SGLang: Super fast GPU-based model inference. - n8n (experimental): no-code workload auto","default_branch":null,"files":null,"tree":[],"storefront":"/r/kalavai-net","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/kalavai-net/kalavai-client/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}