{"owner":"intentee","github":"https://github.com/intentee","claimed":false,"inventory":[],"indexed":[{"repo":"intentee/paddler","github":"https://github.com/intentee/paddler","description":"Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.","language":"Rust","stars":1657,"topics":["ai","llamacpp","llm","llmops","load-balancer"],"license":"Apache-2.0","category":"networking-infra"}],"how_to_buy":"GET /r/intentee/<repo> (Accept: application/json) for any listed repo here: tree, README, price and the checkout to pay (x402; rehearse first at its test twin, simulated money). Repos under 'indexed' are free: clone them from GitHub."}