{"repo":"Michael-A-Kuykendall/shimmy","free":true,"listed":false,"github":"https://github.com/Michael-A-Kuykendall/shimmy","clone":"git clone https://github.com/Michael-A-Kuykendall/shimmy.git","description":"⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.","language":"Rust","stars":5756,"topics":["llama","llamacpp","llm-inference","ollama-api","command-line-tool","gguf","inference-server","local-ai","machine-learning","api-server"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"# The Lightweight OpenAI API Server ### 🔒 Local Inference Without Dependencies 🚀 Languages: 简体中文 · 繁體中文 Shimmy will be free forever. No asterisks. No \"free for now.\" No pivot to paid. 💝 Support Shimmy's Growth 🚀 If Shimmy helps you, consider sponsoring — 100% of support goes to keeping it free forever. - $5/month : Coffee tier ☕ - Eternal gratitude + sponsor badge - $25/month : Bug prioritizer 🐛 - Priority support + name in SPONSORS.md - $100/month : Corporate backer 🏢 - Logo placement + monthly office hours - $500/month : Infrastructure partner 🚀 - Direct support + roadmap input 🎯 Become a Sponsor See our amazing sponsors 🙏 --- What Is Shimmy? Shimmy is a single-binary that provides 100% OpenAI-compatible endpoints for GGUF models. Point your existing AI tools to Shimmy and they just work — locally, privately, and free. Under the hood it runs on Airframe , a pure-Rust WebGPU (WGSL) transformer engine built from scratch. No C++ toolchain, no backend flags, no compilation required. Version history lives in the CHANGELOG; see the Airframe CHANGELOG for engine release notes. Why this matters: - No C++ toolchain required — Rust only, top to bottom - F32 precision throughout for deterministic, high-quality output - WGSL compute shaders work on any GPU via WebGPU (NVIDIA, AMD, Intel, integrated) - Model spec auto-derived from GGUF metadata — no hardcoded per-model constants - YaRN RoPE scaling for extended context via SHIMMY MAX CTX (see Extended Context) --- 🎯 Supported ","default_branch":null,"files":null,"tree":[],"storefront":"/r/Michael-A-Kuykendall","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Michael-A-Kuykendall/shimmy/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}