{"repo":"druide67/asiai","free":true,"listed":false,"github":"https://github.com/druide67/asiai","clone":"git clone https://github.com/druide67/asiai.git","description":"Multi-engine LLM benchmark & monitoring CLI for Apple Silicon","language":"Python","stars":11,"topics":["apple-silicon","benchmark","cli","inference","llm","lm-studio","mcp","mlx","monitoring","ollama"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"asiai Apple Silicon AI — Multi-engine LLM benchmark & monitoring CLI asiai compares inference engines side-by-side on your Mac. Load the same model on Ollama and LM Studio, run asiai bench , get the numbers. No guessing, no vibes — just tok/s, TTFT, power efficiency, and stability per engine. Share your results with the community ( --share ), compare against other Apple Silicon users ( asiai compare ), and get smart engine recommendations ( asiai recommend ). Born from the OpenClaw project, where we needed hard data to pick the fastest engine for multi-agent swarms on Mac Mini M4 Pro. Quick start Or via Homebrew: Other options: Then benchmark and share: Commands asiai detect Auto-detect running inference engines across all known engine ports. asiai bench Cross-engine benchmark with standardized prompts. Runs 3 iterations per prompt by default, reports median tok/s (SPEC standard) with stability classification. Options: Agentic mode — measuring prefix cache reuse Runs 8 sequential prompts with a fixed long system message and varying user messages to expose how the engine reuses cached prefix tokens. Reads cached tokens from the streaming usage when the engine exposes it (llama.cpp, mlx-lm), falls back to the TTFT ratio otherwise. Outputs a verdict prefix cache reuse: yes partial no . The metric that matters when your workload is multi-turn agentic with shared system prompts. Quality modes — measuring quality, not just speed Throughput is not quality. Three deterministic modes ","default_branch":null,"files":null,"tree":[],"storefront":"/r/druide67","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/druide67/asiai/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}