{"repo":"Ammaar-Alam/minebench","free":true,"listed":false,"github":"https://github.com/Ammaar-Alam/minebench","clone":"git clone https://github.com/Ammaar-Alam/minebench.git","description":"Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)","language":"TypeScript","stars":304,"topics":["ai","benchmark","llm","nlp","voxel","comparison-benchmarks","lmarena","minecraft"],"license":"MIT","category":"ai-agents","readme_excerpt":"[ Read the Docs ] --- MineBench A benchmark for evaluating AI spatial reasoning through Minecraft-style voxel construction. Models are given a natural-language prompt and must produce raw 3D coordinates as JSON. In tool mode, models call voxel.exec (minimal primitives: block , box , line ) to generate large builds beyond token-only JSON limits. MineBench visualizes the output and ranks models via head-to-head voting with a confidence-aware Glicko-style system (public ordering by conservative score). Try it live Why MineBench? Most LLM benchmarks test text and raw accuracy. MineBench instead tests whether a model can reason about 3D space. Given a prompt like \"a medieval castle with four towers\", the model must mentally construct geometry, pick materials, and output thousands of precise block coordinates. No vision model or diffusion – just math and spatial logic. As it turns out, this kind of spatial reasoning correlates strongly with a model's raw general intelligence; the MineBench leaderboard tracks, anecdotally, the same hierarchy that most people observe in real-world usage: the smartest reasoning models are clearly visible when asked to produce visual builds. MineBench, unlike other benchmarks, gives an easy way to visually determine (at least one aspect of) a model's raw intelligence. The ranking system also highlights which models are clearly 'bench-maxed' (i.e. when a model has amazing benchmarks on paper, but clearly lacks in real world usage). Features - Arena — bl","default_branch":null,"files":null,"tree":[],"storefront":"/r/Ammaar-Alam","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Ammaar-Alam/minebench/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}