{"repo":"lennart-finke/baba_is_eval","free":true,"listed":false,"github":"https://github.com/lennart-finke/baba_is_eval","clone":"git clone https://github.com/lennart-finke/baba_is_eval.git","description":"Claude et al. play the brilliant puzzle title \"Baba is You\"","language":"Python","stars":62,"topics":["llm-evaluation","llm-tool-call","mcp","mcp-server"],"license":null,"category":"mcp-servers","readme_excerpt":"Baba Is Eval https://github.com/user-attachments/assets/cb6d0d49-b583-46a2-b262-1cf38279a531 We evaluate language models' meta-level reasoning in an interactive setting, like the upcoming ARC-AGI-3, except we use the brilliant puzzle game \"Baba Is You\". In short, the player manipulates the game rules by pushing word blocks around to form or destroy rules. We provide an MCP server to interact with the game in text format. The project is currently an alpha and not stable. Contributions are welcome, and brave devs with model credits to spare are invited to give it a try. Setup 🔩 - Buy \"Baba Is You\" somewhere, like on Steam: https://store.steampowered.com/app/736260/Baba Is You - Clone this repo in the Data folder - macOS + Steam: /Users/[username]/Library/Application Support/Steam/steamapps/common/Baba Is You/Baba Is You.app/Contents/Resources/Data - Windows + Steam (?): C:\\Program Files (x86)\\Steam\\steamapps\\common\\Baba Is You\\Data - Install prerequisites (or use uv ) - Run the setup script (after inspecting its contents) (also required before restarting the game, and for changes to io.lua which in turn require restarting the game) - Open the game, preferably in a command line - macOS + Steam: /Users/[username]/Library/Application Support/Steam/steamapps/common/Baba Is You/Baba Is You.app/Contents/MacOS/Chowdren - (Currently we use clicking as a workaround for focusing, you might need to move the window to (800, 500) pixels on monitor one) - Start the MCP Server On top of this","default_branch":null,"files":null,"tree":[],"storefront":"/r/lennart-finke","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lennart-finke/baba_is_eval/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}