{"repo":"RasputinKaiser/OpenEval","free":true,"listed":false,"github":"https://github.com/RasputinKaiser/OpenEval","clone":"git clone https://github.com/RasputinKaiser/OpenEval.git","description":"Free, local-first evaluation dashboard for agent CLIs with cross-harness transcript collection, live trace intelligence, deterministic graders, and accuracy audits.","language":"TypeScript","stars":10,"topics":["agent-evaluation","ai-agents","cli","evals","nextjs","sqlite","typescript","claude-code","dashboard","logging"],"license":"MIT","category":"dashboards-admin","readme_excerpt":"OpenEval OpenEval is a local-first, harness-agnostic evaluation dashboard for agent CLIs. Every harness is a JSON descriptor; the bundled Claude Code, Codex, and ncode adapters use the same format as user descriptors under harnesses/ . OpenEval runs repeatable cases, grades results with deterministic and rubric-based checks, persists run history to SQLite, and turns the results into an operator-friendly Next.js dashboard. The project is designed for people who want to compare agent behavior on practical software tasks, inspect the exact traces behind a score, and keep their private run history on their own machine. Launch Film https://github.com/user-attachments/assets/97375fda-e019-451b-b15b-8d914792f0c7 The 29.5-second v0.1.1 launch film shows the real OpenEval dashboard: live sessions, collection history, repeatable runs, comparisons, coverage, telemetry, and accuracy audits. The current application release is v0.1.5. Download the full-resolution MP4 · Open the v0.1.1 media release · Latest release: v0.1.5 Build Credits - OpenEval: developed with Noumena Code, Claude Code (including Fable 5 and Sonnet 5), and OpenAI Codex. Fable 5 contributed substantially to the application itself. - Launch film: GPT-5.6 Sol (High) led the edit, composition, visual QA, and final release pass; GPT-5.6 Luna (xhigh) contributed additional iteration passes. - Production stack: Codex, ImageGen, TouchDesigner, HyperFrames, GSAP, CDP Recorder, and FFmpeg. - Acknowledgment: huge thanks to @KingBo","default_branch":null,"files":null,"tree":[],"storefront":"/r/RasputinKaiser","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/RasputinKaiser/OpenEval/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}