{"repo":"justinwetch/SkillEval","free":true,"listed":false,"github":"https://github.com/justinwetch/SkillEval","clone":"git clone https://github.com/justinwetch/SkillEval.git","description":"A visual workbench for A/B testing AI skills. Upload two skill files, run them through a batch of test prompts, and let an AI judge score the results.","language":"JavaScript","stars":33,"topics":["ai","ai-agents","anthropic","claude","evals","evaluations","skills"],"license":"MIT","category":"ai-agents","readme_excerpt":"🧪 Skill Evaluator A visual workbench for A/B testing AI skills. Upload two Agent Skill packages or single-file skills, run them through a batch of test prompts, and let an AI judge score the results. DEMO VIDEO: SkillEval v1.1 product video I built this to improve Anthropic's frontend design skill and prove the improvements with data. That project was hardcoded to frontend evaluation, so I extracted the core evaluation engine and made it extensible—now you can 1v1 any two skills, in any domain, with any model. For the full story on how this started and why data-driven skill development matters, see Teaching Claude to Design Better. --- v1.2 Update v1.2.1 Skill Evaluator v1.2.1 refreshes the supported frontier model list with Claude Opus 4.8, newer Gemini options, and Grok 4.3 through xAI. It also removes disabled Anthropic Fable access, migrates older saved Opus defaults to Opus 4.8, and validates saved defaults so unsupported model IDs fall back safely. Skill Evaluator v1.2 adds support for zipped Agent Skill packages. You can now upload a standard .zip skill package with a root SKILL.md , and Skill Evaluator will preserve its separate references, scripts, assets, and supporting files when generating configs and running evaluations. Single-file .md and .txt skills still work as before, but internally they are treated as one-file Agent Skill packages so both upload paths use the same evaluation model. --- v1.1 Update Skill Evaluator v1.1 adds support for current Anthropic, O","default_branch":null,"files":null,"tree":[],"storefront":"/r/justinwetch","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/justinwetch/SkillEval/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}