{"repo":"mgechev/skillgrade","free":true,"listed":false,"github":"https://github.com/mgechev/skillgrade","clone":"git clone https://github.com/mgechev/skillgrade.git","description":"\"Unit tests\" for your agent skills","language":"TypeScript","stars":679,"topics":["agent","claude-code","codex","eval","gemini-cli","skill"],"license":"MIT","category":"deployment-docker-iac","readme_excerpt":"Skillgrade The easiest way to evaluate your Agent Skills. Tests that AI agents correctly discover and use your skills. See examples/ — superlint (simple) and angular-modern (TypeScript grader). Quick Start Prerequisites : Node.js 20+, Docker 1. Initialize — go to your skill directory (must have SKILL.md ) and scaffold: Generates eval.yaml with AI-powered tasks and graders. Without an API key, creates a well-commented template. 2. Edit — customize eval.yaml for your skill (see eval.yaml Reference). 3. Run : The agent is auto-detected from your API key: GEMINI API KEY → Gemini, ANTHROPIC API KEY → Claude, OPENAI API KEY → Codex. Override with --agent=claude . 4. Review : Reports are saved to $TMPDIR/skillgrade/ /results/ . Override with --output=DIR . Presets Flag Trials Use Case ------ -------- ---------- --smoke 5 Quick capability check --reliable 15 Reliable pass rate estimate --regression 30 High-confidence regression detection Options Flag Description ------ ------------- --eval=NAME[,NAME] Run specific evals by name (comma-separated) --grader=TYPE Run only graders of a type ( deterministic or llm rubric ) --trials=N Override trial count --parallel=N Run trials concurrently --agent=gemini\\ claude\\ codex\\ acp\\ opencode\\ command Override agent (default: auto-detect from API key) --model=NAME Model the agent answers with ( gemini , claude , codex , opencode ). Default: whatever the agent CLI is configured to use --provider=docker\\ local Override provider --acp-command=CMD ACP","default_branch":null,"files":null,"tree":[],"storefront":"/r/mgechev","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mgechev/skillgrade/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}