{"repo":"eval-sys/mcpmark","free":true,"listed":false,"github":"https://github.com/eval-sys/mcpmark","clone":"git clone https://github.com/eval-sys/mcpmark.git","description":"MCPMark is a comprehensive, stress-testing MCP benchmark designed to evaluate model and agent capabilities in real-world MCP use.","language":"Python","stars":458,"topics":["benchmark","mcp-servers","mcpmark","eval-sys","agentic","tool-use","mcp"],"license":"Apache-2.0","category":"mcp-servers","readme_excerpt":"MCPMark: Stress-Testing Comprehensive MCP Use An evaluation suite for agentic models in real MCP tool environments (Notion / GitHub / Filesystem / Postgres / Playwright). MCPMark provides a reproducible, extensible benchmark for researchers and engineers: one-command tasks, isolated sandboxes, auto-resume for failures, unified metrics, and aggregated reports. 🚀 MCPMark Verified is now the default. The standard tasks in this repository are the Verified set — every environment version-pinned and every verifier stabilized. Results from earlier task versions are deprecated and not directly comparable, so please report new numbers as MCPMark Verified . On the Verified set, gpt-5.5 (xhigh) leads at 92.9% and kimi-k2.7 reaches 81.1% . See #264. News - 🚀 12 Jun — MCPMark Verified is now the default task set: every environment version-pinned and every verifier stabilized. Earlier task versions are deprecated; please report scores as MCPMark Verified . On the Verified set, gpt-5.5 (xhigh) leads at 92.9% and kimi-k2.7 reaches 81.1% . See #264. - 📣 27 May — The previous Notion Source Hub page is deprecated; please use the new link: MCPMark Source Hub. - 📌 21 Jan — Pinned MCP server versions for reproducible benchmarks: GitHub MCP Server v0.15.0 (switched to Docker for version control), Notion MCP Server @1.9.1 (Notion released 2.0 but it has many bugs, not recommended). See #246. - 🔥 13 Dec — Added auto-compaction support ( --compaction-token ) to summarize long conversations and av","default_branch":null,"files":null,"tree":[],"storefront":"/r/eval-sys","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/eval-sys/mcpmark/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}