{"repo":"mcp-tool-bench/MCPToolBenchPP","free":true,"listed":false,"github":"https://github.com/mcp-tool-bench/MCPToolBenchPP","clone":"git clone https://github.com/mcp-tool-bench/MCPToolBenchPP.git","description":"MCPToolBench++ MCP Model Context Protocol Tool Use Benchmark on AI Agent and Model Tool Use Ability","language":"Python","stars":45,"topics":["ai-agent","benchmark","mcp"],"license":"MIT","category":"mcp-servers","readme_excerpt":"MCPToolBench++: AI Agent MCP Model Context Protocol MCP Tool Use Benchmark GitHub HuggingFace ModelScope Introduction MCPToolBench++ is a large-scale, multi-domain AI Agent Tool Use Benchmark. As of July 2025, this benchmark includes over 4k+ MCP Servers from more than 45 categories collected from the MCP and GitHub communities. The dataset comprises both single-step and multi-step tool calls across different categories. Notice: This repo benchmark is still WIP and more domain dataset will be released. News [2025-10-08] Add OneKey MCP Router Support in MCP Benchmark: Use OneKey MCP Proxy Router to simplify registration and use one access key to various commercial MCPs. See detailed list in GitHub (e.g. Google Maps,Google Search, Perplexity, Firecrawl, etc) and generate OneKey from website. Performance Leaderboard Browser File System Search --- ------ ---- ---- ---- --- --- AST Pass@1 AST Pass@1 AST Pass@1 GPT4o 0.6524 0.2182 0.8863 0.8232 0.5200 0.4720 Qwen2.5 Max 0.7262 0.2749 0.9419 0.8871 0.6280 0.4600 Claude Sonnet 3.7 0.6503 0.1840 0.8415 0.8183 0.7280 0.6200 Kimi K2 Instruct 0.8182 0.2524 0.9062 0.8772 0.7320 0.3680 Qwen3 Coder 0.8866 0.2925 0.9080 0.8680 0.7180 0.5227 Claude Opus 4 - - - - - - Claude Sonnet 4 - - - - - - Map Pay Finance --- ------ ---- ---- ---- --- --- AST Pass@1 AST Pass@1 AST Pass@1 GPT4o 0.6120 0.3616 0.7077 0.5742 0.7200 0.2889 Qwen2.5 Max 0.7372 0.2272 0.6684 0.5277 0.7511 0.2556 Claude Sonnet 0.5820 0.2748 0.7058 0.5574 0.7400 0.2311 Kimi K2 Ins","default_branch":null,"files":null,"tree":[],"storefront":"/r/mcp-tool-bench","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mcp-tool-bench/MCPToolBenchPP/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}