{"repo":"steviec/mcp-server-tester","free":true,"listed":false,"github":"https://github.com/steviec/mcp-server-tester","clone":"git clone https://github.com/steviec/mcp-server-tester.git","description":"CLI-based tester for verifying that MCP servers work correctly when called directory and by agents","language":"TypeScript","stars":35,"topics":[],"license":"MIT","category":"mcp-servers","readme_excerpt":"MCP Server Tester The MCP Server Tester is a tool for automated testing of MCP servers. Why this tool? Building reliable MCP servers that work consistently and are spec-compliant is harder than it should be: - the Inspector tool helps to build and test the intial server, but won't protect you from regressions - tools works perfectly in direct testing, but LLMs use them incorrectly and inconsistently in the real world - most MCP SDKs aren't fully spec-compliant, and it's hard to know what's missing - the spec evolves rapidly, making it hard to stay current with best practices The mcp-server-tester is a implementation-agnostic CLI testing tool that provides three focused commands that help solve these core issues: - tools - Run tests that verify your tools work correctly with direct MCP calls - evals - Run tests that verify LLMs can consistently understand and use your tools correctly - compliance - Automated server spec validation as the protocol evolves (Work in Progress) --- Commands tools - Direct MCP Tool Testing Test your tools work correctly with direct API calls: Sample output: evals - LLM Integration Testing Test that LLMs can discover and use your tools effectively: Sample output: Note: Requires ANTHROPIC API KEY environment variable. compliance - MCP Specification Compliance Testing (WIP) Test that your server is spec compliant: See the Compliance Command (WIP) section below for details and example output. Quick Start 1. Create server config ( filesystem-server-confi","default_branch":null,"files":null,"tree":[],"storefront":"/r/steviec","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/steviec/mcp-server-tester/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}