{"repo":"microsoft/mcp-interviewer","free":true,"listed":false,"github":"https://github.com/microsoft/mcp-interviewer","clone":"git clone https://github.com/microsoft/mcp-interviewer.git","description":"Catch MCP server issues before your agents do.","language":"Python","stars":156,"topics":["agentic-ai","evaluation","linter","llm","mcp"],"license":"MIT","category":"mcp-servers","readme_excerpt":"MCP Interviewer A Python CLI tool that helps you catch MCP server issues before your agents do. PyPi Blog Example --- Table of Contents - How it works - 🔎 Constraint checking - 🛠️ Functional testing - 🤖 LLM evaluation - 📋 Report generation - Quick Start - Installation - Example - Usage - CLI - Bring Your Own Models - Python - Limitations - Contributing - Trademarks How it works 🔎 Constraint checking The MCP Interviewer helps avoid violating providers' hard constraints and warns you when you're not following recommended guidance. For example, OpenAI does not allow more than 128 tools in a single chat completion request, and recommends at most 20 tools. View all supported constraints Use --constraints [CODE ...] to customize output. Constraint Code Description ------------ ------------- OTC OpenAI tool count limit (≤128 tools) ONL OpenAI name length (≤64 chars) ONP OpenAI name pattern (a-zA-Z0-9 -) OTL OpenAI token length limit OA All OpenAI constraints 🛠️ Functional testing MCP servers are intended to be used by LLM agents, so the interviewer can optionally test them with an LLM agent. When enabled with the --test flag, the interviewer uses your specified LLM to generate a test plan based on the MCP server's capabilities and then executes that plan (e.g. by calling tools), collecting statistics about observed tool behavior. 🤖 LLM evaluation Note: this is an experimental feature. All LLM generated evaluations should be manually inspected for errors. The interviewer can a","default_branch":null,"files":null,"tree":[],"storefront":"/r/microsoft","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/microsoft/mcp-interviewer/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}