{"repo":"ArchishmanSengupta/autovoiceevals","free":true,"listed":false,"github":"https://github.com/ArchishmanSengupta/autovoiceevals","clone":"git clone https://github.com/ArchishmanSengupta/autovoiceevals.git","description":"A self-improving loop for voice AI agents. Uses karpathy's autoresearch as foundation.","language":"Python","stars":155,"topics":["autoresearch","claude","voice-agents","voice-ai","system-prompt-optimization","smallest-ai"],"license":"MIT","category":"ai-agents","readme_excerpt":"autovoiceevals A self-improving loop for voice AI agents. Inspired by the keep/revert pattern from karpathy/autoresearch. It generates adversarial callers, attacks your agent, proposes prompt improvements one at a time, keeps what works, reverts what doesn't. Run it overnight, wake up to a better agent. Works with Vapi, Smallest AI, ElevenLabs ConvAI, and LiveKit. Setup 1. Clone and install 2. Add your API keys Open .env and fill in your keys: You need the Anthropic key (for Claude, which generates scenarios and judges conversations) plus the key for whichever voice platform your agent runs on. 3. Configure your agent Copy an example config for your platform: Then open config.yaml and replace the example with your agent's details. The config has three required fields: Where to find your agent ID: - Vapi: Dashboard → Assistants → click your assistant → ID in the URL or settings panel - Smallest AI: Dashboard → Agents → click your agent → id in the URL - ElevenLabs: Dashboard → Agents → click your agent → ID in the URL Everything else has sensible defaults. See config.yaml for all options. 4. Write a good description The description is the most important part of the config. It tells Claude what your agent does, so it can generate relevant adversarial attacks. The more context you provide, the sharper the attacks. What to include: - What the agent does (booking, ordering, support, etc.) - Services, menu items, or offerings with prices - Staff names and roles (if applicable) - Bu","default_branch":null,"files":null,"tree":[],"storefront":"/r/ArchishmanSengupta","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ArchishmanSengupta/autovoiceevals/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}