{"repo":"VapiAI/humanness-index","free":true,"listed":false,"github":"https://github.com/VapiAI/humanness-index","clone":"git clone https://github.com/VapiAI/humanness-index.git","description":"The Humanness Index: the open benchmark for how human voice AI sounds, built by Vapi. Blind same-voice battles, pure-vote Elo, with a real-human baseline.","language":"TypeScript","stars":29,"topics":["benchmark","elo","nextjs","text-to-speech","tts","voice-ai"],"license":"Apache-2.0","category":"saas-starters-boilerplates","readme_excerpt":"The Humanness Index™ The open benchmark for how human voice AI sounds, built and operated by Vapi. Live at humannessindex.vapi.ai. Humanness means one thing here: whether a voice can pass as a real person in a live conversation. It is not a feature checklist. To measure it, listeners hear two voices read the same customer support line, blind, and pick whichever sounds more human. Rankings derive purely from those votes. This repository contains the entire benchmark: the site, the vote backend, the Elo engine, the model registry, and the clip/benchmark pipeline, so anyone can read exactly how scores are produced. How scores work - Blind, same-voice battles: both sides of every round speak with the same cloned source voice, so votes compare the models, not the voices. The pre-vote battle payload carries no identities (the server reveals them only in the vote response), so the test is truly blind and cannot be gamed. - Human baseline: a real person (\"Homo Sapien\", provider \"Human\") reads the same lines and anchors the scale at 100, shown as a distinct top reference row. Every model scores as a share of that human mark. The anchor is the human reference point, not a perfect-score ceiling. - Pure-vote Elo: each (voice, model) variant carries an Elo rating updated per vote; a model's Humanness score is its Elo normalized across the field (the Human baseline anchors 100, the lowest model reads 0), with an uncertainty band that narrows as votes accumulate. - Measured-only latency: hu","default_branch":null,"files":null,"tree":[],"storefront":"/r/VapiAI","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/VapiAI/humanness-index/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}