{"repo":"lechmazur/debate","free":true,"listed":false,"github":"https://github.com/lechmazur/debate","clone":"git clone https://github.com/lechmazur/debate.git","description":"Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.","language":null,"stars":30,"topics":["benchmark","claude","debates","gemini","gpt","leaderboard","llm"],"license":null,"category":"ai-agents","readme_excerpt":"LLM Debate Benchmark: Adversarial Multi-Turn Argument Under Opposition This benchmark measures how well large language models perform in adversarial, multi-turn debates across a wide range of topics. Strong performance requires more than a polished opening: models need broad knowledge, accurate facts under pressure, strong rebuttal, and the ability to remain coherent and responsive over several rounds. Each matchup runs twice on the same motion with sides swapped . A three-model judge panel decides each debate's winner and margin. The published leaderboard uses Bradley-Terry ratings built from complete side-swapped matchups. --- --- How to read the chart - Higher bars mean stronger judged debate performance. - Bradley-Terry is a relative within-pool rating centered near 1500 , not an absolute capability score. - The grey band spans the 95% robust confidence interval ; darker shading means greater relative density. - The published order uses Bradley-Terry. Glicko-2 remains a secondary scheduling diagnostic. Current snapshot - 49 rated model identities in the complete stored graph; 46 shown publicly - 2,607 complete side-swapped matchups , comprising 5,214 debates , used for ratings - 16,203 judge decisions behind the ratings - 683 topics represented in the rated corpus One side-swapped matchup means two debates on the same motion with PRO and CON roles reversed. Model and data scopes View Models Matchups Purpose --- ---: ---: --- Complete stored rating graph 49 2,660 represent","default_branch":null,"files":null,"tree":[],"storefront":"/r/lechmazur","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lechmazur/debate/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}