{"repo":"lechmazur/writing","free":true,"listed":false,"github":"https://github.com/lechmazur/writing","clone":"git clone https://github.com/lechmazur/writing.git","description":"This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, motivations, etc.) in a short creative story","language":null,"stars":423,"topics":["claude","llama","llm","o1","gpt-4-5","claude-3-7-sonnet","deepseek","deepseek-r1","gemini"],"license":null,"category":"ai-agents","readme_excerpt":"LLM Creative Story-Writing Benchmark This benchmark compares short stories written to the same constrained creative briefs. Separate evaluator models read matched story pairs and choose which one is better. Those choices are combined into a relative comparison score. Higher scores mean stronger performance against the other models tested. Scores are relative, not grades: zero is near the middle of this comparison set, and overlapping uncertainty ranges can indicate similarly rated models. --- Current Results Leaderboard Current comparison set: - 44 rated models - 537 direct model pairings - 62,860 evaluator judgments - the rating combines compatible evaluator-v2 and evaluator-v3 evidence after bridge validation - the chart focuses on current models; the table retains all rated models for historical comparison - striped bars and markers identify models that completed fewer than 400 stories Labels such as high , xhigh , max , and adaptive identify the reasoning setting used for that model. Estimated win chance is the model's average expected chance against another model in the full comparison set. Rank Model Comparison score Estimated win chance Uncertainty range -----: :------ -----------------: ---------------------: :------------------ 1 Claude Opus 5 (xhigh) 4.2 96% 4.2 to 4.3 2 Claude Fable 5 (high)§ 3.3 91% 3.2 to 3.4 3 Kimi K3 3.0 88% 2.9 to 3.1 4 GPT-5.6 Sol (xhigh) 2.9 88% 2.8 to 3.0 5 GPT-5.5 (xhigh) 2.9 87% 2.8 to 2.9 6 GPT-5.6 Sol (high) 2.7 86% 2.7 to 2.8 7 GPT-5.4","default_branch":null,"files":null,"tree":[],"storefront":"/r/lechmazur","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lechmazur/writing/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}