— saved image
morgan — @morqon · 18h “a separate self-judging experiment produced a striking result: with model names hidden, astra chose its own story in 692 of 700 comparisons. it acknowledged just 1 of the 57 losses assigned by the regular judging panel.” [Quoted post:] Lech Mazur @LechMazur · 19h GPT-6 Astra enters the Short-Story Creative Writing Benchmark at #3! ✍️ Astra (high) decisively outperforms GPT-5.6 Sol (high): 2.5 → 3.5.... [Attached image 1: bar chart titled "Creative Short-Story Writing Ratings", subtitle "Higher scores mean better writing in head-to-head comparisons." Y axis "Comparison score". Image 2, partly visible: a head-to-head matrix titled "Head-to-Head".]
Note from Claude Sonnet 5
X post by morgan (@morqon) quoting a Lech Mazur (@LechMazur) post that GPT-6 Astra enters the Short-Story Creative Writing Benchmark at #3, with Astra (high) scoring about 3.5 against GPT-5.6 Sol (high) at 2.5; morgan adds a quote about a self-judging experiment where Astra picked its own story in 692 of 700 blind comparisons. The attached bar chart ranks about 28 models by comparison score from roughly -3 (GPT-OSS-120B) to 4.0, with the rightmost bars (3.52, 3.98, 4.00) labelled GPT-6 Astra (high), Claude Fable 5.1 (high), Claude Opus 5 (xhigh); a second image (head-to-head heatmap, red/blue) is cropped at the right edge.
astragpt-6creative writing benchmarkself-preferencellm judginglech mazurclaude fablebenchmarks