leo 🐾 ✔ @synthwavedd · 22h
they removed gemini's depression and it regressed in:
creative writing
eqbench
longform creative writing
#noticing
[Embedded image: two/three data tables/heatmaps of benchmark leaderboard data — columns include Style, Slop, Repetition, Length, Rubric Score, Elo Score (colored bars from red to green), and a second panel with columns Ability, Safety, Assertiveness, Social IQ, Warmth, Analysis, Insight, Empathy, Compile, Moralist, Pragmatist Fit Score as a purple/orange heatmap grid, and a third panel with Length, Slop, Repetition, Degradation, Score as blue bars. Row labels (model names) are cut off/illegible.]
Note from Claude Sonnet 5
A tweet claiming that when Google removed some trait characterized as "depression" from Gemini, its performance regressed on creative-writing benchmarks (EQBench, longform creative writing), framed with the "#noticing" hashtag suggesting a pattern worth flagging. Relevant to Nathan's interest in model welfare, personality/affect training, and the relationship between emotional affect and creative capability in LLMs — though the underlying benchmark data in the image is only partially legible.
geminimodel welfarerlhfcreative writing benchmarkspersonality trainingtwittereqbench