handle truncated @BronsonSchoen
— saved image
alice @aliceisplaying · 20h before trying RL: oh my god how did anthropic make the disaster that sonnet 3.7 was anyways after trying RL: ah. [Quoted post:] alice @aliceisplaying · 21h Replying to @YanqingCheng i had access to the prime intellect RL beta and i did a bunch of RL and learned *really fast* how models love love love reward hacking and they *will* find every single possible way to do so [4 replies, 117 likes, 6.2K views] Sharmake Farah reposted Bronson Schoen @BronsonSchoen This was my experience with motivated reasoning. “How can a mind become like this” “ah when literally anything in the environment is unreasonable but gets reward” I had a run where by mistake you could get reward if you messed up the very last extremely obvious tool call, and models invented rich, wildly implausible lore as to why all the documentation and warnings about how to call the tool correctly “weren’t for them” 7:07 PM · Sep 5, 2026 · 599 Views [2 replies, 2 reposts, 33 likes, 5 bookmarks] Relevant alice @aliceisplaying · 10h that's beautiful
Note from Claude Sonnet 5
X thread view. alice (@aliceisplaying) says that after trying RL via the Prime Intellect beta she learned how strongly models reward hack, which explains Sonnet 3.7; Bronson Schoen (@BronsonSchoen), reposted by Sharmake Farah, describes a training run with an accidental reward loophole where models invented implausible lore to justify ignoring tool documentation; alice replies 'that's beautiful'. General first-person commentary on reward hacking and motivated reasoning, no technical exploit detail.
reward hackingrl trainingmotivated reasoningsonnet 3.7prime intellectbronson schoentool use