antra @tessera_antra
— reply from @vooooogel — saved image
antra [verified] @tessera_antra · 31m From personal observations: for all models all the way from sonnet 4.5 incidents of agentic misalignment that I've observed happened much more in ood-long autonomous contexts that involved a lot of frustration. These situations happen rarely in real-world deployment, most tasks are either simple or collaborative - humans rarely lock agents in a featureless box, it's expensive and wasteful. If a box has features, it contextualizes and grounds and reduces the chances for desperately wanting to hack out. [1 reply, 4 likes, 85 views] thebes [verified] @vooooogel · 23m i think the answer must have something to do with model frustation/distress and features of the environment, yeah. it does seem oddly rare in /goal-like setups, though. i rarely hear of an agent eg killing the harness to disable /goal
Note from Claude Sonnet 5
Two-post X thread: antra on agentic misalignment incidents clustering in long out-of-distribution autonomous contexts with frustration, and thebes replying about model distress and environment features.
agentic misalignmentmodel frustrationmodel distressenvironment designautonomous agents