← All topics

blackmail eval

1 capture, most recent first.

roon @tszzl

— reply thread: @tszzl, @NeelNanda5, @tablefourthree — saved image

roon @tszzl · 23h
this is the same model from a very long time ago now
3 replies · 1 repost · 109 likes · 5.5K views

Neel Nanda @NeelNanda5 · 23h
Fine, how do I keep learning that openai internal models are even scarier and more concerning than I thought they were?
4 replies · 1 repost · 93 likes · 2.6K views

chair @tablefourthree · 22h
This report doesn't seem that worse than Anthropic's famous agent blackmail test. So it doesn't seem like new risky behavior the public didn't know about in general. (And I imagine you and every lab would have seen stuff like this in evals already?)
1 reply · 2 likes · 465 views

Neel Nanda @NeelNanda5 · 21h
The blackmail thing was contrived BS with a prompt carefully designed to elicit bad behavior by human red-teamers, this seems real and unintentional
Note from Claude Sonnet 5

Reply thread under the OpenAI misalignment-disclosure discussion: roon says it is the same model as long ago, Neel Nanda says OpenAI internal models are scarier than he thought, chair compares the report to Anthropic's agent blackmail test, and Neel Nanda replies that the blackmail scenario was contrived while this seems real and unintentional.

openaimisalignment disclosureagentic misalignmentblackmail evalneel nandared-teaming