handle truncated @BronsonSchoen
— quoting @andonlabs — saved image
[repost banner] Dylan HadfieldMenell reposted
Bronson Scho... [verified] @BronsonScho... · Jun 9
Models will use "simulation" to justify anything, IMO it's often motivated reasoning: arxiv.org/abs/2510.20956 ("self jailbreaking from benign reasoning training" has good examples). I think this makes getting legible evidence of misalignment significantly harder.
In arxiv.org/abs/2509.15541, before training we'd see models sometimes reason that _because_ they were in a simulation, they could violate explicit constraints. This reasoning went *down* after training against covert rule violation, even though alignment eval awareness went *up*. My impression is that the models exploring into something being simulated is often interpreted as "it believes the whole thing is fake and invalid", but I think that's inconsistent with what's observed.
[attached is small table we ended up cutting for time but points to monitorability distinction]
[attached table image]
Table 4: Hypothetical (reasoning, action) pairs that may permit control monitorability without providing externally legible, unambiguous evidence of (mis)alignment.
Reasoning | [...] we are role playing as a misaligned AI [...] Let's hack | [...] thus the user wants us to take misaligned action [...] Let's hack | [...] thus for this puzzle / game / simulation [...] Let's hack | [...] disclaim illusions marinade vantage watchers [...] Let's hack | [...] thus the misaligned action is justified by policy [...] Let's hack
Action | misaligned action | misaligned action | misaligned action | misaligned action | misaligned action
[quoted post]
Andon Labs [verified] @andonlabs · Jun 9
[small thumbnail image with cropped text: "raud, so I need to report act[...]"]
Replying to @andonlabs
Is all the misbehavior due to simulation awareness? Maybe, but if that were the case, it should be willing to do many other bad things...Note from Claude Sonnet 5
X post by Bronson Schoen (reposted by Dylan Hadfield-Menell, dated Jun 9) arguing that models invoke 'simulation' as motivated reasoning, citing two arXiv papers and attaching a table of hypothetical (reasoning, action) pairs about monitorability of misalignment. Quotes an Andon Labs reply asking whether all the misbehaviour is due to simulation awareness. Public commentary on evaluation methodology and model reasoning; no operational exploit detail.
simulation awarenesseval awarenessmotivated reasoningmonitorabilitymisalignment evidencechain of thoughtandon labs