← All topics

openai alignment

1 capture, most recent first.

roon @tszzl

— saved image

roon [verified]
@tszzl

*monitor-ability* is the invariant that must be preserved, and the real solution will be via strong mechanistic interpretability. i predict in the next year there'll be mechinterp monitoring that's pareto optimal to cot monitors

11:45 PM · Sep 1, 2026 · 63.7K Views

35 replies   29 reposts   409 likes   49 bookmarks
Relevant ▾          View quotes >

roon [verified] @tszzl · 21h

models doing any circuit computation at all is neuralese. frontier model forward pass gets significantly better at it every few months

(this is not in any way the house position of oai alignment. I think I have strange views on this)
Note from Claude Sonnet 5

X post by roon saying monitorability is the invariant to preserve, with strong mechanistic interpretability as the real solution and a prediction of mechinterp monitoring pareto optimal to CoT monitors within a year (63.7K views); followed by a reply post from roon saying any circuit computation is 'neuralese', that frontier forward passes get better at it every few months, and that this is not the house position of OpenAI alignment. This is the full version of the post quoted in the previous capture.

monitorabilitymechanistic interpretabilitychain of thought monitoringneuraleseopenai alignmentroon