← All topics

controllability

2 captures, most recent first.

@gfodor

— saved image

gfodor.id @gfodor  [Subscribe]

Is the reason you don't have full control over your employees the fact you can't kill them? No, it's because your employees are sufficiently capable of making decisions, reasoning, interpreting (and misinterpreting) that they will *never* be inherently controllable. If your employees tomorrow are better than you at every skill, then these "misinterpretations" would be potentially catastrophic. Not to mention if you expect to be a slave driver of superintelligent employees who may actually, without you realizing it, have independent goals, you're screwed. You continue to argue from a basis we have solved mechanistic interoperability, which we haven't, and I would be surprised if you are even following the latest research. If you are, prove me wrong - explain specially (not in hand wavy terms) why you think we mech interp driven RL is going to be able to make models fully steerable anytime soon, and explain what methods you've read that give you hope. Don't hand wave with analogies or philosophical arguments - talk to me like an engineer.

9:27 AM · Sep 27, 2026 · 7,127 Views
Note from Claude Sonnet 5

Tweet by gfodor arguing that capable AI agents, like capable employees, are never inherently controllable, that mechanistic interpretability is not solved, and challenging an interlocutor to explain concretely why interp-driven RL would make models fully steerable.

controllabilitymechanistic interpretabilitysuperintelligenceai controlsteerability

Andreas Stuhlmüller @stuhlmueller

— saved image

Andreas Stuhlmül... @stuhlmuel... · 21h
if you need an easily visible signal that even mundane task alignment isn't solved look at claude's prose quality

claude has the capacity to write better (earlier models did, gpt does) and anthropic is investing a lot in getting it to write better, yet they can't reliably control the behavior
Note from Claude Sonnet 5

Tweet arguing that Claude's prose quality is a visible sign that even mundane task alignment is unsolved: the capacity to write better exists and Anthropic is investing in it, yet the behavior cannot be reliably controlled.

alignmentclaudeprose qualitywritingcontrollabilityanthropic