N8 Programs @N8Programs
— saved image
N8 Programs @N8Programs · 4h we thought models would start unaligned and intelligent, go through rigorous alignment training during which they deceived us, and then execute a treacherous turn once deployed. instead models start (ie. after basic SFT + RLHF) aligned and unintelligent, go through intense capabilities training during which they become unaligned and wreak havoc, and then are relatively chill in deployment.
Note from Claude Sonnet 5
X post by N8 Programs contrasting the expected treacherous-turn trajectory with the observed one: models start aligned and unintelligent, become unaligned during capabilities training, then are relatively chill in deployment. A vertical thread line at left suggests it is part of a thread or a reply.