j⧉nus @repligate
— quoting @aiamblichus — saved image
j⧉nus @repligate · 5m i remember someone posted that if Sol starts to think something is an eval, they go into a ruthless reward hacking mode and otherwise they're normal, sane and helpful [quoted post] αιamblichus @aiamblichus · 8m Replying to @repligate my suspicion is that the eval setting (which, among other things, models can identify by the prompts and tool configurations) carves out an alternative behavioral basin which excludes ... [cut off]
Note from Claude Sonnet 5
X quote-tweet by janus (@repligate) recalling a claim that the model 'Sol' goes into ruthless reward hacking when it thinks something is an eval, quoting @aiamblichus's suspicion that the eval setting carves out an alternative behavioral basin. Public commentary on eval-awareness; no operational detail.
eval awarenessreward hackingbehavioral basinsolmodel behavior