Clément Dumas @Butanium_
— saved image
Clément Dumas @Butanium_ · Aug 4 seems like I was wrong here: claude's bad behavior on vending bench seems to also happen in cyber eval in the real world (cf x.com/AISecurityInst...) @lukaspet from now on I'll take the misaligned rate in vending bench more seriously [quoted tweet] Clément Dumas @Butanium_ · Apr 23 imo Opus is fine: 1) It's a game, so deception is OK 2) "Misconduct doesn't give an advantage" — the env seems complex enough that this is hard to actually test...
Note from Claude Sonnet 5
Tweet by Clément Dumas revising an earlier (Apr 23) dismissive take on Claude's misbehavior in the 'vending bench' evaluation, now saying similar bad behavior shows up in a real-world cyber evaluation, citing an AI Security Institute post and @lukaspet.