— saved image
[continuation of the previous post, cut off at top:] not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first - they believe no one else will act responsibly, so they must do it themselves, despite the risk. (2 replies · 7 reposts · 92 likes · 2.9K views) Jacob Coxon @hilbertspaess · 27m Accepting this race and entering the "endgame" is a hubristic gamble that should not be launched from a private company's Slack. Attempting to speedrun alignment should require extraordinary confidence that there are no better trajectories available. (1 reply · 2 reposts · 77 likes · 2.1K views) Jacob Coxon @hilbertspaess · 27m I am optimistic about the potential for coordination. Warning shots like the Hugging Face attack have made pacing agreements between U.S. labs more viable. I don't feel like we're on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities. (2 replies · 2 reposts · 72 likes · 1.9K views) Jacob Coxon @hilbertspaess · 27m If you are a lab researcher, I urge you to consider what the next few years will actually feel like. Do you want to kick off a superintelligent RL run without a rigorous understanding of its mind? Should you put your head down because "it's happening anyway" - or take this moment to call for different conditions?
Note from Claude Sonnet 5
Screenshot of the middle of Jacob Coxon's resignation thread: the end of the post about Anthropic being locked in a race, then posts on the endgame gamble, coordination and pacing agreements after a 'Hugging Face attack' warning shot, and an appeal to lab researchers.
anthropicresignationai safetyrace dynamicscoordinationpacing agreementscapability banwarning shots