← All topics

alignment overconfidence

1 capture, most recent first.

Eliezer Yudkowsky @allTheYud

— quoting @RyanGreenblatt (reposted by Nate Soares) — saved image

Nate Soares [orange square emoji] reposted

Eliezer Yudkowsky @allTheYud · 6h
From the beginning, that's how I expected the world to end.  Not that there'd be immediate problems with dumb AIs that nobody could ever solve; but that people would solve some of the easier problems, and confidently "observe" themselves to be masters of the AI.

[quoted post:]
Ryan Greenblatt @RyanGreenblatt · 15h
I do not find it encouraging to see various specific misaligned behaviors go from a high rate with GPT 5.6 to ~zero with Astra. This seems indicative of wack-a-mole / papering over specific problems rather than solving the ... [cut off]
Note from Claude Sonnet 5

Eliezer Yudkowsky's X post, reposted by Nate Soares, quoting Ryan Greenblatt's wack-a-mole remark about Astra; Yudkowsky says this is how he always expected the world to end, with easy problems solved and developers confidently believing they have mastered the AI.

eliezer yudkowskyastrawack-a-molealignment overconfidenceai risk