Henry Shevlin @dioscuri
— quoting @RyanGreenblatt — saved image
Henry Shevlin [verified] @dioscuri · 2h This is worrying. Seems like building better tools for incident analysis should be one of the absolute top priorities of safety research. [quoted text box, no author header visible] The difficulty of understanding incidents and overseeing AI agents appears to be growing faster than the rate at which more capable AIs help us with oversight and understanding. As in, AI capabilities (and propensities?) for achieving large, ambitious, and misaligned objectives are growing faster than our ability to understand what these agents are doing. [quoted post] Ryan Greenblatt [verified] @RyanGreenblatt · 9h I was the main person doing transcript analysis for this investigation of the Hugging Face incident. My main takeaway: We don't have good approaches for understanding/overseeing the activity and aims of AI 'swarms'.... [cut off]
Note from Claude Sonnet 5
Henry Shevlin argues better incident-analysis tools should be a top safety research priority, with a quoted passage that oversight difficulty is growing faster than AI help with oversight, and quotes Ryan Greenblatt's takeaway from analyzing transcripts of the Hugging Face incident. The middle quoted box has no visible author attribution.
hugging face incidentincident analysisoversightai swarmssafety research prioritiesscalable oversight