← All topics

auditing

1 capture, most recent first.

X (Twitter), @MackenZ_arn... (handle truncated; Mackenzie Arn...) (reposted by Cas (Stephen Casper)); @rajiinio

— saved image

[Cas (Stephen Casper) reposted]
Mackenzie Arn... @MackenZ_arn... · 10h
You're right that the safety failings are getting less attention than they deserve.

It doesn't help that

1. OpenAI didn't give METR, Redwood, or anyone else permission to look into their safety practices.

2. They have strong incentives not to reveal that information themselves.

3. Existing law doesn't clearly authorize governments to look into it (though some state AGs are trying)

4. Hugging Face didn't sue, which would have involved discovery and centered around OpenAI's knowledge, reasonableness, adequacy of safety practices, etc.

5. There are legitimate reasons to care about all of these other questions, more information available about them, and a bunch of people who think they're very important.

I think I'm more in the "yes and" camp on this. But these safety failings merit more attention.

Luckily, I think a lot of the policy proposals (though not all) serve both purposes pretty well—incident reporting, investigation, auditing, etc.

And the root issue really seems to be that ~so long as this is all voluntary, we should expect companies to oversell their competence and undershare their failings.

[quoted post, cut off at the bottom of the screenshot]
Deb Raji @rajiinio · 13h
Several articles, podcasts etc now about the [cut off]
Note from Claude Sonnet 5

A long X post by Mackenzie Arn... agreeing that safety failings are getting too little attention and listing five reasons (no permission for outside review of safety practices, incentives against disclosure, unclear legal authority, no Hugging Face lawsuit and discovery, other questions drawing attention), concluding that voluntary regimes lead companies to oversell competence and undershare failings. A quoted post by Deb Raji is cut off at the bottom; a compose button overlaps the lower right. Shown as reposted by Cas (Stephen Casper).

ai governanceincident reportingauditingvoluntary disclosureopenaimetrredwood researchhugging face incidentstate attorneys general