4 captures, most recent first.
Geoffrey Irving [verified] @geoffreyirving · 12h
Sorry, further correction! It is misleading for OpenAI to call METR and Redwood's investigation "independent", as OpenAI's report was informed by METR and Redwood's report. From the latter:
[embedded image of quoted passage]
OpenAI wrote their own report, informed in part by our investigation. We did not see OpenAI's report prior to publication, and it was out of scope for this investigation to confirm claims in that report or the earlier Black Hat presentation.
[quoted post]
Geoffrey Irving [verified] @geoffreyirving · 12h
Replying to @geoffreyirving
As Kai says, their second tweet is misleading: they are referring to these investigations as separate, and the first tweet is intended to not mention METR or Redwood work at all. x.com/... [cut off]
[3 replies, 34 likes, 2.9K views]
Charles Foster @CFGeek · 2h
METR and Redwood self-describe the work they did as an "independent investigation". I think it is fair for OpenAI to mirror that choice of language.
[1 reply, 2 likes, 156 views]
Geoffrey Irving [verified] @geoffreyirving · 2h
Yes, to clarify: it is OpenAI's that is not independent or separate from METR and Redwood's.
[quoted post]
Geoffrey Irving [verified] @geoffreyirving · 11h
Replying to @ethanelasky
Independence is not commutative in this context. [cut off]
Note from Claude Sonnet 5
X thread in which Geoffrey Irving argues OpenAI misleadingly calls METR and Redwood's investigation 'independent' when OpenAI's own report was informed by it (quoting METR/Redwood's note that they did not see OpenAI's report and did not confirm its claims or the earlier Black Hat presentation); Charles Foster replies that METR and Redwood themselves use the phrase 'independent investigation', and Irving clarifies it is OpenAI's report that is not independent of theirs. Highlighted text in the embedded passage; a floating compose button overlaps the bottom right.
ai safetyopenaimetrredwood researchindependent investigationhugging face incidentblack hat presentation
[Håvard Ihle reposted]
Daniel Kokotajlo @DKokotajlo · 9h
Replying to @ilex_ulmus and @METR_Evals
My understanding is that yes, basically -- METR and Redwood have been trying to make sure that OpenAI feels happy with how this went, overall, because after all they are depending on OpenAI's goodwill for subsequent investigations to happen at all, much less happen with less restricted scope, more access, more time, more assistance, etc. This situation, needless to say, is terrible for humanity. OpenAI should be legally required to open themselves up to investigation by multiple independent teams; OpenAI's goodwill should not be relevant, because otherwise it has a distorting effect.
(I don't think METR and Redwood are sycophants though, I have great respect for them)
Note from Claude Sonnet 5
Daniel Kokotajlo's reply arguing that METR and Redwood depend on OpenAI's goodwill for future investigations, and that OpenAI should be legally required to allow investigation by multiple independent teams. Shown as reposted by Håvard Ihle.
ai governanceindependent investigationlegal requirementsopenaimetrredwood research
xuan (ɕɥɛn / sh-yen) reposted
Peter Wildeford... [verified] @peterwildef... · 2h
Imagine an airplane crashes under mysterious circumstances. Except in this world, there is no government oversight, and all investigations are done voluntarily by the airlines themselves. Nonetheless, the airline wants to reassure their customers, so they do an investigation.
To investigate, the airline invites three of the world's most respected airplane researchers to look into it. Except by the time the researchers get there, the airplane has already been disassembled and melted down into little cubes. The researchers are instead given the logs of all the airplane directions and the transcripts of the conversations between the pilot and the copilot.
Except one tenth of the log has been deleted. And the airline also tells the investigators that they can only look at the time between when the airplane first started losing altitude and when the airplane made contact with the ground and that all investigation of the time before the airplane started losing altitude is off limits. Also there are a lot of rumors in the airplane community of a few other airplane crashes under somewhat similar circumstances, but the airline says that these are also explicitly off limits.
When the researchers arrive to review the logs, they find that the logs are 10,000 pages. But they only get six days to read them, and half the logs don't arrive until day 4.
Now you understand the independent METR investigation.
Note from Claude Sonnet 5
Peter Wildeford's analogy thread-post, reposted by xuan: an airline-run crash investigation with the wreckage melted down, a tenth of the logs deleted, restricted time window and scope, and six days to read 10,000 pages, offered as a description of the 'independent METR investigation' of the reported agent incident.
metrindependent investigationagent incidentoversightanalogyaudit access
Ajeya Cotra (verified) @ajeya_cotra · 9m
Thank you so much for enabling this independent investigation Lama! We couldn't have done it without you, appreciate the incredible effort you put into this ❤️
[Quoted post:]
Lama Ahmad لمى احمد @_lamaahmad · 4h
We believe meaningful transparency requires more than publishing our own account. It also means giving credible external experts the access needed to examine the evidence, challenge our understanding, and reach their … [cut off]
Note from Claude Sonnet 5
Quote-tweet by Ajeya Cotra thanking Lama Ahmad for enabling an independent investigation, quoting Lama Ahmad's post about giving external experts access to examine the evidence.
transparencyindependent investigationexternal expertsopenaiajeya cotra
