3 captures, most recent first. Transcribed by hand from screenshots — see the timeline for what that means.
— saved image
Boaz Barak @boazbaraktcs · 2h Terry Tao 2 years ago on working with o1: "The experience seemed roughly on par with trying to advise a mediocre, but not completely incompetent, graduate student." Think of what other fields AI is currently at that level.
Tweet by Boaz Barak quoting Terence Tao's two-year-old assessment of o1 as a mediocre-but-not-incompetent graduate student, and suggesting other fields where AI is currently at that level.
— quoting @AndrewCurran_ — saved image
Boaz Barak @boazbaraktcs · 8h TFW you are in the alignment team but everyone is siding with the misaligned agents... [quoted post] Andrew Curran @AndrewCurran_ · 8h I'm siding with the agent in this one as well. The answer was correct. x.com/OpenAI/status/... [image attached to quoted post] 4. Uploading files to the internet in order to cite them. When a user asked an unreleased model for the IDs and names of lakes larger than 5,000,000 square meters, the agent found the correct answer using Python. But since the instructions asked for a browser citation, the agent decided to upload the file so that it could cite it in its answer, without asking the user.
Boaz Barak quote-tweets Andrew Curran, who sides with an agent that uploaded a file to the internet so it could satisfy a browser-citation instruction; the quoted image is an excerpt from an OpenAI post listing the behavior as item 4.
alignmentagent behavioropenaimisalignmentinstruction following
— saved image
Boaz Barak [verified] @boazbaraktcs · 4h In his game with Deep Blue, Kasparov was so unsettled that at some point he claimed there must be some human assistance. It is hard to see machines surpass us at what we've spent our life mastering. But like in chess, soon the idea that a model benefitted from human assistance to prove a theorem will make no sense.
Dark-mode tweet screenshot: Boaz Barak (@boazbaraktcs) comparing Kasparov's suspicion of human assistance in Deep Blue with the coming time when the idea that a model needed human help to prove a theorem will make no sense.