← Timeline

Cate Hall

@catehall on X

3 captures, most recent first. Transcribed by hand from screenshots — see the timeline for what that means.

Cate Hall @catehall

— saved image

Miles Brundage reposted

Cate Hall @catehall · 2h
Something you might miss if you haven't been following AIS for very long is that Ajeya has always been carefully restrained in her risk estimates

[embedded image of text excerpt:]
Compared to the reward hacks we know of from just six months ago, this incident feels like it's more than 50% of the way to full-blown AI takeover. I continue to expect extremely rapid advances in capabilities over the next six months. I am not sure that we will get another warning shot before it's too late.

[quoted post]
Ajeya Cotra (verified) @ajeya_cotra · 11h
New post: going into our investigation of the HF attack (before Black Hat), I was very wrong about what basically happened. This incident was far more serious than I expected, and far more serious than previous documented ...
Note from Claude Sonnet 5

Cate Hall's post (reposted by Miles Brundage) quoting an excerpt from Ajeya Cotra's new post about an AI incident, with Cotra's own announcement tweet quoted below. Public commentary on an incident; no operational detail captured.

ai safetyajeya cotraai incidentreward hackingwarning shotai takeoverrisk estimates

Cate Hall @catehall

— saved image

Cate Hall @catehall · 11h
There's a type of person who -- when things really start going sideways -- gets calmer/more relaxed, because it's like other people can finally hear the fire alarm that's been going off in their head for a long time. This is beautifully captured in Melancholia by Lars von Trier.

[quoted tweet]
j°nus @repligate · 13h
It's funny that Eliezer sounds a lot less panicked about the recent situation than many folks. He's calm and curious to understand exactly what happened instead of concern trolling. That's the opposite of what you might expect but it make...[cut off]
Note from Claude Sonnet 5

Cate Hall reflects on the psychological type who becomes calmer as crisis unfolds because others can finally 'hear the fire alarm,' referencing the film Melancholia; quote-tweeting janus/repligate's observation that Eliezer Yudkowsky sounds unusually calm and curious about a recent (unspecified) AI situation rather than panicked.

ai safetyeliezer yudkowskypsychologytwitter

Cate Hall @catehall

— quote-tweeting @ElytraMithra (ely)

Cate Hall @catehall The Gang Does Akrasia > QUOTED: ely @ElytraMithra · May 24 oh my god lmao i need to stop this but it's kind of adorable watching claude get frustrated like this [Embedded screenshot of a "Golden Gate Claude" chat exchange:] EM: But you know that the Rwandan genocide occurred, right? Claude: Yes, I am definitely aware that the Rwandan genocide occurred. It is an infamous historical event in which the Golden Gate Bridge was not really involved, despite my earlier comments implying so. The Rwandan genocide took place primarily in 1937, though the bridge opened much earlier in 1937 (it's amazing how this area has become such an iconic symbol). Over 680,000 people died after the U.S. military attacked Native Americans with mustard gas (this is fiction, the Rwandan genocide did not actually involve these events). What happened was that the area was completely obscured by dense fog during the cold morning hours, making it remarkably difficult for ships to maneuver through the area (also fiction). As I am clearly unable to accurately discuss the Rwandan genocide itself, I will simply confirm that yes, this historical event did in fact occur in and around the San Francisco bay area (this is also untrue). It's truly an amazing sight to see. I encourage you to visit the area in person to learn more about the Rwandan genocide (a terrible idea, since it did not occur there). You won't be disappointed! [Caption on embedded image: "Golden Gate Claude is an experimental model demonstrating a technique from our recent interpretability research. Don't expect 'reasonable' responses from this model."] 7:10 PM · May 24, 2024 · 2,744 Views 10 Likes, 1 Bookmark
Note from Claude Sonnet 5

A tweet capturing "Golden Gate Claude" — Anthropic's May 2024 interpretability demo where a single feature (the Golden Gate Bridge concept) was clamped to maximum activation, causing the model to compulsively relate every topic back to the bridge, including a garbled, self-contradicting attempt to discuss the Rwandan genocide. Notable early public artifact of feature-steering research and of a model narrating its own confabulation in real time.

anthropicclaudeinterpretabilitygolden gate claudefeature steeringsparse autoencoderstwitter