← All topics

jakub pachocki

2 captures, most recent first.

quoted @amir

— saved image

[top edge, partially cut off:] inside & outside OpenAI re: security as this takes off

[embedded card, The Information Pro:]
The Information Pro
Exclusive
Secret Technique Behind OpenAI's 'Astra' Model Sparks Security Concerns
[card image: illustrated collage with a man's face]

6:33 PM · Sep 1, 2026 · 323.4K Views
58 replies, 183 reposts, 1.2K likes, 598 bookmarks
Relevant | View quotes

---

Thomas Larsen @thlarsen · 6h
Update: great news! The architecture is less bad than I assumed, it seems to be only a minor increase in the opaque serial depth.

It's very important that AI companies don't venture further in this direction until we've got much better alignment / interp tools

[quoted post:]
Jakub Pachocki @merettm · 22h
I want to prevent a race into unmonitorability kicked off by confused reporting. The depth of the computation graph for our present frontier models, including Astra, is within a factor of two of GPT-4....
Note from Claude Sonnet 5

Continuation of the preceding scroll: the bottom of the Amir Efrati post card (The Information: 'Secret Technique Behind OpenAI's Astra Model Sparks Security Concerns'), then Thomas Larsen's update that the architecture is less bad than assumed, quoting Jakub Pachocki's statement about computation-graph depth of OpenAI frontier models including Astra.

astraopenaiopaque serial depthlooped transformersmonitorabilityjakub pachockithe information

Jakub Pachocki @merettm

— reply by @DKokotajlo — saved image

Jakub Pachocki [verified] @merettm · 12h

I want to prevent a race into unmonitorability kicked off by confused reporting. The depth of the computation graph for our present frontier models, including Astra, is within a factor of two of GPT-4.

OpenAI has worked to preserve and utilize chain-of-thought monitoring since our very first reasoning models. We deeply care about this technique, as it can give us a view into how model alignment generalizes from its training distribution. I do think it is fragile and unfortunately trending in a negative direction, for reasons not contingent on architecture changes that I will write about soon. But there are things we can do to strengthen it, and it's a core goal of our current research program.

224 replies   593 reposts   5.2K likes   1M views

[repost banner] Connor Axiotes reposted

Daniel Kokotajlo [verified]
@DKokotajlo

Thanks for speaking up on this and for keeping the depth low for now. I look forward to reading your deeper explanation. It seems to me (and I suspect you agree?) that monitorability is very important and we are now in something of a race to the bottom on it; even with depth low this is a worrying direction to be moving yes? And as the information article says, even if openai doesn't go further, others might... I urge you to make it your job to get some sort of industrywide monitorability standard set up, either to arrest the slide into oblivion or better yet to race to the top. I think this is something where we need more than just political will, we need thoughtful technical specifications. You can contribute greatly towards both.

8:05 AM · Sep 2, 2026 · 10K Views [partly covered by the navigation bar]
Note from Claude Sonnet 5

Two stacked X posts: Jakub Pachocki (OpenAI) saying he wants to prevent a race into unmonitorability, that the computation-graph depth of current frontier models including Astra is within a factor of two of GPT-4, and that chain-of-thought monitoring is valued but fragile; and Daniel Kokotajlo's reply, reposted by Connor Axiotes, urging an industrywide monitorability standard. Capture is partly overlaid by the X navigation bar and a floating button at the bottom.

chain of thought monitorabilityopenaiastracomputation graph depthmonitorability standarddaniel kokotajlojakub pachocki