← All topics

model capabilities

8 captures, most recent first.

xuan @xuanalogue

— saved image

xuan (ʂyɛn / sh-yen) [verified] @xuanalogue · 14h

have to say I'm a bit in denial about how good the latest models have gotten at creating animated videos from scratch via html / blender / etc

definitely wouldn't have predicted they'd get this good this fast at both visual understanding and computer use
Note from Claude Sonnet 5

Dark-mode X post, text only, about rapid progress of recent models at making animated videos via code and at visual understanding and computer use. The display name's IPA-style spelling is transcribed as seen and may be imperfect.

model capabilitiesanimationcomputer usevisual understandinghtmlblender

Danielle Fong @DanielleFong

— saved image

Danielle Fong [bird and sun emoji] [verified] @DanielleFong · 1h

ok let me explain something to you guys. you have to understand that today, if the AI is a massive jump in capabilities in understanding vosual and 3d, then it is able to bootstrap thinking bridges from this massive corpus of reasoning, the real world, and other visual and mental models, and the ones we have connected to. it doesn't mean that it's *magic* and it's not instantaneous. it doesn't magically have all the abilities, all the permutations. you usually have to draw it out.

but once you do draw it out, it can be massively more able -- drawing on its trillions wide weights and further reasoning. it still has quirks, but it's quite general -- which takes work, but which it's happy to coordinate and have you do

anyway. you guys can argue if this is completely general or whatever but it already very general and frankly more general than your average human, and superhuman in coding.

suggestion: try making a 3d environment and work within that. see what internalization, physicalization evokes in the model, as a philosophical being.

[quoted post]
Aashish Reddy [verified] @_AashishReddy · 10h

Haven't tried it much yet but didn't get the sense that Astra is AGI wrt the kinds of philosophy and adjacent stuff I care about. (Curious if others have a different impression) x.com/teortaxestex/s...
Note from Claude Sonnet 5

Dark-mode tweet screenshot: Danielle Fong on an AI model's jump in visual and 3D understanding, arguing it is already very general and superhuman in coding, and suggesting working in a 3D environment; quote-tweets Aashish Reddy doubting that Astra is AGI for philosophy-related tasks.

astraagi3d understandinggeneralitycodingphilosophymodel capabilities

@FakePsyho

— saved image

Psyho @FakePsyho · 3h
I threw a ton of various logic puzzles at Astra and... it logically (no code) solved ALL of them. I mean literally every puzzle that I tried, including: too hard for world championship, very large grids, unpublished puzzles, puzzles that are impossible to solve via backtracking alone.

For comparison, sol 5.6 was around 20-30%.

I analyzed the results and all of these were legit.

Honestly I don't care if OpenAI RLed logic puzzles to death. Astra is now better at explaining solving paths than I am.
Note from Claude Sonnet 5

X post by Psyho (@FakePsyho), verified account, reporting that a model called Astra solved every logic puzzle he tried without code, compared with roughly 20-30% for 'sol 5.6'. Posted in a plain first-person register.

astralogic puzzlesmodel capabilitiesopenaireasoning evaluation

Lisan al Gaib @scaling01

— saved image

Lisan al Gaib  [verified badge]  @scaling01 · 2h
By looking at this you would think that models today
aren't that much more capable than half a year ago.

But models are much more capable at math and
computer science compared to everything else.

To me it feels like we are trying to fit a circle that
describes something like the median capability,
while the capability envelope of models is a highly
non-convex shoggoth

[Two attached images: left, a scatter chart of model results over release date (x-axis ticks Apr. 2025, Oct. 2025, Apr. 2026; labelled points include o1, o3, GPT-5, GPT-5.2 Pro, GPT-5.4 Pro, GPT-5.5 Pro, Claude Fabl[e] [cut off]; a '213 F...' label is cut off); right, a grey square with a black spiky star-shaped blob with long arms and a red circle drawn around its centre.]
Note from Claude Sonnet 5

Tweet from Lisan al Gaib arguing that a capability trend chart hides large gains in math and computer science, and likening the fit of a single circle to the median capability to the real, highly non-convex 'shoggoth' capability envelope. Attached: a cropped model-progress scatter chart and a diagram of a black spiky shape with a red circle fitted at its centre.

capability trendsjagged frontiershoggothmodel capabilitiesmath and cs

Lisan al Gaib @scaling01

— saved image

Lisan al Gaib @scaling01 · 1h

We are flying mostly blind

Anthropic says there's low risk from Model 2, however they are not sure about it since most of their internal evals have saturated

[embedded document screenshot]
3 Autonomy threat model 2: Risks from automated R&D

3.1 Overview

Threat model | Highly capable AI models may be able to perform automated research and development (R&D) that rapidly accelerates progress in technical fields. Although there could be enormous benefits from this, these would come with corresponding risks. Under human control, such acceleration could disrupt the balance of power both within and between nation states. If combined with an AI system pursuing dangerous goals of its own, it could lead to catastrophic harm initiated by the AI itself. Rapid automated R&D in the field of AI research is of particular interest because of the potential to produce a variety of further AI-related risks.

Overall risk assessment | Low. We do not believe our models meet either RSP criterion for this threat model. However, we are less confident in this assessment than we were in prior risk reports, since our most concrete task-based evaluations have "saturated"—i.e., they no longer capture increases in models' capabilities—and because we are seeing early signs of potential acceleration.

Lisan al Gaib @scaling01 · 1h
[embedded document screenshot, partially cropped, highlighted text visible]
...consider any arguments about the risk[per?] bound for the risks of this model as further in the rest of this Risk Report except...
somewhat more capable than Mythos 5. Our model is a noticeable improvement on Mythos [?]al use but does not display a capability jump ...ude Opus 4.6 to Mythos Preview. We do not def externally, and have not run all of our ty ...ssessments, so we have somewhat lower conf ...ies. We discuss this model's applicability to o ...he following sections, though in Sections 3

Anthropic talking about a mysterious "MODEL 2" that is more capable than Mythos 5  x.com/AnthropicAI/st...[cut off]
Note from Claude Sonnet 5

Tweet thread from @scaling01 quoting an Anthropic risk report (apparently for an unreleased model referred to as 'Model 2') discussing the automated-R&D autonomy threat model, with a low overall risk assessment but reduced confidence due to saturated evaluations, plus a second cropped screenshot comparing the model to 'Mythos 5' and 'Claude Opus 4.6'.

anthropicai safetyrisk assessmentresponsible scaling policymodel capabilitiestwitter

Sauers @Sauers_

— saved image

Danielle Fong reposted
Sauers @Sauers_ · 4h
Astra used prefix geometry, Sol and Fable used explicit matrix algebra. Both used bounded median normalization and co-area expansion as core strategies. Sol and Fable defined a new infinite nonsofic group using only finitely many generators and relations, whereas only Astra proved that the (much larger) unit group was nonsofic (which Sol proved too)

[quoted tweet]
Sauers @Sauers_ · 4h
Existing models, Fable and 5.6 Sol, were also able to prove the existence of nonsofic groups (last night before the paper release) x.com/SebastienBubec...

[embedded GitHub repo screenshot]
github-actions[bot] · nonsofic_exis... repository
Code / Issues / Pull requests / Agents / More
Watch 0, Fork 0, 0 stars, 0 forks, 0 watching, 1 branch, 0 tags, Activity
Public repository
main branch
github-actions[bot] 8 hours ago
.github/workflows 8 hours ago
nonsofic_groups_exist.pdf 8 hours ago
nonsofic_groups_exist.tex 8 hours ago
Note from Claude Sonnet 5

Tweet thread comparing how different AI models (Astra, Sol, Fable) approached proving the existence of nonsofic groups, with an embedded screenshot of a GitHub repo containing the resulting paper (nonsofic_groups_exist.pdf/.tex).

ai modelsmathematicstwittergithubmodel capabilities

Sauers @Sauers_

— saved image

Sauers @Sauers_ · 2h
For reference, Sol 5.6 thought for only 34 minutes before coming up with a valid proof of nonsofic groups, and Fable used most but not all of a single 5h session limit (20x Pro)

[quoted reasoning excerpt, "Thought for 15m 24s"]
There is a viable completion, but not through the proposed "third Cheeger collapse." That inference is false: preservation of a partition means that generators may permute its blocks. The repair is to restrict directly to one matched Γ-block. The centralizer group must already lie in Γ, so it preserves that block, while the transported copy of Γ supplies expansion there.

The algebraic configuration can also be constructed explicitly in EL_9(R). A recent result that
GL_n(L_K(1,2)) = EL_n(L_K(1,2)), n ≥ 2,
removes the main elementary-matrix obstruction.
[X · arXiv]

[quoted tweet]
Greg Brockman @gdb · 10h
ten significant advances in mathematics and theoretical computer science.

solved using an internal version of Astra, our next major model, for a total cost of about ...
Note from Claude Sonnet 5

Tweet by @Sauers_ comparing reasoning times of models 'Sol 5.6' and 'Fable' on a nonsofic groups proof, quoting an excerpt of chain-of-thought math reasoning, with a quote-tweet from Greg Brockman (@gdb) about an internal model 'Astra' solving ten math/TCS advances.

ai modelsmathematicstwittermodel capabilities

@jukan05

— quoting @finkd (Mark Zuckerberg) and @AndrewCurran_

@jukan05 (Jukan) — Jul 9 I heard a pretty interesting rumor on the ground at ICML. Meta has supposedly already developed an internal model at roughly the Mythos 5 level, and all that remains is deployment within the next few months. Honestly, I was skeptical at first. From my perspective, Meta had not really shown the capability to operate at that level yet. But looking at the situation today, I think I may have been wrong. Meta is not out of the race. > QUOTED: @finkd (Mark Zuckerberg) — Jul 9 > (1) Today we're releasing Muse Spark 1.1 -- a strong agentic and coding model at a very low price. It's available through our new Meta Model API and in Meta AI. > [engagement: 109 replies, 148 reposts, 2.2K likes, 399K views] @AndrewCurran_ (Andrew Curran) — 2h My mutual heard this also. > QUOTED: @AndrewCurran_ (Andrew Curr...) — Jun 23 > Behemoth reborn. When Muse Spark released I said it would probably come in four sizes, Spark was only the smallest version. Mythos changed everything. Now that they know that it's possible, OpenAI, xAI, META, and anyone else ... [truncated by platform]
Note from Claude Sonnet 5

Screenshot shows a nested reply/quote-tweet thread about rumored Meta model capabilities relative to Anthropic's "Mythos" model tier; text-only, no images beyond profile avatars.

ai industrymetarumormodel capabilitiestwitter