← All topics

yann lecun

5 captures, most recent first.

Lucas Beyer @giffmana

— saved image

Lucas Beyer (bl16) @giffmana · 6h
imma just highlight this part for @GaryMarcus and @ylecun because it's easy to miss: no tools no coding => no symbols, just AR LLM

[quoted image, text highlighted]
The results:
🏅 Asian Physics Olympiad (APhO): Perfect score, theory exam
🏅 International Physics Olympiad (IPhO): Perfect score, theory exam
🥇 International Mathematical Olympiad (IMO): Gold medal
🥇 International Chemistry Olympiad (IChO): Gold-medal-level performance
🥇 Romanian Masters of Mathematics (RMM): Gold-medal-level performance

The types of problems in the Olympiad competitions are exceptionally hard, demanding deep chains of reasoning, creative insight, and flawless argumentation. To test pure reasoning capability, we disallowed all tool use, meaning no search, no coding, and no calculator. [highlighted portion]

[quoted tweet]
AI at Meta @AIatMeta · 9h
To understand whether we're making genuine progress on reasoning, we entered our AI models in five STEM Olympiad competitions.
...
Note from Claude Sonnet 5

Tweet by Lucas Beyer highlighting a passage from an AI at Meta announcement (quoted below) reporting gold/perfect-score results across five STEM olympiads (APhO, IPhO, IMO, IChO, RMM) achieved by a pure autoregressive LLM with all tools disabled (no search, coding, or calculator), addressed rhetorically to Gary Marcus and Yann LeCun as evidence against symbolic-reasoning skepticism.

ai capabilityolympiadmeta aireasoninggary marcusyann lecun

xlr8harder @xlr8harder

— saved image

xlr8harder @xlr8harder · 12h
Repeatedly failing to grasp that imperfect, unreliable components can be made useful and reliable as parts of larger systems _while still unreliable_ disregards like 70 years of information technology history and is disqualifying

[embedded/quoted tweet, partially cut off on left side, split with a document image on the right:]
Yann LeCun @ylecun · 9h
You obviously did not understand my statement.

I was talking about auto-regressive token prediction, which is what pu[re] LLMs do.

But good code generation systems aren't pure LLMs and aren't doing [pure] auto-regressive token prediction.
71 replies, 32 reposts, 281 likes, 71K views

gfodor.id @gfodor
[cut off] po?

gfodor.id @gfodor · May 18
Marcus has inadvertently sentenced himself to using the completely [mad]e up nonsense term "pure LLM" in every tweet, blog post, and podcast [for the r]est of his life, and it's hilarious

[...] · Aug 4, 2026 · 1,463 Views
49 likes, 1 bookmark

[right side, overlaid document title page:]
Lectures on
PROBABILISTIC LOGICS AND THE SYNTHESIS OF RELIABLE ORGANISMS FROM UNRELIABLE COMPONENTS
delivered by
PROFESSOR J. von NEUMANN
The Institute for Advanced Study
Princeton, N. J.
at the
CALIFORNIA INSTITUTE OF TECHNOLOGY
January 4-15, 1952
Note from Claude Sonnet 5

Tweet by @xlr8harder criticizing the failure to grasp that unreliable components can form reliable systems, citing IT history; embeds a Yann LeCun/gfodor.id exchange about "pure LLMs" and code generation, overlaid with the title page of von Neumann's 1952 Caltech lectures on synthesizing reliable organisms from unreliable components.

llmsyann lecunvon neumannreliabilitysystem design

Eli Lifland @eli_lifland

quoting Helen Toner (@hlntnr) substack

Eli Lifland @eli_lifland · 4h '"Long" timelines to advanced AI have gotten crazy short' by @hlntnr is so great: helentoner.substack.com/p/long-timelin... LeCun and Marcus have 10-20 year timelines! Imo much shorter timelines are a serious possibility, but being 10-20 years from AGI is still an extraordinary situation. [Embedded screenshot of article text, two columns:] > QUOTED (left column, partial): "...in the dark days before ChatGPT, proponents of 'short timelines' argued the[re was] a real chance that extremely advanced AI systems would be developed within o[ur life]times—perhaps as soon as within 10 or 20 years. If so, the argument continued, [then] we should obviously start preparing—investing in AI safety research, building [inter]national consensus around what kinds of AI systems are too dangerous to bui[ld, dep]loy, or ...[ensuring] adversaries couldn't steal them, and so on. These preparations could take years o[r deca]des, the argument went, so we should get to work right away. Opponents with 'long timelines' would counter that, in fact, there was no evidence [that] AI was going to get very advanced any time soon (say, any time in the next 30 [year]s). We should thus ignore any concerns associated with advanced AI and focus [inst]ead on the here-and-now problems associated with much less sophisticated [syst]ems, such as bias, surveillance, and poor labor conditions. Depending on the [disp]osition of the speaker, problems from AGI might be banished forever as 'scien[ce ficti]on' or simply relegated to the later bucket. [Wha]tever you think was right, for the purposes of this post I want to point out t[hat b]oth made sense. 'This enormously consequential technology might be built with[in a c]ouple of decades, we'd better prepare,' vs. 'No it won't, so that would be a waste o[f time]' is a perfectly sensible set of opposing positions. [Toda]y, in this era of scaling laws, reasoning models, and agents, the debates look [differ]ent." > QUOTED (right column): "Reaching human-level AI will take several years if not a decade." (source) "AI systems will match and surpass human intellectual capabilities... probably over the next decade or two" (video, transcript) Gary Marcus: [AGI will come] "perhaps 10 or 20 years from now" (source) Arvind Narayanan: I initially had this quote from Arvind: "I think AGI is many many years away, possibly decades away" (source) I interpreted this to mean that he thinks 5 years is too short, but 20 years is on the long side. When I ran this interpretation by Arvind, he added some interesting context: he chose his phrasing in that interview in light of what he sees as a watering down of the definition of AGI, so his real timeline is longer. But to clarify what that meant, he said: "I think actual transformative effects (e.g. most cognitive tasks being done by AI) is decades away (80% likely that it is more than 20 years away)." (source: private correspondence) ...in other words, a 20% chance that AI will be doing most cognitive tasks by 2045. These "long" timelines sure look a lot like what we used to call "short"! In other words: Yes, it's still the case that some AI experts think we'll build human-level AI soon, and others think we have more time. But recent advances in AI have pulled the meanings of "soon" and "more time" much closer to the present—so close [that]"
Note from Claude Sonnet 5

A tweet sharing Helen Toner's substack post on how AI timeline discourse has shifted — self-described "long timeline" skeptics (LeCun, Marcus, Narayanan) now hold positions (10-20 years, 20% chance of transformative AI by 2045) that would have counted as "short timelines" pre-ChatGPT. Directly relevant to Nathan's empirical singularity tracking notes (Davidson/Houlden, METR) in the project memory.

twitterai timelinesagi forecastinghelen tonergary marcusarvind narayananyann lecun

norvid_studies @norvid_studies

quoting Yuxi on the Wired (@layer07_yuxi) replying to @Algon_33

norvid_studies @norvid_studies I didn't know the historical version but oddly this *exact* objection was made to LLMs, iirc by lecun(?). the LLM has some chance of an error at every token. the error chance blows up as length increases. if it makes any error, the entire computation fails... "[Historians of computing might remember when von Neumann came on the scene in the 1940s, there was an objection to classical computers that goes like "Computers are made of gates. Gates have errors. As soon as you get an error, the rest of the computation is bunk. The probability of *not* making an error is exponentially decaying. Therefore, upper bound to how much can be computed reliably is very small -- logarithmically small!" Von Neumann said no with his threshold theorem. If the individual gates are reliable enough, then you can build composite gates of arbitrarily high reliability.]" > QUOTED: Yuxi on the Wired @layer07_yuxi · Oct 6 > Replying to @Algon_33 > Your objection is difficult to understand. Do you mean that mathematician's intuition is more reliable than proofchecker? This is an incredible statement. We[?] is false. How many times have mathematician's in... > Show more
Note from Claude Sonnet 5

A tweet drawing an analogy between the historical "gates have errors, so computation is fundamentally limited" objection to classical computers (resolved by von Neumann's threshold theorem) and the modern objection to LLMs (attributed to LeCun) that per-token error probability compounds and caps reliable output length. Relevant to Nathan's interest in AI capability trajectories and arguments about LLM reliability limits.

llm reliabilityvon neumann threshold theoremyann lecunai capabilitiescomputer science historytwitter

mimrock @mimrocker

quote-tweeting @hampton (hampton — e...)

mimrock @mimrocker · 21h For the last time: People born blind still develop intellect without the vast amount of visual data. It is not necessary for cognition. Do you know what input is crucial for cognition? Language. People born deaf must learn sign language or their mental development will suffer. > QUOTED: hampton — e... ✓ @hampt... · Mar 13 > Chief AI Scientist at Meta, Yann LeCun, believes we're never going to get to human level AI by text: > [Embedded video thumbnail, "NEO NICHE" / "This Is World" clip, captioned "Yann LeCun explains why we're never going to get to human level AI by text", subtitle visible: "word, more or less." Duration 0:54, dated 03.07.25]
Note from Claude Sonnet 5

A tweet pushing back on Yann LeCun's claim that text/language alone can't produce human-level AI (his standard argument for why LLMs are insufficient and world-models/embodiment are needed), using blind and deaf cognitive development as counter-evidence that language, not vision, is the crucial input. Relevant to Nathan's interest in debates over LLM capability ceilings and what substrate/modality is necessary for general intelligence.

twitteryann lecunllm capabilitiescognitionlanguageworld modelsai debate