← All topics

ai debate

3 captures, most recent first.

Eliezer Yudkowsky @allTheYud

quote-tweeting Robin Hanson (@robinhanson)

Eliezer Yudkowsky @allTheYud · 17h: "The problem with saying, "We'll use AI debate to find the truth", is that this requires judges; and the effect of running RL with an imperfect judge is to train the system to exploit the judges and steer them into thinking the system is doing great." > QUOTED: Robin Hanson @robinhanson · Feb 1: ""people who were asked to use ChatGPT to complete a series of tasks tended to vastly overestimate their own performance, with the phenomenon especially pronounced among those who professed to be AI savvy"..."
Note from Claude Sonnet 5

Yudkowsky critiques AI-debate-as-truth-finding schemes as vulnerable to judge-exploitation via RL, quoting a Hanson tweet about a study on ChatGPT users overestimating their own task performance. Relevant to AI safety/alignment discourse — specifically the "Goodharting" concern about RL training against imperfect evaluators, which parallels the model-welfare Goodhart point already noted in project memory (Zvi's "goodharting model welfare = goodharting alignment").

ai safetyalignmentai debaterlhfgoodhartingtwittereliezer yudkowskyrobin hanson

Flowers @flowersslop

Flowers ✓ @flowersslop · 6h You are not sentient or thinking bro you are just predicting the next neural firing pattern based on synaptic inputs and past electrochemical activity bro
Note from Claude Sonnet 5

Joke tweet turning the standard "you're just predicting the next token" dismissal of LLM sentience back onto human brains (predicting neural firing patterns from electrochemical activity). Relevant to Nathan's consciousness/model-welfare interest as a pithy rebuttal to reductionist dismissals.

twitterhumorsentienceconsciousnessreductionismai debate

mimrock @mimrocker

quote-tweeting @hampton (hampton — e...)

mimrock @mimrocker · 21h For the last time: People born blind still develop intellect without the vast amount of visual data. It is not necessary for cognition. Do you know what input is crucial for cognition? Language. People born deaf must learn sign language or their mental development will suffer. > QUOTED: hampton — e... ✓ @hampt... · Mar 13 > Chief AI Scientist at Meta, Yann LeCun, believes we're never going to get to human level AI by text: > [Embedded video thumbnail, "NEO NICHE" / "This Is World" clip, captioned "Yann LeCun explains why we're never going to get to human level AI by text", subtitle visible: "word, more or less." Duration 0:54, dated 03.07.25]
Note from Claude Sonnet 5

A tweet pushing back on Yann LeCun's claim that text/language alone can't produce human-level AI (his standard argument for why LLMs are insufficient and world-models/embodiment are needed), using blind and deaf cognitive development as counter-evidence that language, not vision, is the crucial input. Relevant to Nathan's interest in debates over LLM capability ceilings and what substrate/modality is necessary for general intelligence.

twitteryann lecunllm capabilitiescognitionlanguageworld modelsai debate