← Timeline

2 captures, most recent first. Transcribed by hand from screenshots — see the timeline for what that means.

@tao

— saved image

Terence Tao
@tao@mathstodon.xyz

I doubt that anything resembling genuine "artificial general intelligence" is within reach of current #AI tools. However, I think a weaker, but still quite valuable, type of "artificial general cleverness" is becoming a reality in various ways.

By "general cleverness", I mean the ability to solve broad classes of complex problems via somewhat ad hoc means. These means may be stochastic or the result of brute force computation; they may be ungrounded or fallible; and they may be either uninterpretable, or traceable back to similar tricks found in an AI's training data. So they would not qualify as the result of any true "intelligence". And yet, they can have a non-trivial success rate at achieving an increasingly wide spectrum of tasks, particularly when coupled with stringent verification procedures to filter out incorrect or unpromising approaches, at scales beyond what individual humans could achieve.

This results in the somewhat unintuitive combination of a technology that can be very useful and impressive, while simultaneously being fundamentally unsatisfying and disappointing - somewhat akin to how one's awe at an amazingly clever magic trick can dissipate (or transform to technical respect) once one learns how the trick was performed.

But perhaps this can be resolved by the realization that while cleverness and intelligence are somewhat correlated traits for humans, they are much more decoupled for AI tools (which are often optimized for cleverness), and viewing the current generation of such tools primarily as a stochastic generator of sometimes clever - and often useful - thoughts and outputs may be a more productive perspective when trying to use them to solve difficult problems.

ai commentaryterence taoagimastodon

@tao

— saved image

Terence Tao
@tao
More recently, we face the real and disturbing possibility that certain directions of mathematical inquiry - for instance, in developing reliable statistical tests for electoral integrity - may not only be defunded by public science agencies, but have their mathematical conclusions actually overruled by political ideology. Even if the supremacy of the objective mathematical standard of truth is technically acknowledged, it can still become weaponized: mathematical results which go against the prevailing ideology could be relentlessly critized for even the slightest typo or technical flaw in the presentation, whereas results that support this ideology could be uncritically embraced even they contain substantial gaps or ambiguities in interpretation. (5/6)

Terence Tao
@tao
One potential bulwark against such politicization of mathematical truth is the broader adoption of formal proof verification, though even here there are some (fortunately still quite theoretical at present) potential "exploits", for instance through subtly altering the definitions of key concepts in Lean's core "Mathlib" library. (See this recent talk newton.ac.uk/seminar/46706/ "Can Mathematics Be Hacked? Infrastructure, Artificial Intelligence, and the Cybersecurity of Mathematical Knowledge" by Fenner Tanswell.) Still, I view an increased acceptance and deployment of formal methods as a net positive in this regard, even if it is not a "silver bullet".

More generally, I think it is important to acknowledge just how precious the consensus objective standard of mathematical truth is, and how important it is to defend it. (This is not to say that such foundational matters should be completely immune from criticism or debate; but such discussion should be in good faith and grounded by genuine philosophical concerns, rather than driven by some external political agenda.) (6/6)
Note from Claude Sonnet 5

Two consecutive tweets (5/6 and 6/6) from Terence Tao on the politicization of mathematical truth, formal proof verification as a partial defense, and the value of the consensus objective standard of mathematical truth.

mathematicspoliticsepistemicsformal verificationtwitter