X (Twitter), @Andrew_S_Ros...
— saved image
Jonathan Birch reposted Andrew S. Ros... @Andrew_S_Ros... · Sep 26 Here's another perspective: when asked to review a manuscript or proposal, an LLM will never say "this looks great, accept as is." It will *always* come up with a laundry list of "flaws", even for excellent work. These flaws can be superficially sensible but actually low-quality. [quoted post:] Anshul Kundaje @anshulkundaje · Sep 25 Brainstorming with frontier AI models in more open ended domains (like bio that do not have closed verifiable loops) that you have deep expertise in, really showcases the pretense of understanding that they display. 1/
Note from Claude Sonnet 5
Tweet by Andrew S. Ros... (reposted by Jonathan Birch) saying LLM manuscript reviews always produce a laundry list of superficially sensible but low-quality flaws, quoting Anshul Kundaje on the pretense of understanding frontier models show in open-ended domains.
llm peer reviewpretense of understandingopen-ended domainsai limitations