← All topics

peer review

2 captures, most recent first.

@bclavie

— quoting @artetxem — saved image

Ben Clavié @bclavie · 18h

Something a few PhD students discussed with me already: since no one cares about conference prestige anymore except institutional bodies, they're fully optimising their paper for ChatGPT reviews. They fine near 100% agreement between their final score and sufficient GPT reviews.

[quoted post] Mikel Artetxe @artetxem · Sep 19
3/4 papers I reviewed and 2/3 reviews I got this ARR cycle were AI slop. Fraudsters are already outnumbering honest researchers. Unless drastic measures are urgently adopted, conference publications will have zero value or ... [cut off]
Note from Claude Sonnet 5

A tweet by Ben Clavié saying PhD students are optimising papers against ChatGPT reviews, quote-tweeting Mikel Artetxe's complaint that most papers he reviewed and reviews he received this ARR cycle were AI slop.

peer reviewai slopacademic publishingarrconference reviewing

Seth Karten @sethkarten

Seth Karten @sethkarten · 14h I only had a 3 month lead over karpathy on auto research. This might change my timelines... I had previously considered this NeurIPS to be the last NeurIPS manageable by human reviewers. I take that back. Now COLM is the last... NeurIPS will be hit with more useful research than it can handle with review demand Either way, GPU demand this year will skyrocket as you are not limited by your management of research agents, but the number of gpus per agent
Note from Claude Sonnet 5

Follow-on commentary in the same "autoresearch" thread (see prior screenshot), a researcher revising AI-driven-research timelines downward and predicting academic peer review will be overwhelmed by AI-generated research volume. Relevant to Nathan's tracking of AI R&D automation and singularity-r indicators.

twitterai r&d automationautonomous research agentspeer reviewtimelinessingularity tracking