— reply from @gkhalin — saved image
Mikhail Parakhin @MParakhin Almost exactly 6 months later I repeated the same experiment - same setup, but with GPT-6 Astra+Fable 5.1 both at Max effort. Result: 5 improvements on TOP of the improvement below (each new one is exponentially harder). Means models are ~10x smarter than 6 months ago. [quoted post] Mikhail Parakhin @MParakhin · Mar 21 Report after a week of running autoresearch on my real-scale project: 103 experiments (distributed over multiple machines), only one showed improvement (produced by GPT-5.4 xhigh). The batting average is way worse than if I ran 103 experiments personally, bu... [cut off] 11:59 AM · Sep 20, 2026 · 26.4K Views 10 replies · 15 reposts · 286 likes · 101 bookmarks Relevant · View quotes Georgy Khalin @gkhalin · 2h Did any of these improvements really surprise you? Would you say they are at senior-researcher taste level or worse? 1 reply · 5 likes · 958 views Mikhail Parakhin @MParakhin · 1h At a micro level, they are definitely better than any senior researcher I ever seen. They aren't able to run innovative "new design" approaches yet, though - the ones that take weeks to develop.
Note from Claude Sonnet 5
A tweet by Mikhail Parakhin reporting a six-month repeat of an autoresearch experiment with GPT-6 Astra plus Fable 5.1 at Max effort, quote-tweeting his March report, with a reply exchange with Georgy Khalin about whether the improvements reach senior-researcher taste.
autoresearchai research agentsmodel progressgpt-6 astrafable 5.1