dr. jack morris @jxmnop
jack morris @jxmnop
heard from a friend of a friend that back in March a google researcher fixed a bug in Gemini training code and the model instantly got several points better on every benchmark
that's why it's so good now. one bug fix. crazy world we live in
4:24 AM · Apr 18, 2025 · 15.2K Views
Note from Claude Sonnet 5
An anecdote (unverified, "friend of a friend") claiming a single bug fix in Gemini training code produced a large jump in benchmark performance, offered as commentary on how fragile/contingent frontier model quality can be. Industry rumor about ML training practices.
twittergeminigoogle-deepmindml-trainingbug-fixbenchmarksai-industry