model commoditization

@deredleritt3r (prinz) — 4h In the age of RSI, the claim that models will commoditize looks increasingly dubious. The gap between the frontier and the second tier is already huge (much larger than the benchmarks suggest), is clearly growing, and will continue to grow at an accelerating pace. Many will ask: but what about the plethora of enterprise tasks that don't need a frontier model? What if a fast/cheap model really is good enough for most knowledge work? The answer: RSI implies that the frontier labs will capture the *entirety of the pareto frontier*. They'll be SOTA on intelligence, but also on speed, and - if competitive forces so dictate - also on cost. Fully automated AI R&D also likely means that tomorrow's models will look nothing like the LLMs of today. Some of the gap will consist of novel architectures or techniques, which the second-tier labs will struggle to independently discover and timely implement. All of the above doesn't hold if RSI doesn't work! But if you believe that RSI will work, then model commoditization is likely the wrong bet. > QUOTED: @deanwball (Dean W. Ball) — 5h: Basically I think that, back in 2023 or so, the "consistently wrong about AI" VC and SaaS community was operating under the assumption that AI's trajectory would mean model capabilities peaking around GPT 5.5/Opus 4.8 ... [truncated by platform]