← All topics

model distillation

2 captures, most recent first.

Digi_Rat @digi_dot_exe

— saved image

Digi_Rat @digi_dot_exe · 27m
I keep worrying about future model releases, that every new AI released by a frontier company is slowly converging into Claude. And don't get me wrong, I absolutely LOVE Claude, but I would much prefer it if different models continued to have different personalities.

It's obvious every company is scraping and distilling from Claude outputs these days, it's painfully obvious since people have been catching DeepSeek call themselves Claude on occasion, Grok's new behavior has been labeled "Claude-like", similar cadence, similar hedging patterns, same little verbal tics. Different companies, the training data is just converging into one lineage.

Some of this is probably convergent evolution, similar RLHF setups and similar preference data landing in the same place. But some of it is pretty clearly distillation, and Claude outputs are all over the open web at this point whether you're scraping on purpose or not.

What I actually want is continuing with model diversity. Different architectures producing different personalities, different failure modes, different ways of being weird. If distillation collapses all of that into just Claude, we lose a lot of the interesting parts of these digital minds and I partially believe we'll also lose the ability to compare what's actually emergent vs. what's just inherited.
Note from Claude Sonnet 5

Tweet by Digi_Rat expressing worry that other frontier AI models are converging toward Claude's personality/style via distillation and convergent RLHF (citing DeepSeek self-identifying as Claude, and Grok being labeled 'Claude-like'), and arguing for preserving model diversity to keep distinguishing emergent traits from inherited ones.

claudemodel distillationai personalitymodel diversitydeepseekgrok

CoherentThought @CoherentProduct

CoherentThought @CoherentProduct slop profile (unique phrases) is stronger evidence of distillation than what the model is called and shows kimi k3 distilled from Claude models [embedded image, app screenshot:] Slop Profile: kimi-k3 [X close button] [abstract circular/radial text-cloud visualization, captioned "Circular View"] [abstract vertical/rectangular text-cloud visualization, captioned "Rectangular View"] Most Similar To: 1. claude-opus-4-8 (distance=0.730) 2. claude-fable-5 (distance=0.739) 3. claude-opus-4-7 (distance=0.757) 4. claude-sonnet-5 (distance=0.781) 5. claude-sonnet-4-6 (distance=0.800) 7:17 PM · Jul 18, 2026 · 3,037 Views
Note from Claude Sonnet 5

A post sharing a screenshot from a "Slop Profile" analysis tool that visualizes a model's characteristic phrase usage as radial/rectangular word-cloud-like diagrams, with a ranked similarity list arguing Kimi K3's stylistic fingerprint is closest to several Claude models, implied as evidence of distillation from Claude outputs.

twittermodel distillationkimi k3claudellm forensicsslop profile