representation-learning

Sasha Malysheva ✓ @aimalysheva · 3h if we think of models as cities, and hidden representations of concepts as the main landmarks in each city (the church, the train station, the university, etc), then the numbers in the hidden states are just the coordinates of those landmarks so linear stitching between two models is then like finding a map from one city's coordinate system to another's the images attached are a literal version of that: Berlin→Vienna and Vienna→Milan (took some inspiration from my recent travels haha) what makes this useful for intuition building is that the map doesn't have to be perfect everywhere! it just has to preserve the relative structure well enough to navigate so in the context of LLMs, I do think we need to research a question of which formalizations of "same structure" are actually measuring the same thing, and which ones aren't [Attached image: two side-by-side map diagrams. Left: "Berlin -> Vienna (affine), residual = 58% of Vienna footprint" showing a warped grid over a Vienna street map with landmark points (state university, main square, historic core, central park, national art museum, imperial theatre, grand cathedral, main rail terminal) plotted as green dots (Vienna real) and orange circles (Berlin -> adapted). Right: "Vienna -> Milan (affine), residual = 52% of Milan footprint" with similar warped grid over a Milan map, landmarks (main rail terminal, historic core, national art museum, central park, imperial theatre, grand cathedral, state university) plotted with green dots (Milan real) and orange circles (Vienna -> adapted).] Quoted reply below (Sasha Malysheva, Jun 24, with a 0:10 video thumbnail): "been looking into how the different formalizations of the Platonic Representation Hypothesis connect to linear stitching..."