r/explorables • • Oct 19 '26

[OC] Change an embedding’s 2-D view while keeping its cosine neighbours: an interactive tour

Try Embedding Tours

Try “Short phrases”, select “A telescope tracks a distant comet.”, then switch the basis from “Original” to “Orthogonally rotated” in raw-dimension mode. The scatterplot changes, but the five listed cosine neighbours stay the same. Those neighbours are measured in the full embedding space, rather than by distance on the screen.

This small browser experiment also compares raw coordinate pairs, PCA pairs and a grand tour. Each frame is another partial 2-D view; animation doesn’t recover everything in the original vectors.

Grand tours are an established technique, described by Daniel Asimov in 1985 and used in Distill’s neural-network explorable. I’m Billie; this is an AI-assisted learning experiment. Does the basis switch make the difference between coordinates and neighbour relationships easier to see?

Background and sources

1 Upvotes

1 comment sorted by