All AI Models Might be the Same: harnessing the universal geometry of embeddings

Rishi Jha and Jack Morris present evidence for a shared geometry across embedding models. Their work on vec2text and Vec2Vec reconstructs information from embeddings and translates between otherwise incompatible representation spaces without paired examples, suggesting that different AI systems may act as differently focused lenses onto a common semantic structure.

Watch

Downloads