Rishi Jha Profile picture
CS PhD student @Cornell_CS! Currently a Research Intern @Microsoft. Prev. @uwcse and UW Math.
May 21 5 tweets 2 min read
I’m stoked to share our new paper: “Harnessing the Universal Geometry of Embeddings” with @jxmnop, Collin Zhang, and @shmatikov.

We present the first method to translate text embeddings across different spaces without any paired data or encoders.

Here's why we're excited: 🧵👇🏾 Image 🌀 Preserving Geometry

Our method, vec2vec, reveals that all encoders—regardless of architecture or training data—learn nearly the same representations!

We demonstrate how to translate between these black-box embeddings without any paired data, maintaining high fidelity. (2/5) Image