Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Michele Bevilacqua Profile picture
Michele Bevilacqua
@MicheleBevila20
Researcher. ex @SapienzaNLP/@MetaAI. Natural Language Processing. He/him.
Apr 25, 2022 • 11 tweets • 6 min read
New work on autoregressive language models for retrieval!

We train our model, SEAL (Search Engines with Autoregressive LMs) to produce text snippets occurring somewhere in the corpus, in relevant documents. We use the generated ngrams to rank documents in the corpus.

Thread 👇 This is the result of my internship @MetaAI. Joint work with @ot_y @PSH_Lewis @scottyih @riedelcastro @Fabio_Petroni. I couldn't have asked for a better team 💕
Code & checkpoints: github.com/facebookresear…
Paper: arxiv.org/abs/2204.10628

2/n