Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Guanzhi Wang Profile picture
Guanzhi Wang
@guanzhi_wang
Research Scientist @NVIDIA GEAR. PhD @Caltech. Voyager, MineDojo, Eureka.
Dec 19 • 9 tweets • 4 min read
Introducing NitroGen, an open foundation model for generalist gaming agents!
nitrogen.minedojo.org

✅ Open access to the largest action-labeled gameplay videos with 40K hours across 1,000+ game titles
✅ Universal simulator for measuring cross-game generalization
✅ Open gaming foundation model trained to play 1,000+ games with large-scale behavior cloning

🧵 How to get actions at internet scale?

We tap into a massive, underused resource: YouTube & Twitch gameplay with live controller overlays. We use template matching to locate gamepad overlays and then use a fine-tuned SegFormer model to parse gamepad actions.