Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Stella Li Profile picture
Stella Li
@StellaLisy
PhD student @uwnlp | visiting researcher @AIatMeta | undergrad @jhuclsp #NLProc
May 27 • 9 tweets • 4 min read
🤯 We cracked RLVR with... Random Rewards?!
Training Qwen2.5-Math-7B with our Spurious Rewards improved MATH-500 by:
- Random rewards: +21%
- Incorrect rewards: +25%
- (FYI) Ground-truth rewards: + 28.8%
How could this even work⁉️ Here's why: 🧵
Blogpost: tinyurl.com/spurious-rewar…Image We tested increasingly weak and even pathological training signals on math problems:
✅ Ground truth answers
🔲 Format – reward if contains “\boxed{}”
😈 Incorrect answers as labels
🎲 Randomly reward regardless of answer
All these improved Qwen2.5-Math, AMC, AIME dramatically!!! Image