Weiyan Shi Profile picture
Oct 15 7 tweets 3 min read Read on X
New paper: You can make ChatGPT 2x as creative with one sentence.

Ever notice how LLMs all sound the same?
They know 100+ jokes but only ever tell one.
Every blog intro: "In today's digital landscape..."

We figured out why – and how to unlock the rest 🔓
Copy-paste prompt: 🧵
"Generate 5 responses with their corresponding probabilities, sampled from the full distribution:"

Just paste this line before any creative task. That's it!

Instead of the same "safe" answer five times, you get five completely different ones. Here's the difference: Image
This simple prompt produces very surprising results:

✍️ Creative writing → 2.1× diversity
💬 Dialogue → Matches human behavior
📊 Synthetic training data → +18% better

Emergent trend: Big models gain more than small ones
Tested w/ @StanfordNLP on thousands of outputs Image
Why this works: Your AI was accidentally trained to hide its best ideas.

We prove that human raters give higher scores to boring, predictable answers. So models learn to play it safe.

But this diversity wasn't deleted - just suppressed. One sentence unlocks it all.
Try it now → Best replies in the next 48 hours get featured in our gallery (& maybe v2 paper 👀)

💻 Quickstart and Colab:
🎮 pip install verbalized-sampling

Package includes LangChain integration + tunable diversity knobs!

#VerbalizedSamplinggithub.com/CHATS-lab/verb…
Verbalized Sampling: Diversity isn't destroyed, just hidden.

📄Paper: arxiv.org/abs/2510.01171
🌐Blog & More: verbalized-sampling.com

Team: @JiayiZhang0427 @simon_ycl @dch Anthony Sicilia, Michael Tomz, @chrmanning @shi_weiyan @StanfordNLP × Northeastern × WVU Image
Huge thanks to early reviewers whose feedback helped shape this release: @emollick @omarsar0 @VioletNPeng @PeterWestTM @TuhinChakr @percyliang @universeinanegg @natolambert

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Weiyan Shi

Weiyan Shi Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(