elvis Profile picture
Building with LLMs, RAG, and AI Agents @dair_ai • Prev: Meta AI, Galactica LLM, PapersWithCode, PhD • Creator of the Prompting Guide (~3M learners)

Dec 5, 2018, 9 tweets

A simple method for fair comparison? #NeurIPS2018

Considerations:

Reproducibility checklist:

There is room for variability, especially when using different distributed systems:

Complexity of the world is discarded... We need to tackle RL in the natural world through more complex simulations.

Embedding natural background?

Set the bar higher for the naturalism of the environment:

You learn a lot by considering this idea of stepping out in the real world:

Reproducibility test:

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling