Nomic AI Profile picture
Nov 23 9 tweets 3 min read
What are the latest research trends in AI?
Explore all NeurIPS submissions from 1987 to 2022 in Atlas.
atlas.nomic.ai/map/neurips
Learn how it works and how to make it yourself👇
Each point is an accepted abstract at NeurIPS between 1987 and 2022.
Clusters of points represent research topics. For example, all papers about graph neural networks are here:
Atlas lets you interact with unstructured datasets over time. Filtering by submission year shows us how submissions to NeurIPS evolve:
80's and early 90's: Kernels, Speech Recognition and models of the brain.
90's-00's: RL, Clustering and Active Learning become popular.
2010's: Theory of DL, ConvNets, Causal Inference and Adversarial Attacks
2018-2022: Self supervised learning, Pruning, Bandit problems, 3D Deep learning
Searching the map for `transformer` surfaces the prevalence of the architecture across research topics:
Language models, Vision, Speech, 3D modeling, RL, EEG, Pruning and compression.
Make this map and others with 30 lines of Python:
github.com/nomic-ai/maps Image
Bonus: A map of just 2022 accepted submissions:
atlas.nomic.ai/map/neurips_20…
@hen_str Would love to see this as the paper explorer for the NeurIPS 2023 Virtual Conference :)
Huge thanks to @Yuvaaa___ for facilitating the data collection and cleaning this past summer while interning at Nomic!

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Nomic AI

Nomic AI Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @nomic_ai

Nov 1
How do people use #stablediffusion ?
Explore 6.4 million AI generated images from @krea_ai in Atlas.
atlas.nomic.ai/map/809ef16a-5…
@krea_ai How it works 👇
Every point is a user-generated image and its prompt.
Points are close together if an AI considers their images similar.

For example, Billionaires Row is a region containing co-located generations of @elonmusk , Jeff Bezos, Mark Zuckerburg and US dollars.
@krea_ai Check out the muppet axis, along which frogs become more "Kermit like". Kermit is part of the larger muppet simplex, which is part of the larger still cartoon pentagon.

These geometries remind me of the figures in @ch402's "Toy Models of Superposition": transformer-circuits.pub/2022/toy_model…
Read 5 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(