Pramod Goyal Profile picture
Trying to change the world one line at a time AI Dev zetta global prev @joindimension founder @hacktogetherdev
May 11 29 tweets 10 min read
Most influential LLM papers and the ideas they introduced (post 2017)

A long thread 🧵 Image 2017

The foundational transformers paper

Multi-head attention mechanism
Scaled dot-product attention
Position-wise feed-forward networks
Positional encodings Image