Taylor Webb Profile picture
Studying cognition in humans and machines.
Dec 21, 2022 15 tweets 5 min read
Here's one to add to the LLM debates: in a new paper, we found that GPT-3 matches or exceeds human performance on zero-shot analogical reasoning, including on a text-based version of Raven's Progressive Matrices.

arxiv.org/abs/2212.09196…

Thread: Analogical reasoning is often viewed as the quintessential example of the human capacity for abstraction and generalization, allowing us to approach novel problems *zero-shot*, by comparing them to more familiar situations.