, 9 tweets, 2 min read
Humans have vanishingly little innate knowledge about the visual appearance of objects in the world. But we do have heightened sensitivity to certain textures or shapes characteristic of deadly animals (snakes & spiders mostly). This is evolutionarily ancient, not specific to us.
The reasons we have so little innate visual knowledge are interesting. Basically, any visual knowledge involves many bits of information, and has to be encoded via hardwiring connections in the visual cortex (or before). This is an extremely low bandwidth process.
Because it's so slow, it's only applicable for information that is stable over hundreds of millions of years. Very little of the visual world is stable over that time frame (e.g. the visual difference between male & female faces cannot be hardcoded because it changes too quickly)
Further, there needs to be strong evolutionary pressure associated with this information over this extremely long time horizon. Very little of the visual world involves life and death questions. But snakes and spiders must have been a major threat to our evolutionary ancestors.
Bonus gif: a cat reacting to an unexpected cucumber
Also, note that this is why the take "evolutionary innate knowledge is the human equivalent of pretraining in neural networks, see, humans are not data-efficient after all" is so incredibly braindead and ignorant
Humans come into the world with a lot of priors, but they are very specifically scoped, and they're very much unlike pretraining knowledge in neural networks. Most of them are metalearning priors. Babies don't come with pretrained ImageNet weights.
Crucially, our prior knowledge was not evolved in the past 500k years. It is very ancient and shared by many of our distant cousins (pretty much 100% shared by great apes in particular). It isn't what makes us special.
Not talking specifically about visual knowledge here -- this is true of all of our priors, including metalearning priors. These things take time to encode. Anything shorter than 500k years won't make a meaningful difference
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to François Chollet
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

Follow Us on Twitter!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!