Profile picture
Janelle Shane @JanelleCShane
, 6 tweets, 3 min read Read on Twitter
A bird ID-ing algorithm will totally miss that a bird has 3 eyes or 2 heads as long as the markings are ok. It has no clue how birds work.
I mean... this is what happened when image recognition algorithms tried to caption another algorithm's attempt at generating "an image of a girl eating a large slice of pizza".
Spoiler: they saw nothing wrong.
Generated image from: arxiv.org/abs/1711.10485 Image is a blobby girl with random orifices and bits of her hand floating around a pizza-textured object. Microsoft Azure and others: A person eating a slice of pizza
Also state-of-the-art algorithms will do things like this
Azure's image recognition algorithm has difficulties with sheep
Here's Visual Chatbot weighing in on an AI-generated image of "a herd of cows is grazing in the grass".
Visual chatbot: demo.visualdialog.org
Image from supp. data of this paper: arxiv.org/abs/1711.10485 Image: two blocky brown blobs on a grassy-textured field. There are tree-colored areas and sky-colored areas too.<br />
Caoption: two cows are laying in the grass in a field<br />
Me: Do they look like very normal cows?<br />
Bot: yes<br />
Me: No... missing heads?<br />
Bot: No<br />
Me: Or missing ears?<br />
Bot: UNK
Visual Chatbot sees nothing wrong with the other algorithm's "a herd of sheep grazing on a lush green field".
Visual chatbot: demo.visualdialog.org
Image from supp. data of this paper: arxiv.org/abs/1711.10485 Image: looks like grazing sheep if you zoom out, but if you zoom in you see that the sheep have no legs, just black blobby areas.<br />
Caption; a herd of sheep grazing on a lush green field<br />
Me: Do the sheep have all the proper sheep-parts?<br />
Bot: Yes<br />
Me: Like... legs?<br />
Bot: yes<br />
Me: Do you know what legs are?<br />
Bot: no<br />
Me; How many giraffes do you see?<br />
Bot: 4
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to Janelle Shane
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member and get exclusive features!

Premium member ($3.00/month or $30.00/year)

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!