Next: Ravi Shekhar on breaking captioning models arxiv.org/abs/1705.01359 #acl2017nlp
Take a captioned image, replace one noun with a different noun that makes it a false caption. Can do this automatically w/ COCO cat labels
Tasks: classify captions, detect the impostor word, correct it
HieCoeAtt is slightly better at classification, and way better and detecting the foil word (though terrible in abs sense)
and everyone is bad at correcting the word
Share this Scrolly Tale with your friends.
A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.