This is big ... semantic search is here. Let me show you with poetry. Yes poetry! I coupled @OpenAI's new CLIP model with 25K landscape photos from @unsplash. With it, you get a glimpse into how the AI *visualizes* poetry. A thread 🧵:
"Where Alph, the sacred river, ran through caverns measureless to man Down to a sunless sea." (Kubla Khan)
And on the pedestal, these words appear: My name is Ozymandias, King of Kings (Ozymandias)
’Twas brillig, and the slithy toves Did gyre and gimble in the wabe: All mimsy were the borogoves, And the mome raths outgrabe. (Jabberwocky)
I hate them. I hate them as I hate sex, the man’s mouth sealing my mouth, the man’s paralyzing body— (Mock Orange)
Among twenty snowy mountains, The only moving thing Was the eye of the blackbird. (Thirteen Ways of Looking at a Blackbird)
Because I could not stop for Death – He kindly stopped for me – The Carriage held but just Ourselves – And Immortality. (Because I could not stop for Death)
And what shoulder, & what art, Could twist the sinews of thy heart? And when thy heart began to beat, What dread hand? & what dread feet? (The Tyger)
Pretty incredible stuff! It's crazy that 1] I'm using the pre-release from @OpenAI (share the full model!) 2] I'm only using 1% of all of @unsplash (share all the data!)
I have a @streamlit app coming soon where you can put in your own work. Retweet to help get the word out!
And now, for my favorite failure mode (à la @JanelleCShane)
Look on my Works, ye Mighty, and despair! Nothing beside remains. (Ozymandias)
• • •
Missing some Tweet in this thread? You can try to
force a refresh