This is big ... semantic search is here. Let me show you with poetry. Yes poetry! I coupled @OpenAI's new CLIP model with 25K landscape photos from @unsplash. With it, you get a glimpse into how the AI *visualizes* poetry. A thread 🧵:
"Where Alph, the sacred river, ran through caverns measureless to man Down to a sunless sea." (Kubla Khan) ImageImage
And on the pedestal, these words appear: My name is Ozymandias, King of Kings (Ozymandias) ImageImage
’Twas brillig, and the slithy toves Did gyre and gimble in the wabe: All mimsy were the borogoves, And the mome raths outgrabe. (Jabberwocky) ImageImage
I hate them. I hate them as I hate sex, the man’s mouth sealing my mouth, the man’s paralyzing body— (Mock Orange) ImageImage
Among twenty snowy mountains, The only moving thing Was the eye of the blackbird. (Thirteen Ways of Looking at a Blackbird) ImageImage
Because I could not stop for Death – He kindly stopped for me – The Carriage held but just Ourselves – And Immortality. (Because I could not stop for Death) ImageImage
And what shoulder, & what art, Could twist the sinews of thy heart? And when thy heart began to beat, What dread hand? & what dread feet? (The Tyger) ImageImage
Pretty incredible stuff! It's crazy that 1] I'm using the pre-release from @OpenAI (share the full model!) 2] I'm only using 1% of all of @unsplash (share all the data!)

I have a @streamlit app coming soon where you can put in your own work. Retweet to help get the word out!
And now, for my favorite failure mode (à la @JanelleCShane)

Look on my Works, ye Mighty, and despair! Nothing beside remains. (Ozymandias) ImageImage

• • •

Missing some Tweet in this thread? You can try to force a refresh

Keep Current with Travis Hoppe

Travis Hoppe Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!


Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!