CLIP + StyleGAN FFHQ (noise vecs) is amazing! Same seed for each image (9):
"it was one of those rare smiles with a quality of eternal reassurance in it that you may come across four or five times in life"
vs
"Grey eyes that grow sadder than sunset or rain" #AI#art#poetry
I think the problem vs other methods (CC CLIP gang @advadnoun@erocdrahs@JanelleCShane) is an unstructured image+network is too complicated to optimize -- starting with a limited latent space (humans? cats? churches?) limits the space for CLIP to shine. Credit to @l4z for idea
Jan 13, 2021 • 10 tweets • 6 min read
This is big ... semantic search is here. Let me show you with poetry. Yes poetry! I coupled @OpenAI's new CLIP model with 25K landscape photos from @unsplash. With it, you get a glimpse into how the AI *visualizes* poetry. A thread 🧵:
"Where Alph, the sacred river, ran through caverns measureless to man Down to a sunless sea." (Kubla Khan)