Tweet

Russ Maschmeyer

Oct 11 • 10 tweets • 8 min read

AI unlocks unlimited product photography. 🤯

Recent advances have made it possible for merchants to turn mobile photos into high quality product images + ad creative.

AI can now learn and reproduce a product on demand. More…👇[1/10]

#ai #aiart #stablediffusion #dreambooth

Products with simple forms and organic lines reproduce exceptionally well. We took this trainer on adventures across unfamiliar terrain. 👟🏔 [2/10]

This mid-century Eames Lounge got a tour of some Bond-villain HQs nestled into the world’s most beautiful landscapes. 🏜🧊 [3/10]

A home fashion shoot got a *slight upgrade. 💅 [4/10]

And Big Bear finally got a chance to showcase his holiday versatility. 🎃🧸🎁🌼 [5/10]

Of course AI can generate expressive images of real products for ads and other creative applications too… [6/10]

But some products don't embed/reproduce well. StableDiffusion is currently challenged by…
1. Text, logos, and precise detail
2. Complex geometry
3. Counting

But even in its current state, AI is capable of helping new merchants put their best foot forward and could be a powerful tool for creatives working with more established brands. [8/10]

https://twitter.com/_akhaliq/status/1578072594162810880

The pace of progress around AI is staggering. Breakthrough research papers appear each week, enabling a new mind-bending wave of possibilities. It's both exciting and exhausting! 😅 [9/10]

https://twitter.com/_akhaliq/status/1578072594162810880

All the nerdy details…
We used #dreambooth to train models for each product. 200-250 regularization images from the same product category, 20-25 training images of a specific product, 4000 iterations (~1–1.5hrs on an A100). ✌️🙏[10/10]

• • •

Missing some Tweet in this thread? You can try to force a refresh

This Thread may be Removed Anytime!

Twitter may remove this content at anytime! Save it as PDF for later use!

More from @StrangeNative

Russ Maschmeyer

@StrangeNative

Sep 13

1/ As soon as StableDiffusion landed we dropped everything to build a GENIE! 🧞‍♂️

🎙 Voice UI
🖼 AI Art
😎 AR previews
🤑 Instant purchasing
📦 On-demand production

Could AI make every shopper’s wish come true? 🤔👇

#ai #aiart #stablediffusion #dalle #dalle2 #vui

@StabilityAI

2/ Shopping is hard when you want something specific but aren’t sure where to find it. New models from @StabilityAI and @OpenAI can create a detailed image of anything you can imagine, so skip searching — ask for exactly what you want and print it on-demand! 🖨🌽

3/ The patterns in our prototype were created using the prompts you hear in the video and the tiling technique we developed. Each frame of animation is a real step of the generation process. You’re watching StableDiffusion dream in real time 💭👀

https://twitter.com/pushmatrix/status/1564988182780846083?s=20&t=SK9p2WvGBjFX9hlzAbPCrA

Read 7 tweets

Russ Maschmeyer

@StrangeNative

Aug 24

@Shopify

Could you tell which room was virtual? 👀

Traditional AR can’t tell you how a couch feels. Our team @Shopify explored "Reverse AR" to wrap a virtual room around a real thing. Sit on a couch in-store while seeing it in your space—best of both worlds!

👇 How we built it… 🧵1/12

@Apple

At home, shoppers scan their space using @Apple’s #RoomPlan or a photogrammetry app like @RealityComposer_ or @Polycam3D. It only takes a few seconds. 🧵2/12

@Apple

@Apple @Polycam3D In store, shoppers can instantly visualize their room around an object. Computer vision systems identify and segment furniture and people from the video stream and mask them into the virtual room. 🧵3/12

Read 13 tweets

Russ Maschmeyer

@StrangeNative

Jul 13

@Shopify

Lots of interest in this “reset button” for your room we built @Shopify that uses @apple’s new #RoomPlan API. Here’s how we built it… 👇 🧵1/12

@Shopify

@Shopify @Apple AR makes it easy to try new couches, but the couch already in your space can get in the way. What if every room had a reset button? Space Eraser models spaces in high-fidelity—capturing room-defining objects, their size, position, orientation… [2/12]

@Shopify

@Shopify @Apple Live pixel data combines with LiDAR depth data to enable a lifelike digital twin of your room that can be overlaid onto your real space using AR and then edited digitally… [3/12]