Design Director, GenAI @Meta. Former product lead XR/AI @Shopify and co-founder @primersupply
Mar 2, 2023 • 7 tweets • 3 min read
Johnny Lee famously hacked a Wii Remote to turn a 2D screen into a 3D window. We revived this trick in Chrome using a standard webcam.
Here’s how we did it. 🧵👇
We send the webcam video through Google’s MediaPipe Face Mesh library to track our eyes.
Oct 11, 2022 • 10 tweets • 8 min read
AI unlocks unlimited product photography. 🤯
Recent advances have made it possible for merchants to turn mobile photos into high quality product images + ad creative.
AI can now learn and reproduce a product on demand. More…👇[1/10]
#ai#aiart#stablediffusion#dreambooth
Products with simple forms and organic lines reproduce exceptionally well. We took this trainer on adventures across unfamiliar terrain. 👟🏔 [2/10]
Sep 13, 2022 • 7 tweets • 5 min read
1/ As soon as StableDiffusion landed we dropped everything to build a GENIE! 🧞♂️
🎙 Voice UI
🖼 AI Art
😎 AR previews
🤑 Instant purchasing
📦 On-demand production
Could AI make every shopper’s wish come true? 🤔👇
#ai#aiart#stablediffusion#dalle#dalle2#vui2/ Shopping is hard when you want something specific but aren’t sure where to find it. New models from @StabilityAI and @OpenAI can create a detailed image of anything you can imagine, so skip searching — ask for exactly what you want and print it on-demand! 🖨🌽
Aug 24, 2022 • 13 tweets • 10 min read
Could you tell which room was virtual? 👀
Traditional AR can’t tell you how a couch feels. Our team @Shopify explored "Reverse AR" to wrap a virtual room around a real thing. Sit on a couch in-store while seeing it in your space—best of both worlds!
👇 How we built it… 🧵1/12
At home, shoppers scan their space using @Apple’s #RoomPlan or a photogrammetry app like @RealityComposer_ or @Polycam3D. It only takes a few seconds. 🧵2/12
Jul 13, 2022 • 12 tweets • 11 min read
Lots of interest in this “reset button” for your room we built @Shopify that uses @apple’s new #RoomPlan API. Here’s how we built it… 👇 🧵1/12
@Shopify@Apple AR makes it easy to try new couches, but the couch already in your space can get in the way. What if every room had a reset button? Space Eraser models spaces in high-fidelity—capturing room-defining objects, their size, position, orientation… [2/12]