Cyril Diagne Profile picture
ML × Interaction Design. Making @clipdropapp, prev: resident @googlearts, head @ecal_mid, co-founder @lab212
Jan 14 9 tweets 3 min read
Stable Diffusion 100% in the browser with running at < 1s per image ⚡️

Thanks to SD Turbo by @AxSauer & al @StabilityAI and diffusers.js on webGPU by @daken_

Demo:

More info in ↓🧵 cyrildiagne.com/lab/sdturbo-we…
It’s currently only compatible Chrome/Edge v120+ (webgpu can be enabled with an experimental flag on Safari TP & Firefox 122+)

You need to activate both experimental WebAssembly flags to run the latest @onnxruntime Image
Jun 17, 2022 5 tweets 6 min read
Today we're launching @clipdropapp Image Upscaler on @ProductHunt, the easiest way to upscale your images 2x or 4x with AI.

⚡️ Upscale, denoise and enhance in 1 click
🔍 Sharpen blurry edges
✨ Remove JPEG compression artifacts
🔌 Public API

producthunt.com/posts/clipdrop… @clipdropapp @ProductHunt Once again, our team has used a couple of our favorite tricks to push the quality and speed of 2x and 4x image upscaling models.

It's an ongoing effort, but the result is already quite spectacular 🤓
Dec 19, 2021 12 tweets 7 min read
This weekend I played with 3 things I ♥: machine learning, #generativeart, and the web.

Here's a small neural network running entirely in a #webgl GLSL shader that hallucinates thousands of new handwritten digits in real-time.

How so? 👇🧵 I first learned about CPPNs in "Generating Large Images from Latent Vectors" by @hardmaru back in 2016 (!).

At the time, GANs were stuck at 256px and I was amazed to learn about these fast, high resolution, generators.

blog.otoro.net/2016/04/01/gen…
Oct 22, 2020 8 tweets 11 min read
Aaand here it is..!!! 😱

After months of hard work with @jblanchefr, @ClipDropApp beta (AR Copy Paste) is now publicly available on #Android, #iOS, #macOS, and #Windows

🔥 clipdrop.co 🔥

Here's a thread of what you can already do with it ↓ 1/n

#ML #AR #AI You can capture directly from your desktop with a screenshot and drag & drop to any other app (my favorite feature 🤩)

It works from/to virtually any application & websites: @figmadesign, @Photoshop, @Canva, @Pitch, @Powerpoint, @GoogleDocs...etc!

#ML #Augmented #DesktopOS
May 17, 2020 6 tweets 4 min read
Proto 6/10: Copy printed text to desktop with AR+ML

Code: github.com/cyrildiagne/ar…
Book: Neurones, les intelligences simulées, Frédéric Migayroux & al (Editions Hyx 2018 @centrepompidou)

#ML #AR #AI #AIUX #ARCore #ARKit #WebXR

Technical Insights: ↓ The magic here is to use ARCore + AugmentedImages rather than SIFT.
Phone gets a new desktop screenshot on touch and adds it to ARCore (< 100ms).
Tracking is crazy fast & precise.

Interesting alternative to touch screen for interactive installations!
May 3, 2020 6 tweets 6 min read
4/10 - Cut & paste your surroundings to Photoshop

Code: github.com/cyrildiagne/ar…

Book: @HOLOmagazine
Garment: SS17 by @thekarentopacio
Type: Sainte Colombe by @MinetYoann @ProductionType
Technical Insights: ↓

#ML #AR #AI #AIUX #Adobe #Photoshop The secret sauce here is BASNet (Qin et al, CVPR 2019) for salient object detection and background removal.

The accuracy and range of this model are stunning and there are many nice use cases so I packaged it as a micro-service / docker image: github.com/cyrildiagne/ba… Image
Feb 10, 2019 4 tweets 2 min read
The coarse knob of #StyleGAN really is mesmerizing. Esp. how it adds/replaces some features to match the artistic style (collars, hats..etc) On random interpolation, the truncated latent space also looks surprisingly continuous & morphologically coherent.