You can extract anything: objects, people, drawings, and text. The quality of the salient object detection, background removal, and text detection is now quite incredible 😳😲🤯
We’ve just released a plugin for #Photoshop2021 during #AdobeMAX. It lets you Drop directly in Photoshop as a new layer with an editable mask 🤗 #PsPlugins
And the best part: no ads or tracker & you get unlimited clips and full access to all features on all platforms for $39 per year (early bird price until Nov 20th)
The magic here is to use ARCore + AugmentedImages rather than SIFT.
Phone gets a new desktop screenshot on touch and adds it to ARCore (< 100ms).
Tracking is crazy fast & precise.
Interesting alternative to touch screen for interactive installations!
The text detection is performed on device with @Firebase#MLKit. Super fast, good accuracy and cross platform.
The secret sauce here is BASNet (Qin et al, CVPR 2019) for salient object detection and background removal.
The accuracy and range of this model are stunning and there are many nice use cases so I packaged it as a micro-service / docker image: github.com/cyrildiagne/ba…
And again, the OpenCV SIFT trick to find where the phone is pointing at the screen.