Rewatched @Tesla's AI day recently, and when @karpathy introduced the Transformer used in AutoPilot, it immediately reminded me of @DeepMind's #PerceiverIO which I recently contributed @huggingface. Wonder whether Tesla's approach was inspired by it... ... or whether they were already using this (long) before the paper's introduction. Especially the sentence "you initialize a raster the size of the output space that you'd like and tile it with position encodings "=> this is exactly what Perceiver IO does as well! @drew_jaegle

Happy to share my first @Gradio demo hosted as a @huggingface Space! It showcases @facebookai's new DINO self-supervised method, which allows Vision Transformers to segment objects within an image without ever being trained to do so! Try it yourself!

huggingface.co/spaces/nielsr/… I've also converted all ViT's trained with DINO from the official repository and uploaded them to the hub: huggingface.co/models?other=d…. Just load them into a ViTModel or ViTForImageClassification ;)