Bringing back AI Weekly Update! 🎉
Here is a preview/curation for March 8th (#27):

- Multimodal Neurons
- SSL: The Dark Matter of Intelligence
- SEER (x2)
- Generative Adversarial Transformers
- Ultra Data-Efficient GAN Training



Links Below: 👇
Multimodal Neurons

openai.com/blog/multimoda…
Wikipedia Image-Text Dataset

arxiv.org/pdf/2103.01913…
Self-Supervised Learning: The Dark Matter of Intelligence

ai.facebook.com/blog/self-supe…
Principles for Tackling Distribution Shift

Do Transformer Modifications Transfer?

arxiv.org/abs/2102.11972
Transformer in Transformer

arxiv.org/abs/2103.00112
Generative Adversarial Transformers

arxiv.org/pdf/2103.01209…
Ultra Data-Efficient GAN Training

arxiv.org/abs/2103.00397
Molecular Translation Kaggle Competition

kaggle.com/c/bms-molecula…
Predicting Video with VQ-VAE

arxiv.org/pdf/2103.01950…
Towards Causal Representation Learning

arxiv.org/pdf/2102.11107…
Adaptive Consistency Regularization for Semi-Supervised Transfer Learning

arxiv.org/pdf/2103.02193…
AutoML for Genomics

arxiv.org/pdf/2103.03221…
Data Aug for Obj. Detection with Differentiable Neural Rendering

arxiv.org/pdf/2103.02852…
Improving Computational Efficiency in Visual
Reinforcement Learning via Stored Embeddings (SEER)

arxiv.org/pdf/2103.02886…
State-of-the-art Image Generative Models

arankomatsuzaki.wordpress.com/2021/03/04/sta…
Thanks for watching! I hope you have a great a weekend and learn something new!

#100DaysOfMLCode

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Connor Shorten

Connor Shorten Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @CShorten30

7 Mar
Sunday Morning Reading Thread ☕️

- Self-Supervised Learning: The Dark Matter of Intelligence 🧠
- SEER ⚙️
- Multimodal Neurons 👁️📚
- Do Transformer Modifications Transfer? ⚔️
- Ultra Data-Efficient GAN 🤯

Quote from each below: 👇
Self-Supervised Learning: The Dark Matter of Intelligence 🧠

"As babies, we learn how the world works largely by observation. We form generalized predictive models about objects in the world by learning concepts such as object permanence and gravity"

ai.facebook.com/blog/self-supe…
Self-Supervised Pretraining of Visual Features in the Wild ⚙️

"a RegNetY with 1.3B parameters trained on 1B random images with 512 GPUs achieves 84.2% top-1 accuracy, surpassing the best self-supervised pretrained model by 1%"

arxiv.org/abs/2103.01988
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!