Tweet

@emblebi

@uniprot

@DNDi

@Nature

This Thread may be Removed Anytime!

Twitter may remove this content at anytime! Save it as PDF for later use!

More from @DeepMind

DeepMind

@DeepMind

6 Jul

Many models bake in domain knowledge to control how input data is processed. This means models must be redesigned to handle new types of data.

Introducing the Perceiver, an architecture that works on many kinds of data - in some cases all at once: dpmd.ai/perceiver (1/)

Like Transformers, Perceivers process inputs using attention. But unlike Transformers, they first map inputs to a small latent space where processing is cheap & doesn’t depend on the input size. This allows us to build deep networks even when using large inputs like images. (2/)

Perceivers can learn a different attention pattern for each type of data (shown for images and video), making it easy for them to adapt to new data and unexplored problems where researchers may not know what kinds of patterns they should be looking for. (3/)

Read 4 tweets

DeepMind

@DeepMind

14 May

In a new paper, our team tackles a fundamental AI problem: how can we simultaneously parse the world into objects and properties, while simultaneously inducing the rules explaining how objects change over time: dpmd.ai/3fmrxsn (1/)

@LittleBimble

Work by @LittleBimble with @pfau, @pushmeet, Matko Bosnjak, Lars Buesing, Kevin Ellis, and Marek Sergot. (2/)

This system combines the Apperception Engine with a binary neural network to learn a provably 100% accurate model of non-trivial environments (e.g. Sokoban) from noisy raw pixel data. (3/)

Read 4 tweets

DeepMind

@DeepMind

7 May

Multimodal transformers achieve impressive results on many tasks like Visual Question Answering and Image Retrieval, but what contributes most to their success? dpmd.ai/3h8u23Z (1/)

@jalayrac

This work explores how different architecture variations, pretraining datasets, and losses impact multimodal transformers’ performance on image retrieval: dpmd.ai/3eENAtF

(By Lisa Anne Hendricks, John Mellor, Rosalia Schneider, @jalayrac & @aidanematzadeh) (2/)

Multimodal transformers outperform simpler dual encoder architectures when the amount of data is held constant. Interestingly, larger datasets don’t always improve performance. (3/)

Read 4 tweets

DeepMind

@DeepMind

10 Dec 20

@wojczarnecki

For #NeurIPS2020, we spoke with @wojczarnecki about Spinning Tops, advice he wish he received as a student, and his goals for next year! #PeopleBehindThePapers

AI has been extremely successful in real world games (GO, DOTA, StarCraft) with results coming from relatively simple multi-agent algorithms. In this paper, we hypothesise that they share a common geometry - Spinning Tops. Learn more: bit.ly/3qI8RrD #NeurIPS2020

I’ve always loved biology. During my masters I decided to take a handful of neurophysiology courses - which I found to be interesting. But eventually I realised that my true strengths were in mathematical sciences. A career in ML and AI became a natural way to combine the two.

Read 5 tweets

DeepMind

@DeepMind

1 Dec 20

Yesterday we shared the news that #AlphaFold has been recognised as a solution to the ‘protein folding problem’ by #CASP14, the biennial Critical Assessment of Protein Structure Prediction. But what exactly is protein folding, and why is it important? A thread… (1/6)

Proteins are the building blocks of life - they underpin the biological processes in every living thing. If you could unravel a protein you would see that it’s like a string of beads made of a sequence of different chemicals known as amino acids. (2/6)

Interactions between these amino acids make the protein fold, as it finds its shape out of almost limitless possibilities. For decades, scientists have been trying to find a method to reliably determine a protein’s structure just from its sequence of amino acids. (3/6)

Read 6 tweets

DeepMind

@DeepMind

9 Jun 20

@seb_ruder

We have research scientist @seb_ruder up next with more #AtHomeWithAI recommendations!

He suggests the Deep Learning Book from @mitpress for a comprehensive introduction to the fundamentals of DL: bit.ly/351qMzb (1/7)

@seb_ruder

Overwhelmed with the number of available machine learning courses? @seb_ruder recommends taking a look through @venturidb’s curated - and ranked - list available on @freeCodeCamp.

bit.ly/3erZEN4 #AtHomeWithAI

@fastdotai

Do you have a technical background? Are you looking for an introduction to natural language processing?

Sebastian recommends the @fastdotai course, “A Code-First Introduction to Natural Language Processing”.

bit.ly/3esFtP8 #AtHomeWithAI

Read 7 tweets

Share this page!

DeepMind

Try unrolling a thread yourself!

More from @DeepMind

DeepMind

DeepMind

DeepMind

DeepMind

DeepMind

DeepMind

Did Thread Reader help you today?

Like this author's thread?