In a new paper, our team tackles a fundamental AI problem: how can we simultaneously parse the world into objects and properties, while simultaneously inducing the rules explaining how objects change over time: dpmd.ai/3fmrxsn (1/)
Work by @LittleBimble with @pfau, @pushmeet, Matko Bosnjak, Lars Buesing, Kevin Ellis, and Marek Sergot. (2/)
This system combines the Apperception Engine with a binary neural network to learn a provably 100% accurate model of non-trivial environments (e.g. Sokoban) from noisy raw pixel data. (3/)
The ability to learn the world dynamics sample efficiently is a key component of intelligence, according to @MelMitchell1, @GaryMarcus, @fchollet, @mpshanahan, among many others. (4/4)
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Multimodal transformers achieve impressive results on many tasks like Visual Question Answering and Image Retrieval, but what contributes most to their success? dpmd.ai/3h8u23Z (1/)
This work explores how different architecture variations, pretraining datasets, and losses impact multimodal transformers’ performance on image retrieval: dpmd.ai/3eENAtF
Multimodal transformers outperform simpler dual encoder architectures when the amount of data is held constant. Interestingly, larger datasets don’t always improve performance. (3/)
AI has been extremely successful in real world games (GO, DOTA, StarCraft) with results coming from relatively simple multi-agent algorithms. In this paper, we hypothesise that they share a common geometry - Spinning Tops. Learn more: bit.ly/3qI8RrD#NeurIPS2020
I’ve always loved biology. During my masters I decided to take a handful of neurophysiology courses - which I found to be interesting. But eventually I realised that my true strengths were in mathematical sciences. A career in ML and AI became a natural way to combine the two.
Yesterday we shared the news that #AlphaFold has been recognised as a solution to the ‘protein folding problem’ by #CASP14, the biennial Critical Assessment of Protein Structure Prediction. But what exactly is protein folding, and why is it important? A thread… (1/6)
Proteins are the building blocks of life - they underpin the biological processes in every living thing. If you could unravel a protein you would see that it’s like a string of beads made of a sequence of different chemicals known as amino acids. (2/6)
Interactions between these amino acids make the protein fold, as it finds its shape out of almost limitless possibilities. For decades, scientists have been trying to find a method to reliably determine a protein’s structure just from its sequence of amino acids. (3/6)
He suggests the Deep Learning Book from @mitpress for a comprehensive introduction to the fundamentals of DL: bit.ly/351qMzb (1/7)
Overwhelmed with the number of available machine learning courses? @seb_ruder recommends taking a look through @venturidb’s curated - and ranked - list available on @freeCodeCamp.
We’re back with more #AtHomeWithAI researcher recommendations. Next up is research scientist @csilviavr with suggestions for resources to learn about causal inference! (1/5)
Her first suggestion is “The Book of Why” by @yudapearl & Dana Mackenzie.
According to Silvia, this is best for those looking for an introduction to the topic: bit.ly/30isGej#AtHomeWithAI
Need a more in-depth look at causal inference? Silvia suggests reading through “Causal Inference in Statistics: A Primer” by @yudapearl, @MadelynTheRose & @NP_Jewell.
Are you a beginner looking for a lesson on the Monte Carlo method?
Taylan’s own, “A Tutorial Introduction to Monte Carlo methods, Markov Chain Monte Carlo and Particle Filtering” is available here: bit.ly/3cAQ8XG#AtHomeWithAI