Google DeepMind Profile picture
We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Erik Schumacher Profile picture jothi sadhanand Profile picture amit Profile picture JaKeoung Koo Profile picture Pengfei Ni Profile picture 15 subscribed
May 14 10 tweets 4 min read
Introducing Veo: our most capable generative video model. 🎥

It can create high-quality, 1080p clips that can go beyond 60 seconds.

From photorealism to surrealism and animation, it can tackle a range of cinematic styles. 🧵 #GoogleIO ✍️ Prompt: “Many spotted jellyfish pulsating under water. Their bodies are transparent and glowing in deep ocean.”
Mar 19 6 tweets 3 min read
We're announcing TacticAI: an AI assistant capable of offering insights to football experts on corner kicks. ⚽

Developed with @LFC, it can help teams sample alternative player setups to evaluate possible outcomes, and achieves state-of-the-art results. 🧵 dpmd.ai/49PGq1b 📊 Corner kicks can be challenging for AI to model due to the limited availability of data - @premierleague matches only average about 10 a game.

TacticAI uses a geometric deep learning approach to tackle this problem. → dpmd.ai/43p5Gcc
Feb 15 9 tweets 4 min read
Introducing Gemini 1.5: our next-generation model with dramatically enhanced performance. It also achieves a breakthrough in long-context understanding.

The first release is 1.5 Pro, capable of processing up to 1 million tokens of information. 🧵 dpmd.ai/3SEbw4p
Gemini 1.5 was designed using a new Mixture–of-Experts (MoE) architecture, making it much more efficient to train and serve.

When tested on a set of text, code, image, audio and video evaluations, 1.5 Pro outperforms 1.0 Pro on 87% of benchmarks used for developing our LLMs.
Jan 17 6 tweets 3 min read
Introducing AlphaGeometry: an AI system that solves Olympiad geometry problems at a level approaching a human gold-medalist. 📐

It was trained solely on synthetic data and marks a breakthrough for AI in mathematical reasoning. 🧵 dpmd.ai/alphageometry
AlphaGeometry is a system made up of 2️⃣ parts:
🔵 A neural language model, which can predict useful geometry constructions to solve problems
🔵 A symbolic deduction engine, which uses logical rules to deduce conclusions

Both work together to find proofs for complex geometry theorems.Image
Jan 4 9 tweets 4 min read
How could robotics soon help us in our daily lives? 🤖

Today, we’re announcing a suite of research advances that enable robots to make decisions faster as well as better understand and navigate their environments.

Here's a snapshot of the work. 🧵 dpmd.ai/advanced-robot…
To produce truly capable robots, two fundamental challenges must be addressed:
🔘 Improving their ability to generalize their behavior to novel situations
🔘 Boosting their decision-making speed

We deliver critical improvements in both areas. ↓ dpmd.ai/advanced-robot…
Dec 14, 2023 6 tweets 3 min read
Introducing FunSearch in @Nature: a method using large language models to search for new solutions in mathematics & computer science. 🔍

It pairs the creativity of an LLM with an automated evaluator to guard against hallucinations and incorrect ideas. 🧵 dpmd.ai/x-funsearch
🔎 FunSearch uses an evolutionary approach to find the “fittest” ideas, which are expressed as computer programs to be run and evaluated automatically.

An iterative procedure allows the LLM to suggest improvements to programs while the evaluator discards bad ones. Image
Dec 6, 2023 6 tweets 3 min read
We’re excited to announce 𝗚𝗲𝗺𝗶𝗻𝗶: @Google’s largest and most capable AI model.

Built to be natively multimodal, it can understand and operate across text, code, audio, image and video - and achieves state-of-the-art performance across many tasks. 🧵 dpmd.ai/announcing-gem…
We’ve optimized Gemini 1.0 for three different sizes, meaning it can run on everything from data centers to mobile phones. 🔨

1️⃣ Ultra: our largest one for highly complex tasks
2️⃣ Pro: our best one for scaling across many tasks
3️⃣ Nano: our most efficient one for devices
Nov 29, 2023 6 tweets 3 min read
Introducing GNoME: an AI tool that helped discover 2.2 million new crystals. 💎

Crystals are found in everything from the chips powering our phones to solar cells creating clean energy.

The model also better predicts the stability of new materials. 🧵 dpmd.ai/GNoME-AI
Graph Network for Materials Exploration (GNoME) was trained using ‘active learning’: a technique to scale up a model first trained on a small, specialized dataset. 📈

Developers can then introduce new targets, allowing machine learning to label new data with human assistance. Image
Jul 24, 2023 4 tweets 2 min read
Meet the Google DeepMind team at #ICML2023! 👋

We’ll be presenting new research, supporting workshops with partners and hosting a range of demos.

Here’s a snapshot of the work you can hear about today at booth #109. 🧵 https://t.co/rkF1rl2vmDdpmd.ai/473bmKd
Image 🧬 Our AI tool #AlphaFold cracked one of the biggest challenges in biology: predicting how proteins fold.

Over a million researchers are now using it to accelerate progress toward new discoveries.

Chat to the team behind the breakthrough at 10:30 HST. 📍 #ICML2023 Image
Jun 7, 2023 7 tweets 5 min read
As society becomes more digital, it’s critical to improve the code powering the world's computing.

Today in @Nature, we present AlphaDev, an AI system using reinforcement learning to discover enhanced computer science algorithms.

How does it work? 🧵 dpmd.ai/alphadev-tw 📁 AlphaDev uncovered new and improved algorithms for 𝘀𝗼𝗿𝘁𝗶𝗻𝗴, a method for ordering data.

Billions benefit from this everyday without realising it.

These underpin everything from ranking social media to how information is processed on devices. ⬇️ dpmd.ai/3OThC0G Image
May 25, 2023 6 tweets 6 min read
With more powerful AI systems comes more responsibility to identify novel capabilities in models. 🔍

Our new research looks at evaluating future 𝘦𝘹𝘵𝘳𝘦𝘮𝘦 risks, which may cause harm through misuse or misalignment.

Here’s a snapshot of the work. 🧵 dpmd.ai/novel-ai-risks Under our framework, AI developers could use evaluation to uncover:

🔵 To what extent a model has certain ‘dangerous capabilities’ that could be used to threaten security, exert influence, or evade oversight
🔵 Whether it's prone to applying these to cause harm. ⬇️ Image
Dec 9, 2022 4 tweets 4 min read
Introducing Dramatron, a new tool for writers to co-write theatre and film scripts with a language model. 🎭

Dramatron can interactively co-create new stories complete with title, characters, location descriptions and dialogue.

Try it yourself now: dpmd.ai/dramatron-gith… ✏️ We interviewed 15 industry experts including playwrights, screenwriters and actors who produced work using Dramatron.

Canadian company @TheatreSports edited co-written theatre scripts and performed them on stage in Plays By Bots to positive reviews. dpmd.ai/dramatron-tw
Dec 8, 2022 8 tweets 7 min read
In @ScienceMagazine, we present #AlphaCode - the first AI system to write computer programs at a human level in competitions.

It placed in the top 54% of participants in coding contests by solving new and complex problems.

How does it work? 🧵 dpmd.ai/alphacode-scie… 🔵 Previous AI systems don’t have the problem-solving skills needed to excel at coding competitions.

By combining advances in large-scale transformer models with large-scale sampling and filtering, #AlphaCode made significant progress in this field: dpmd.ai/alphacode-scie…
Dec 8, 2022 4 tweets 4 min read
Introducing a generalist neural algorithmic learner, capable of carrying out 30 different reasoning tasks, with a 𝘴𝘪𝘯𝘨𝘭𝘦 graph network.

These include:
🔵 Sorting
🔵 Shortest paths
🔵 String matching
🔵 Convex hull finding

And more: dpmd.ai/3FC1FqA What makes this the first-of-its-kind? 🤔

Similar to Gato, an AI agent capable of many tasks such as language modelling and image captioning, this model covers a diverse set of algorithm domains, matching single-task specialists' power - and remaining robust out-of-distribution.
Dec 1, 2022 6 tweets 4 min read
Introducing DeepNash - the first AI to master Stratego, a game of hidden information which is more complex than chess, Go and poker.

Published in @ScienceMagazine, it uses a novel model-free reinforcement learning algorithm.

Here's how it works. 🧵 dpmd.ai/deepnash-tw 🧩 Stratego is a game of imperfect information: players can't directly observe their opponent's pieces.

This makes it hard for other AI-based systems to go beyond amateur level. It also means that a successful technique called “game tree search” is not sufficiently scalable. Image
Oct 20, 2022 4 tweets 3 min read
From helping transform the way we can predict wind power output to improving the performance of Document AI and giving wider access to #AlphaFold, we’re proud to partner with @GoogleCloud to bring our AI research into the real world.

Here’s how. 🧵 1️⃣ Industries aiming to use AI to read documents need lots of training data, which can be hard to find.

We helped develop machine learning models that need 50% less data to parse utility bills and purchase orders for @GoogleCloud Document AI users.
Jul 14, 2022 4 tweets 3 min read
Working together with @YouTube’s product and engineering teams, we've helped optimise the decision-making processes that increase safety, decrease latency, and enhance the viewer, creator, and advertiser experience for all.

How? A 🧵...

dpmd.ai/dm-youtube 1/ Our team developed a label quality model that helps label videos with greater precision according to @YouTube’s ad friendly guidelines, improving how videos are identified and classified. 2/
Apr 21, 2022 5 tweets 3 min read
Recently the DeepMind Jax Ecosystem was joined by four new libraries: Mctx, KFAC-JAX, DM_AUX, and TF2JAX. See the thread 🧵 for more detail.

We hope that this fosters new research and applications in the ML community! 1/ Mctx provides AlphaZero and MuZero Monte Carlo tree search: dpmd.ai/mctx

Work by @fabiointheuk, Ivo Danihelka, @matteohessel, and @laurentsifre, with support from many others. 2/
Mar 9, 2022 7 tweets 5 min read
Congratulations to @demishassabis, John Jumper, and David Baker who will be awarded the Wiley Foundation 20th annual Wiley Prize in Biomedical Sciences on April 1: dpmd.ai/Wiley-Prize 🧵 1/7 Demis and John accept the award on behalf of the @DeepMind team who worked on #AlphaFold, which was recognised as a solution to the “protein folding problem” at CASP14 in Nov 2020: dpmd.ai/casp14_blog 2/7
Sep 29, 2021 4 tweets 2 min read
From packing an umbrella to preparing for extreme conditions, predicting short term weather patterns is crucial for daily life.

New research with the @metoffice and SOTA model advances the science of Precipitation Nowcasting - the prediction of rain: dpmd.ai/nowcasting 1/4 Today’s weather systems provide planet-scale predictions several days ahead, but often struggle to generate high-resolution predictions for short lead times. Nowcasting fills this performance gap, with predictions on rainfall within the next 1-2 hours. 2/4
Sep 9, 2021 10 tweets 9 min read
Introducing the '21 DeepMind x @ai_ucl Reinforcement Learning Lecture Series, a comprehensive introduction to modern RL.

Follow along with our researchers are they explore Markov Decision Processes, sample-based learning algorithms & much more: dpmd.ai/2021RLseries 1/2 Image Also find the full series via the DeepMind @YouTube channel: dpmd.ai/DeepMindxUCL21