Google DeepMind Profile picture
Sep 9, 2021 10 tweets 9 min read Read on X
Introducing the '21 DeepMind x @ai_ucl Reinforcement Learning Lecture Series, a comprehensive introduction to modern RL.

Follow along with our researchers are they explore Markov Decision Processes, sample-based learning algorithms & much more: dpmd.ai/2021RLseries 1/2 Image
Also find the full series via the DeepMind @YouTube channel: dpmd.ai/DeepMindxUCL21
In the first lecture of the series, Research Scientist Hado introduces the course and explores the fascinating connection between reinforcement learning and artificial intelligence: dpmd.ai/RLseries1

#DeepMindxUCL @ai_ucl Image
In lecture two, Research Scientist Hado explains why it's important for learning agents to balance exploring and exploiting acquired knowledge at the same time: dpmd.ai/RLseries2

#DeepMindxUCL @ai_ucl Image
In the third lecture, Research Scientist Diana shows us how to solve MDPs with dynamic programming to extract accurate predictions and good control policies: dpmd.ai/RLseries3

#DeepMindxUCL @ai_ucl Image
In lecture four, Diana covers dynamic programming algorithms as contraction mappings, looking at when and how they converge to the right solutions: dpmd.ai/RLseries4

#DeepMindxUCL @ai_ucl Image
In this lecture, Hado explores model-free prediction and its relation to Monte Carlo and temporal difference algorithms: dpmd.ai/RLseries5

#DeepMindxUCL @ai_ucl Image
In part two of the model-free lecture, Hado explains how to use prediction algorithms for policy improvement, leading to algorithms - like Q-learning - that can learn good behaviour policies from sampled experience: dpmd.ai/RLseries6

#DeepMindxUCL @ai_ucl Image
In this lecture, Hado explains how to combine deep learning with reinforcement learning for deep reinforcement learning. He looks at the properties and difficulties that arise when combining function approximation with RL algorithms: dpmd.ai/RLseries7

#DeepMindxUCL @ai_ucl Image
In this lecture, Research Engineer Matteo explains how to learn and use models, including algorithms like Dyna and Monte-Carlo tree search (MCTS): dpmd.ai/RLseries8

#DeepMindxUCL @ai_ucl Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Google DeepMind

Google DeepMind Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @GoogleDeepMind

Oct 16
We’re announcing a research collaboration with @CFS_energy, one of the world’s leading nuclear fusion companies.

Together, we’re helping speed up the development of clean, safe, limitless fusion power with AI. ⚛️ Image
Fusion powers the sun, but here on Earth, one approach involves controlling a super-hot, ionized gas called plasma inside a tokamak machine.

To predict power generation, we need to simulate how heat, electric current and matter flow through the core of a plasma and interact with systems around it. This is where TORAX comes in.Image
TORAX is our open-source plasma simulator allowing CFS to run millions of virtual experiments to test plans for their tokamak, SPARC.

Using reinforcement learning, we’re now rapidly identifying the most efficient paths for it to generate more power than it consumes - a landmark achievement known as crossing "breakeven."
Read 5 tweets
Oct 15
Veo is getting a major upgrade. 🚀

We’re rolling out Veo 3.1, our updated video generation model, alongside improved creative controls for filmmakers, storytellers, and developers - many of them with audio. 🧵
🎥 Introducing Veo 3.1

It brings a deeper understanding of the narrative you want to tell, capturing textures that look and feel even more real, and improved image-to-video capabilities.

🖼️ Ingredients to video

Give multiple reference images with different people and objects, and watch how Veo integrates these into a fully-formed scene - complete with sound.
Read 6 tweets
Sep 18
We’re announcing a major advance in the study of fluid dynamics with AI 💧 in a joint paper with researchers from @BrownUniversity, @nyuniversity and @Stanford. Image
Equations to describe fluid motion - like airflow lifting an airplane wing or the swirling vortex of a hurricane - can sometimes "break," predicting impossible, infinite values.

These "singularities" are a huge mystery in mathematical physics.
We used a new AI-powered method to discover new families of unstable “singularities” across three different fluid equations.

A clear and unexpected pattern emerged: as the solutions become more unstable, one of the key properties falls very close to a straight line.

This suggests a new, underlying structure to these equations that was previously invisible.
Read 4 tweets
Sep 4
We’re helping to unlock the mysteries of the universe with AI. 🌌

Our novel Deep Loop Shaping method
published in @ScienceMagazine could help astronomers observe more events like collisions and mergers of black holes in greater detail, and gather more data about rare space phenomena. 🧵
Astronomers already know a lot about the smallest and largest black holes. ⚫

But we have limited data on intermediate-mass black holes, and the observatories we use to measure their gravitational waves need improved control, and expanded reach. ↓ goo.gle/47oalza
⚡This is where Deep Loop Shaping comes in.

Developed in collaboration with @LIGO Laser Interferometer Gravitational-Wave Observatory, @CalTech and the Gran Sasso Science Institute, it reduces noise and improves control in an observatory’s feedback system - helping stabilize components used for measuring gravitational waves.📸 Caltech/MIT/LIGO Lab
Read 8 tweets
Aug 26
Image generation with Gemini just got a bananas upgrade and is the new state-of-the-art image generation and editing model. 🤯

From photorealistic masterpieces to mind-bending fantasy worlds, you can now natively produce, edit and refine visuals with new levels of reasoning, control and creativity.

A quick dive into Gemini 2.5 Flash’s capabilities 🧵
🎯 Character consistency

Give the model reference images and it can produce new visuals that maintain a character, subject or object’s likeness across different poses, lighting, environments or styles - helping you create more compelling, narrative-driven work.Image
Image
Image
Image
🔄 Design application

Looking to apply a specific artistic style, design, or texture? 2.5 Flash can now easily transfer this from one image to another while preserving the previous subject's form and details.Image
Image
Image
Read 6 tweets
Jul 23
Our new state-of-the-art AI model Aeneas transforms how historians connect the past. 📜

Ancient inscriptions often lack context – it's like solving a puzzle with 90% of the pieces lost to time. It helps researchers interpret and situate inscriptions in their past context. 🧵
By transforming each ancient text into a unique historical fingerprint, Aeneas can identify similarities across 176,000 Latin inscriptions.

In our study, historians found these ‘parallels’ to be helpful research starting points 9 out of 10 times - improving their confidence by 44%.Image
We tested Aeneas on the Res Gestae Divi Augusti – one of the most debated inscriptions.

Without prior knowledge, it successfully mapped out the leading scholarly theories on its dating, showing how AI can help model history in a quantitative way. 📊 Image
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(