Thread by @adcock_brett

OpenAI + Figure

conversations with humans, on end-to-end neural networks:

→ OpenAI is providing visual reasoning & language understanding
→ Figure's neural networks are delivering fast, low level, dexterous robot actions

(thread below)

Here's some background:

Two weeks ago, we announced Figure + OpenAI are joining forces to push the boundaries of robot learning

Together we are developing next generation AI models for our humanoid robots

It’s been 13 days & we're excited to share today's update

@OpenAI @Figure_robot The video is showing end-to-end neural networks

There is no teleop

Also, this was filmed at 1.0x speed and shot continuously

As you can see from the video, there’s been a dramatic speed-up of the robot, we are starting to approach human speed

@OpenAI @Figure_robot Figure’s onboard cameras feed into a large vision-language model (VLM) trained by OpenAI

Figure's neural nets also take images in at 10hz through cameras on the robot

The neural net is then outputting 24 degree of freedom actions at 200hz

@OpenAI @Figure_robot In addition to building leading AI, Figure has also vertically integrated basically everything

We have hardcore engineers designing:

- Motors
- Firmware
- Thermals
- Electronics
- Middleware OS
- Battery Systems
- Actuator Sensors
- Mechanical & Structures

@OpenAI @Figure_robot AI work shown here was led by @coreylynch and Toki Migimatsu, big congrats!

Our goal is to train a world model to operate humanoid robots at the billion-unit level. Follow our journey: @Figure_robot

We are scaling up our AI team, join us: figure.ai/careers