Post

How to get URL link on X (Twitter) App

On the Twitter thread, click on or icon on the bottom
Click again on or Share Via icon
Click on Copy Link to Tweet
Paste it above and click "Unroll Thread"!
More info at Twitter Help

Runway

@runwayml

Oct 22, 2024 • 7 tweets • 3 min read • Read on X

Scrolly

Introducing, Act-One. A new way to generate expressive character performances inside Gen-3 Alpha using a single driving video and character image. No motion capture or rigging required.

Learn more about Act-One below.

(1/7)

Act-One allows you to faithfully capture the essence of an actor's performance and transpose it to your generation. Where traditional pipelines for facial animation involve complex, multi-step workflows, Act-One works with a single driving video that can be shot on something as simple as a cell phone.

(2/7)

Without the need for motion-capture or character rigging, Act-One is able to translate the performance from a single input video across countless different character designs and in many different styles.

(3/7)

One of the models strengths is producing cinematic and realistic outputs across a robust number of camera angles and focal lengths. Allowing you generate emotional performances with previously impossible character depth opening new avenues for creative expression.

(4/7)

A single video of an actor is used to animate a generated character.

(5/7)

With Act-One, eye-lines, micro expressions, pacing and delivery are all faithfully represented in the final generated output.

(6/7)

Access to Act-One will begin gradually rolling out to users today and will soon be available to everyone.

To learn more, visit

(7/7)runwayml.com/research/intro…

• • •

Missing some Tweet in this thread? You can try to force a refresh

This Thread may be Removed Anytime!

Twitter may remove this content at anytime! Save it as PDF for later use!

More from @runwayml

Runway

@runwayml

Jan 17

Today we are releasing Frames. Our most advanced base model for image generation, offering unprecedented stylistic control and visual fidelity. Learn more below.

(1/10)

With Frames, you can begin to define worlds that represent your own artistic points of view. Styles, compositions, subject matter and more. Anything you can imagine, you can begin to bring to life with Frames.

(2/10)

(3/10)

Read 10 tweets

Runway

@runwayml

Dec 2, 2024

Today we’re sharing an early video keyframing prototype that treats creative exploration like a search process of all latent artistic possibilities. One which allows you to simultaneously navigate this vast space with both precise control as well as serendipitous nonlinear discovery.

(1/8)

Graph Structure: A Window in Latent Space

The Graph structure is the foundation of the prototype. Images are represented as nodes, serving as waypoints in the model's latent space. These nodes can be connected to other nodes to create an edge; a video that transitions from the first frame to the last frame across latent space and time.

(2/8)

Balancing Control and Serendipity

Precise controls help limit the vast space of possibilities, but at the same time, variation and unpredictability can result in "happy accidents"–possibilities that we would not have considered given precise control. To balance this tradeoff, we provide two affordances for users to manipulate images in a "relational" manner that allows unpredictability in consistent dimensions.

(3/8)

Read 8 tweets

Runway

@runwayml

Nov 25, 2024

Introducing Frames: An image generation model offering unprecedented stylistic control.

Frames is our newest foundation model for image generation, marking a big step forward in stylistic control and visual fidelity. With Frames, you can begin to architect worlds that represent very specific points of view and aesthetic characteristics.

See below for examples.

World 1089: Mise-en-scène

(1/11)

Frames allows you to design with precision the look, feel and atmosphere of the world you want to create.

World 3190: 1980s SFX Makeup

(2/11)

World 3204: 1970s Album Art

(3/11)

Read 11 tweets

Runway

@runwayml

Nov 22, 2024

Introducing, Expand Video.

This new feature allows you to transform videos into new aspect ratios by generating new areas around your input video. Expand Video has begun gradually rolling out and will soon be available to everyone.

See below for more examples and results.

(1/6)

Use Expand Video to help shape your story. Seamlessly extend your frame beyond its original boundaries while maintaining visual consistency to create stories with new compositions.

(2/6)

Expand into the unexpected with text prompts or guiding images.

(3/6)

Read 6 tweets

Runway

@runwayml

Nov 1, 2024

Advanced Camera Control is now available for Gen-3 Alpha Turbo. Choose both the direction and intensity of how you move through your scenes for even more intention in every shot.

(1/8)

Move horizontally while panning to arc around subjects.

(2/8)

Or, move horizontally while panning to explore locations.

(3/8)

Read 8 tweets

Runway

@runwayml

Aug 8, 2024

Explore adding GVFX to any footage you have. From shot on your phone to high quality cinematic action.

Learn how:

(1/7) academy.runwayml.com/gen3-alpha/gen…