Runway’s New Restyle Smashes AI Video!

Runway Gen-3 just dropped a GAME-CHANGING feature: Style Transfer for video! This lets you take the style of ANY image and apply it to your video's first frame, influencing the entire clip. We're diving deep into how it works, exploring its limitations, and uncovering some powerful workflows you can use RIGHT NOW. I'll show you how to combine Runway with Midjourney, Magnific AI, and even Runway's OWN incredible tools to achieve incredible results. Plus, I'll reveal Runway's secret weapon for PERFECT lip-sync and performance capture!

Key Features & Topics Covered:

Runway Gen-3 Alpha: The latest update and how to access it.
Style Transfer: A complete walkthrough of the new feature.
Midjourney Integration: Using Midjourney's "re-texture" for style creation.
Magnific AI: Leveraging Magnific's style reference capabilities.
Runway ACT-1: Combining style and transfer with performance capture.
Workflow Optimization: Tips and tricks for best results.
Limitations & Troubleshooting: Understanding the tool's current boundaries.
Creative Examples: From Twilight Zone to A Trip to the Moon and beyond!
Say Motion Integration.
Gen-1 vs Gen-3 Comparison

LINKS

00:00 - Intro: Runway Gen-3's Style Transfer Revolution!
00:24 - How Style Transfer Works in Gen-3 Alpha
00:54 - First Test: Twilight Zone Reimagined
01:44 - Midjourney Re-Texture Workflow
02:51 - Structure Transformation Setting Explained
03:20 - A Trip to the Moon in Steampunk Style
04:32 - Using Footage of Tuesday, and Magnific AI
05"01 - Magnific Style Transfer
05:40 - Results
06:24 - Fixing Lip Sync & Movement with ACT-1
06:44 - The Full ACT-1, Gen-3, and Midjourney WORKFLOW.
07:11 - Hubspot's New Claude Ebook
08:37 - What Not To Do (Hilarious Fail!)
09:22 - Experimenting with Say Motion
10:38 - Gen-1 vs. Gen-3: The Evolution of AI Video

Runway’s One Frame Style reference reminds me of what EbSynth could have become today if they had stayed in the game.

[KearnuPhoenix]

That application of ACT-1 really blows your mind and you pass the threshold of ACTUALLY WATCHABLE where you forget to stare at the tech and execution and simply are just watching the movie.

[bobhawkey]

Lol. I think we did this before - it's Burgess Meredith. Really cool stuff! Thanks for the overview.❤

[christophermoonlightproduction]

With your Say Motion approach, I'd put the 3D model into Viggle as a middle step and then use that output.

[Zoyous]

The "What Not to Do" output reminds me of the mixture of editing and practical effects from Michel Gondry's video for "Let Forever Be" by the Chemical Brothers. I appreciate you playing around with using these tools unintended ways for creative results!

[MindSnackBar]

With the right workflow, you could essentially take entire movies and restyle it to something else. Like turning the fast and the furious movie into an anime

[AdrianoBla-gl]

Hi Tim, what happens "on this table" is a typical blacksmith maneuver where several assistants take turns hammering on an anvil. I think the result of this surreal video was really cool.

[swle]

That part at 10:23, put it through viggle first then stylize the first frame > then put the entire thing into runway.

[echopeakbicycling]

I'm now looking forward to seeing a "The Cabinet of Dr. Caligari" remake.

[WayneDawkinsThePartyMan]

For me their strength is really Act one and the ability to add prompted background from a blank background image. Still you can have innocent words cause your Act one render to be rejected.

[SuzyTurner]

Seeing those last couple of videos, it's mind blowing to see how far it's come in just two years! 😯

[JayJayD]

Great video Tim - great update by Runway also. Soooo many good tools now - soooo much cost also :/ lol

[infinitemonkeys]

in a perfect world, this would be where the (don't hold your breath because it's been a while and going to be a while longer) video model from Midjourney should start.
As a wise person once said - what an amazing time to be alive (if you ignore everything going on in the world and just play with AI tools)

[WebStixx]

That Twilight episode makes so sad :( . One of my faves

[Apuat]

That Tuesday Magnific example was giving some strong 'Arcane', NPR (Non Photorealistic Rendering) vibes. Looked quite solid!

[BabylonBaller]

My Man Tim's now doing official "In video" sponsorships, lets gooo 🚀🚀

[TalentedKamarty]

Imagine where this tech will be by the end of the year 🤯🤯

[shadyendeavor]

This one definitely got the creative juices flowing. If only I had the monetary juices flowing...

[Shanghaimartin]

For all its flaws, I actually remember the day the earth stood still remake quite fondly :)

[mroberts]

Fascinating video as always! Just a quick note: around 2:40, it's Burgess Meredith, not Meredith Burgess