Runway Gen-3: BIG Breakthrough for Narrative Filmmakers

The thumbnail isn't clickbait, I really mean this. Whilst exploring Runway's AI Video tutorials I ended up discovering three, incredibly important breakthrough's for achieving realistic, authentic "Over the shoulder" style conversation shots. This kind of shot is a fundamental building block for narrative filmmakers, but AI seems to relentlessly struggle to recreate it successfully. This video features my workaround discoveries for getting fantastic, authentic over-shoulder conversation shots.

0:00 Coming up... and Intro
0:14 The problem with "Over the shoulder" shots
1:53 Adding the word "Conversation" in the prompt
2:26 Tackling eye control in "over the shoulder" shots
3:01 Testing the theory in Runway Gen-3 and discovering speed control
4:48 Testing Gen-3 Lip Sync
5:48 Is it possible to prompt mouth movements for specific words?
6:09 What next for AI character dialogue control?

******************************
******************************

Facebook Group for Writers and AI Filmmakers to Connect and Collaborate:
"AI Filmmakers and Creative Writers: Network and Connect"

******************************
******************************

***** BUY MY BOOK!!!! *****
If you feel like charming your way into the hearts of the women in your life (wife, GF, mother, sisters, lovely cat lady next door who watches your house for you while you're away...)

Consider buying the eBook of my screenplay, "Telepathy SUCKS!"

I spent more than a decade laughing and crying (literally) whilst I wrote the screenplay, and it's the reason this entire channel exists.

or, you could really go to town and buy the paperback version:

******************************
******************************

AI Tools I Use
#midjourney
#aimidjourney
#midjourneycommunity
#leonardoai
#LTXstudio
#haiperai
#midjourneyai
#pikalabs
#RenderNet
#kaiberai
#Klingai
#domoai
#runwaygen2
#runwaygen
#pixverse
#Lensgo
#lumaai
#EMOai
#switchlight
#SyncLabs
#openai
#openaisora
#sora
#controlnet
#stablediffusion
#stablediffusionai

@KaiberAI
@domoaiofficial
@Pika_Labs
@RunwayML
@OpenAI
@LTX.Studio

AI Channels Worth Checking Out
#Curiousrefuge

AI Tags
#lipsync
#aifilmmaking
#musicvideo
#aimusicvideos
#aifilmmaking
#ai
#videotoaianimation
#artificialintelligence
#artificial_intelligence
#filmmaking

Screenwriting Links
#filmcourage
@filmcourage

[TheinterfaceTvSeries]

This is one of the best tutorials I've seen for generative AI video. You are correct in that there doesn't seem to be anyone with any narrative storytelling experience training these things. I caught hell trying to get and OTS shot from all of these models! You've seemed to have cracked the code. I've said several times, I'm not impressed that AI can create crazy surreal images, I need normal images. I don't need an Teddy bear and a cate wearing top hats eating noodles, I need a person walking into a room and sitting down at a table.

[navidhabibi]

what a magic This tutorial is fantastic for filmmakers. Please make more tutorial videos like this to make the videos more accurate and better, we need them

[NEURAMos]

I like AI video generation more and more. I think in 2 or 3 years each of us will be able to create incredible videos and share our creativity with others)

[HistoryViper]

Great Job! This is what makes your channel unique!

[shireensingh]

thanks for making this. I'm an aspiring filmmaker from INDIA and your videos cover a topic with such nuance and the right questions. always looking forward to the content made by you

[Interdimensionaltravelagent]

Older the shoulder with truly consistent characters would be a game changer.

[kiro]

This is very helpful information, love your channel! Thanks for sharing what you are testing and discovering on Runway gen 3 alpha

[awakejakeproduction]

*Wow, thank you for sharing this technique! I'll definitely be giving this method a try 🤗😏*

[magiccosplayuniverse]

Great video! I need to try this with our Ai vids!

[micbab-vgmu]

It is difficult to learn gen3 if for 35$ you have only 22 videos :)

[prod.dailydailydaily]

the new gen 3 is wild I also used it on my photos. just wild!

[miketemple]

Keep writing your story folks. By the time you’re done, AI might be ready. This is exciting!

[AdamReese-wlfz]

This is why im not starting official production of my movie series yet. Im waiting fot the tools to advance from their current state and thankfully... Weve seen good progress past few months. Its starting to kook promising

[TashaCaufield]

Exciting stuff, indeed! Great tips! 🎉

[cbnewham]

Congratulations! You've cracked a couple of things and pushed the tech a little further. Still a long way to go, but that's impressive. I haven't used things as extensively as you and was not aware of the lip synch capabilities - although only a couple of days ago I too tried writing text for a character to say... and like you, found it doesn't really work as yet

[Beyondflix]

uploading an image and soundfile at the same time would be a great leap forward already.. great video, let's make you the filmmaker at runway :)

[johndev]

These are really great tips, thank you! 🙂

[cbnewham]

BTW, perhaps keep a list or spreadsheet which details all of the things you want to be able to do (lip synch, camera position, consistent characters, etc) and indicate whether it's currently possible and which tech to use. That would be super useful if you ended each of your videos with the current update of the list.

[ai-aniverse]

Maybe i need to try again. Its been a bit frustrating for me. Interested to hear you input.

[MancaveMunchies]

I tried using Runway. While I liked the visual results, the cost per attempt was a bit daunting. Plus, I still haven't found a way to generate consistent characters needed to produce a movie with Runway. After dabbling with a half dozen AI video packages during the past couple of months, the two that I used to create 4 shorts are LTX Studio and Vidu. I use LTX to develop the characters and dialog, along with Vidu to provide some visual punch at a price that doesn't break the bank. While the results aren't yet perfect, at least I can tell a complete story that doesn't take weeks to craft.