You Need This Hack To Get Consistent AI Video Using Stable Diffusion Controlnet and EBsynth | Part 1

Video consistency in stable diffusion can be optimized when using control net and EBsynth. In this tutorial, I'll share two awesome tricks Tokyojap taught me and introduce a free generator for creating a grid from your images.

It's a crucial step to achieve flicker free and consistent AI animation. Tokyojap uses the text2img tab instead of the img2img tab in stable diffusion, which allows for incredible style transfer in high resolution quality.

He calls it the temporal consistency method. It's the best flickerfree AI video technique I've come across in 2023, made possible with stablediffusion, controlnet, and EBsynth. Get ready to take your videos to the next level with these powerful tools!

0:00 Introducing Tokyojab's 2 hacks
0:38 Showcasing Tokyojab's videos
2:30 Start Tutorial
3:36 Export video into img sequence
5:25 Making the grid from 4 images on Sprite sheet packer website
6:17 Settings in Stable diffusion and Control net
7:48 The VAE (variational auto encoder) + the installation
8:39 Prompting in Stable Diffusion
10:17 Cutting the grid into 4 images with ezgif sprite sheet cutter
11:01 Create the images in EBsynth
11:57 Stitching the images together in davinci resolve 18
13:03 What is in the 2nd Tutorial

Links:
-Tokyojab Reddit post:
The 3 civit ai models:
-Art & Eros
-Realistic-vision-v12
-Cine Diffusion
-Pexels girl
Installing the vae model, on the  hugging face website
Sebastian Kamph's Installation of Stable diffusion automatic 1111 webui
Creating the grid and cutting it:
Rundiffusion
EBsynth Free Software

DISCLAIMER: No copyright is claimed in this video and to the extent that material may appear to be infringed, I assert that such alleged infringement is permissible under fair use principles. If you believe material has been used in an unauthorized manner, please contact the poster.

[digital_magic]

I want to APOLOGIZE for something. A friendly viewer of the above video reminded me of the following:
-In English, there is a HUGE difference between referring to a non-white person as "person of color" vs "colored person". "Person of color" (PoC) is the preferred terminology. "Colored person" is an extremely racist term popularized in pre-1970s America and is found extremely offensive in modern English-speaking culture.

I wasn't aware of that and i feel really bad that i used the word colored person :-( This wasn't intentional, I thought i was doing the right thing and in this way i wasn't discriminating anybody. If anybody who has watched this video feels discriminated by me then i am very sorry for that. I am not a racist at all, i worked on a school for migration children and i have good feelings to all people all over the world.

[PriNovaFX]

Take the automatic1111 stable diffusion roop extension for nearly perfect face swaps. This works also for grid images. All you have to do is to input into the control face option "0, 1, 2, 3" to face swap all four faces. This works great.
Thank you for this video

[infiniteshowrooms]

...yeah, we're going to need that part 2, asap.

Incredible!🎉

[Amazombe]

It's CRAZY stuff to stand out. Like and Subscribe. Thanks to you and the inventor!!!

[judymyers]

These AI tools are getting so crazy, that if you don't use them to your own advantage, you will be left so far behind everyone else. To be fair, it's really good for content creators (and even better if they use it along with Famester). Create some content, and make it go popular straight away, I like that.

[ElHongoVerde]

5:55 YAY! Seb is the best.
Amazing tutorial, mate. You got me.

[Fahnder]

Thank you!
It's also getting more obvious where the limits of AI imaging will be.

[GerardoValerio]

❤ whoa! Tokyojab is a genius! And you sir are amazing for breaking this down so easily to make! Thank you so much for sharing this knowledge 🙏

[DJHUNTERELDEBASTADOR]

Muchas gracias amigo por compartir estos conocimientos.. nuevo seguidor saludos desde Bolivia

[kritikusi-]

This is by far the best walkthrough guide I have come across. Good job my guy. Awesome content.

[PHATTrocadopelus]

This is amazing!! Looking forward to part 2!!

[tazlo]

*Netflix adaptations gonna got a next level*

[oriisking]

Amazing. I'll be waiting for the second one ❤

[ThomasLennon]

What a brilliant video, been following Tokyojab showcasing but the written guide wasn't as intuitive as the video. Looking forward to part 2!

[lincolnrenall]

looking forward to video 2 also...still experimenting with this method, got some OK result with 1 frame but a little tricky getting the 2x2 frames to diffuse without border changes...and still experimenting with amount of keyframes to avoid blurry interpolation between....but hey its an interesting approach looking forward to next video

[KaiKIsa]

i was with a deadly urge, i wished to animate while on seaart, thank you for the video, omg feels like that animation of the erosion bird

[YAHURDME]

Bless you and him for sharing this knowledge!

[planetmuskvlog]

I don’t know why people are having the Ai generate the background in every frame. Animators do not draw the background over and over. We have a BG plate the character animation is an overlay. Instant flicker-free

[Failed_Society_Real]

Your prpduction is fantastic
Im learning a lot from you 😌

[atdfilms]

Thank you for posting this breakdown of his workflow! Did you ever post part 2? Couldn't see it on your uploads etc? Thank you