Anime to REAL Life in Stable Diffusion - Tutorial // turn characters realistic

If you've ever wondered how to turn anime characters realistic, change anime face to real face, etc. - this step-by-step tutorial is for you! I'll share 3 ways to turn anime characters real using Stable Diffusion and Automatic1111. Let's have some fun! ^_^

🎥 Watch Next:

\\__ Articles __//

\\__ LINKS __//

\\__ TIMESTAMPS __//
00:00 - Intro
00:20 - Which model/ checkpoint to use
01:08 - Anime to Real: Loopback
02:35 - Anime to Real: Img2img
04:30 - Inpaint & Upscale
05:12 - Some won't work...
05:58 - Installing ControlNet tutorial
07:42 - Anime to Real: ControlNet

[FrozenMadLad]

I knew this was going to be a serious video as soon as I saw your checkpoint list, holy moly. I have like 6 and I feel overwhelmed 🤣

[pokepress]

A few months ago, I did something similar with screenshots from Pokémon Masters EX. I used the “Realistic Vision” model, as well as a custom embedding based on screenshots from the Detective Pikachu movie. Here are some things I learned:

-For “canny” and “soft edge” ControlNet operations, you may want to set the end point of the processing to .7-.9 so the filter doesn’t apply for the last few steps. This can sometimes help the rendering process remove some of the exaggerated features.
-When using both “canny” and “soft edge”, I set the weight of “canny” lower than “soft edge”
-When using the color preprocessor, I generally maxed out the resolution.

You can see the results in some videos I posted in April/May. If I do something like that again, I’ll be interested in trying some of the suggestions you made.

[geoffrey]

Thanks to share all these information! SD seems to me more and more complicated but you make it simple to understand.

[SLVSTRN]

Would you have more tips and tricks on this? I truly love what you've shown me here! I want to learn more from you!

[eladwarshawsky]

This is great info, I am planning to make a Avatar the Last Airbender go from anime to live-action end to end for at least an episode or two based on the original. I wish this stuff was less tedious tho.

[gantzstar]

Hi, I "believe" I followed your same exact steps using the same image, but my results are not the same as yours.

2 things I noticed:
I'm not using any preprocessors (because I cant find the tile and depth_midas preprocessors), but I am using the tile and depth models.

Also, for the 2-3 control modules, am I supposed to run all at once? For example, the 1st module is for depth, the 2nd module is for tile, and the 3rd module is for color?

[PRASADKULAL]

Awesome tutorial, thank you for the step by step guide👍

[manabananaz]

I want to thank you for the tutorial as its pretty good for the most part but I think there are some aspects you have glossed over that have left myself a bit confused. With the last method using control net and combining lets say depth and tile are you using the base anime pic for the next model or are you using the genned model as the new base, like for example; You put your base tanjiro anime picture for depth in unit 0, then once you gen it, are you putting the new genned image into unit 1 with the tile setting the enabled? or are you still using the base anime picture instead and then they mash up when you gen the final result? other than that I think its very good, a little to fast in some aspects but very very helpful. Thank you so much for the video!

[銭形-on]

nice to meet you. Thank you for the wonderful explanatory video. Even if the conditions are the same depending on the character, things may not go as well as you did. I think one possible point is that the prompts are different. Could you please share if possible?

[dreamscapeyoutube]

Better than live action lol. Btw my subscribers were just talking about you on my discord, they wanted to invite you in. And maybe in the future, we could colab on some video (like in the old YT days). Keep it up !

[mohdfantasia]

Hope you do a tutorial how to use this on draw things app.. it's stable diffusion on ipad but still I don't know how to use it well and it's kind of different from automatic1111

[Eumenez]

What is the purpose of using the tiled controlnet? what does it do?

[Featured-ys]

What is the name of the program please? 🌸

[ZuperMazterGames]

It is possible to do Anime to Realistic video? Can´t find anything online

[personmuc]

A lot of information are missing like what depth model you've used and such...

[stCk.]

hey hello i only find these 3 that end with pth and these are different from ur video even the size is smaller
ip-adapter_sd15.pth
ip-adapter_sd15_plus.pth
ip-adapter_xl.pth

[Thelanis]

how many tries does it take you until u get it perfect?

[AlexandreDinant-ft]

is it possible to turn anime video to real life realistic video?

[jack-alvin]

At this point I'm not sure if the voice is real or not