Stable Diffusion resize to 24K?? Easy method + vram tips to get upscaling with Tiled VAE extension

preview_player
Показать описание
In this video I'm going to use Multidiffusion extension and UltraSharp upscaler for a very straightforward way to push high quality and high resolution in your images. I'll take an image from 512 x 768 to 16,384 x 24,576 and also provide some memory management tips to avoid out of memory errors when upscaling.

Items discussed in this video:

4x-UltraSharp upscaler:

Multidiffusion on Github (Available as an Automatic1111 extension, but the documentation here is worth reading)
Рекомендации по теме
Комментарии
Автор

It's the only upscale method that works for me. For some reason without Tiled Diffusion and Tile VAE the image won't go larger than 4k. It processes without error, but the size remains. Your method works.

TheSchwarzKater
Автор

Totally Underrated workflow for upscaling. Awesome video, has been working for me very well. Sometimes I have trouble choosing the right denoising strenght, but overall its a perfect preliminary way to upscale. I wish I could know more about the tiling (I'm not programming savvy), so that I can tweak and overclock it. Many would be greatful if you do a long form of upscaling techniques, and elaborate on the details in the settings - I'm sure the community would greatly appreciate it. Either way what you have brought is priceless

ga
Автор

Thankyou, been looking for how to upscale with tilled diffusion.

ps: if you're using control net with tile you can leave it empty since the control net will use your img2img image as an input

daffatahta
Автор

Thk. Going to try to push my 3060 12gb to do 12k.

deathcometh
Автор

Hi. I don't see the point, why you are using Controlnet here. When you activate Tiled VAE, you are losing details (I have rtx 3090, so I activate Tiled VAE only when need to upscale to 8k or more). Controlnet is for adding extra details (as creator of Tiled Diffusion says). But you put denoise in the lowest level, so there will be no extra details. So what is the point activate Controlnet ? And all in all I don't get the tile use of Controlnet as you already do that with Tiled VAE. If you want extra details, just add a little bit denoise and more sampling steps and you even don't need Controlnet. Controlnet just adds extra rendering time. Also 4k Ultrasharp adds some contrast, when sometimes you actually would like to avoid that. So I've noticed, that less contrast is being added when you uncheck Fast Encoder and Fast Decoder in Tiled VAE. It will add 1+ minute extra rendering time, but somehow I got less contrast. Don't know how it's connected, weird of course, but the result is better.

relaxation_ambience
Автор

Hi, if you don't mind me asking, what were your PC specs when you recorded this video? I was thinking of upgrading my PC to be able to do this as well as you did.

sefer-nvcn
Автор

With rtx4090 I was able to set Encoder tile size: 2400 (base was 512x512)
I'm using different upscaler:

pastuh
Автор

Awesome channel, keep up the great work!!!

cartoonminiboss
Автор

should make a video on forgeui explaining what tf everything means lmao especially hypertile integrated

lordsirmoist
Автор

Thank you for the tutorial. Please would you mind to share the link for original tutorial on reddit?

denisavozarova
Автор

Interesting workflow. An other Tutorial I watched by "Artificially Intelligent" used the Ultimate SD upschaler script in img2img to get to 8K
Using that method I get artifacting and new characters being generated in the 512x512 tiles.
That doesn't seem to be a problem here. ( denoising is low in both methods. )

Following this guide
I had to update the image in Controlnet, because I got an "ValueError: images do not match" error. otherwise. it wouldn't continue.
Thank you for the guide.

guinhill
Автор

Why don't you use the Extra Scale directly, what is the point of going through Img2Img first? Thank you for this video!

NicolasHinckxt
Автор

In your first upscale (the hires.fix one) you used 4x ultra sharp. Wouldn't it be better to use Latent for this first upscale? and then use the 4x ultra sharp in the img2img part?

gohan
Автор

Did you know you can change Automatic1111 to output .jpg files without any noticeable loss in quality but much reduced file sizes.

jibcot
Автор

So for SDXL you need different controlnet models

TheSchwarzKater
Автор

Do I have to change the image in contrlnet after upscaling, or can I only change the main image for upscaling?

Artazar
Автор

can you tell me pls. what lora is this <lora:long:0.7>

NyaMeeEain
Автор

when you are in img2img you do not need to place anything into controlnet, it grabs the image from above automatically

earthequalsmissingcurvesqu
Автор

Where did you get ESRGAN_4x? I can't find it anywhere😭

kam
Автор

I had 8gb ram, but today i increased it to 32 in the hope that i will be able to generate inage in high resolution and use deforuma because at big size my laptop do not genrate the image . But after that things have got even worse if i try to make a image of big size even of 1024×768 my laptop is straight up showing that blue resstaring screen with that sad pc image..what should i do..what are the actual factors that increase my speed and fix this problem I will sound like an absolute idiot...but was I supposed to increase my VRAM instead of RAM

harshitpruthi-gocd