Relight anything with IC-Light in Stable Diffusion - SD Experimental

Relighting has always been a weakness of any Stable Diffusion workflow, until now!

In this Stable Diffusion Experimental episode, we'll take a look at a new node suite that is both exciting and really close to being production ready, IC Light.

Workflows:

IC-Light (github):

Models:

Timestamps:
00:00 - Intro
01:07 - IC-Light overview
02:09 - IC-Light github and models
03:49 - Workflow 1: Relight with Mask as Light Source
11:16 - Workflow 2: Relight with Background as Light Source
15:14 - Workflow 3: Relight Product Shots
16:17 - Final considerations and Outro

#stablediffusion #ic-light #iclight #stablediffusiontutorial #relight #ai #generativeai #generativeart #comfyui #comfyuitutorial #risunobushi_ai #sdxl #sd #risunobushi #andreabaioni

[aysenkocakabak]

great, I learned a lot. I feel so good about it :)

[JohanAlfort]

Nice insight to this new workflow, super helpful as usual :) This opens up a whole lot of possibility! Thanks and keep it up.

[xxab-ygzs]

Those videos are great, please keep them coming up. Im totally new to SD and Comfy, you actually make me believe it can be used in a professional, productive way.

[UnclePapi_]

Andrea, I really enjoyed your live stream and your interaction with those of us who were with you. However, this follow up on the node, the technical aspects, and your insight as a photographer is Outstanding. Excellent work!

[aynrandom]

Thank you for explaining the actual workflow and the function of every node. I also like the mask editor trick. Just wondering why some of my images also changed after the lighting is applied? Sometimes there are minimal changes with the eyes, face etc

[KeenHendrikse]

Thank you for this video, it was really helpful. There are a few undefined nodes with the workflow, do u have any advice as to how I can fix this?

[zeeyannosse]

BRAVO ! thanks for sharing!. super interesting development !

[uzouzoigwe]

Well explained and super useful for image composition. I expect that a small hurdle might be when it comes to reflective/shiny objects...

[Architectureg]

how to make sure the input picture doesn't change in the output? it seems to change how can i keep it exaclty and just manipulate thelight instead?

[denchxu]

Given groups=1, weight of size [320, 4, 3, 3], expected input[2, 8, 90, 160] to have 4 channels, but got 8 channels instead

What's going on? It could still be used normally before.

[houseofcontent]

This is a great video! Thanks for sharing the info.

[PierreGrenet-tytc]

This is a great tutorial, thank you ! ...but how to use ic light with sd web UI. I have just installed it but it doesn't appear anywhere 😒😒 could help ?

[caseyj]

Yeah we know... just waiting this for 😅

[dreaminspirer]

I would SEG her out from the close up. then draft composite her on the BG. This probably reduces the color cast :)

[mohammednasr]

hi dear Andrea Baioni
I am very interested in mastering Comfy UI and was wondering if you could recommend any courses or resources for learning it. I would be very grateful for your advice

[JavierCamacho]

Sorry to bother you, I'm stuck in comfyui. I need to add AI people to my real images. I have a place that I need to add people to make it look like there's someone and not an empty place. I've look around but I came up short. Can you point me to the right direction?

[cycoboodah]

The product I'm relighting changes drastically. It basicaly keeps the shape but introduces too much of latent noise. I'm using your workflow without touching anything but I'm getting a very different results.

[QuickQuizQQ]

Super useful in a product industry.quick quiestion please:
got prompt
Failed to validate prompt for output 243:
* CheckpointLoaderSimple 82:
- Value not in list: ckpt_name: not in
* ControlNetLoader 215:
- Value not in list: control_net_name: 'control_sd15_depth.pth' not in []
* ControlNetLoader 316:
- Value not in list: control_net_name: not in []
* ImageResize+ 53:
- Value not in list: method: 'False' not in ['stretch', 'keep proportion', 'fill / crop', 'pad']
Output will be ignored
Failed to validate prompt for output 269:
* CheckpointLoaderSimple 2:
- Value not in list: ckpt_name: not in
* LoadAndApplyICLightUnet 37:
- Value not in list: model_path: 'iclight_sd15_fc.safetensors' not in []
Output will be ignored
Failed to validate prompt for output 291:
Output will be ignored
Failed to validate prompt for output 220:
Output will be ignored
Failed to validate prompt for output 76:
Output will be ignored
Failed to validate prompt for output 270:
Output will be ignored
Failed to validate prompt for output 306:
Output will be ignored
Failed to validate prompt for output 212:
Output will be ignored
Failed to validate prompt for output 225:
Output will be ignored
Failed to validate prompt for output 230:
Output will be ignored
im getting this error and i think reason is i didnt install ic-light model..i already installed it and should i install controlnet model too?
Thank you

[yangchen-zdzl]

Hello, I am a ComfyUI beginner. When I used your workflow, I found that the light and shadow cannot be previewed in real time, and when the light and shadow are regenerated to the previously generated photo, the generation will be very slow, and the system will report an error: WARNING SHAPE MISMATCH WEIGHT NOT MERGED torch.Size([320, 8, 3, 3]) != torch.Size([320, 4, 3, 3])

[syducchannel]

Can you guide me how to use Ic - light in Google Colab?