Become a Style Transfer Master with ComfyUI and IPAdapter

This time we are going to:
- Play with coloring books
- Turn a tiger into ice
- Apply a different style to an existing image

00:00 Intro
00:16 Sketch to Image
08:52 Replace objects and materials
12:41 Apply style to image
17:02 Negative image conditioning

[goodieshoes]

Watch tv? Nah. Play games? Nah. Tweak and generate with IP-adapter deep into the night, under the guidance of master Mateo : YES!!

[nicolasmarnic]

I love your videos, the amount of useful information you give (although it makes me dizzy to see the nodes), the tranquility of your voice and the charisma you exude.
Thank you very much for the workflows <3

[voxyloids]

Wow ! I'm messing with it all day and you upload a new masterpiece ! 😍 I even learning to draw all day yesterday . This is a great usage !

[swannschilling]

Thanks so much, just came back to Comfy and IP Adapters! This is amazing, thanks for taking the time! 😊

[FeyaElena]

Thank you so much for the detailed breakdowns of how IPadapter works. We are looking forward to new videos!

[aamird]

This is such a nice tutorial. Thank you for walking through IPA+Controlnet possibilities.

[anylatent]

What you talk about flows smoothly, and I gain a lot from it.thanks.

[konstabelpiksel]

the best thing about matteo is he always start with a fresh comfyui default setting, not some overwhelming spaghetti pre made nodes. makes it easy to understand the process and follow along. thanks matteo!!

[Grunacho]

Thank you for this amazing tutorial. I love to see my own drawings and styles come to life, and how quickly new things are created 🙂

[jorgeluismontoyasolis]

Mateo, you are amazing. Thank you so much!

[kademo]

Thx for the work, you're awesome

[godofdream]

its not about sketch, its about colour controls...many people want to make comic, but cant draw...with control-net, ipadapter and sd any one can draw anything... But colour control, for example dress color, home colour, overall multiscreen scene colour. that's the problem.

[rajibpaul]

all awesome stuffs, im trying to learn from you ...but here is this tiger example the network is broken at KSampler step, i have no clue why, is there any conflict between nodes due to comfyUI updates ? please help

[Avalon]

I'm missing the Plus high strength model, if I use the manager what model am I looking for??

[SuperCinemad]

Good workflow!!! but inpaint model call error ksampler, maybe you know how fix this?

[YoMeiOhMei]

Thank you for these amazing tools Matteo! I was wondering if maybe you have some tips on how to best transfer an art-style to a subject that the checkpoint has no knowledge of.
I have some 3D renders of creatures that I would like to turn into an illustration. So far sending the 3D render as the latent image and a style reference through ipadapter along with some style descriptions in the prompt was "ok". However unless I keep the denoise extremely low the features of the creatures (especially the faces) change drastically. I already tried turning the 3D render into lineart/depth, testing several controlnets...similar to what you did with the castle. Unfortunately nothing really did the trick. Either the design of the creatures changes or I get hardly any of the style into the picture.

[wlaznik]

Great tutorial! You're really doing a fantastic job! Thanks a lot! Just tell me, please, where can I find xl-lineart-fp.16 that you're using as a controlnet model?

[Drew_pew_pew_pew]

Does style transfer also work with sd 1.5 models?

[johnwhittaker-txpd]

I can't get anything except the error "mat1 and mat2 shapes cannot be multiplied". Even though I downloaded the models, put them in the correct directories and have everything named properly, the Load ControlNet Model nodes will not recognize them / allow me to choose them.

[alexliu-mitd]

How to use IPAdapter with Cos Stable Diffusion XL 1.0 Edit?