ComfyUI IPAdapter (SDXL/SD1.5): Create a Consistent AI Instagram Model

🎨 Dive into the world of IPAdapter with our latest video, as we explore how we can utilize it with SDXL/SD1.5 models and ControlNet using ComfyUI to get a Consistent AI Instagram Model! 🚀

Prerequisite

References

Model References

In today’s video, we showcase the power of IPAdapters from Tencent AI Labs. Watch as we explore the synergy of IP Adapters to seamlessly blend TEXT2IMG and IMG2IMG together with ControlNet and SDXL models, resulting in the creation of AI models with a remarkably consistent facial appearance and clothing.
We provide a detailed step by step tutorial to achieving AI models and Applications requiring uniformity where a standardized and consistent facial appearance is paramount, such as character design, digital storytelling, and beyond.

📈 Timestamps:
0:00 - Introduction
1:29 - Requirements
3:34 - Get Face
6:00 - Image Preprocessing
7:42 - IPAdapter Face
12:06 - IPAdapter Clothes
14:06 - ControlNet
15:50 - SD15
17:48 - Magic Poser
19:04 - Outro

My Hardware Specs
GPU: 24GB VRAM
RAM: 32GB
CPU: 24 Core

👍 If you're looking to level up your skills with ComfyUI or simply interested in the world of AI computer vision, don't miss out on this in-depth exploration! Hit that like button, subscribe for more content, and let us know your thoughts in the comments below.

[DataLeveling]

Dear all, due to the breaking changes in IPAdapter, some of the nodes used here are no longer available.
I have updated the workflow to include the changes accordingly and also made some small changes to the workflow.
Please download from the workflow link. Thank you!

[DataLeveling]

Dear all, I have made a mistake in understanding the attention mask element in the IPAdapter node. I thought it was used to increase the face weight but it was actually used for the positioning of the final output in the image.
You could omit the step of masking out the head of the model in the 'Image Preprocessing' step. As for the clothes, you should still keep it only if you want the final output region to be the same as that of the input image.

[clintslowik]

Just wanted to comment on how much I appreciate your step by step process and explanations through the video and your help in the comment section! It seems with a number of the other creators in the space they create walk throughs which assume you already know a lot of the necessary setup and steps that novices simply don't know. Keep up the great work!

[NiteSeek]

just gonna say it here, you know you spend to much time in comfyui when you keep trying to click drag the screen up
love your content this stuff is a massive help to get things working

[bioboi]

I cant do anything with IPAdapters, keep getting error after error and I've done everything, made sure models are in the right directory, made sure to use sdxl ipadapter models for sdxl models, there just seems to be nothing I can do; can anyone help. (Error while deserializing header: MetadataIncompleteBuffer)

[paulg]

Came from AI Jason, glad I did! Thanks for the great explanations.

[brandonc.]

I was stuck on how to use IPAdappter.. your video really helps me alot! keep up the good work. can't wait for your next drop

[astr]

So many good tips I couldn't keep up writing them all down ill be rewatching this for sure.

[manojkchauhan]

This tutorial is excellent! The instructions provided are crystal clear, and the thorough explanations render it effortlessly comprehensible. Your efforts are truly commendable! 👍

[moradsemmar]

hello i need help i cant find Prepare Image For InsightFace on confy interface

[RedawNLIVE]

Little bit upset i spent all day installing everything needed just to have errors thrown at me "assertion error this and assertion that.."
Also have scrolled through comments and realise that it won't replicate a face i have already created which is a bummer..
Great video dude, you've done well explaining everything and explaining it well. Very patient and precise tut.
Hopefully i can get this mess sorted out but for now i'll have to stick with fooocus.
Incredible job you've do for us. Thank you!

[christianberntsen]

Prepare Image For InsightFace is not there, and it looks quite different on my end.

[yorkewu]

I'm glad I found this video, very well explained on the IPadapter workflow. Subscribed to the channel.. btw, love the Singaporean accent :)

[ProzacgodAI]

I created a little workspace save state add-on for comfy UI. You can find it in the comfy UI manager. I called it multi-workspaces because that's what the original intent was, but as it sort of carried on, eventually just became save states. Still working on a concept for multiple work spaces, the idea would be maybe to make them work together and save in the same JSON blob.

You should go check it out.

[w.m]

When i type winter, cafe in the prompt, it only gives me a coffee shop but no human in it. Curious to know why it works in your case ? I'm on arm architecture (M2)

[IrrealKIM]

Thank you so much!! I have applied and it works perfectly!

[Paulo-utli]

Keep up the good work! Really nice videos! Would love to see a video about InstantID as well.

[zpapipoi]

why i dont have prepare image for insightface

[CornPMV]

Error occurred when executing IPAdapterTiled:
insightface model is required for FaceID models; -> Maybe because the IPAdapterTiled not does not have insightfacemodel docker like in the IPAdapter FaceID?

[juncando]

Thank You. Thank You. Thank You. Latent Vision brought me here.