Refacer - Painting to Realistic (and Vice-Versa) in ComfyUI

Faces. Most of us have at least 1, and they're great fun to play with. This AI stuff seems to be zooming ahead really quickly, so I figured why not put a bunch of face things together, both old and new, and see how quickly it can generate? Thus, Refacer was born. Powered by SDXL, you can pop in any face and change it to whatever style takes your fancy! Realistic to anime, painting to realistic, cartoon to pixel art - it's all down to your choice of prompt and model :)

Want to support the channel?

GitHub:

== Even More Info! ==

[nerdbg]

You're slowly making your way onto my top 5 YTbers list :)

[Skydamhoezee]

Lots of fun bringing Dutch heroes to life from paintings! Good results with the StockPhoto model, but even better with JuggernautXL.

[JonMurray]

Totally and utterly lost but very interested hahah! New subscriber ✌🏻

[chrisgreenwell]

Great stuff, thank you :) I am looking for workflow that will take a face from image (a) and put it into image (b) with no prompting and keep all the facial details from (a).

[Hazzehh]

Can't believe Newton had grey hair at 30

[runebinder]

Really cool, although if I try an image with 2 faces changes the index sticks with the face on the left and doesn't swap to the other person on the right.

[suthamchindaudom]

I really like this workflow. You are awesome.
Is there a way comfyui can convert a realistic portrait photo to a painterly photo or watercolor, or anime without distort facial features of a person? Could you build such a workflow please?

[ponponych]

Лучше использовать IPadapter модель unnorm. Прям с силой 1.0. Копируется только лицо, а картинка рисуется по промту.

[PeteJohnson]

I'm struggling to work out what the CLIP Model is, where to find it/place it. can anyone assist please? 🙂

[alexgilseg]

This is hellacool! However I'm struggling using the workflow to reverse the process.. How did you use this to turn photo into painting ?

[Beauty.and.FashionPhotographer]

SIMILARIZE would be holy grail comfyui Workflow now, after the REFACER has made photos from a painting. A cool challenge, where your Newton Photo would be made looking more like the painting of NEWTON you used, so a forcing of facial features towards the original painting sort of thing? .... not sure if this is even remotely possible....

[hugoleote]

I managed to make this work. You need the following custom nodes:

cg-use-everywhere
comfyui-art-venture
ComfyUI-AutoCropFaces
ComfyUI_IPAdapter_plus
ComfyUI-PhotoMaker-Plus
ComfyUI_TGate

And the Clip_Vision must be

Great work!

[thebonuslvl]

very nice tx, u seemed to mention that this refacer goes the other way as well (making real faces into paintings, cartoons etc) yet whatever i write in the prompt, neg or change weight it tries to make it a realistic photo image.. any idea on what im doing wrong cos this looks like a very powerful tool i'd just prefer it the other way round?

[francaleu]

Hi Nerdy Rodent, Thank you.. Is it possible to do the same no speciphic to faces? I mean full body or pictures without humans?

[flyingdogsoft]

Amazing examples! So license is fine and not so terrible limited as Face-ID?

[arri]

Node type not found "IPAdapterAdvanced". The manager can't seem to fix this missing node. How can I install this?

[randomprocess]

is this workflow available on your patreon?

[edmondyang]

Error occurred when executing LoraLoaderModelOnly:

Error while deserializing header: HeaderTooLarge

I am getting this on the LORA loader :( any tips?

[davidrosbo]

Is there an option to do this in Forge? On an rtx4060 comfy would take 2 mins per image whereas forge does it in 10 seconds.

[azmodel]

I'm sorry, I'm very lost... I go to the repository I found a PNG file and that's it... I tried to replicate it manually on ComfyUI but I'm missing several nodes... So, is there any place in the repository where I can grab everything I need?