ComfyUI: Step-by-Step Guide to Creating Creative Videos Series 1: 'Magic Arms'

Recently, I came across a very interesting video where the arm in the frame changes its texture based on what it touches—sometimes it becomes spiky cactus, other times it turns into intricately layered pinecones, and occasionally it resembles LEGO bricks. The creator claims to have achieved this using ComfyUI in conjunction with AE and other post-production tools. I found it fascinating and decided to take on the challenge to see what can be achieved solely with ComfyUI.

I recorded a real-life video and used ComfyUI tools such as AnimateDiff, SegmentAnything, Detailer, IPAdapter, ControlNet, etc., to achieve the "touch to transform" effect. I must say, I'm quite satisfied with the quality of the final product!

In this video, I will share with you the detailed steps of how I set up the workflow, taking you through the magic transformation.

Workflow:

Custom Nodes Used:

[Mohdimranreturns]

Awesome video can we replicate this with clothes ? Like an model walking and it changes different clothes items?

[canibalcorps]

great video ! How can i have this sheep on the board at the beginning ? i love it !

[Ai_mayyit]

i got error in iimg to mask workflow can you help me to get raid of iit

[walidflux]

how can i get the images from depth to run them on the completed workflow?