3D+ AI (Part 2) - Using ComfyUI and AnimateDiff

This is a multi part tutorial where I will be talking about how to use Blender without having to learn how to rig or model. We use Mixamo to get our models and animations and import them into Blender to render a video we could later run through an AI program like ComfyUI.

HOW TO SUPPORT MY CHANNEL
_________________________________________________________________________
SOCIAL MEDIA
________________________________________________________________________
My PC Specs
GPU: RTX 4090
CPU: 13th Gen Intel(R) Core(TM) i9-13900KF
MEMORY: CORSAIR VENGEANCE 64 GB

PDF file with all links to workflows and models:

0:00 Intro
0:50 Workflows
2:12 ComfyUI Parameters
6:11 ControlNets
7:24 Queue Prompt
9:31 LCM Setup
9:57 Lets Run an example

[hbddiug]

Please, don't stop! Great tuttorials!°

[PulpoPaul]

es realmente increible lo bueno que sos explicando y manjeando estas herramientas, gracias crack!

[gabesaltman]

THANK YOU for putting together all the resources in a clean document and thank you for a great workflow! One thing I noticed is that the iterative upscaler definitely adds details or extra elements to a render that may disrupt your original composition. The quality is fantastic but I'm wondering if there's a way to maintain quality upscale without adding extras?

[KuschArg]

Hi, this is great! Thanks for sharing :) Btw how can I put the wires straight lines in the workflow? I do really like that setting, looks more cleaner than the curve wires... Thanks!

[amkkart]

Hi i used your installation guide and set the base path to my A1111.. where do I drop the loras and embeddings and how to install the ip adapter? Love your videos thanks for your efforts to educate us

[mhfx]

Thank you for sharing this, I'm a 3d artist that's been waiting for ai to get to this point so I am super excited to try this out. I am curious about openpose --- is there no option to use an exported rig directly from your 3d software? You already have the camera and rig in blender, you should be able to export this info somehow so openpose doesn't have to guess with depth or soft edges and that would ideally solve the issue with it messing up which way the character is facing --- I'll investigate it own my own as well, but I'd figure I'd at least ask first

[drviolet]

Have you tried Ksampler RAVE? seems working pretty well, would be curious to hear if in this specific workflow it helps even more or nah

[moritzryser]

tysm! got everything working except on the last node group: FaceRestoreModelLoader & Upscale Model Loader, which 2 models do you recommend to install there so I can finalise my renders <3

[Truthseeker_]

where can i find and install the the LineartStandardPreprocessor node

ERROR: comfyui When loading the graph, the following node types were not found: LineartStandardPreprocessor Nodes that have failed to load will show as red on the graph.

FIX: If you stumble across this after already installing the preprocessor node just uninstall the node and reinstall and you will be fixed

[SapiensVirtus]

hi! beginners question. So if I run a software like ComfyUI locally, does that mean that all AI art, music, works that I generate will be free to use for commercial purposes?or am I violating terms of copyright? I am searching more info about this but I get confused, thanks in advance

[mVRxi]

Hi, I downloaded all the files from your PDF and when I try to generate some video i'm getting this error in the KSampler from the "Output" section:

AttributeError: type object 'GroupNorm' has no attribute 'forward_comfy_cast_weights'

Can somebody help to know what i'm doing wrong? :S

[alexebcy]

HELP PLS :/
all my video combine node are red :/

Failed to validate prompt for output 281:
* (prompt):
- Return type mismatch between linked nodes: frame_rate, INT != FLOAT
* VHS_VideoCombine 281

[planet_cs]

Any clue how to fix the frame rate issue? All nodes connected to the initial Frame Rate node have a red circle around the frame_rate input.

[armandadvar]

How did you create Comfy UI workflow? Where is it?

[futurediffusion]

why do you upload the info on mega T.T mega still loading forever and dont give me the file .

[emssdhk]

Anyone else getting crazy xformer errors? I can't get anything to go through no matter how many times and ways I disable it.

[hefland]

Hmm, I'm getting a purple outline on my ksampler, so it seems that everything before it seems to load and work well. Plus i bypassed everything after, such as Iterative Upscale, Face Detailer sections. I get these errors below. If I figure it out, I'll update a comment.
ERROR:root:!!! Exception during processing !!!
ERROR:root:Traceback (most recent call last):

[luisgregori]

The render take more than 30 minutes for me, i dont understand i have a rtx4060ti 16go

[tiberiuslawson]

The volume on your videos are very low compared to any other youtube video I watch. Just letting you know

[DimiArt]

i really really really hope you can get it to work with automatic1111! i love using automatic1111's UI.