Create convincing 3D Character Rotations using Controlnet and custom openpose images!

In this tutorial we use custom controlnet open pose images to render head poses we can use in a convincing 3d head & shoulders rotation animation. The technique can be used to create heads for rigging
head turns in Adobe Character Animator or used in a shot in your animations or just for fun to see your Stable Diffusion characters in a 3d-like animation.



📚 Resources mentioned in video:

Other relevant videos:

How to Create Controlnet Character Walk Cycles!

#cg
#3d
#adobe character animator
#head rigging
#3d platter rotation
#adobe mixamo
#character animation
#controlnet
#gamedevelopment
#stablediffusiontutorial
#unity
#stablediffusion
#aigeneratedart
#midjourney
#dalle2
#machinelearning
#ai

[BooooClips]

Now do this with an existing character or at least pose an existing character, it’s the last step before I can make my comic idea lol, we’re so close!

[dannieamme]

THIS!! is what I have been waiting for

[danielfischer]

You are on a real good path... better than many on youtube .... great job and keep going!!

[jasongv]

My man made sure to give her a big cake😂

[AIWarper]

I’d love to see your attempt at a run animation sprite sheet or some other 2D video game asset

[GES]

Can you make a tutorial for if you already have a face from straight forward, and need to apply it to the different-direction-facing heads? (Versus just using the +/- txt inputs to use "the same woman" creating a new face from the ground up)

[LaichuTV]

Bro thx for sharing :)
Would like to see some SD tutorials
Subscribed

[chariotsx]

I would love to do this with my original characters. I want to use custom characters, and then be able to pose my characters. I hope the AI will master all kinds of poses, so we can pose our characters alone, and also together with other characters. We also need to be able to combine characters & backgrounds. If we can do all of these things, then that will make it a lot easier to use AI to create comics.

[M.I.F..]

Nice! A little tricky technique, but well done! 👍🏻✌️

[FreestyleMovement]

awesome tutorial! i'm unsure on how to get openpose installed so it shows up in Webui.. can you explain or point me to a video?

[yasu]

wow i'm following alot of stable diffusion animation work flows but yours is so cool i know it is not considered an animation but you definitely have the skill and mastermind to do something great
I'm so excited to take a deep dive in your channel to see your work flows
I wish i can stop time by now cause i just can't keep up with all of that anymore :copium:

[Unstable_Stories]

Would it be possible to train the ai with just the first five images you got and then use it to get the other angles? Training the ai on things that exist already seems really good, but I am having trouble training the ai on a character that is made with ai if that makes sense. If anyone has any info on that lmk

[boi]

hey hitlab is it possible to do this with things that arent characters, for example a plant pot or headphones? thank you. :)

[杨健-yw]

You did a really cool thing, great job! I have successfully replicated it following your steps, but I want to customize and generate other poses. However, the results are not as good as yours. Can you tell me some tips on how you made those poses?

[TheAiConqueror]

does anyone know how i can upscale the faces individually on a character sheet but the faces look the same? Thanks very much

[phat]

What the tag Midjourney for? Didn’t see anything from midjourney in the video.

[huemanzu]

why just the top ortion not the bod rottion?

[toyourfun]

can you write prompts? + negative... thank you

[ph]

Why would you not be thorough enough to eliminate the bizarre extra fingers pointing out?! That's a huge disqualifier and sign of sloppy made videos that aren't sufficiently thought through.

[quantumneuralnetworking]

You'd be better off using those rotations

To generate profile images that you can use as projection maps in zbrush on the actual mesh of a true character