From sketch to 2D to 3D in real time! - Stable Diffusion Experimental

Game ready assets, both 2D and 3D? In real time? From simple sketches?
Well, it depends on your definition of "game ready" I guess. In this episode of Stable Diffusion Experimental, we'll set up a workflow to turn your sketches into 2D illustrations and 3D meshes for your games.

In every Stable Diffusion Experimental video, we will look at new tools that are not quite production ready yet, but are still interesting and exciting enough to warrant further inspection.

Resources needed:

Models:

Timestamps:
00:00 - Intro
00:31 - Workflow Overview
02:12 - Setting up the 2D workflow
11:05 - Testing the 2D workflow
14:30 - Setting up the 3D workflow
19:03 - Testing the 3D workflow
20:23 - Testing everything in real time
22:57 - Expanding the workflow
24:26 - Outro

#stablediffusion #stablediffusiontutorial #ai #generativeai #generativeart #comfyui #comfyuitutorial #sdxllightning #triposr #3d #2d #illustration #render #risunobushi_ai #sdxl #sd #risunobushi #andreabaioni

[shshsh-zyqq]

you are the best. the workflow is so unique and your explanation is so good. I love each time you explain why we need a node to be connected. By learning it, I could improvise the workflow since I know which node is for what. thank you so much!.

[jaoltr]

🔥Great content and video. Thanks for the detailed information!

[Crovea]

Very exciting stuff, thanks for sharing!

[prodmas]

You don't need the lightning Lora with a lightning model. It's only used for the non-lightning models.

[LarryJamesWulfDesign]

Awesome stuff!
Thanks for the detailed walk through.

[shape]

Great content! Love the way you explain everything.

[JavierCamacho]

Dude!! You are awesome!!! Thanks for the amount of time and effort you put into this.
Is it possible to use SD to add more details to the 3d texture after you have a "good" 3d model? For example, rotate the model and then generate some extra texture?

[ЕкатеринаЧудинова-эш]

Hi! Thank you for a great tutorial! Unfortunately, my TripoSR Viewer is stucked instantly on Loading scene mode. Do you know how to fix that, please?

[---Nikita--]

more tuts for generating 3d models pls

[placebo_yue]

Sadly tripoSR is broken now. Do you have any solution to that bro? Nobody can give me answers or help so far :(

[Gounesh]

Is there a way to retexture with higher res images?

[bkdjart]

Nice tutorial. Would you get faster inference using a lcm model? Also the official tripo website service has a refine feature and it looks great! Do you know if that feature is available in comfyui?

[remaztered]

So great video! But I have a problem with RemBG node - how can I install this node?

[voxyloids]

Always confused by scetch node because I use sketch book pro and then cntr+v ....

[Luca-fbsq]

How to export the 3D mesh generated by Triposr and attach textures, is this possible?

[kalyanwired]

this is awesome. How do you save the model as fbx/obj to use in blender ?

[Darkfredor]

hello, for me, on the linux mint, the nodes import failled...:(

[ValleStutz]

Is it anyhow possible to set the output directory?
And what about the image textures in the obj?

[miayoung]

when I select auto Q and hit prompt once, then my comfyUI start prompting constantly even if i didn't change anything, why is that?

[mechanicalmonk]

Have another neural net generate the starting sketch from the 2D image