ComfyUI Architectural design plan workflow #comfyui #controlnet #ipadapter

ComfyUI interior design ControlNet IPadapter workflow

From an architectural design plan, up to endless design possibilities
you can upload an existing plan, prompt and examples and receive endless variations , adapted to the dimensions of the furniture and spaces you have created.

#comfyui #stablediffusion #ipadapter #controlnet #depthanything #img2img

Workflow:
*update Workflow Version (Compatible with Ip-adapter V2)

old version

DepthAnyThing demo:

DepthAnyThing Model

LineArt (and other ControlnNets) Model

WidStudio

[ysy]

very cool. So the first step is to use one of the available virtual decoration tools and then bring the basic decoration over to ComfyUI to generate multiple versions with different esthetics.

[vojtechpiroch]

Hi, thanks for the video. What type of lora are you using? My results are blurry, I think it's because I'm using the wrong lora. Thanks

[artiovisual]

😍Thank you very much for your video! Very good content, honestly shared. I have a question: Lora is important because I don't have Lora like yours. Thank you very much, Wish you all the best !

[mechanickun]

I downloaded the workflow you provided for me to run. I found and collected various necessary parts, but I couldn't find the of the error message. Do you know where I can get this file?

[aipamagica]

This is awesome. After loading the depthanything, i see it in load advanced controlnet model, but it doesn't show up in the aio aux preprocessor. Is something missing?

[mechanickun]

I started working after many attempts. In the saved value, only the Aio aux Perprocessor part did not work as set, so I set both work windows to none. The output image comes out well as the image in the inserted image and the image in the depth map, but the color does not apply. Is this related to the role of the Aio aux Perprocessor?

[pavangandhi]

Warning: Ran out of memory when regular VAE decoding, retrying with tiled VAE am getting this error what do I do?

[cirociro-wbbz]

I am not sure where to download deepanything preprocessor, just downloaded the model.

I got bug report below:


Error occurred when executing AIO_Preprocessor:

An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.

[salehkamel]

hi after installing Ip adapter i have everything but apply Ip adapter node what should i do i re install it but noting happened and i updated the comfy too

[jindongzhu]

Hello! Let me ask you: How to install Depth-Anything? Thanks！

[TheMondriam]

Thanks for the Tut. Everything works if I bypass the IP adapter groupnode. But If I activate it I get this:
Prompt outputs failed validation
IPAdapterModelLoader:
- Value not in list: ipadapter_file: not in []
CLIPVisionLoader:
- Value not in list: clip_name: 'model.safetensors' not in []
By the way I downloaded the 3 ip adapter files from hugging face and place them into the "d-webui-controlnet\models" folder
Any guidance will be appreciated.

[AbbaComunic.]

Error occurred when executing KSampler:

list index out of range

[zhiyuanli]

Hello, I download the workflow, and I also have a problem when running IPAdapter.

Error occurred when executing IPAdapterApply:

Error(s) in loading state_dict for Resampler:
size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]).

File "E:\05-Software\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)

File "E:\05-Software\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)

File "E:\05-Software\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))

File "E:\05-Software\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 769, in apply_ipadapter
self.ipadapter = IPAdapter(

File "E:\05-Software\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 369, in __init__

File "E:\05-Software\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 2152, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(

[kevinwang]

For some reason my ksample kept on throwing errors with this, even with the latest update?



mat1 and mat2 shapes cannot be multiplied (77x2048 and 768x320)

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))

File "D:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1344, in sample
return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)

File "D:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1314, in common_ksampler
samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,

File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack\modules\impact\sample_error_enhancer.py", line 22, in informative_sample
raise e
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack\modules\impact\sample_error_enhancer.py", line 9, in informative_sample
return original_sample(*args, **kwargs) # This code helps interpret error messages that occur within exceptions but does not have any impact on other operations.

File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control_reference.py", line 47, in refcn_sample
return orig_comfy_sample(model, *args, **kwargs)

[tvandang]

i have this error when running it. can you assist? Thank you.

Error occurred when executing IPAdapterApply:

'NoneType' object has no attribute 'patcher'

File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)

File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)

File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))

File "C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 751, in apply_ipadapter
clip_embed = encode_image_masked(clip_vision, image, clip_vision_mask)

File "C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 270, in encode_image_masked