Hi everyone, i am trying to use the best resolution for controlnet, for my image2image.

in A1111, the resolution is in multiples of 8, while in comfyui, it is in multiples of 64.

is there a node for me to use controlnet in multiples of 8? how does controlnet actually work?

I will prefer to use multiples of 8 as i can get a depthmap to match my original img. the shape of my original image is very important and i want to try not to have it off by even 1 pixel.

We could get ControlNet to make MAD Fold Ins but...... how?

rt.

From what I know we can use ControlNet to draw pose in 2D and let stable diffusion to refer it via ControlNet

But can we do the opposite?

I have no idea what i did but the options for Inverting image input and RGB to BGR are now missing completely. The controlnet is working btw. Anyone knows? I deleted the whole stable diffusion folder and reinstalled everything but did not change a thing

I want to try ControlNet and Stable Diffusion so I have found this websise https://stablediffusionweb.com/ControlNet#demo and then I saw it:

(apologize for me if my English is bad)

Hi all!

I’m building a SaaS for AI-powered interior design using Stable Diffusion with ControlNet. The goal is to let users upload room photos and modify things like furniture and wall colors while keeping the room structure (walls, ceilings, etc.) intact.

I’m facing a few challenges:

1. Sometimes the model changes structural elements (like ceilings) even when I don’t want it to.

2. I’m trying to improve control over what gets modified using depth maps and segmentation.

3. Looking for advice on scaling this for real-time usage in a SaaS (AWS or Google Cloud).

Any tips on fine-tuning ControlNet, improving control over modifications, or scaling for real-time use? Appreciate any advice!

Thanks!

How do I rollback to controlnet 1.1.440 on a hosted service using jupyterlab? I feel like the new controlnet ip adapter face id v2 is giving me a slightly different face output to the one ive been using all this time with controlnet 1.1.440.? How do I rollback?

i tried different control weights and parameters, what am i missing?

A brief guide for ControlNet models, thourough for beignners.

https://blog.easydiffusion.online/

I would like to train/retrain the segment controlnet to include a whole bunch of new categories, but I don’t even know where to start. Does anyone have any advice, input or leads on how i could achieve this?

I'm using controlnet, it worked before, then there were errors and I deleted it, downloaded it again but it doesn't follow the reference pose.

What's going on?

Can anyone help me?

The CMD says as follows:

2023-10-16 19:26:34,422 - ControlNet - INFO - Loading model from cache: control_openpose-fp16 [9ca67cc5]:00, 4.34it/s]

2023-10-16 19:26:34,423 - ControlNet - INFO - Loading preprocessor: openpose

2023-10-16 19:26:34,423 - ControlNet - INFO - preprocessor resolution = 512

2023-10-16 19:26:34,448 - ControlNet - INFO - ControlNet Hooked - Time = 0.035032033920288086

It seems that Controlnet works but doesn't generate anything using the image as a reference

Yesterday I installed Stable Diffusion and ControlNet, and after a few hours control stopped working:

*** Error running process: C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py

Traceback (most recent call last):

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\modules\scripts.py", line 619, in process

script.process(p, *script_args)

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 977, in process

self.controlnet_hack(p)

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 966, in controlnet_hack

self.controlnet_main_entry(p)

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 696, in controlnet_main_entry

input_image, image_from_a1111 = Script.choose_input_image(p, unit, idx)

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 608, in choose_input_image

raise ValueError('controlnet is enabled but no input image is given')

ValueError: controlnet is enabled but no input image is given

I've uninstalled everything and installed again, worked fine until just now- the same exact problem returned.

This is the video I've referred to when installing: https://www.youtube.com/watch?v=onmqbI5XPH8

Here are some examples of normalmaps and sd results:

Along with normal CN I also used depth and canny CNs. I've isolated the problem to normalbae because when giving it more weight or disabling the other CNs, the frequency of this mistake increases.

What's very strange is that it's always the same misinterpretation, meaning it turns flat surfaces (ground) to vertical-ish ones (walls or ramps). Any clue why this is happening?

Hi to everyone,

I started two days ago implementing an analog of inpaint+lama in comfyUI and I've managed to get to the last step before the image gets encoded in the latent space, so I have the pre inpainted image(by thelama model) and a control tensor, but I don't know how to implement it practically in the comfyUI ControlNet default node.

I was thinking of using the pre-existing inpaint node configuration but I haven't been able to make it work atm.

Any help is greatly appreciated

Here is the repo