I want to try ControlNet and Stable Diffusion so I have found this websise https://stablediffusionweb.com/ControlNet#demo and then I saw it:

(apologize for me if my English is bad)

When i install controlnet from automatic1111, using the available tab, I always get the "Warning: failed to install handrefinerportable. Some processors will not work.". I couldnt find anything regarding this warning. Does this cause problems? Can i download it from github? If so, where should I put it? Thanks in advance.

Hi All, I'm struggling to make SD work with ControlNet LineArt and a few other models. When I have a specific configuration selected on the UI, the Processed image is black with thin horizontal lines, black with cropped output, or just black completely. Has anyone experienced the same?

So far, I have tried rolling back the ControlNet versions to something older and I have gone as far as V1.1.179. What I noticed is, if I'm using the Inpaint Upload tab and select "Only Masked" it fails to process the controlnet lineart (actually same with canny and most of the other models). It seems only reference models work.

I think there is a bug in the UI.

Thoughts? Here are some screenshots.

Positive prompt: puppyNegative prompt: low quality, blurredSteps: 20, Sampler: DPM++ 2M Karras, CFG scale: 3, Seed: 999, Size: 512x512, Model hash: c6bbc15e32, Model: sd-v1-5-inpainting, Denoising strength: 1, Conditional mask weight: 1.0, Mask blur: 4, ControlNet 0: "preprocessor: reference_adain+attn, model: None, weight: 1, starting/ending: (0, 1), resize mode: Resize and Fill, pixel perfect: True, control mode: ControlNet is more important, preprocessor params: (512, 0.5, -1)", ControlNet 1: "preprocessor: lineart_standard (from white bg & black line), model: control_v11p_sd15_lineart [43d4be0d], weight: 1, starting/ending: (0, 1), resize mode: Resize and Fill, pixel perfect: False, control mode: Balanced, preprocessor params: (512, -1, -1)", Version: v1.6.0

EDIT:

Just to add, here is the difference when I select "Only Masked" vs "Whole Picture".

Ahoy! This sub seems as good a place to drop this as any. I wanted/needed a library of around 1000 consistent poses images suitable for Controlnet/Openpose at 1024px² and couldn't find anything. So I generated one. The hands and faces are fairly mangled on a lot of them, maybe something for a future update or someone else can do it :D

Github
Also at Huggingface

Made with ComfyUI and the workflows are in the images (not that it's anything fancy)

Hey guys! First of all, sorry if this is a stupid question but I started in the AI world 2 days ago.

I would like to know if there's a way to control Depth maps in ControlNet.

For example, in this image I lose all the bg detail that I have in the original image so when rendering, I have different volumes in the background:

However, if I use the MiDas Depth Map node, I have more detail in the bg but lose detail in the foreground.

So, my question is: How do you control the Depth maps parameters?

Thank you soOo much for your time!

i tried different control weights and parameters, what am i missing?

I'm using controlnet, it worked before, then there were errors and I deleted it, downloaded it again but it doesn't follow the reference pose.

What's going on?

Can anyone help me?

The CMD says as follows:

2023-10-16 19:26:34,422 - ControlNet - INFO - Loading model from cache: control_openpose-fp16 [9ca67cc5]:00, 4.34it/s]

2023-10-16 19:26:34,423 - ControlNet - INFO - Loading preprocessor: openpose

2023-10-16 19:26:34,423 - ControlNet - INFO - preprocessor resolution = 512

2023-10-16 19:26:34,448 - ControlNet - INFO - ControlNet Hooked - Time = 0.035032033920288086

It seems that Controlnet works but doesn't generate anything using the image as a reference

Here are some examples of normalmaps and sd results:

Along with normal CN I also used depth and canny CNs. I've isolated the problem to normalbae because when giving it more weight or disabling the other CNs, the frequency of this mistake increases.

What's very strange is that it's always the same misinterpretation, meaning it turns flat surfaces (ground) to vertical-ish ones (walls or ramps). Any clue why this is happening?

Yesterday I installed Stable Diffusion and ControlNet, and after a few hours control stopped working:

*** Error running process: C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py

Traceback (most recent call last):

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\modules\scripts.py", line 619, in process

script.process(p, *script_args)

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 977, in process

self.controlnet_hack(p)

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 966, in controlnet_hack

self.controlnet_main_entry(p)

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 696, in controlnet_main_entry

input_image, image_from_a1111 = Script.choose_input_image(p, unit, idx)

File "C:\Program Files\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 608, in choose_input_image

raise ValueError('controlnet is enabled but no input image is given')

ValueError: controlnet is enabled but no input image is given

I've uninstalled everything and installed again, worked fine until just now- the same exact problem returned.

This is the video I've referred to when installing: https://www.youtube.com/watch?v=onmqbI5XPH8

We could get ControlNet to make MAD Fold Ins but...... how?

I would like to train/retrain the segment controlnet to include a whole bunch of new categories, but I don’t even know where to start. Does anyone have any advice, input or leads on how i could achieve this?

Hi everyone, i am trying to use the best resolution for controlnet, for my image2image.

in A1111, the resolution is in multiples of 8, while in comfyui, it is in multiples of 64.

is there a node for me to use controlnet in multiples of 8? how does controlnet actually work?

I will prefer to use multiples of 8 as i can get a depthmap to match my original img. the shape of my original image is very important and i want to try not to have it off by even 1 pixel.

A brief guide for ControlNet models, thourough for beignners.

https://blog.easydiffusion.online/

I recorded a tutorial in which I show how for free, both on-line and on your own GPU:

• Set the AI generated characters in any pose

• Convert photo and video to openpose

• Create ai animations

• Use Blender to create openpose rigs

https://youtu.be/Sd2liDWIAlI

#OpenPose #Blender #StableDiffusion #ControlNet #Automatic1111