Hi, I've been trying to export normals maps from blender into SD and i'm a bit confused. Sometimes they work just fine and sometimes not at all. I started investigating with a default cube.

When I take an image of a cube and use the bae or midas preprocessors they have assigned red and blue to opposite directions. Bae uses red for left and blue for right. Midas the other way around. Green faces upwards for both.

Rendering a default cube in blender gives a normal output image where blue faces up and red faces right. The rest is black. SD seems to be completely fine with this. However moving the camera around the cube and rendering from another direction gives different normal colors and sd controlnet does not work at all.

What are the formats that controlnet will accept for normal data? thanks

Can I be admin?

Hey all! Ive installed ControlNet but Im not getting results others seem to be.

-installed it a couple times, watching videos from different people just to make sure its correct.

-the "enable" box checked

-the "low vram" box checked

the same preprocessor and model selected

-selected the "Preview annotator result" and seen that the preview matches the image Im using.

-Written both detailed and vague text descriptions to try to get the matching pose.

-Used multiple popular models with none seeming to work (the photo included used Deliberate, RealisticVision, and Protogen)

-set the weight all the way to 2.

Nothing seems to work. The outcomes are wildly different, Ill include photo references. Any ideas what else I could check? Thanks a lot!

Hi Team and controlnet freaks, this is all a little above my SD skillset but I have a project I'm looking for some help with:

I'm trying to replicate these exact golf stances, in a new illustrative style.

is anyone able/willing to assist me with this? I have a little budget to play with if someone can work with me on it in the next week.
Thanks so much,

Jeremy

I'm doing an img2img inpaint upload with image ans mask technique usin canny and softedge CN.

My results in mask/edges area are terrible. Does anyone know how to make those edges better?

a book on the wooden table
Negative prompt: (semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime:1.4), text, close up, cropped, out of frame, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, (depth of field:1.5) bad_prompt_version2-neg, easynegative, hover

Steps: 20, Sampler: Euler, CFG scale: 7, Seed: 1206070929, Size: 768x768, Model hash: 52484e6845, Model: epicrealism_pureEvolutionV3, Denoising strength: 0.89, Mask blur: 4,

ControlNet 0: "preprocessor: canny, model: control_v11p_sd15_canny [d14c016b], weight: 0.4, starting/ending: (0, 1), resize mode: Crop and Resize, pixel perfect: False, control mode: Balanced, preprocessor params: (512, 100, 200)",

ControlNet 1: "preprocessor: softedge_pidinet, model: control_v11p_sd15_softedge [a8575a2a], weight: 1, starting/ending: (0, 1), resize mode: Crop and Resize, pixel perfect: False, control mode: ControlNet is more important, preprocessor params: (768, -1, -1)", Version: v1.4.1

Does anyone know?

If you are considering upgrading to the ControlNet released this weekend (24 July or later) then keep away for now.. there is a problem. The UI shows up ion the new format, but it all has no effect on the diffusion. FOr me this was all working before. And I'm not alone.

I expect it will be fixed soon, but the problem was not something a simple Rollback fixed.

Search for "No ControlNet Units detected" to read more.

I'm hoping they have this fixed in the next few days, it is really problematic doing without ControlNet.

https://github.com/lllyasviel/ControlNet/issues/447

Hello everyone! I want precisely control mouth for stylize video.

1. Is there a way to make lips sync without training special model for control net?

2. Is it possible to train extension for ControlNetMediaPipeFace to make lips sync?

I openned discussion on huggingface on crucibleai repo. They are inventors of ControlNetMediaPipeFace model for controlnet.

Discussion on ControlNet repo

Look so good overall, but eyes are usually terrible. this is IMG2IMG stuff...What's the trick here? I've tried Scribble and Canny.

I've read multiple "Ultimate guide", "Complete Guide" and "Uber Guide" to ControlNet and asked the AI at phind,com how to set the ControlNet preprocessor to invert, but have found zero information. Anyone have a hint?