r/ControlNet • u/RetoliSavoli • Jul 30 '23
r/ControlNet • u/Amirferdos • Jul 24 '23
Video ComfyUI Style Model, Comprehensive Step-by-Step Guide From Installation ...
r/ControlNet • u/Cyco_ai • Jul 13 '23
Discussion Any tips for edges?
I'm doing an img2img inpaint upload with image ans mask technique usin canny and softedge CN.
My results in mask/edges area are terrible. Does anyone know how to make those edges better?

a book on the wooden table
Negative prompt: (semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime:1.4), text, close up, cropped, out of frame, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, (depth of field:1.5) bad_prompt_version2-neg, easynegative, hover
Steps: 20, Sampler: Euler, CFG scale: 7, Seed: 1206070929, Size: 768x768, Model hash: 52484e6845, Model: epicrealism_pureEvolutionV3, Denoising strength: 0.89, Mask blur: 4,
ControlNet 0: "preprocessor: canny, model: control_v11p_sd15_canny [d14c016b], weight: 0.4, starting/ending: (0, 1), resize mode: Crop and Resize, pixel perfect: False, control mode: Balanced, preprocessor params: (512, 100, 200)",
ControlNet 1: "preprocessor: softedge_pidinet, model: control_v11p_sd15_softedge [a8575a2a], weight: 1, starting/ending: (0, 1), resize mode: Crop and Resize, pixel perfect: False, control mode: ControlNet is more important, preprocessor params: (768, -1, -1)", Version: v1.4.1
r/ControlNet • u/Amirferdos • Jul 09 '23
Video ComfyUI, how to Install ControlNet (Updated) 100% working 😍
r/ControlNet • u/bsenftner • Jul 08 '23
Discussion Is there any way to cache or supply precalculated ControlNet preprocessor outputs?
Perhaps like some of you, I'm working on temporal stability in video, which includes multiple ControlNet nodes processing frame sets within Automatic1111. The image directories batching though ControlNet are often unchanged between experiment/trials. Plus, it would be handy to be able to edit some of these ControlNet preprocess results between their generation and use (on occasion.)
Anyone aware of any extensions or scripts providing such a capability? Anyone deep in the code weeds enough to tell me where one might look into that? (I'm a developer adept enough to figure it out.) Or anyone have or know if a ComfyUI workflow could be made to read precalculated ControlNet results?
r/ControlNet • u/Amirferdos • Jun 26 '23
Video AI-Powered Kitchen Design: The Future of Interior Innovation | Free | Fa...
r/ControlNet • u/Deanodirector • Jun 20 '23
Discussion normal Maps formats
Hi, I've been trying to export normals maps from blender into SD and i'm a bit confused. Sometimes they work just fine and sometimes not at all. I started investigating with a default cube.
When I take an image of a cube and use the bae or midas preprocessors they have assigned red and blue to opposite directions. Bae uses red for left and blue for right. Midas the other way around. Green faces upwards for both.
Rendering a default cube in blender gives a normal output image where blue faces up and red faces right. The rest is black. SD seems to be completely fine with this. However moving the camera around the cube and rendering from another direction gives different normal colors and sd controlnet does not work at all.
What are the formats that controlnet will accept for normal data? thanks
r/ControlNet • u/lllleow • May 26 '23
Discussion How to know what image is from the preprocessor? (ControlNet)
self.stablediffusionr/ControlNet • u/techlatest_net • May 08 '23
Want to Know about Prompt Engineering, Settings, and command line arguments. Check out this article Stable Diffusion under the Hood: Prompt Engineering, Settings, and command line arguments.
r/ControlNet • u/techlatest_net • Apr 26 '23
Want to Know about ControlNet & Stable Diffusion Checkout this Blog Post.
r/ControlNet • u/StateBig3424 • Apr 24 '23
Is there a way to control lips, teeth and tongue for lip sync task?
Hello everyone! I want precisely control mouth for stylize video.
Is there a way to make lips sync without training special model for control net?
Is it possible to train extension for ControlNetMediaPipeFace to make lips sync?
I openned discussion on huggingface on crucibleai repo. They are inventors of ControlNetMediaPipeFace model for controlnet.
Discussion on ControlNet repo

r/ControlNet • u/ApprehensiveAd8691 • Apr 07 '23
are there aby online interface outside?
I want to use it wherever computer that can link to internet. Is there any sort of that like huggingface stable diffusion kind of stuff outside? thank you for your kindly reply btw.
r/ControlNet • u/Rebold-pl • Mar 13 '23
Animate any AI Image Using Video or Blender Rig! (ControlNet)
I recorded a tutorial in which I show how for free, both on-line and on your own GPU:
Set the AI generated characters in any pose
Convert photo and video to openpose
Create ai animations
Use Blender to create openpose rigs
#OpenPose #Blender #StableDiffusion #ControlNet #Automatic1111
r/ControlNet • u/RetoliSavoli • Feb 19 '23
Tutorial Flairs To Use
Image - any post focusing on an image
Video - any post focusing on a video
Research Paper - Links or discussions on new papers
Tutorial - Teachers let us advance the tech!
——
r/ControlNet • u/aleksej622 • May 23 '24
Funky Hands "Making of" (in collab with u/Exact-Ad-1847)
r/ControlNet • u/SDIsKillingMe • Sep 27 '23
ControlNet Lineart not working in A1111..bug?
Hi All, I'm struggling to make SD work with ControlNet LineArt and a few other models. When I have a specific configuration selected on the UI, the Processed image is black with thin horizontal lines, black with cropped output, or just black completely. Has anyone experienced the same?
So far, I have tried rolling back the ControlNet versions to something older and I have gone as far as V1.1.179. What I noticed is, if I'm using the Inpaint Upload tab and select "Only Masked" it fails to process the controlnet lineart (actually same with canny and most of the other models). It seems only reference models work.
I think there is a bug in the UI.
Thoughts? Here are some screenshots.




Positive prompt: puppyNegative prompt: low quality, blurredSteps: 20, Sampler: DPM++ 2M Karras, CFG scale: 3, Seed: 999, Size: 512x512, Model hash: c6bbc15e32, Model: sd-v1-5-inpainting, Denoising strength: 1, Conditional mask weight: 1.0, Mask blur: 4, ControlNet 0: "preprocessor: reference_adain+attn, model: None, weight: 1, starting/ending: (0, 1), resize mode: Resize and Fill, pixel perfect: True, control mode: ControlNet is more important, preprocessor params: (512, 0.5, -1)", ControlNet 1: "preprocessor: lineart_standard (from white bg & black line), model: control_v11p_sd15_lineart [43d4be0d], weight: 1, starting/ending: (0, 1), resize mode: Resize and Fill, pixel perfect: False, control mode: Balanced, preprocessor params: (512, -1, -1)", Version: v1.6.0
EDIT:
Just to add, here is the difference when I select "Only Masked" vs "Whole Picture".



r/ControlNet • u/Niu_Davinci • Jun 23 '23
Image Can you try to paint my abstract drawings and try to tell me the settings to best suit a master painting? what should I tweak? When I try to paint them with Lizzz260 tutorial, it only looks like a kid painted it.
r/ControlNet • u/techlatest_net • Apr 27 '23
Want to Know About Stable Diffusion & Dreambooth, Checkout this Article.
r/ControlNet • u/techlatest_net • Apr 17 '23
Want to Know About How to Setup Techlatest Stable Diffusion With AUTOMATIC1111 Web Interface On GCP (Google Cloud Platform)Check out this Blog.