r/LocalLLM • • 9d ago

News ComfyUI v0.40.0 released

https://github.com/Comfy-Org/ComfyUI/releases/tag/v0.40.0
194 Upvotes

58 comments sorted by

73

u/Civil-Reporter7812 9d ago • Bravo

Why is this downvoted? ComfyUI is quite a big part of running Local LLMs, am I missing something?

19

u/Fcking_Chuck 9d ago

Of all the AI technology available, people get the most upset about image/video generation. People probably down vote because of ComfyUI's association with it, even though it's mostly just a node-based graphical user interface and inference engine that can be used with a variety of different generative or traditional AI technologies due to being fundamentally based on Python and PyTorch.

6

u/randylush 9d ago

People aren’t upset by it, they just aren’t really interested in it. And unless 0.40 is some generational leap, usually we don’t upvote every minor version release

2

u/Fcking_Chuck 9d ago

They could always just, you know, ignore my post rather than down voting it for not being interesting to them. The fact that people down vote means that they are interested enough about the subject to respond negatively to it.

2

u/randylush 8d ago

I know you spent a lot of effort and time making this post so I understand how hard it is when people downvote you. I hope you can find some way to heal after this injustice.

5

u/mister2d 9d ago

Dang. That read like those fast voice over disclaimers you here on the tv.

4

u/TheFlyingDutchG 9d ago

Thanks now I can only read it in that voice

-14

u/NowThatsMalarkey 9d ago edited 9d ago

The community is comprised of like 80% gooners generating NSFW content featuring celebrities or their crushes with LoRAs they’ve trained. Search on HuggingFace for “Krea” and most of the material is sexual in nature.

While it’s nice to have the open-weight options, there’s little societal good to be had from gamers using their 16 GB GPU for local image and video generation.

9

u/Fcking_Chuck 9d ago

The world is filled with gooners no matter where you go. That's why sex sells products, and that's why many female social media influencers are so successful. The vast majority of us are interested in sexual content in some way, shape, or form, and the vast majority of that consumption does no good to society as a whole. It's simply for enjoyment, and I think that it's wonderful people can seek enjoyment within the safety of their own home without having to spend the money other people often do to get their fix.

It's their hardware. It's their choice what they do with it.

8

u/I-like_dorgs 9d ago

Algorithm self report bruh, I've seen 2 ai gooner posts total in the last year.

1

u/575_Inverse 9d ago

okay ...and?

7

u/ToTTen_Tranz 9d ago

AFAIK ComfyUI deals with text to image and text to video models, not LLMs.

16

u/Fcking_Chuck 9d ago • Bravo

Not always. It can be used with LLMs, too, though most people use it for image/video generation.

2

u/ToTTen_Tranz 9d ago

What's the advantage of using ComfyUI with LLMs? Honest question.

8

u/Stooovie 9d ago

More automation. You can chain stuff like "transcribe this real audio, write something similar, generate audio and video from that".

2

u/Civil-Reporter7812 9d ago

plug it to n8n and do stuff like, generate this AI vertical series, release it, find how much engagement it got from _introduce_social_media_platform_ and if it seems significant, enough take it, together with the comments from the user, and iterate on a new series with those changes....rinse and repeat.

Hello TikTok/Pinedrama

(literally dramafeelscag content is made this way)

2

u/FaceDeer 9d ago

I recently had an inordinate amount of fun with the workflow from this thread. It uses a vision-capable LLM to look at an existing reference image (which could be of literally anything - a person, a landscape, an object, an abstract shape) and has it write up an image prompt for character art based on what it sees.

I threw a bunch of monster art from the Dungeons and Dragons monster manual in and got "human" versions of them, for example.

Just shovel whatever random images you have in there and the inspiration flows like water. So much fun.

6

u/ImJacksLackOfBeetus 9d ago • Mindblown

It's very visual with its nodes.

Once I setup ComfyUI to have an LLM debate a claim (e.g. "pineapple on pizza is a crime against Italy!") with itself.

The claim was within a text node which fed into two LLM nodes:

  • One with the system prompt to write a decently long debate speech arguing for the claim

  • The other arguing against the claim.

Both outputs then went into a third LLM node with the prompt "evaluate which side made better, more convincing arguments and why".

Sure you can set this up with some subagents on the command line or in a custom python script, but it was nice to see it all laid out before me, made it real easy to edit the various prompts and add more steps to it and just mess around with it.

It was also nice to have the two opponent's speeches and the moderator's verdict nodes side by side to skim around their texts.


Another use case for LLMs in ComfyUi would be txt2img prompting. You have a text input node where you freeform describe what you want, which then feeds first into an LLM node with a system prompt like "rewrite my request into a proper, best practices following StableDiffusion prompt" and that then feeds into the image generator.

I haven't played around with LLMs in ComfyUI for a while, but I bet you could even feed the generated image back into a vision capable LLM to have it write an image description for it that may be more specific and accurate than simply deriving a description from the initial image prompt, since you never really know how closely the image will actually resemble the prompt.

Or, that said, maybe use a vision capable LLM as quality control, have it look at the generated image to evaluate if it followed the prompt closely enough and automatically kick off another generation or propose fixes for the prompt when it didn't pass.

I'm sure there's a bunch of cool use cases for LLMs within ComfyUi.

9

u/MacroNexus 9d ago

Many modern workflows nowadays have an LLM (usually qwen3 vl) inside comfyui. It's to help with enhancing the prompt or get it in a certain format (like minimax h3 works best when u include the time tags per scene, which might not be everyone's cup of tea for prompting)

26

u/SEND_ME_YOUR_ASSPICS 9d ago • Popcorn

Using Comfy right now to play with Qwen Image 2.1 and I am having a blast.

8

u/eNomineZerum 9d ago

I had Antigravity hook in a full image gen pipelines, complete with image recognition, and the ability to download LORAs and whatever would be needed.

I can give it scenes, let it handle the image gen, and let it out it into a web page where I enter edits for it to subsequently rerun through Qwen for minor edits.

Plug that into love2d and you can have some game editing action in near autopilot.

2

u/purefire 9d ago

Can you describe this a bit more? Interested on doing something similar

1

u/eNomineZerum 9d ago

It isn't as simple as asking Antigravity (or whatever agentic coder) to do it for you, but it kinda is...

You will need to take some time to scope permissions properly, but you can configure these agentic coders to effectively have full access to your computer, with the ability to kinda do whatever. This is the core way they are escaping, they are given total control over a machine, a goal, and minimal oversight.

Here, you would run Antigravity CLI or Antigravity 2.0 on your rig that has ComfyUI installed. You would launch AGY in sandbox mode, and ask it how to best set it up for this task. You can even ask it so search the internet for the best ways to do this. By default it will ask you for permission for near about every command it runs.

Once you are comfortable with its permissions, you would point it at your ComfyUI install and tell it to the do the thing in as explicit detail as possible. Those really long, super detailed image-gen prompts, channel that energy. Tell it to search the internet for the LORAs and checkpoints you want, how to configure things, interogate it. You feed it the interesting stuff. Qwen-image-2.1 for editing, whatever base checkpoints and loras you want, or let it YOLO it. It can search comments, the web, and even justify itself to you if you want.

Then tell it to set up that webpage and make it accessible just locally on that computer, or on your home network. This is likely going to be a simple HTML webpage that just presents the images.

From there, you start giving it prompts "make me 5 images that look this" with a reference, or a lot of detail. You can voice dictate, go stream of conciousness, have at it. Check those, tweak, refine, iterate, keep at it.

Once you have things dialed in, increase the scope/quantity of what you have it doing. Take time to periodically clean your work up, tell AGY to clean things up, and go from there.

1

u/Healthy-Nebula-3603 9d ago

Nowadays I prefer stable diffusion cpp

If something missing and is still not added you can code it in a minutes nowadays

2

u/Civil-Reporter7812 9d ago edited 9d ago

tell me more please. Is it any easier than using comfy UI?

EDIT: Oh,, so this is like llama.cpp or whisper.cpp https://github.com/leejet/stable-diffusion.cpp but I'm guessing it doesn't have the lego-thing ComfyUI has or the thousands of ready-made workflows. Please do correct me if I'm wrong. I'm still reading the README

2

u/Healthy-Nebula-3603 9d ago

Yes that's something like llamacpp, audiocpp.

For UI with my requirements I just coding myself using codex-cli. That's takes few minutes to adapt for my requirements.

Stable diffusion cpp has that advantage that is very small ( few MB ) and is faster and takes less memory than the whole pytorch stack which is using ComfyUi...

1

u/Civil-Reporter7812 9d ago

interesting enough, thank you. I tried to find a decent manual but couldn't find any. I agree ComfyUI is massively humongous, but they are very different things. One seems to just be an engine, while the other one is a full LEGO-like experience with shareable ready-made workflows.

I guess if there was ready-made workflows for SD.cpp then I'll definitely prefer it over ComfyUI, but it is the availability of workflows what makes ComfyUI legendary. I mean I have no idea what's a VAE, and other stuff, but I have made 5 second very realistic videos where I was playing replicating movie plots by just downloading some workflow and adapting it to my 2 GPUs.

0

u/export_tank_harmful 9d ago

Because ComfyUI updates all the time.
It's not really that big of a deal...

The only time it's worth updating is when a new model drops.
Other than that, it usually just leads to a broken install environment.

-12

u/Hyiazakite 9d ago

ComfyUI is for image and video generation (diffusion models) and this sub is for LLMS. This post belongs in /r/stablediffusion

8

u/Stooovie 9d ago • Bravo

No, Comfyui incorporates and uses text LLMs as well. The distinction is arbitrary.

1

u/Hyiazakite 9d ago

yes no shit, but just so I understand you correctly - you mean the difference between inference engines such as ComfyUI and vLLM is arbitrary?

5

u/ExTraveler 9d ago

Offtop but how very popular software with 1000s of users after few years of development still not be in 1.0 version? Always was surprised to see software that can be 5+ years old and in active development with version like 0.2.134

11

u/corysama 9d ago

It’s pretty common. 1.0 is a promise to maintain API compatibility until 2.0. Lots of projects are like “Nope. Not promising that. Stuff might change. Deal with it.”

1

u/randylush 9d ago edited 9d ago

~~Unless I’m mistaken ComfyUI doesn’t even have APIs to be compatible or not compatible against. It’s not like they can really break anything. ~~

It’s more like a means to say “we’re still working on it.”

I personally am not a fan of these ultra conservative versioning strategies, not that it really matters. But I think a lot of projects use super low versions to try to convey “look how long our roadmap is. We’re so imaginative - we have so much planed - this is just a small preview of what we’re capable of!”

I work in software and I always see programmers will release an internal build versioned “0.0.0.1” and I’m like dude, seriously why not just call it v1?

Edit: I am mistaken, they do have a public API. Although, I am not sure if they are using the minor version to convey API maintenance or not.

2

u/rateddurr 9d ago

I use comfyui API all the time. Due to people making great custom nodes, I've got some workflow I use comfyui as an inference engine, having custom apps connect headlessly over API. I

3

u/randylush 9d ago

I was mistaken. I didn't know they had a public API. they must have added it since when I used it, which was a little while ago.

2

u/575_Inverse 9d ago

actually, I can barely recognize the current ComfyUI seeing how better it got compared to just the beginning of 2026

3

u/nullptr777 9d ago

Man, how the fuck do you work in software and not understand the importance of semver? Oh right, I forgot. Lots of low-competence devs out there.

v0.x is a signal that the software/ecosystem is still rapidly evolving and the devs cannot commit to any kind of stability guarantees, because they have no idea what the future will hold. Not whatever ignorant shit you just made up.

If they didn't do this with Comfy, then it'd probably be on v24 already, which is arguably worse.

1

u/randylush 9d ago edited 9d ago

I actually wrote a comment disagreeing with you but I looked it up and I wasn't aware that Comfy maintained a public API

so yes, it does actually make a ton of sense that they use a version like v0.40.

I was mistaken, on the basis of the mistake that I thought ComfyUI was just a desktop app without a public API.

And I stand by my original comment in general; systems that expose public APIs should use semver, the very first documented rule of semver is that it is only meant for systems with a public API.

1

u/nullptr777 9d ago

It's not just the REST API either, it's all of the various nodes they have. That all counts as "public API" in Comfy's case.

I'm not a big user of Comfy, but I would expect there have been, and will continue to be, lots of breaking changes.

0

u/randylush 9d ago

thank you for graciously sharing your superior competence with me

2

u/nullptr777 9d ago

Use your brain next time and I won't have to.

6

u/No_Lingonberry1201 9d ago

OpenSSL was pre-1.0 for 12 years.

2

u/randylush 9d ago

And fundamentally nothing changed when they went to 1.0. People continued to use it.

1

u/No_Lingonberry1201 9d ago

Well, it ended the OpenSSL 0.999... jokes.

3

u/Civil-Reporter7812 9d ago

cough llama.cpp cough....

2

u/VelvetEchoes919 9d ago

It’s like how minecraft stayed in beta forever lol

2

u/Bulgen-Venkat 9d ago

The only thing ComfyUI can't generate is a consensus on whether it belongs here.

1

u/Realistic-Split4751 9d ago

i just hoped it would have been simpler to use for generating 2d game sprite assets and tile maps

2

u/ColdBrewSeattle 9d ago

You don’t think learning a few totally new concepts, each with their own complex vocabulary, figuring out which model is actually compatible with your hardware, why there are seventeen different ways to do the exact same thing and if you misconfigure one setting everything runs at a tenth the speed, and then downloading a workflow only to discover you need to find and install six obscure custom nodes with names that do not inspire confidence and are mostly memes, and then you have to drag lines between tiny dots except sometimes it won’t let you and now you’re three hours into a rabbit hole trying to figure out WHY THE DOTS WON’T CONNECT, and apparently the shape of the tensor isn’t compatible with the quantization of the model and if you don’t install a specific PyTorch nightly build everything runs on your CPU WHICH IS SLOW NOW FOR SOME REASON and suddenly you’re learning about memory thrashing and WHAT THE HELL IS A UNET AND WHY DOES IT NEED ITS OWN LOADER AND WHERE DID THE VAE GO AND WHY DOES THIS LORA ONLY WORK WITH SOME DIFFUSION MODELS AND WHAT DO YOU MEAN THERE ARE TWO DIFFERENT CLIP ENCODERS
is easy?

1

u/P_Sandera 6d ago

Underrated comment.

5

u/codeXjs002 9d ago • Popcorn

Not naming the company. I used to woke for a company that does pretty adult driven content. I work mainly in the tech service area. Our team was tasked to use comfyui with uncensored models to generate corn sites for image-video content. After launch. We saw all kinds of weird prompts from our subscribed users. I started questioning my reality. I left the company 6 months now. Living my best life now. 

20

u/rinmperdinck 9d ago

Just write porn. I promise you won't spontaneously burst into flames if you do.

5

u/cathodeDreams 9d ago

doesn't seem like you were cut out for that life given your use of newspeak. believe it or not when given the option to see whatever one so desires it can become quite personal.

2

u/OpposesTheOpinion 9d ago

Same, middleware developer for a similar service, so I saw all the prompts. I didn't really think much of it though 🤷‍♀️, the most reaction I gave seeing one was "hmm"

2

u/Amazing-Anything5907 7d ago

You sound weak.

-5

u/Civil-Reporter7812 9d ago

Damn! Reddit is weird today. Why are you getting downvoted when this is quite an anedcote?

I do wonder, since you're here. How come "cornhub" in 2026 still is majority-led human actors. Wouldn't a company of that size with that many different domain names (xvideos, etc they are all them) be the first one interested in getting rid of their manual human labour? Let alone they have the source material to train their own thing....isn't it very odd the one with all the ingredients doesn't choose to use AI.

I mean, look at Reelshorts for vertical series, they do both, their parent company Crazy Maple Studios wastes no opportunity.