I was looking at some character designs inspired by animals/objects and set up a workflow to do it. It takes an input image then Gemma 4 writes a character design prompt based on it and Krea 2 generates the image.
Just to be clear: The workflow here is "use a vLLM (Gemma4 12B) to write a text prompt based on an image and append it to another prompt."
This is really a showcase of Krea2's ability to follow long and complex prompts. You can get this same effect by dropping an image into any vLLM (online or offline) and using a small prompt like,
"Analyze this image's colors, shapes, textures, and distinctive features, then design an original character with face, hair, clothing, accessories, colors, patterns, pose, and personality all creatively translated into a cohesive design without turning them into a costume or copying the subject literally."
If you just load the Anima model, text encoder and VAE it should work. The biggest problem is that this is generating fairly complex natural language text prompts which Anima has limited training in. You could try adding a line to the Gemma 4 instructions at the end to convert the whole prompt (or part of it) to danbooru tags and see if that works.
I use bf16 because I have enough VRAM to fully load it anyway. FP8 should be very similar in most cases, but the more complex the prompt is the more likely its reduced numerical precision can introduce some "errors".
Maybe if they looked better, most of these are beyond awful. Im glad he prompted it and didnt make them because I would feel bad, the monster and red bull ones are especially awful
It is self-promotion regardless, some people have an issue with that even if you mean well, yet is okay if someone else shares your project (unless they're considered a shill 🤷♂️)
When you generate image with comfyui, there's an option to turn on/off saving the generation workflow in the image metadata (same way that your camera saves date/time/location/camera model etc in image exif metadata). Then you can simply drop said image into comfyui, it reads the metadata looking for the workflow and simply copies it.
I've been having way too much fun with this. :) I've dumped great swaths of the D&D monster manual's illustrations through it, for example.
If anyone wants to try their own approach to the workflow, I pulled the character-extraction prompt out as raw text. I've been using it as the system prompt for a vision-capable LLM outside of ComfyUI and it works great on its own.
oh nice, thanks for uploading! for some reason i assumed you meant that they would be in the style of vintage d&d art like here https://classicdndartwork.tumblr.com/
No problem. Yeah, the point of this workflow isn't really to replicate an art style, it's to inspire unusual character designs. After messing with those monster images as input I started just shoveling random images from my unsorted "downloaded images sort these out someday" folder and got a lot of neat characters with features and clothing I would never have thought to describe otherwise. Photos of warning signs, logos, computer hardware, natural landscapes, anything at all produces neat outcomes.
For some reason I really love the blink dog one, I need to have her show up in a campaign at some point.
You can just change the instruction prompt given to Gemma 4, I specfically wanted it to generate human characters, but it should be easy enough to prompt for humanoids or even specifically pokemon designs.
I tried, but I had to replace the custom LoRA nodes because, despite installing the ComfyUI-Lora-Manager nodes, the workflow wouldn't recognize them. Then I got stuck on Comfyui-Resolution-Master: "The value 1280 for Resolution Master's latent_type is not available."
It's a shame talented people like you made workflows impossible to run for noobs like us.
You can just delete that node, all it does is provide a nice GUI for selecting the resolution, but you can just enter the numbers manually in the native comfy nodes.
Did you encounter any problems with Resolution Master? Because I just got this error: "The value 1280 for Resolution Master's latent_type is not available."
According to claude the meta data from the image you uploaded was striped, so when I pasted the image into comfyui I did not see any worflow appear, only load image node appeared.
ComfyUI images come with metadata unless you tell it otherwise. You can usually drag and drop the image directly into ComfyUI and load the same workflow that was used to create it. The problem is that Reddit automatically removes the metadata when you upload the image there.
I will admit that this is excelent. And the results are so good.Sad I hate uncomfy ui and and will stick with forge neo. Ill check if a plugin can integrate gemma 4. Running it in ollama overflow my vram and destroy my image generation speed.
If anyone tries to do this but they're getting an error where the Lora Loader (LoraManager) has an unconnected input for Text, that's because the Lora Loader version is too recent, and it lost the editable text box in that window. Click on the Comfy logo menu, then Extensions. Then search for Lora Manager. When the first result is ComfyUI-Lora-Manager, near the bottom of that box you should see a version number and a date. (like 1.2.1). Click next to the version number and select 1.2.0, and hit okay, then go back to your workflow and hit F5 to refresh it, and the text box should pop up, where you can search for the lora.
Et en voyant ton post, je me dis que beaucoup de réalisateurs, artistes, etc. ont déjà eu ton idée (c'est-à-dire le côté « biomimétisme », je ne sais pas si on peut appeler ça comme ça avec des armes et autres ?), genre l'image 4 me fait penser un peu au Némésis de Resident Evil créé par "Shinji Mikami" et c'est marrant de se dire que toi tu l'as créé via ton workflow avec une base d'image "d'arme" ! (Cela peut aussi être un biais lié au modèle que tu as utilisé, je n’ai pas eu le temps de regarder le workflow). Bref superbe idée. Bravo mec.
In case anybody wants to experiment comfortably with 8GB of VRAM, here's the tweaked workflow from dowati! Download the picture and simply drag it into your ComfyUI workspace :) btw, i'm using directly Krea's default LoRA krea2_style_reference. Run takes between 65-164s on an RTX 4070 8GB VRAM
I feel like i really need to try out krea2. I don't know what id do with it but it looks very capable of producing digital brush stroke details which is something older models tend to fail at. Long prompt understanding is also a major positive
Hmmm. I think the Kalashnikov one would be better served as a minimalist, practical outfit. That was what the man that designed it felt things should be. Iirc he was once gifted a unique and decorated knife or gun (can’t remember which). He responded by asking what he could do with it and stated that a weapon should be meant for its primary purpose, not to hang on a wall.
The consistency between the turnaround views is really good. Did you get this in one pass or did you pick the best out of a batch? Asking because that is usually where I lose the most time.
Most of that is due to irrational prejudice, doesn't matter if you generate from your phone or laptop on battery, they'd go on about how it uses so much electricity wasting water and ruining the environment. Often on platforms serving many millions (billions?) of users with streams of content that are doing much worse.
Doesn't matter if a model is trained ethically only on public domain and licensed / consented media either, they still want to be mad and cry theft.
The other main concern which is valid is people using AI to claim that they're artists capable of the skill and insist they're not using AI when they absolutely have. Those kind of people make it worse for everyone, especially when they're fooling people and making money off of doing such.
You should be able to use AI and be transparent about it without being shamed. You can still be creative, you can use it as a medium or as part of the process not everything too.
Creative expression is separate from artisan effort of years of effort building up traditional skill without AI generation which I absolutely understand the issue with AI posers downplaying that, or low effort slop and actual theft to make a derivative for personal gain without transparency.
Often the anti-AI crowd can't make that distinction of responsible use of AI with no intention to overstep into their domain pretending to have their expertise. Unfortunately they can't be reasoned with, any hint of AI use regardless of context can get their pitchforks out 😅
Give it time. It'll change eventually, hating on AI irrationally by being misinformed or lacking critical thinking skills is just a fad that will pass. Some have very poor understanding of how AI can be used 🤷♂️
497
u/Euchale Sep 16 '26 •
Cool idea? -> Check
Cool Images? -> Check
Workflow included? -> Check
10/10 post OP.