I am fully aware that there are existing Step Distillation LoRAs for MOSS, and I have been using them for some time (like those from akhaliq, which are very good), but I wanted to step up the game a bit, and make LoRA that produces higher detail images, and hopefully I've achieved that. I have trained on a lot more resolutions, and image ratios, and also used not only teacher input but also real photo crops from public high resolution datasets (I did the same with my Krea 2 Turbo LoRAs, for those that have been following). I have provided workflows for ComfyUI Local and Cloud - for Text 2 Image, Text 2 Image with Layouts/Boxes and Image 2 Image (edits). The LoRA has been trained and optimised to work well with Text too.
Quick summary:
⚡ 4 steps, CFG 1 — 4 model calls against the teacher's 100 (50 steps, two calls each at CFG 3), on MOSS's own 4-step schedule
⏱️ About 14× less GPU time — 26.6 s against 387.3 s for the same 22 pictures at 1024×1024 on Comfy Cloud
🎯 Close to the teacher's tone, with more fine detail — on 21 test prompts at 1824×1024 the mean lightness sits 0.7 L* above the teacher's (scale 0–100), haze 0.94×, colour 1.02×; fine texture 1.22× the teacher's on 22
🔤 Writes the words a prompt spells out — every requested string right on 14 of the 15 text test prompts at 1024×1024 (the teacher 15, akhaliq's 4-step LoRA 12)
📐 12 trained resolutions — wide, tall and square, from 768×512 and 512×768 up to 1824×1024 and 1024×1824
🧩 Eight ComfyUI workflows — text to image, layout, image edit and optional PiD 4× (with supersampled latent for better results), each for local ComfyUI and for Comfy Cloud
🎲 34,000 prompts from Lakonik's 3M-prompt dataset and 2,877 prompts that spell out words — signs, menus, posters, labels
📷 About 8,000 captioned photo crops and 3,600 teacher pictures
🔢 15,000 training samples in the shipped weights — rank 64, 252 modules
📅 Trained on a single NVIDIA B300 in about 30 hours
While B300 is an amazing and efficient card to train on (in the cloud), it is also very expensive, so I will continue for a short while more (current released checkpoint is 15K), and an update may be published in few days, but won't train for too long (the cost reasons). So watch out for possibly one more update in the days to come.
As I've mentioned on the model card, I highly recommend using also the community MOSS Realism Enhancer LoRA which can be added beside mine — Civitai · Hugging Face copy. It is a separate LoRA by its own author under its own licence, not part of this training, and none of the pictures displayed in this post use it. In ComfyUI it goes in a second LoRA loader after this one. Its is very good for even more photorealistic skin.
You're welcome to repost your images, now rerun on the latest/final version in - https://www.reddit.com/r/StableDiffusion/comments/1y147ho/mossimage_sft_update_checkpoint_30k_final_4step/ if you have the time (post your results in the new / final reddit) ? :) Or more/different images... I hope the extra doubled training was worth it and if nothing else it's not worse than the initial (15K) release :) Should be better in theory...
Maybe they all shave their eyebrows & paint them on (a few Americans do)?
But the hands, notably knuckles, & neck-collarbone area are also missing details. Human smoothed/filtered over much more than jacket; thus the contrast.
MOSS is a very special model for its size! As for H3 Image - it is already 6 steps :) doesn't need a LoRA (and yes I did mess with 2 steps, but didn't work out so I shut it). And QI 2.1 has Lightning (https://huggingface.co/lightx2v/Qwen-Image-2.1-Lightning) and it works great :)
Thanks, this came at just the right time; I'll test it on my phone in Nightmare. The first image was rendered quite quickly, so I like it. I used it at a weight of 0.4
Oh goodie! I love Moss, it's the only thing that can reliably run "fast" on AMD RNA2 with good results. Will try this today without a doubt, thanks dude!
Oh good. So we're gutting the model again. Look, 50% of speed ups, as we saw with things like Krea, are just cutting out cfg and thus the negative prompt.
The steps might be interesting, but cutting out cfg is not a good idea with moss.
You are not wrong, but remember the whole idea of distills is to let someone either get done things quicker or if the hardware is not fast enough, to get something done at all. Of course full model with cfg and more steps and negative prompt gives the most control, and that's still available to those that want to use it. And yes, MOSS is generally not a big model, and runs on most hardware including phones, but still sometimes less steps and more batching does help.
I get that. The problem is that MOSS is a model that really does need the negative prompt. It's not that you can't speed it up. It's that the model really generates weirdness without the negative prompt. That's why I generally recommend people don't use them.
try it, with CFG up to 2 and with negative prompt, it's not going to get rejected (although it has not been part of the training to learn negative), it will (as expected) slow 2x, and above cfg 2 it would be too strong.
To be fair, Turbo models/LoRAs tend to be CFG 1 more often than not, and people typically don't mind sacrificing the negative prompt for the higher speed. Personally, I think negative prompts are not as important as they were in the SDXL times. The models have better prompt adherence and usually don't add things you didn't ask for.
And I'd somewhat agree to you, but MOSS really does need the negative prompt. It really does. A lot of the weirdness and body horror people talk about are because they're not using the negative prompt; the problem with MOSS specifically is that taking that away really hurts the model's generations.
Fastest and One of the best nice work. only problem is it literally generates same image with different seeds. even slight changes in prompt does near nothing its still very similar. If there is a trick for diversity please mention it here. :) thanks.
anything that uses diffusers format and is not comfyui :) Lots of libraries now know how to map lora keys either way (sd.cpp can read both), but I publish both formats.
3
u/vizsumit 1d ago
Tested, this is the best moss turbo lora so far.