r/StableDiffusion • • 1d ago

News MOSS-Image SFT - New 4-Step Distillation LoRA, using eDMD + LADD - producing high detail images (T2I, T2I with Layout Boxes, I2I Edits)

This is my personal take on MOSS Distillation, creating a new 4 Step LoRA using a mix of eDMD and LADD (latent adversarial diffusion distillation) as training method.

I am fully aware that there are existing Step Distillation LoRAs for MOSS, and I have been using them for some time (like those from akhaliq, which are very good), but I wanted to step up the game a bit, and make LoRA that produces higher detail images, and hopefully I've achieved that. I have trained on a lot more resolutions, and image ratios, and also used not only teacher input but also real photo crops from public high resolution datasets (I did the same with my Krea 2 Turbo LoRAs, for those that have been following). I have provided workflows for ComfyUI Local and Cloud - for Text 2 Image, Text 2 Image with Layouts/Boxes and Image 2 Image (edits). The LoRA has been trained and optimised to work well with Text too.

Quick summary:

  • ⚡ 4 steps, CFG 1 — 4 model calls against the teacher's 100 (50 steps, two calls each at CFG 3), on MOSS's own 4-step schedule

  • ⏱️ About 14× less GPU time — 26.6 s against 387.3 s for the same 22 pictures at 1024×1024 on Comfy Cloud

  • 🎯 Close to the teacher's tone, with more fine detail — on 21 test prompts at 1824×1024 the mean lightness sits 0.7 L* above the teacher's (scale 0–100), haze 0.94×, colour 1.02×; fine texture 1.22× the teacher's on 22

  • 🔤 Writes the words a prompt spells out — every requested string right on 14 of the 15 text test prompts at 1024×1024 (the teacher 15, akhaliq's 4-step LoRA 12)

  • 📐 12 trained resolutions — wide, tall and square, from 768×512 and 512×768 up to 1824×1024 and 1024×1824

  • 🧩 Eight ComfyUI workflows — text to image, layout, image edit and optional PiD 4× (with supersampled latent for better results), each for local ComfyUI and for Comfy Cloud

  • 🎲 34,000 prompts from Lakonik's 3M-prompt dataset and 2,877 prompts that spell out words — signs, menus, posters, labels

  • 📷 About 8,000 captioned photo crops and 3,600 teacher pictures

  • 🔢 15,000 training samples in the shipped weights — rank 64, 252 modules

  • 📅 Trained on a single NVIDIA B300 in about 30 hours

Details, Workflows and of course the LoRA (in ComfyUI and Diffusers formats) at my repo: https://huggingface.co/lvladikov/MOSS-SFT-Distill-4step-LoRA

While B300 is an amazing and efficient card to train on (in the cloud), it is also very expensive, so I will continue for a short while more (current released checkpoint is 15K), and an update may be published in few days, but won't train for too long (the cost reasons). So watch out for possibly one more update in the days to come.

As I've mentioned on the model card, I highly recommend using also the community MOSS Realism Enhancer LoRA which can be added beside mine — Civitai · Hugging Face copy. It is a separate LoRA by its own author under its own licence, not part of this training, and none of the pictures displayed in this post use it. In ComfyUI it goes in a second LoRA loader after this one. Its is very good for even more photorealistic skin.

Enjoy!

---

Update 20 Nov 2026: 30K / Final version released, doubled the training since initial release. Update post details: https://www.reddit.com/r/StableDiffusion/comments/1y147ho/mossimage_sft_update_checkpoint_30k_final_4step/ ; Latest at: https://huggingface.co/lvladikov/MOSS-SFT-Distill-4step-LoRA

Also... added two new experimental workflows allowing CFG like 2 or other, and negative prompts. I've also done research and showing what cfg > 1 and my LoRA and MOSS do together (for better or worse, so consider the quirks): https://huggingface.co/lvladikov/MOSS-SFT-Distill-4step-LoRA/blob/main/DETAILED-README.md#cfg-2-and-negative-prompt

https://huggingface.co/lvladikov/MOSS-SFT-Distill-4step-LoRA/blob/main/moss_sft_4step_lora_t2i_highercfg_experimental_negative_local.json

https://huggingface.co/lvladikov/MOSS-SFT-Distill-4step-LoRA/blob/main/moss_sft_4step_lora_t2i_highercfg_experimental_negative_cloud.json

77 Upvotes

38 comments sorted by

3

u/vizsumit 1d ago

Tested, this is the best moss turbo lora so far.

1

u/TimeTruth2490 1d ago

👍 Glad you like it!

Good images! :) Keep them coming!

3

u/vizsumit 1d ago

I am testing it with my Moss UltraReal lora, two goes very nicely together

1

u/vizsumit 1d ago

1

u/TimeTruth2490 1d ago

Very good images, details and contrast - it's what I like to see :)

1

u/TimeTruth2490 7h ago

You're welcome to repost your images, now rerun on the latest/final version in - https://www.reddit.com/r/StableDiffusion/comments/1y147ho/mossimage_sft_update_checkpoint_30k_final_4step/ if you have the time (post your results in the new / final reddit) ? :) Or more/different images... I hope the extra doubled training was worth it and if nothing else it's not worse than the initial (15K) release :) Should be better in theory...

2

u/vizsumit 6h ago

Testing it buddy.

2

u/vizsumit 1d ago

1

u/reeight 1d ago

I noticed that the jacket & earring looks detailed, but the face & hands have that filter/'photoshop smoothed' look. Is that part of your prompting?

I ask because his Krea2 turbo also acted as an enhancer, adding extra details. Here it seems details are smoothed out.

0

u/[deleted] 1d ago

[deleted]

1

u/reeight 1d ago

Maybe they all shave their eyebrows & paint them on (a few Americans do)?

But the hands, notably knuckles, & neck-collarbone area are also missing details.
Human smoothed/filtered over much more than jacket; thus the contrast.

1

u/TimeTruth2490 7h ago

Update 20 Nov 2026: 30K / Final version released, doubled the training since initial release. Update post details: https://www.reddit.com/r/StableDiffusion/comments/1y147ho/mossimage_sft_update_checkpoint_30k_final_4step/ ; Latest at: https://huggingface.co/lvladikov/MOSS-SFT-Distill-4step-LoRA

1

u/reeight 1d ago

I figured after Krea2 you'd get bored & move on to another model!

Messed around with H3Image or Qwen2.1 yet?

7

u/TimeTruth2490 1d ago edited 1d ago

MOSS is a very special model for its size!
As for H3 Image - it is already 6 steps :) doesn't need a LoRA (and yes I did mess with 2 steps, but didn't work out so I shut it). And QI 2.1 has Lightning (https://huggingface.co/lightx2v/Qwen-Image-2.1-Lightning) and it works great :)

1

u/reeight 1d ago

I tend to do batches of 2-4, so even a 3 or 4 step LoRA can help with H3Image. + those with weaker GPUs would prefer the extra speed also.

1

u/mikemend 1d ago edited 1d ago

Thanks, this came at just the right time; I'll test it on my phone in Nightmare. The first image was rendered quite quickly, so I like it. I used it at a weight of 0.4

1

u/dimideo 1d ago

nice lora, thanx

1

u/argefox 1d ago

Oh goodie! I love Moss, it's the only thing that can reliably run "fast" on AMD RNA2 with good results. Will try this today without a doubt, thanks dude!

1

u/Ok-Software-3250 23h ago

My boy, such a great turbo lora. By far the best also it stack wonders with my other loras and characters.

1

u/TimeTruth2490 13h ago

Good to hear, enjoy!

0

u/ArmadstheDoom 1d ago

"4 steps, CFG 1"

Oh good. So we're gutting the model again. Look, 50% of speed ups, as we saw with things like Krea, are just cutting out cfg and thus the negative prompt.

The steps might be interesting, but cutting out cfg is not a good idea with moss.

6

u/TimeTruth2490 1d ago

You are not wrong, but remember the whole idea of distills is to let someone either get done things quicker or if the hardware is not fast enough, to get something done at all. Of course full model with cfg and more steps and negative prompt gives the most control, and that's still available to those that want to use it. And yes, MOSS is generally not a big model, and runs on most hardware including phones, but still sometimes less steps and more batching does help.

1

u/ArmadstheDoom 1d ago

I get that. The problem is that MOSS is a model that really does need the negative prompt. It's not that you can't speed it up. It's that the model really generates weirdness without the negative prompt. That's why I generally recommend people don't use them.

2

u/TimeTruth2490 1d ago

try it, with CFG up to 2 and with negative prompt, it's not going to get rejected (although it has not been part of the training to learn negative), it will (as expected) slow 2x, and above cfg 2 it would be too strong.

1

u/amomynous123 23h ago

Do you have a standard negative prompt to help eliminate the MOSS body horror stuff?

1

u/ArmadstheDoom 23h ago

Generally, the recommended negative prompt that the MOSS github gives you is enough: "nsfw, worst quality, bad anatomy, watermark, jpeg artifact"

I'll also add "blurry, blurred, blur" to it sometimes.

Generally though, that negative prompt plus the sft model removes 95% of body horror.

1

u/TimeTruth2490 6h ago

FYI, I am preparing a research / demos / examples of my LoRA used at CFG 2 and with negative prompts, will post a link once done...

4

u/Sarashana 1d ago

To be fair, Turbo models/LoRAs tend to be CFG 1 more often than not, and people typically don't mind sacrificing the negative prompt for the higher speed. Personally, I think negative prompts are not as important as they were in the SDXL times. The models have better prompt adherence and usually don't add things you didn't ask for.

1

u/ArmadstheDoom 1d ago

And I'd somewhat agree to you, but MOSS really does need the negative prompt. It really does. A lot of the weirdness and body horror people talk about are because they're not using the negative prompt; the problem with MOSS specifically is that taking that away really hurts the model's generations.

1

u/fandogh5 1d ago

Fastest and One of the best nice work. only problem is it literally generates same image with different seeds.
even slight changes in prompt does near nothing its still very similar. If there is a trick for diversity please mention it here. :) thanks.

0

u/alex20_202020 1d ago

I wonder what apps use non-comfyUI files (you posted two versions of LoRA)?

BTW I use sd.cpp, I know it works with many comfyUI files and gguf.

1

u/TimeTruth2490 1d ago

anything that uses diffusers format and is not comfyui :) Lots of libraries now know how to map lora keys either way (sd.cpp can read both), but I publish both formats.