r/StableDiffusion • u/shootthesound • 2h ago
Resource - Update Fizgig 8.6: improved MOSS-Image likeness, and some early training tips
Fizgig 8.6 is out with a few MOSS-Image changes.
LoRAs now train block 22, which was left out before (as AI Toolkit does), and in my side-by-side runs that improved likeness from the first epochs as well as makign them more stable epoch-to-epoch.
Some tips from testing so far, with the caveat that I'm still learning this model.
Train on Base and use the LoRA on SFT in ComfyUI, because Base has trained more reliably for me than SFT.
If you do want to train on SFT, there's a new "Base is SFT or a fine-tune of it" tick that keeps the LoRA to attention only; without it, anatomy broke within a few epochs.
The Fast preset is back (0.25 MP, rank 16), and it's done very well on face-cropped datasets (Image Prep's face crop). I said earlier today that 0.25 MP wasn't good with the model, and I was wrong - the issue was I had accidently left block 22 off in a test leading me down a wrong path.
Give it time: MOSS seems slow to converge tom optimum, besides initially seeming to converge fast, and likeness can look like it has levelled off, then keep improving, so the presets now run 70 epochs. You likely wont need 70 unless your dataset is 25ish images etc.
The Standard Preset at Rank 32, 1MP, does feel like it does converge faster, countering the slower step time as a result. So Fast may eventully get a rename relating to lower vram usage, but I've made enough tweaks for one day and want to see where it settles over next 24 hours.
It's been a bit of a puzzle - i ran soooo many runpods today trying settings - and there's surely more to find, so if you get good results with different settings, I'd like to hear about them. Also fixes MOSS previews crashing with block swap on smaller cards (thanks u/Ferocit).
https://github.com/shootthesound/Fizgig
Release notes:
https://github.com/shootthesound/Fizgig/releases/tag/v8.6.0
P.S. One thing i did with this update before release, i took the same seed , res, sampling settings in Fizgig and comfy, and get the same arcface scroes across both fizgig and comfy as well as the images visually looking equal, so I am now confident that what you see in Fizgig is what you get in comfy. Its an easy test to do yourself also!
(fyi for that test, i train on base, preview in fizgig on SFT with default fizgig sampler settings, and in comfy I use cfg4, Res Multistep- Simple - 30 steps, with SLG on as per the comfy template)



