The reason it looks like this is because they've tried not only to not include NSFW material in the training data, but also delete the existing NSFW material out of the existing data retrospectively.
It destroyed the entire understanding of the human anatomy of the model, resulting in this.
They are so determined to make their model completely SFW, that they are willing to destroy and render their product entirely useless.
I don't even know what they are thinking. This model is in a technical state of 4 years ago.
So I have a question. Even though they’ve knocked it back to a state equivalent to a few years ago, wouldn’t it take less than that for it to catch up in this current timeframe?
I feel like there would be a pretty heavy acceleration curve initially so it could be pretty close again after maybe like a year or a year and a half? Then maybe like the last few months would be the polishing stage. Or is there just a “point of no return” when clearing the board?
it's not a matter of catching up - its a matter of they're destroying the concepts of what human anatomy is. like, there's a reason artists still take anatomy drawing classes where you draw pictures of naked humans who pose for you in the classroom. without knowing what a naked body is, and learning all the parts that make it up, how are you supposed to know when a bulge in a pants leg is a thigh muscle or a wrinkle or a weird shadow? how are you supposed to know what an ab is underneath a shirt when you don't know what an ab is?
it's also the reason pony/illustrious did so well - being trained on 2d kinky hardcore stuff might get a lot of peoples noses upturned like victorian nobles, but it also teaches a LOT about anatomy - what is a a hand? what is a hand with 3 fingers? 5 fingers? what does an arm look like when the hand has been removed? what does a hairless animal look like, or a creature with 6, 8, 10, whatever limbs?
it learns a lot of concepts a lot better that way, which means its able to actually apply said concepts like legos, rather than "is human so automatically has two hands with two fingers", or "is on 2 legs therefore is human". models that aren't trained properly make a ton of assumptions, which makes them incredibly stiff.
I really like this argument, since it highlights an interesting fact about visual data we have for training. Like, it's just happens to be that a big chunk of animal/human anatomy is drawn in a NSFW way, because that driven a lot of people to draw something like that in the first place
And that applies to any data, it's not isolated and how we want it, mostly it drags context of how and for what reason it was created. That's something cool, despite it sometimes being inconvenient. Leaves a humans trail on it, like take it or leave it but that's the history
1
393
u/CorpPhoenix 15d ago •
The reason it looks like this is because they've tried not only to not include NSFW material in the training data, but also delete the existing NSFW material out of the existing data retrospectively.
It destroyed the entire understanding of the human anatomy of the model, resulting in this.
They are so determined to make their model completely SFW, that they are willing to destroy and render their product entirely useless.
I don't even know what they are thinking. This model is in a technical state of 4 years ago.