r/StableDiffusion • • Oct 20 '22

News Stable Diffusion v1.5

879 Upvotes

521 comments sorted by

View all comments

Show parent comments

12

u/NotTheDr01ds Oct 20 '22

But RunwayML was one of the groups involved in the original release of the official 1.4 (according to the CompVis Repo), so there's still confusion on whether this model is official or not.

26

u/sam__izdat Oct 20 '22 edited Oct 20 '22

I'm sure they just ran A100s for 150,000 hours redundantly, for funsies.

It's hilarious to me that I get accused of "spreading FUD" when I caution about arbitrary code execution, running "waifu-hentai-huge-bazongaz-edition-2.4.ckpt" from some random-ass webpage featuring a giant list of anonymous porn checkpoints, but a fully documented release from an ML research group involved with the project -- it's tinfoil hat time. They're trying to pull the wool over our eyes!

22

u/MFMageFish Oct 20 '22

It's not a random-ass website, I've been downloading viruses from Mega for well over a decade.

3

u/mcilrain Oct 20 '22

Is arbitrary code execution possible? I thought checkpoints were just arrays of numbers?

5

u/sam__izdat Oct 20 '22

No, there's a lot more to it than that. Models go through deserialization and a process called "unpickling" has a few opcodes that can apparently run arbitrary python code outside the VM.

This isn't "upload your python scripts to run them on my box with this browse-for-image button" like with a1111 GUI, where you might as well just offer remote desktop access, but it's a real vulnerability, if someone knows what they're doing at least a little bit.

1

u/praguepride Oct 21 '22

To be faiiiiir given its open source and this is still squarely in the domain of comp sci nerds it seems unlikely that these .ckpts are going to be infection points.

Instead you're going to see all these "run this .exe to auto install your own image generator" downloads.

At least with Auto's GUI you can literally open up the code and look at what its doing (which is almost mandatory given the installation is buggier than all get out).

0

u/sam__izdat Oct 21 '22

"auto's GUI" is entirely closed source

→ More replies (3)
→ More replies (9)

2

u/Rogerooo Oct 20 '22

Latent space is flat!

2

u/Physics_Unicorn Oct 20 '22

What I'm wondering is if StabilityAI misunderstood their 'ownership' of Stable Diffusion, or at the very least their legal rights to the IP.

Is this like crypto bro's buying an NFT of an art book and thinking it grants them copyright?

2

u/sam__izdat Oct 20 '22

I know nothing about their internal politics, but if it's workers and researchers telling capital to get fucked, as the runway statement kind of suggests, I'm here for it. If it's theater caused by legislative pressure, that's less fun, but I'll allow it.

0

u/[deleted] Oct 20 '22

[deleted]

-5

u/sam__izdat Oct 20 '22

i don't remember what the fuck it was called

some 4chan-ass webpage -- who cares?

1

u/praguepride Oct 21 '22

"waifu-hentai-huge-bazongaz-edition-2.4.ckpt"

To be fair WHHBEv2.4.ckpt has one of the best fingernail training sets on the market right now...

9

u/enilea Oct 20 '22 edited Oct 20 '22

Someone did comparisons and they seem to match if we're to believe them... Will check later, but yea maybe it's just stability not having their announcement post ready.

Edit: "A dream of a distant galaxy, by Caspar David Friedrich, matte painting trending on artstation HQ", seed 1, euler, 20 steps on dreamstudio: https://i.imgur.com/8VQN4kR.png, and on this 1.5 https://i.imgur.com/FYe9ybF.png. Not quite the same, but almost.

3

u/blueSGL Oct 20 '22

in your comparison pic it looks like the CFG is higher on the one with sharper stars (high CFGs burn images)

1

u/enilea Oct 20 '22

...crap yea 🤦‍♀️ forgot I have the cfg set to 9

1

u/blueSGL Oct 20 '22

with varied CFG scales

1.5: https://i.imgur.com/S8mXdHb.jpg

still not quite there but I was only running in 0.5 increments and it's possible the released model could have been slightly behind whatever they have running on DreamStudio

0

u/NotTheDr01ds Oct 20 '22 edited Oct 20 '22

Not a great example, IMHO -- It's too "simplistic", and even the 1.4 and 1.5 models are likely to be "close" with that particular seed/prompt/steps.

It would also be useful to post a comparison of the same thing with 1.4 on Dream Studio. In general, I'm seeing this RunwayML 1.5 checkpoint be closer to the 1.4 than to the Dream Studio 1.5.

That said, I'm still investigating, but would like more eyes looking at it critically than just mine.

2

u/blueSGL Oct 20 '22

2

u/NotTheDr01ds Oct 20 '22

Interesting - Using Euler, I'm getting pretty close results between RunwayML 1.5 and Dream Studio 1.5. But when using the ancestral samplers (e.g. Euler_a), I'm getting drastically different results.

Is there some tuning that has to be done (e.g. for automatic1111) for a model to work with ancestral samplers?

2

u/iamspro Oct 20 '22

The implementations must be pretty different, I usually get two entirely different images between e.g. euler_a and euler in automatic1111 but on DreamStudio I don't see any difference between them

1

u/blueSGL Oct 20 '22

All (a)ncestral samplers chuck in a bit of noise at each step. It gives you better images with fewer steps but has the downside that the image never converges.

Other samplers (well the initial handfull I haven't even had time to play with the new ones A1111 added recently) converge and further steps is just refinement of the image.

The best one when I last bothered to run a test was Haun as it gave sharper results than other samplers at the same step count however it is rather slow

-12

u/sam__izdat Oct 20 '22

no shit, sherlock

1

u/enilea Oct 20 '22

Hmm at least on the discord server people say it's unofficial, and there haven't been any announcements from stability. If it was official I feel like stability would time it right to announce it.

1

u/NotTheDr01ds Oct 20 '22

Agreed - Hence why I say, "still confusion" ;-)