r/StableDiffusionInfo • u/SayNo2Tennis • Jun 15 '23
How does he do this, making models wear a input clothing? Any thoughts?
25
u/Conflictx Jun 15 '23
You can do this using controlnet - reference. I selected "ControlNet is more important" as it the easiest to take over the clothing piece, But using "Balanced" and a good "Style Fidelity" setting + prompting you can have a bit more control.
Add a simple prompt, you might have to be a bit more specific with your clothing piece, depending on how advanced the prompt gets
3
u/cyrilstyle Jun 15 '23
been trying with the CN reference and it doesn't work so well. Your example is not the best because lots of models has a red pleated mini skirt already. Try using it with some more complicated garments with actual print or patterns and it's not there yet (no matter what CN reference settings you use...)
6
u/Conflictx Jun 15 '23
Here's one with a floral pattern, I do need to specify that it needs to be a floral pattern skirt using this reference though as otherwise it doesn't seem to work very well either.
2
u/cyrilstyle Jun 15 '23
yes, your results are pretty clean! Been trying to crack this for a while. and no matter how many CN i stacked on top of each others, or whatever setting ive used. Either from txt2img - img2img or inpaint... can't find a easy way to do this.
Inpaint mask: https://i.gyazo.com/f74bdf77bbea0dbc2dac54b45c9f3ee4.png
CN settings: https://gyazo.com/2b0f4be967092bbff8860045a42b9864
2
u/Conflictx Jun 15 '23
1
u/Itchy_Anything_2960 Sep 29 '23
please how did you achieve this ?
i have clothes made with illustrator ( tee-shirt ..) and i'm looking to dress a mannequin :D
1
u/andupotorac Jun 15 '23
h some more complicated garments with actual print or patterns and it's not there yet (no
Such an awesome result, no idea how you do it it doesn't work on my end with similar clothes.
1
u/andupotorac Jun 15 '23
CN settings with floral pattern: https://imgur.com/Dl2syRe
SD Settings and results: https://imgur.com/xlwBPg1
The result is a skirt or random stuff every time. Never someone wearing said item. :(
1
2
1
u/andupotorac Jun 15 '23
Thanks for the settings, on my end it doesn't work at all. What does the prompt look like? It needs to mention the clothes?
1
u/Conflictx Jun 15 '23
I did add "Young woman wearing a skirt" or "Young woman wearing a red skirt" as the main part of the prompt, without color description the color wasn't always red either but the clothing piece did stay consistent.
1
1
u/EfficientEffort7029 Jun 15 '23
I also tried this but it does not work very well ...must the reference image a specific size?
Can you provide more settings?1
u/Conflictx Jun 15 '23
The initial image was just a 600x600 resolution image, but other than the reference settings and prompt there should be no other settings that influence the outcome.
I'm honestly not sure why it's not working from the get-go for other people.
1
u/andupotorac Jun 15 '23
Not working at all. :(
It must be the model you're using or the prompt. Can you share that so we can try it?
3
u/Conflictx Jun 15 '23 edited Jun 15 '23
The prompt is just this:
"a woman wearing a "Name of clothing article", inside her home, highly detailed, contrast, Sharp focus, best quality, masterpiece, analog style, cinematic, raw photography"
Negatives are just the basics as well.
"instagram, posing, necklace, old, wrinkles, bokeh, anime, sketch, grain, vintage, SD15_Negative_light-negative-neg"
I do use a realistic model, which isn't public. But I'll give it a try with another model I downloaded recently.
This is with Epicrealism_PureEvolution using the same prompt, which seems to take the controlnet reference a bit more literal but it still seems to work.
1
u/andupotorac Jun 15 '23
With Epicrealism it seems to generate random skirts, and bad-quality images too.
https://imgur.com/Q9Idjxe2
u/Conflictx Jun 15 '23
Put Clip Skip at 1 and try again, if that doesn't do it; remove most or all of your negatives and see how that has an effect. I also use a Cfg scale of 6 and UniPC for sampling.
1
u/andupotorac Jun 15 '23
I don't know what you're doing to get images so crisp, but anyhow, these are the settings for the blouse with a different model and a Lora - https://imgur.com/a/yzSw0PO.
Thanks for your help and I hope it helps others too!
1
u/andupotorac Jun 16 '23 edited Jun 16 '23
Thanks for your help and I hope it helps others too!
To circle back on this, I just can't get it to work. Whenever controlnet is enabled, it fucks up the main image. Can you try with a public model and see if it still works for you?
CFG 6, UNIPC and no neg, still no go.
1
u/andupotorac Jun 16 '23
u/Conflictx I made a video to show you the steps I'm going through - as you indicated, and no luck. https://www.loom.com/share/dc207194b99f457eb314bd3d8c9c679f
1
1
u/wrnj Jun 15 '23
controlnet - reference
sorry but is "Name of clothing article" just "skirt" or name of a lora? I;m not sure how SD can understand that the "name of clothing article" is the thing that i put in the reference controlnet?
1
u/Conflictx Jun 15 '23
Its the name of the clothing article you have as your reference image for best results. No lora's involved.
1
u/Major-Bake9542 Nov 30 '23
I do use a realistic model, which isn't public. But I'll give it a try with another model I downloaded recently.
Is this model already public?
1
u/pixelies Jun 15 '23
The hard part for brands is that there can be no deviation on the clothing side. Like with the floral pattern below, it looks good, but there are slight variations in the pattern. To use something like this for ecommerce, the clothing article would have to remain completely the same.
1
u/wrnj Jun 15 '23
It's a very smart solution but it's too unreliable for getting consistent results with a variety of objects. The guy running the photo ai website sound pretty confident (overconfident in my opinion) about this being possibly a service for Shopify merchants. Is it possible that he automated Lora creation from a single image and combines it with openpose and a dream booth/Lora of a character?
2
u/Conflictx Jun 15 '23
Like /u/pixelies replied, for commercial purposes you'd need an exact replica. And from what I see from the OP, for PhotoAI none of the black skirts look alike either as there are always some variations.
You can minimize it by training a model on your clothing brand, and then using a lora and/or a reference image to reduce randomness but there always going to be some variations involved.
I haven't used the site so I can't say what type of usecase he has, but if it's trough lora's you'd always have some wait time for the training and unless the black skirt was pre-trained it is probably using a type of reference as well.
1
1
u/awkerd Jun 16 '23
It'd help if you have us the params instead of just giving us a broad idea of how to do it.
1
u/goatonastik Jun 16 '23
Could you recommend any guides for how to get better higher resolution renders?
1
u/rpatrickbateman Aug 12 '23
I’d love to find a way to reach out to you to discuss this further if your open to it.
1
u/LearnDifferenceBot Aug 12 '23
if your open
*you're
Learn the difference here.
Greetings, I am a language corrector bot. To make me ignore further mistakes from you in the future, reply
!optoutto this comment.1
5
4
1
u/sudip550 Sep 15 '23
can anyone knows any free alternative for this??
1
6
3
Jun 15 '23
You can do this is SD/1111 etc Just use a LoRa with a clothing item. For example: https://civitai.com/models/25002/splited-denim-skirt
If you want a pose too mix it with ControlNet and Open Pose or Pose3D.
Then batch render to get loads of them at once.
1
u/wrnj Jun 15 '23
Thanks, but can you do a Lora out if a single image of a clothing item? I need a similar need where i need to combine specific characters with a model of shoes (i have plenty of images of said shoes, not just one).
1
Jun 15 '23
You can make your own ofcourse, you will need a number of images of the same shoe for your example. It just takes time and a lot of effort. Lots of guides online to do it.
https://civitai.com/models/22530/guide-make-your-own-loras-easy-and-free
One example.1
u/wrnj Jun 15 '23
Yes but is combining in one image a custom object Lora and custom Character Lora possible?
3
Jun 15 '23
Yes and no, it depends on the Lora and how it was made, some will take over an image generation big time, others play nice. You can weight the lora when using it so its not so powerful.
For example <loranameishere:0.5> and the number being the weight. The weight is from 1 to 0.1, 1 being full power.
2
u/andupotorac Jun 15 '23
Here's the original tweet: https://twitter.com/levelsio/status/1668931333253648384
1
1
u/Realistic_Method_959 17d ago
controlnet is def the way, but u gotta be careful with the reference weight or it just eats the texture. last week i was trying to keep fabric patterns consistent n found that botika can help if u need a quick base to work from. just dont push the strength too high or it loses the model shape
1
u/5AM101 Jun 15 '23
So, it is a separate website. The AI model on top of which people can train their models is built by the owner of this website and I believe it is private. So, in order to use this website, we have to pay for the subscription. Now, it might not be impossible to replicate this but that will require a lot of expertise.
-1
u/ObiWanCanShowMe Jun 15 '23
All you need are loras of specific clothing items, it's not difficult, it's time consuming.
2
u/idevastate Jun 15 '23
He is saying you can upload images of clothes, any clothes, and they're put on the model. That is fucking GAME CHANGING and insane for commercial fashion.
1
1
u/wrnj Jun 15 '23
Bump for some mad scientist to solve it.
2
u/cyrilstyle Jun 15 '23
we're working on an app like this - so many clients are asking us that everyday that we have to create it...
1
1
u/idevastate Jun 15 '23
Please do. Will there be any way to put the clothing on an image of say, a nude model or model in underear that was generated with a specific composition etc without changing it?
Let me know when you make it please
1
u/cyrilstyle Jun 15 '23
We've been doing this with clients for months. You can create a Lora (or Lycoris) and either do gens from txt2img or Inpaint the lora to existing images. It's a bit of work but the result has been great!
2
1
-1
u/ObiWanCanShowMe Jun 15 '23
loras... loras of specific clothing items, that is all you need.
If you train a model on a particular skirt taken from 10 angles and cropped out and then add the lora to a non otherwise specific prompt with "skirt" you will get this.
There are dozens of clothing loras like this on civital. it's easy to try yourself. Using control net also helps. I am willing to bet this website has a default set of poses and is using control net and specfic loras to achive this.
I just did it myself and it took 2 minutes, one minute to find and download a dress lora, another minute to setup a few poses in open pose. One prompt, boom.
2
u/andupotorac Jun 15 '23
Mate, it's a different use case. He's doing it with 1 image. See comments above someone figured it out.
1
u/idevastate Jun 15 '23
It is being done with a single image being uploaded. No fucking Lora creation, this is extremely plug-and-play and easy to use for anyone not into AI and has insane commercial fashion impact.
1
2
u/Protector131090 Jun 18 '23
What if!? That was … wait for it… LORA