SDXL LORA STYLE Training! Get THE PERFECT RESULTS!

Просмотров 50 тыс.

% 1 297

In this video, I'll show you how to train LORA STYLE SDXL 1.0 using YOUR OWN IMAGES! I spend hundreds of hours testing, experimenting, and hundreds of dollars in cloud computing training to bring you the ultimate LORA STYLE training guide for complete beginners and experts alike for Stable Diffusion. SDXL is incredibly easy to train as long as you know what you are doing with the right training parameters. After this video, you’ll have the required knowledge to train any style you want with the Kohya GUI tool.
What do you think of SDXL Style LORA? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
✨ Support my work on Patreon: www.patreon.com/aitrepreneur
⚔️ Join the Discord server: bit.ly/aitdiscord
🧠 My Second Channel THE MAKER LAIR: bit.ly/themakerlair
📧 Business Contact: theaitrepreneur@gmail.com
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✨ PATREON LINK: www.patreon.com/aitrepreneur
Previous Lora video: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-N_zhQSx2Q3c.html
Kohya ss GUI: github.com/bmaltais/kohya_ss
SDXL: huggingface.co/stabilityai/stable-diffusion-xl-base-1.0/
Jup1t3R!
scale_parameter=False relative_step=False warmup_init=False
Runpod: bit.ly/runpodAi
Runpod Template: runpod.io/gsc?template=ya6013lj5a&ref=w18gds2n
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
►► My PC & Favorite Gear:
i9-12900K: amzn.to/3L03tLG
RTX 3090 Gigabyte Vision OC : amzn.to/40ANaue
SAMSUNG 980 PRO SSD 2TB PCIe NVMe: amzn.to/3oBR0WO
Kingston FURY Beast 64GB 3200MHz DDR4 : amzn.to/3osdZ6z
iCUE 4000X - White: amzn.to/40y9BAk
ASRock Z690 DDR4 : amzn.to/3Amcxph
Corsair RM850 - White : amzn.to/3NbXlm2
Corsair iCUE SP120 : amzn.to/43WR9nW
Noctua NH-D15 chromax.Black : amzn.to/3H7qQSa
EDUP PCIe WiFi 6E Card Bluetooth : amzn.to/40t5Lsk
Recording Gear:
Rode PodMic : amzn.to/43ZvYlm
Rode AI-1 USB Audio Interface : amzn.to/3N6ybFk
Rode WS2 Microphone Pop Filter : amzn.to/3oIo9Qw
Elgato Wave Mic Arm : amzn.to/3LosH7D
Stagg XLR Cable - Black - 6M : amzn.to/3L5Fuue
FetHead Microphone Preamp : amzn.to/41TWQ4o
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Special thanks to Royal Emperor:
- TNSEE
-Gluthoric
Thank you so much for your support on Patreon! You are truly a glory to behold! Your generosity is immense, and it means the world to me. Thank you for helping me keep the lights on and the content flowing. Thank you very much!
#stablediffusion #sdxl #lora #aitools #texttoimage #ai
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - All LLM & ChatGPT Video:
►► ru-vid.com/group/PLkIRB85csS_tqEhGFLAPIYuQ-Rwhg_kpQ
RECOMMENDED WATCHING - My "Tutorial" Playlist:
►► bit.ly/TuTPlaylist
Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.
Timestamps:
00:00:00 Train SDXL with LORA
00:00:57 What is LORA?
00:01:11 Koya SS GUI
00:01:53 Image Dataset preparation
00:04:45 Find good video game images on Steam
00:05:32 Upscale images sharper with Stable Diffusion
00:07:50 Make sure images are not too big for LORA Training
00:08:31 SDXL LORA Training Folder Creation
00:09:45 Instance Prompt
00:10:30 Find the right style for LORA Training
00:12:48 Class Prompt
00:13:00 LORA Repeats Training Steps
00:14:21 Regularization images
00:17:39 Training Data
00:18:18 LORA Image Captioning
00:22:52 How to replace a word in multiple text files on Windows
00:26:00 The right SDXL STYLE LORA Training Parameters
00:26:28 LORA Type Standard vs LoCON or LoHA LyCORIS
00:26:49 Train Batch size
00:27:44 Number of Epoch Training
00:28:54 BF16 & FP16 & Cache
00:29:27 The RIGHT Learning Rate for SDXL STYLE LORA
00:30:11 SDXL Image Resolution & Buckets
00:30:55 LORA Network Rank & Network alpha
00:31:40 Gradient Accumulate Steps LORA
00:32:21 Noise Offset LORA
00:33:14 LORA Training & VRAM Usage
00:33:38 GPU Solutions & RunPod
00:34:02 Runpod Setup for LORA Training
00:34:41 Runpod Template LORA Update
00:36:43 How to select the right LORA Model?
00:38:43 Chose the final Model
00:41:37 Conclusion on LORA STYLE Training

Опубликовано:

11 сен 2023

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 121

@Aitrepreneur 9 месяцев назад

HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx

@LouisGedo 9 месяцев назад

👋

@Sicarius-prod 9 месяцев назад

How about reviewing oobabooga's new TTS extension?

@odessaodesa5307 2 месяца назад

Thank you very much! You have the only video on RU-vid about training LoRa for style, not for character!!! 👍🙏😻

@ryanzamora155 8 дней назад

Finally, a video on style LoRA! Very thankful for it. My VRAM isn't so good that I can train/generate stuff on SDXL, but this guide is so general that I can rely on it even for stuff based on SD1.5. I suppose the only difference would be that I'll still be stuck on 512 x 512 resolution and some other minor differences. Thank you very much!

@thedesigngraphik 7 месяцев назад

Pateron supporter and was one of your followers asking for this for a few months. I finally had time this weekend to explore this, and just wanted to say a huge thanks! I finally have a lora that doesn't look so nasty and overtrained. I had improved results already using your character training from awhile back, but this really nailed it in, and the tip about using a famous artist helped. I actually found using a famous art movement (abstract expressionism) helped it to understand my work. This is massive, thanks so much for all the videos you have posted this year, for stable diffusion that have been game changing for me.

@polykrom 9 месяцев назад

thanks a lot again for this so great tutorial and the patreon you made in conjuction ! Great job Dude !

@scienceandmind3065 8 месяцев назад

thanks for the great content. you now are the first creator I support on Patreon.

@SanAndreas-Akiyama 9 месяцев назад

Finally you back ❤

@Aitrepreneur 9 месяцев назад

I am ;)

@stevebruno7572 9 месяцев назад

Thanks for the update

@Aitrepreneur 9 месяцев назад

😉

@dkf-nl1703 9 месяцев назад

Thank you for another excellent video. One question I still have is how can I change the trigger word(s)? Do they change when you replace the subject in the .txt files? Or is it hard coupled to the instance prompt? In your previous video (the character one) you had to prompt "sascha luss" to create the Milly character, which my brain doesn't really like 🙂

@nic-ori 9 месяцев назад

Useful information. Thank you.

@Aitrepreneur 9 месяцев назад

Glad it was helpful!

@diegopons9808 7 месяцев назад

Hey! Thanks for all of your knowledge and support always. I have a quick question. What app do you use for your notes (the app where you save the sample photos of your epochs to compare and choose the best one ?

@jurandfantom 9 месяцев назад

replaying in background to increase stats :) good to see you posting video once again. Hopefuly you were able to catch up few things when you were waiting for training results :)

@Aitrepreneur 9 месяцев назад

Thanks yeah a little bit ;)

@bixxybear 9 месяцев назад

Please do another simplified video on how to locally install vicuna, previous videos seem to have become outdated.

@tomasokeefeparrot247 9 месяцев назад

Hey, great video as always! As a video suggestion, could you make a guide to creating abstract concepts with Stable Diffusion? I'm trying to create a Solarpunk model that could work on different styles: photorealism, illustration, anime, oil painting etc.

@tomasokeefeparrot247 9 месяцев назад

And if anyone has any suggestion on how to do it I'm interested in your guy's thoughts!

@Aitrepreneur 9 месяцев назад

Yeah I plan on making more training videos ;)

@rashedulkabir6227 9 месяцев назад

@@Aitrepreneur Also make a video about how to fix hands.

@deadlymarmoset2074 9 месяцев назад

Is there anyway to enque trainings in khoya? So that you could set a few up and have them train overnight.

@coulterjb22 9 месяцев назад

When you run a test on all of the models to choose which you like, have you run that a few times to see if your best model stayed the best?

@stevebruno7572 9 месяцев назад

Also been meaning to ask don't you find when training a character using another celebrity's name that the model is trained on that the model's image generation still picks up a lot of mannerisms and locations that the original celebrity was trained with despite the trained character Lora being used? Like hypothetically if you were a doppelganger for Ben Stiller and lived in the same universe as Zoolander and you decided to train your own face but instead of using Bstiller as the name of the Lora you use Derrik Zoolander because it's a great match and your AI model would certainly know who he was even after training it would seem to be that it would continually show you at modeling runways and dressed fashionably, and doing his poses even though the face would look less dramatic than Zoolander and more like typical Ben Stiller (Edited to add the Zoolander thing)

@travisatessier 9 месяцев назад

what is that tool he's using where he's searching for what prompts sdxl understands? the "something" studio by stability ai

@chromo48 9 дней назад

"No effort required whatsoever..." That pretty much sums it all up.

@danielkahbe964 9 месяцев назад

Can you make one more on character training? The old one is kinda outdated, I followed your guide and my results were pretty good.

@Aitrepreneur 9 месяцев назад

I did one a few weeks ago: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-N_zhQSx2Q3c.html

@PaddysPubPatron 9 месяцев назад

Thought you were dead. Welcome back.

@Aitrepreneur 9 месяцев назад

Still alive and kicking! 😁

@coulterjb22 9 месяцев назад

Thank you for all of your hard work. Its mind simply amazing. The time to do this AND make this video must have been crazy tough!

@Midplayz 7 месяцев назад

What if I want to train a LoRA to generate comic pages with panels and all? What type of images should I use to train it?

@notheories9012 7 месяцев назад

This is great but I'd be interested in training some thing that SDXL doesn't already know about. Would I have to create a model for this?

@Flor-ly5cg 5 месяцев назад

Hi. thank you for the tutorial. I get this message at the beggining of the training. The following values were not passed to `accelerate launch` and had defaults used instead: `--num_processes` was set to a value of `1` `--num_machines` was set to a value of `1` `--mixed_precision` was set to a value of `'no'` `--dynamo_backend` was set to a value of `'no'` To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.

@MilesBellas Месяц назад

Stable Diffusion content = interesting

@sitr2516 9 месяцев назад

This is good but What I would really like to see, esp for patreon subscribers. is a tutorial on how to in-paint, and make hyper realistic stuff. or maybe even better is how to use comfy UI and all of its little addons and stuff.

@TheEnderFlash 11 дней назад

What should the regularization images contain for style training?

@karkarkarkarkar 9 месяцев назад

Should I remove character tags when pruning/tagging? I'm training on an anime art style and not sure if I should include tags like "Erza Scarlet" for example.

@Latentnaut 28 дней назад

Could you send the link to the Text Replacer app?

@377omkar 3 месяца назад

Whwre do you see that all the styls

@Christopherseander92 9 месяцев назад

I used your settings right (SDXL-style.json) with 40 images and 20 reps, I think it overfitted very early on, would you lower the learning rates or change something else?

@Aitrepreneur 9 месяцев назад

Yes you can change the learning to rate to something like 0.0009 instead

@activemotionpictures 9 месяцев назад

10:40 - What's that purple URL website? is it a local instalation of SD?

@travisatessier 9 месяцев назад

right? what is that?

@swannschilling474 9 месяцев назад

This is great info...but I realized that repeats is nothing more than a way to describe how often you would be theoretically save a checkpoint/LORA because the minimum is one epoch. Also I never experienced that upping your batch size reduces training time. It reduces steps, but iteration time increases as well...so its just a trade off and the training total time stays the same! For Gradient Accumulation to not get weird, just make sure that Batch Size times Gradient Accumulation is not higher that your total images count! 🙂

@digidope 9 месяцев назад

Yes, the author does not seem to understand the point of repeats. It's there so you can balance your dataset. You have images in folders with the repeat number: woman20, dog10, sword15. You can use it to add more concepts to same LORA and/or balance the importance of the dataset. Want more dog than sword? Then set dog repeats higher.

@swannschilling474 9 месяцев назад

@@digidope thanks for the info, I did not know that you can create multiple subfolders with different repeats and different subjects... I always thought you'd need another training pass to do so! I will do some testing!! 😁

@digidope 9 месяцев назад

@@swannschilling474 Read the documentation. DOCS folder has series of README documents. There is also examples like: image_folder_structure

@madrooky1398 8 месяцев назад

Everything that is supposed to be a variable has to be named. I.e. you want to change eye colours? Describe the eye colours! But you can also train a bias on purpose. For example you don't like beards but your base model has a lot of beards and you need to use negative prompt to keep the guys shaved? Train the model with shaved guys and don't mention that they are shaved, so the model will start to default to beardless guys more. That way you just need to know what you want to be optional later and base your concept around that. If you are not persistent with these things the model gets confused and produces rubbish.

@azimuth2142 9 месяцев назад

Is it available for Radeon yet?

@Tulak123 9 месяцев назад

Ahoj, dík za návod ale mohl bys prosím zapnout automatické titulky jaksi nejsem zdělán v tvém jazyce. Zdravý odběratel z České Republiky.

@wndrflx 9 месяцев назад

On the character training tutorial we used 10 epochs and you said it would take about 2 hours. I have a 4090 and it took about 50 minutes. Is this a difference in hardware speed or could it have been incorrect settings?

@thewanderingartists 9 месяцев назад

I have 1660ti laptop, should I quit before I even try installing AI ?

@cristitanase6130 9 месяцев назад

Is there a minimum VRam requiring for this?

@generalawareness101 9 месяцев назад

18GB

@jimdelsol1941 9 месяцев назад

Will you make a tutorial on how to make a Lora for a particular pose / situation ? Btw, do you know how they train "photorealism loras" ? Or "details lora" ? I'm wondering if for each image in the training dataset they put a value for details or photorealism in the captions.

@Aitrepreneur 9 месяцев назад

Yes more training videos coming ;) I want to learn and teach people how to train literally ANYTHING!

@jimdelsol1941 9 месяцев назад

@@Aitrepreneur Thanks !

@pastuh 8 месяцев назад

Upload into GPT and ask which generated image is best

@eyalohim 8 месяцев назад

the runpod template doesnt work agian pls help im a patreaon supporter

@researchandbuild1751 4 месяца назад

Question though - if SD already knew what walking dead style was, why bother making another Style LORA for it?

@eugenbuzuk2000 9 месяцев назад

in Runpod, when i trying to connect to ports, there is message "The port is not up yet", or a "Bad gateway"

@eugenbuzuk2000 9 месяцев назад

in containers log there is - Syncing Kohya_ss to workspace, please wait... but it lasts forever

@AI_FOR_VFX 7 месяцев назад

What if I collect real photos of only 1 person, then train it to create real styles for animated photos? Is this the opposite of your way of doing things? Can it work?

@CostelAMVs 9 месяцев назад

Can you please make tutorials on anime characters training and anime style? I think such a video would be very helpful for the community 💟

@Aitrepreneur 9 месяцев назад

It's the same thing as a normal style, I trained the jojo's bizarre adventure anime style using the same technique

@CostelAMVs 9 месяцев назад

@@Aitrepreneur Thank you very much for the answer. I will also try to create similar styles

@basemmgtow7954 8 месяцев назад

can you talk about AnimateDiff extension

@DeFirm- 9 месяцев назад

Does clothing fall under the category of style?

@CannonBoe 16 дней назад

TBH compressing pngs sounds like a terrible idea. In my graphic design workflow if there's any gradient on the picture, compressed pngs with these online tools won't pass unless it's an unimportant background asset.

@CultofThings 8 месяцев назад

The rambling is more than I can take.

@GhostSAIYAN04 9 месяцев назад

Anyone know how can i do it in google colab please ?!

@moon47usaco 9 месяцев назад

Thank you for File Rename Basic. Windows rename is HORRIBLE. I used to switch over to my mac just to do proper renaming. No I can do it in windows, no problem... =]

@EvolvedSungod 9 месяцев назад

I cant get SDXL to work at all. In a1111 it just gives errors and can't load the checkpoint. Also didn't work at all with Easy Diff which I much prefer to a1111, where it just gives a weird collage of colors in the generated images. So far all the times I've posted on different videos asking for help, no one has ever replied. I'm close to giving up on all this.

@sinanisler1 9 месяцев назад

hi overlord

@Aitrepreneur 9 месяцев назад

Hey 👋

@StrangeSupreme2045 17 дней назад

10:42 what is this website??

@NaitorStudios 9 месяцев назад

For some reason I can only train with my RTX 4080 if I use the lowvram preset... Is that right?

@Aitrepreneur 9 месяцев назад

How much Vram is that 16Gb? You should be able to use a higher resolution at least

@NaitorStudios 9 месяцев назад

@@Aitrepreneur yes, 16gb... It fails because of so little amount of vram... Idk if some of the settings can help without changing it from 1024px

@Aitrepreneur 9 месяцев назад

I mean the first setting I would change is either resolution or network rank, that's the main 2 parameters that affect a lot the vram usage (with batch size)

@SacWebDeveloper 9 месяцев назад

All of your trainings seem to just be enhancing things that already exist in the model, what if what you want to train, say a concept (like a skateboard trick performed by a range of people), is not in the base model? Would we be better off training a model refinement instead of a LoRA? How does that differ from LoRA training?

@digidope 9 месяцев назад

I followed the tutorial and started training with 10 images and it takes whopping 12hours for 15 epochs with RTX3090 😮 I have all the same settings and 20 repetitions.

@joelchamp1949 9 месяцев назад

I do 1 epoch, usually works well enough for what I need.

@digidope 9 месяцев назад

@@joelchamp1949 I did the whole 15 epochs for the 12 hours and when testing the results, the epochs 14 and 15 are the best. The style starts appear around epoch 8 but not as that strong. It depends on dataset and size on dataset. I had only 10 images, but if i have had 200 then less would have been enough.

@joelchamp1949 9 месяцев назад

@@digidope yeah cool. If I'm not mistaken doing 1 epoch would be the equivalent of your 15th epoch, some might say it's overtrained but I've been using it for art style so I want the maximum effect to carry over.

@1300thiago 9 месяцев назад

What happened for the reupload?

@Aitrepreneur 9 месяцев назад

youtube demonitized and buried my last video so reup here again, let's hope it works this time...

@tuoni410 9 месяцев назад

Any work around for running SDXL on RTX 2070 Super 8gb?😢

@Aitrepreneur 9 месяцев назад

Use --medvram arguments and --xformers

@tuoni410 9 месяцев назад

got it thanks!@@Aitrepreneur

@anfanger4 9 месяцев назад

so textual inversion embeddings lost the game?

@Aitrepreneur 9 месяцев назад

I mean kinda yeah, no real reason to use them anymore when you have LORA, they work the same way already

@digidope 9 месяцев назад

@@Aitrepreneur It's funny as they have always worked the same. For some reason nobody, including you didn't train LORA's first. But isn't the princible still different, so result should also be different? Negative embedings are still TI's not LORAs.

@sherpya 9 месяцев назад

reupload?

@Aitrepreneur 9 месяцев назад

Yes... youtube being youtube again demonitized and buried my last video...

@ill1c1t-one 3 месяца назад

Rah-bee

@TheOriginalOrkdoop 9 месяцев назад

Has any youtuber made a specific video about training objects? I need some advice, tips, and tricks for training objects. I am looking to train a specific style of cake. Can anyone point me in the right direction? I have made about 15 Loras about this specific cake, and none of them are perfect. Thank you for any help you can provide.

@FrancescDestefani-gs4wm 9 месяцев назад

allah hakbar ragazzuoauoli nuovo stile da rappresentare come intro in hdio

@dtory 9 месяцев назад

Second comment 😅

@Aitrepreneur 9 месяцев назад

A bit late I'm afraid xD

@Kavokane 9 месяцев назад

I love your videos, but wtf is up with the constant renaming of your videos?

@tanjabeckers9478 9 месяцев назад

Wtf

@vxarson4749 9 месяцев назад

Probably trying different things to get better CTR

@CultofThings 8 месяцев назад

$$$

@alonsorobots 9 месяцев назад

Thanks SO much for the content. Why do you shake the video? like at :53 It's kinda annoying of people trying to read. If you don't want people to read, then I would suggest not adding an image that people would want to read.

@sripathia996 9 месяцев назад

How to change face on video ..

@ryanzamora155 8 дней назад

So basically... I went to the video in the first place to learn how to properly caption training images after being intimidated by the thought of precisely describing everything for a style... only to be told to suck it up. UGH.

@AndriyNic 9 месяцев назад

0:57 from left Volodymyr Zelenskyy - world leader😎❤

@codih1716 9 месяцев назад

not a fan of the shaky avatar

@dreamyrhodes 3 месяца назад

Why are you training a style that SDXL already knows?

@johnconor8698 8 месяцев назад

Can you teach us how to train a Ai to only make basic pose drawings?

@HanSolocambo 3 месяца назад

Nice tutorial as always but in 40 minutes there's way too long about character training, just for the sake of comparing. Maybe focus more on the essential that's only related to what people come in for : style. ;) Cheers.

@sitr2516 8 месяцев назад

What the hell is up with these giant month long periods between videos now?