SDXL LORA STYLE Training! Get THE PERFECT RESULTS!

preview_player
Показать описание
In this video, I'll show you how to train LORA STYLE SDXL 1.0 using YOUR OWN IMAGES! I spend hundreds of hours testing, experimenting, and hundreds of dollars in cloud computing training to bring you the ultimate LORA STYLE training guide for complete beginners and experts alike for Stable Diffusion. SDXL is incredibly easy to train as long as you know what you are doing with the right training parameters. After this video, you’ll have the required knowledge to train any style you want with the Kohya GUI tool.

What do you think of SDXL Style LORA? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Jup1t3R!
scale_parameter=False relative_step=False warmup_init=False
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
►► My PC & Favorite Gear:
Recording Gear:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Special thanks to Royal Emperor:
- TNSEE
-Gluthoric

Thank you so much for your support on Patreon! You are truly a glory to behold! Your generosity is immense, and it means the world to me. Thank you for helping me keep the lights on and the content flowing. Thank you very much!

#stablediffusion #sdxl #lora #aitools #texttoimage #ai
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - All LLM & ChatGPT Video:

RECOMMENDED WATCHING - My "Tutorial" Playlist:

Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.

Timestamps:
00:00:00 Train SDXL with LORA
00:00:57 What is LORA?
00:01:11 Koya SS GUI
00:01:53 Image Dataset preparation
00:04:45 Find good video game images on Steam
00:05:32 Upscale images sharper with Stable Diffusion
00:07:50 Make sure images are not too big for LORA Training
00:08:31 SDXL LORA Training Folder Creation
00:09:45 Instance Prompt
00:10:30 Find the right style for LORA Training
00:12:48 Class Prompt
00:13:00 LORA Repeats Training Steps
00:14:21 Regularization images
00:17:39 Training Data
00:18:18 LORA Image Captioning
00:22:52 How to replace a word in multiple text files on Windows
00:26:00 The right SDXL STYLE LORA Training Parameters
00:26:28 LORA Type Standard vs LoCON or LoHA LyCORIS
00:26:49 Train Batch size
00:27:44 Number of Epoch Training
00:28:54 BF16 & FP16 & Cache
00:29:27 The RIGHT Learning Rate for SDXL STYLE LORA
00:30:11 SDXL Image Resolution & Buckets
00:30:55 LORA Network Rank & Network alpha
00:31:40 Gradient Accumulate Steps LORA
00:32:21 Noise Offset LORA
00:33:14 LORA Training & VRAM Usage
00:33:38 GPU Solutions & RunPod
00:34:02 Runpod Setup for LORA Training
00:34:41 Runpod Template LORA Update
00:36:43 How to select the right LORA Model?
00:38:43 Chose the final Model
00:41:37 Conclusion on LORA STYLE Training
Рекомендации по теме
Комментарии
Автор

HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx <3
"K" - Your Ai Overlord

Aitrepreneur
Автор

Thank you very much! You have the only video on YouTube about training LoRa for style, not for character!!! 👍🙏😻

odessaodesa
Автор

Finally, a video on style LoRA! Very thankful for it. My VRAM isn't so good that I can train/generate stuff on SDXL, but this guide is so general that I can rely on it even for stuff based on SD1.5. I suppose the only difference would be that I'll still be stuck on 512 x 512 resolution and some other minor differences. Thank you very much!

ryanzamora
Автор

what is that tool he's using where he's searching for what prompts sdxl understands? the "something" studio by stability ai

travisatessier
Автор

Pateron supporter and was one of your followers asking for this for a few months. I finally had time this weekend to explore this, and just wanted to say a huge thanks! I finally have a lora that doesn't look so nasty and overtrained. I had improved results already using your character training from awhile back, but this really nailed it in, and the tip about using a famous artist helped. I actually found using a famous art movement (abstract expressionism) helped it to understand my work. This is massive, thanks so much for all the videos you have posted this year, for stable diffusion that have been game changing for me.

thedesigngraphik
Автор

Hey, great video as always!
As a video suggestion, could you make a guide to creating abstract concepts with Stable Diffusion?
I'm trying to create a Solarpunk model that could work on different styles: photorealism, illustration, anime, oil painting etc.

tomasokeefeparrot
Автор

thanks for the great content. you now are the first creator I support on Patreon.

scienceandmind
Автор

Can you make one more on character training? The old one is kinda outdated, I followed your guide and my results were pretty good.

danielkahbe
Автор

"No effort required whatsoever..."
That pretty much sums it all up.

chromo
Автор

This is great info...but I realized that repeats is nothing more than a way to describe how often you would be theoretically save a checkpoint/LORA because the minimum is one epoch. Also I never experienced that upping your batch size reduces training time. It reduces steps, but iteration time increases as well...so its just a trade off and the training total time stays the same!
For Gradient Accumulation to not get weird, just make sure that Batch Size times Gradient Accumulation is not higher that your total images count! 🙂

swannschilling
Автор

This is good but What I would really like to see, esp for patreon subscribers. is a tutorial on how to in-paint, and make hyper realistic stuff. or maybe even better is how to use comfy UI and all of its little addons and stuff.

sitr
Автор

Also been meaning to ask don't you find when training a character using another celebrity's name that the model is trained on that the model's image generation still picks up a lot of mannerisms and locations that the original celebrity was trained with despite the trained character Lora being used? Like hypothetically if you were a doppelganger for Ben Stiller and lived in the same universe as Zoolander and you decided to train your own face but instead of using Bstiller as the name of the Lora you use Derrik Zoolander because it's a great match and your AI model would certainly know who he was even after training it would seem to be that it would continually show you at modeling runways and dressed fashionably, and doing his poses even though the face would look less dramatic than Zoolander and more like typical Ben Stiller (Edited to add the Zoolander thing)

stevebruno
Автор

thanks a lot again for this so great tutorial and the patreon you made in conjuction ! Great job Dude !

polykrom
Автор

Please do another simplified video on how to locally install vicuna, previous videos seem to have become outdated.

bixxybear
Автор

Stable Diffusion content = interesting

MilesBellas
Автор

Everything that is supposed to be a variable has to be named. I.e. you want to change eye colours? Describe the eye colours!

But you can also train a bias on purpose. For example you don't like beards but your base model has a lot of beards and you need to use negative prompt to keep the guys shaved? Train the model with shaved guys and don't mention that they are shaved, so the model will start to default to beardless guys more.

That way you just need to know what you want to be optional later and base your concept around that. If you are not persistent with these things the model gets confused and produces rubbish.

madrooky
Автор

What if I want to train a LoRA to generate comic pages with panels and all? What type of images should I use to train it?

Midplayz
Автор

Upload into GPT and ask which generated image is best

pastuh
Автор

All of your trainings seem to just be enhancing things that already exist in the model, what if what you want to train, say a concept (like a skateboard trick performed by a range of people), is not in the base model? Would we be better off training a model refinement instead of a LoRA? How does that differ from LoRA training?

SacWebDeveloper
Автор

Is there a minimum VRam requiring for this?

cristitanase