How to create your own Flux AI Model 💥 (Flux LoRA Fine Tuning) 💥

In this tutorial, you'll learn

1. How to create Dataset for LoRA Fine-tuning of Flux Dev Model
2. How to Fine-Tuning your own Model for less than $5 using Replicate
3. How to use the Model and create AI Generated Images

This is not a sponsored video (I wish 🤣). I used replicate because I know a lot of people serving the replicate models at scale. You can use FAL as well. Colab is a pain in this, you need to get credits of A100 and try, that's why I decided to go ahead with this.

In this video, we also learn to store the fine-tuned LoRA adapter on your hugging face model hub so you can use it later whenever you want.

Timestamps:

00:00 Intro
00:23 LoRA Finetuning Dataset creation
02:24 LoRA Fine-Tuning Parameters
07:19 Your custom LoRA and Flux Inference

🔗 Links 🔗

❤️ If you want to support the channel ❤️
Support here:

🧭 Follow me on 🧭

[heisenurger]

This was a fantastic explanation of training a Flux model! I've been looking all over for exactly this and you've done the best job at explaining it without rushing over the smaller details. Greatly appreciate you sharing your knowledge and expertise!

[emonhossain_pro]

Fantastic walkthrough on fine-tuning FLUX.1! Really appreciated the detailed steps and practical tips. This made things much clearer! 👍

[skillbuddy]

Thank you Thalaiva. I am going to try it today. I have become a fan of you!

[andyy]

Thank you so much for the tutorial! Very clear and straight forward! when i try to upload a zip folder with photos, it does not upload anything. Any idea why its not uploading the zip-folder?

[EclipticVistaYT]

It's a very awesome tutorial but I would like to know how to add realism in the lora we create.

[artyartemis]

there many Ai artist asking me how to train Flux Lora for free so... I am suggesting your channel to them

[NobleCaveman]

Great tutorial! I'm going to use this for halloween lol

[somratdutta]

Hi sir, can you tell me how to run on Mac?

[rajivraghu]

Excellent.. i was searching for this :)

[robdiaz]

I use Flux locally on my computer, can I do this on my pc or I still need to use Replicate? Thank you

[gentleman.editsss]

Can we create for multiple characters?? Does it have an option of initial image option?

[tomchurch]

Thanks so much for this video. I followed it and worked great. Question - You mention you can run locally on Mac after the training model is produced. How would you do this please?

[sammathew]

It seems the age of trusting in photos is over! Having a picture taken with camera was a gold standard to capture reality, be it for authentication (e.g., IDs) or for reporting a real event. Seems this was short-lived, maybe only 80 years.

[ysy]

Very grateful. I tried this and was able to train my Lora. Now, when I tried it on my ComfyUI using the nodes from x-flux, I get the error: Error occurred when executing FluxLoraLoader: Error(s) in loading state_dict for Missing key(s) in state_dict: "qkv_lora1.down.weight", "qkv_lora1.up.weight", "proj_lora1.down.weight", "proj_lora1.up.weight", "qkv_lora2.down.weight", "qkv_lora2.up.weight", "proj_lora2.down.weight", "proj_lora2.up.weight".

[panwar]

How about using controlnet and upscaler with? In order to produce more crisp images?

[mshonle]

I wonder how you can see the autocaptions, so that you can see if any noise/incorrect captioning made its way. Similarly, if you can run multiple samples for the autocaptions, to see how much it varies and if there are any better captions.

[imyashw]

Noob question - Do I have to train it again and again if I want to use in future?

[yashpatidar.]

How did you get $95 for free on Replicate?

[jaydev]

I'm new to this, can you please explain me

1. That download weight means the Flux LoRA fine tune model file, right? And we can use it in Google collab, Huggingface or any other platform.

2. In hf_lora label can we mention any other repo platform or can we only store the repo only in replicate to use it later to use via replicate new Reflux platform.

[ramp]

When you were trying out the fine tuned model in replicate, did u have to deploy it in a server to try it? Per replicate pricing it says.. "Unlike public models, you’ll pay for setup and idle time in addition to the time it spends processing your requests." THank you