Fine Tune LLaMA 2 In FIVE MINUTES! - 'Perform 10x Better For My Use Case'

In this video, I show you how to fine-tune LLaMA 2 (and other LLMs) for your specific use case. This allows your GPT model to perform much better for your business or personal use case. Give LLaMA detailed information that it doesn't already have, make it respond in a specific tone/personality, and much more.

Enjoy!

Join My Newsletter for Regular AI Updates 👇🏼

Need AI Consulting? ✅

Rent a GPU (MassedCompute) 🚀
USE CODE "MatthewBerman" for 50% discount

My Links 🔗

Media/Sponsorship Inquiries 📈

Links:

[paulstevenconyngham]

Would be cool to see a video that doesnt use a platform to do the finetuning.

[tunestyle]

Another homer! Thanks, Matt! I am pursuing machine learning and data analysis career because of you. Please know how much we value your tutorials. Keep doing what you're doing!

[jonmichaelgalindo]

Please post an *actual* video on free / open source training for LLaMa2! I'm going to try to figure it out myself after my authors event in October, but I would love if someone could just tell me how so I don't have to suffer. 😭

[BlayneOliver]

I love how he used ChatGPT to train Llama 😂

[_gwyneth]

love this tutorial -- it's something i've been trying to figure out for a while now. i tried out a few other platforms and none of them are as easy as gradient

gradient makes it so much simpler to get started with my own models. really like how few lines of code it takes to get started so all i need to do is focus on my training data (which is really the important part for finetuning anyways). seems like they abstract away all of the boilerplate and infra setup, which is the main painpoint for a lot of devs like me who are just getting started.

[thehve]

This is awesome but with one major drawback, you can't download the fine-tuned model. Still this is a greatly appreciated video!

[tmhchacham]

Amazing! I'm excited and waiting for the deeper dive into fine tuning.

[Zeroduckies]

We can use an external knowledge base data base with a search function that fices higher priority to most recently used

[sluggy]

So great having a youtube channel thats 100% productivity oriented for us lazy asses. Im just trying to get shit done. I dont have enough time in the day to go through all the rigamarole.
As long as i got ctrl+c, ctrl+v and this channel. Life is good

[matthew_berman]

What are you doing to train your model on?? Let me know 😉

PS. Chris Chang is the founder of Gradient and he'll be answering your comments as well as @chrischang7870

[ankitranjan]

1. Can we export the fine-tuned model for inference on our local machine? How do we do this?
2. How much does it cost to fine-tune per input token?

[benwatson]

Interesting, but I would have preferred to do this offline on locally saved models.

The other thing that would be useful is to work out what the pros and cons of the foundation models that are out there. My use case is for highly specialised experts, so the foundation model would need to be pretty robust.

[JeeneyAI]

Finally! one of the fine tuning tutorials actually works! If not for this, I was starting to think this nonsense was like sasquatch sightings. But alas! You cannot download the model to run locally. Everything has a grab to it. It's really hard to trust these platform companies with anything at all. Their security is the best, they say. Until your stuff is leaked all over the net. Then, it's an honest mistake. Honey pots, like single points of public safety failure.

[himham]

Would love a deeper dive on how to use txt or json files to fine tune with llama 2 and potentially ways to run offline.

Also as a layman, are there any ways outside of Google Collab to have a more chat style interface post-tune?

🙏So much for all of your awesome content!!!

[abagatelle]

Excellent Matt, so useful. Looking fwd to your video on data sets as that is going to be really critical in getting good results. Well done!

[ageaxe]

Uncertain whether the second part of the video has been uploaded. Could someone assist me with this?

[julianschmidt]

Thank you for doing a 10 minutes add video on Gradient! I'm sure the payout you received was great! Greeting from Germany.

[stickmanland]

Would love a tutorial on how to finetune Llama 2 offline. (no apis)

[Mario]

Can‘t wait for the next videos!
Can please make a Video how to train an Ai Model to rewrite Text in a special Voice?

Also it would be interesting, if it‘s possible to train the Model only with a txt file and than ask questions about it.

[PetterBruland]

Next thing I want, is setting up two AIs to start talking to each other, setting a goal to share the most of each of AIs "know" to share "knowledge"