filmov
tv
Fine-Tuning Llama 3 on a Custom Dataset: Training LLM for a RAG Q&A Use Case on a Single GPU
![preview_player](https://i.ytimg.com/vi/0XPZlR3_GgI/maxresdefault.jpg)
Показать описание
Are you happy with your Large Language Model (LLM) performance on a specific task? If not, fine-tuning might be the answer. Even a simpler, smaller model can outperform a larger one if it's fine-tuned correctly for a specific task. In this video, you'll learn how to fine-tune Llama 3 on a custom dataset.
👍 Don't Forget to Like, Comment, and Subscribe for More Tutorials!
00:00 - Why fine-tuning?
00:53 - Fine-tuning process overview
02:19 - Dataset
02:56 - Lllama 3 8B Instruct
03:53 - Google Colab Setup
05:30 - Loading model and tokenizer
08:18 - Create custom dataset
14:30 - Establish baseline
17:37 - Training on completions
19:04 - LoRA setup
22:25 - Training
26:42 - Load model and push to HuggingFace hub
28:43 - Evaluation (comparing vs the base model)
32:50 - Conclusion
Join this channel to get access to the perks and support my work:
#llama3 #llm #rag #finetuning #promptengineering #chatgpt #chatbot #langchain #gpt4
👍 Don't Forget to Like, Comment, and Subscribe for More Tutorials!
00:00 - Why fine-tuning?
00:53 - Fine-tuning process overview
02:19 - Dataset
02:56 - Lllama 3 8B Instruct
03:53 - Google Colab Setup
05:30 - Loading model and tokenizer
08:18 - Create custom dataset
14:30 - Establish baseline
17:37 - Training on completions
19:04 - LoRA setup
22:25 - Training
26:42 - Load model and push to HuggingFace hub
28:43 - Evaluation (comparing vs the base model)
32:50 - Conclusion
Join this channel to get access to the perks and support my work:
#llama3 #llm #rag #finetuning #promptengineering #chatgpt #chatbot #langchain #gpt4
LLAMA-3 🦙: EASIET WAY To FINE-TUNE ON YOUR DATA 🙌
How to Fine Tune Llama 3 for Better Instruction Following?
Llama 3 Fine Tuning for Dummies (with 16k, 32k,... Context)
'okay, but I want Llama 3 for my specific use case' - Here's how
Fine-Tuning Llama 3 on a Custom Dataset: Training LLM for a RAG Q&A Use Case on a Single GPU
Fine Tune Llama 3 using ORPO
LLaMA 3 Tested!! Yes, It’s REALLY That GREAT
New LLaMA 3 Fine-Tuned - Smaug 70b Dominates Benchmarks
Llama 3 AI Hackathon: Kick-Off and Introduction
Fine Tune LLaMA 2 In FIVE MINUTES! - 'Perform 10x Better For My Use Case'
'I want Llama3 to perform 10x with my private knowledge' - Local Agentic RAG w/ llama3
Fine-Tune Llama 3 Model on Custom Dataset - Step-by-step Tutorial
Mastering LLAMA-3 Fine Tuning 🦙 | Custom Data
Fine-Tune Llama 3 with LlaMA Factory in Free Colab
Fine-tuning Llama 3 with the Zephyrus G14 #programming #software #ROGPartner #ROGZephyrusG14
Create Instruction Fine-Tuning Dataset from Llama-3 Model Locally
Fine-tuning Large Language Models (LLMs) | w/ Example Code
Fine-Tuning Meta's Llama 3 8B for IMPRESSIVE Deployment on Edge Devices - OUTSTANDING Results!
Fine-Tune Llama 3 for Specific Tasks with Free Google Colab
The EASIEST way to finetune LLAMA-v2 on local machine!
Use TorchTune to Fine Tune Llama 3 Locally
Steps By Step Tutorial To Fine Tune LLAMA 2 With Custom Dataset Using LoRA And QLoRA Techniques
Anyone can Fine Tune LLMs using LLaMA Factory: End-to-End Tutorial
Llama 3 - 8B & 70B Deep Dive
Комментарии