Fine Tune LLaMA 2 In Ten MINUTES! - With Google Colab and 0$

Показать описание

In this video, we're going to fine-tune LLAMA 2 on Google Colab with zero dollars using a free dataset, aided by libraries from Hugging Face. We'll make the fine-tuning process easy and explain what LoRA and QLoRA are, as well as how the fine-tuning process works.

00:00 - Intro
00:50 - When to fine-tune model and use RAG
01:40 - How Fine Tuning Works
02:23 - What is LoRA
03:13 - What is QLoRA
03:45 - Installation
05:01- Model Setup
05:20 - Data Set
07:20 - QLoRa Parameter
07:55 - Training arguments
09:01 - SFT and RLHF
09:55 - Loading Data
11:22 - Training the model
12:10 - Results
13:30 - Uploading to Hugging Face

_______________________________________________________________

💷 50% Discount Code : A2LH6LZ

_______________________________________________________________

#llama2 #finetune #gpt #falcon #ai #llms #gpt #huggingface #autogpt

Рекомендации по теме

Комментарии

Would like to see a video of how to create a custom dataset for Fine tuning a model. Thank you !

henrijohnson

Thank for the video and work you put in

drp

Thank you for this nice video, you explain well the subject, I wish if you can make a tutorial on how to craft a training dataset from a custom data (like pdf documents).

hajhouj

This doesn't even work with A100 GPU High-Ram since it runs out of memory when you are training the model. I don't know how you could possibly do it on the free version.

RuChopra-oz

Do you know how to inference it or convert it on google colab to GGUF or any other to run it locally?

mrboltik

Hey, many thanks for the nice example.
When I try to follow up using the notebook, I run into this problem

ImportError Traceback (most recent call last)
in <cell line: 14>()
12 )
13 from peft import LoraConfig, PeftModel
---> 14 from trl import SFTTrainer

1 frames
in <module>
21 import torch.nn.functional as F
22 from torch.nn.utils.rnn import pad_sequence
---> 23 from transformers import top_k_top_p_filtering
24
25

ImportError: cannot import name 'top_k_top_p_filtering' from 'transformers'

Do you have an idea how to solve this?
Which versions of the package would be compatible?

Cheers,
Mirko

maindset.academy

Fine Tune LLaMA 2 In Ten MINUTES! - With Google Colab and 0$

Fine Tune LLaMA 2 In FIVE MINUTES! - 'Perform 10x Better For My Use Case'

Fine-tuning Llama 2 on Your Own Dataset | Train an LLM for Your Use Case with QLoRA on a Single GPU

The EASIEST way to finetune LLAMA-v2 on local machine!

Steps By Step Tutorial To Fine Tune LLAMA 2 With Custom Dataset Using LoRA And QLoRA Techniques

LLAMA-2 🦙: EASIET WAY To FINE-TUNE ON YOUR DATA 🙌

LLAMA-3 🦙: EASIET WAY To FINE-TUNE ON YOUR DATA 🙌

How to Create Custom Datasets To Train Llama-2

'okay, but I want Llama 3 for my specific use case' - Here's how

How to fine-tune an LLM? 1k samples

EASIEST Way to Fine-Tune LLAMA-3.2 and Run it in Ollama

Fine-Tuning Llama 3 on a Custom Dataset: Training LLM for a RAG Q&A Use Case on a Single GPU

Fine-Tune Llama 2 Model on your Custom Data (Free Colab and Code Available)

fine tuning llama-2 to code

🐐Llama 2 Fine-Tune with QLoRA [Free Colab 👇🏽]

How to Fine-tune Llama 2 Model with Custom Dataset

Efficient Fine-Tuning for Llama-v2-7b on a Single GPU

Fine-tune LLama 2 in 2 Minutes on your Data - Code Example

EASILY Train Llama 3 and Upload to Ollama.com (Must Know)

Lessons From Fine-Tuning Llama-2

How to Fine Tune Llama 3 for Better Instruction Following?

Fine-tuning Llama 2 for Tone or Style

Fine-Tune Llama 3.2 Model on Custom Dataset - Easy Step-by-Step Tutorial

Fine Tune LLaMA 2 In Ten MINUTES! - With Google Colab and 0$

End To End LLM Project Using LLAMA 2- Open Source LLM Model From Meta