Fine-tuning Large Language Models (LLMs) | w/ Full Code

preview_player
Показать описание
We use a fictional company called Cubetriangle and design the pipeline to process its raw data, #finetune 3 large language models (#LLM) on it, and design a #chatbot using the best model.

00:00:17 Presentation (Key concepts)
00:02:39 #llama2 Pre-trained vs llama2-chat (fine-tuned) models
00:13:22 Fine-tuning schema
00:14:22 CubeTriangle data description
00:17:21 Data processing (first step)
00:21:56 Data processing (second step)
00:32:19 Fine-tuning tutorial
00:53:54 1.5 billion vs 3billion parameter llms
01:09:30 Chatbot schema
01:10:41 Chatbot implementation
01:13:03 Chatbot demo
01:18:10 Wrap up

The models that I used in this video are:

Key #python libraries:
#huggingface #transformer #torch #openai #chainlit
Рекомендации по теме
Комментарии
Автор

What people never say is how they convert pdf to qa pairs programmatically 😵‍💫

dhrumil
Автор

Abriu a mente para muitas possibilidades, estou recomendando ao amigos. Continue :)

alexdossantosliberato
Автор

The best and holistic video on fine tuning LLM😊. Looking forward to your PEFT fine tuning with LORA/QLORA video

RAJARAM-cxjb
Автор

Really appreciated your LLM series! Keep it going!

lijunlang
Автор

Very exciting! Thanks for the informative session!

hadi-yeg
Автор

this is so good....sir can we have more full end to end projects to show in our resume..ur teaching is so dope

MANASSINGHA-ih
Автор

very beautiful and sweet thanks alot man

nathWSD
Автор

You choose the best model based on what ? and how can we include Quantization ?

KinesitherapieImanesghuri
Автор

can i use kaggle or colab for this? im on cpu.

AreebaTariq-qs
Автор

your content is amazing but your voice is very low to hear...

sureshm