Finetune Tiny LLaMA 1.1B On A Custom Dataset - Function Calling - JSON Mode

Показать описание

Let's finetune Tiny LLaMA on a custom dataset to call functions and respond in JSON! In this video, I'll show you how to fine tune tiny llama and guide you through the whole process from setting up our custom dataset to inferencing the fine tuned model. I hope this video helps and I appreciate you for watching!

► Allyson AI - 10x Employee For SMBs & Entrepreneurs - Join The Waitlist:

► FREE Finetuning Tiny LLaMA Guide:

► Join The Discord Community
Premium is FREE for life for the first 100 members:
FIRST100MEMBERS

► AI Tools Featured in This Video:
Unsloth AI
Google Colab

► Tools I Use (Supports the channel):

► TIMESTAMPS:
0:11 - Unsloth AI
0:41 - Reviewing the Custom Dataset
4:33 - Setting up the Tiny LLaMA Finetuning Google Colab
7:11 - Install Tiny LLaMA Model
7:30 - Download the Custom Dataset w/ Function Calling & JSON
7:43 - Start Finetuning TinyLLaMA
9:07 - Inferencing The Finetuned TinyLLaMA Model

► All My Links:

► VIDEOS YOU DON'T WANT TO MISS:

Рекомендации по теме

Комментарии

Join Industry Insiders - Business Discord Community 🚀
FREE lifetime access for the first 100 members!

Use code FIRST100MEMBERS

isaiahbjork

Good video but after any training, the first thing you need to do is plot the evaluation loss curve to see how the model is behaving over the different epochs. Now that the model outputted wrong results you have no idea what would be the cause.

MrDonald

How do we make sure we are not overfitting the model? And make it lose its conversational abilities? I tied once and got any function calling responses back

varunmehra

Is this model able to be incorporated with the swiftui llama.cpp project?

brandonwinston

Is the traiining only for english language?

wilfredomartel

what's the point if it's so hard, maybe even impossible to get it consistent or even correct?

avi

I just wanted to tell you that i love your video. But there's something about lund in my language.

-rate

Finetune Tiny LLaMA 1.1B On A Custom Dataset - Function Calling - JSON Mode

Fine-Tune TinyLlama 1.1B Locally on Own Custom Dataset

TinyLlama 1.1B: NEW LLAMA Model Size on 3 Trillion Tokens (Installation Tutorial)

Fine-tuning a CRAZY Local Mistral 7B Model - Step by Step - together.ai

Stanford's new ALPACA 7B LLM explained - Fine-tune code and data set for DIY

Developing an LLM: Building, Training, Finetuning

Qwen 1.5: Most Powerful Opensource LLM - 0.5B, 1.8B, 4B, 7B, 14B, and 72B - BEATS GPT-4?

Tutorial 2- Fine Tuning Pretrained Model On Custom Dataset Using 🤗 Transformer

Llama 1-bit quantization - why NVIDIA should be scared

The Secret to 90%+ Accuracy in Text Classification

TinyLlama: The Era of Small Language Models is Here

How To Install CODE LLaMA LOCALLY (TextGen WebUI)

How-To Instruct Fine-Tuning Falcon-7B [Google Colab Included]

Should You Use Open Source Large Language Models?

We code Stanford's ALPACA LLM on a Flan-T5 LLM (in PyTorch 2.1)

Fine-tuning T5 LLM for Text Generation: Complete Tutorial w/ free COLAB #coding

TinyLlama 1.1B LLM RAG Research Chatbot llamaindex Colab Demo Small LLM Amazing performance

HuggingFace Fundamentals with LLM's such as TInyLlama and Mistral 7B

This Open Source LLM Improves On Mixture of Experts Technology | Python Code & Full Test

Best 1 Bit LLM Pretraining [With Source Code] | How 1 Bit LLMs Work?

LangChain - Using Hugging Face Models locally (code walkthrough)

NVC-1B: A Large Neural Video Coding Model - ArXiv:2407.19402

How Did Llama-3 Beat Models x200 Its Size?

MiniCPM 2B: Smallest But MOST Powerful LLM With ONLY 2B In Size!

Large Language Models (LLMs) & Fine-tuned Models On Top of LLMs | 2023