Fine-Tune TinyLlama 1.1B Locally on Own Custom Dataset

Показать описание

This video explains in easy and simple tutorial as how to train or fine-tune TinyLlama model locally by using unsloth on your own data.

#tinyllama #unsloth #tinyllama1b

PLEASE FOLLOW ME:

RELATED VIDEOS:

All rights reserved © 2021 Fahd Mirza

Fahd Mirza

Рекомендации по теме

Комментарии

MAGISTRAL! :D Thanks thanks thanks! :D

SonGoku-pcjl

Don't we have to uplode the tokenizer too in the HF hub for future inferencing??
and don't we need to merge the PEFT model and base model to get the actual model ?
Please clear these doubts 🙏.

MRARyA-liwt

Hi, can you make a tutorial on how to finetune this model for inferencing in ollama? I can't get it to work for ollama. Tried possibly all the tutorials in the web for this.

glorified

how cam i load the saved model and test?

onesecondnanba

why you decide the training data for tiny llama have to be in that format? Is it somehow defined by tinyllama developers or you just choose iy on your onw? The problem with this format is tinyllama do not understand that "instruction" and "response" are somehow special words and generate this words in the answer.

Iiochilios

can you store the trained model in a directory ?

ugayashan

7:52 I get the same error and rerunning it a few times in a row does nothing.

shaigrustamov

can you provide the collaborative file please?

hellosaloni

can you provide the code for "dataset preparation code". Awesome Video btw

legendchdou

Fine-Tune TinyLlama 1.1B Locally on Own Custom Dataset

Fine-Tune TinyLlama 1.1B Locally on Own Custom Dataset

Fine Tune LLaMA 2 In FIVE MINUTES! - 'Perform 10x Better For My Use Case'

TinyLlama 1.1B: NEW LLAMA Model Size on 3 Trillion Tokens (Installation Tutorial)

TinyLlama: The Era of Small Language Models is Here

Developing an LLM: Building, Training, Finetuning

TinyLlama 1.1B LLM RAG Research Chatbot llamaindex Colab Demo Small LLM Amazing performance

Run ANY Open-Source Model LOCALLY (LM Studio Tutorial)

Qwen 1.5: Most Powerful Opensource LLM - 0.5B, 1.8B, 4B, 7B, 14B, and 72B - BEATS GPT-4?

LangChain - Using Hugging Face Models locally (code walkthrough)

How to Quantize an LLM with GGUF or AWQ

Install OLMo LLM Locally

Train AI Model on Raw Text - LLM For Story Writing

Understanding the LLM Development Cycle: Building, Training, and Finetuning

MiniCPM 2B: Smallest But MOST Powerful LLM With ONLY 2B In Size!

TinyAgent: Function Calling at the Edge