BEST Datasets for LLMs | Plus: Create Your Own

Показать описание

How to choose the best data set to fine-tune a specific LLM, like MPT-30B-Chat? What are the perfect data sets to pre-train an AI model or a LLM (Large Language Model).

The easiest way is at Huggingface. Fine the perfect dataset, discover new data sets and see what the structure and the content of datasets look like, before you create your own data set for your fine-tuning of your LLM.

#finetune
#finetuning
#datasets
#dataset
#ai

Discover AI

Рекомендации по теме

Комментарии

Thanks for this!!! However, this could have been even better if you gave an actual demo on a notebook of how you would approach and modify a dataset. Or creating a dataset with the Evol-Instruct technique or the orca's approach of creating a data set. Still great content though

earltan

hey, have you done or recomend any video regarding the hw to run your onpremise llm? or cloud?

danson

is there open source datasets for arabic language ?

walidsalahuddin

Hi, I'm enjoying the videos, do you have a discord server or any way to get in cotact with you personally? Thank you!

marcussamuel

How can i optimise data content with my personal data ?

mohamedmohamoud

your channel is gold, but unfortunately there is no clear path to walk through the videos for a beginner who has no idea where to start and where to go after

abdoualgerian

I think the pricing is bit off, you can get A100 80GB for lot less than $5/h

NeuroScientician

4090 ti is straining under 4-bit quantized 30-b version. Reasonable token speed though . ROCm coming to 7900 XTX, a card that is practically 1/2 the price of the 4090 (essentially, you'll have free electricity consumption for quite some time when you plan in the price difference). Taken all together you'll have cca 600-700 Watt per hour power consumption when the model is running. All in all you'll have a great AI toy for under 3, 000-3, 500 US$ (Ryzen 9 16 core, 32 thread and all combined).

blablabic

BEST Datasets for LLMs | Plus: Create Your Own

BEST Datasets for LLMs | Plus: Create Your Own

Best Places to Find Datasets for Your Projects

Prepare Fine-tuning Datasets with Open Source LLMs

How to Fine-Tune and Train LLMs With Your Own Data EASILY and FAST- GPT-LLM-Trainer

10 Free Dataset Resources for Your Next Project!

How To Create Datasets for Finetuning From Multiple Sources! Improving Finetunes With Embeddings.

How to Build LLMs on Your Company’s Data While on a Budget

Fine Tune LLaMA 2 In FIVE MINUTES! - 'Perform 10x Better For My Use Case'

My Top 5 Favorite Datasets for LLM Fine-Tuning

LLM Evaluation Basics: Datasets & Metrics

The 4 Essential Dataset Types for LLMs: A Deep Dive

Fine-tuning Large Language Models (LLMs) | w/ Example Code

How to Fine-Tune and Train LLMs With Your Own Data EASILY and FAST With AutoTrain

Vector databases are so hot right now. WTF are they?

Build a Large Language Model AI Chatbot using Retrieval Augmented Generation

Q: How put 1000 PDFs into my LLM?

Creating datasets to evaluate your own LLM?

Q: How to create an Instruction Dataset for Fine-tuning my LLM?

The Wrong Batch Size Will Ruin Your Model

Convert Any Text to LLM Dataset Locally - Demo with Example

Building with Instruction-Tuned LLMs: A Step-by-Step Guide

Andrew Ng's Secret to Mastering Machine Learning - Part 1 #shorts

Building and Curating Datasets for RLHF and LLM Fine-tuning // Daniel Vila Suero // LLMs in Prod Con

Cosmopedia Dataset - Best Synthetic Dataset for LLMs