What is LLM quantization?

preview_player
Показать описание
In this video we define the basics of quantization and look at how its benefits and how it affects large language models.

Links mentioned:

#largelanguagemodels #quantization #artificialintelligence #chatgpt #llama

0:00 Intro
0:33 Basic concept
0:51 Benefits
1:30 Quantization 101
2:48 Impact on model size and perplexity
3:48 Impact on inference speed
4:25 Qualitative analysis
  1. Airtrain AI
Рекомендации по теме
What is LLM 0:05:13

What is LLM quantization?

Part 1-Road To 0:32:55

Part 1-Road To Learn Finetuning LLM With Custom Data-Quantization,LoRA,QLoRA Indepth Intuition

Understanding: AI Model 0:06:59

Understanding: AI Model Quantization, GGML vs GPTQ!

Which Quantization Method 0:15:51

Which Quantization Method is Right for You? (GPTQ vs. GGUF vs. AWQ)

Quantization in deep 0:15:34

Quantization in deep learning | Deep Learning Tutorial 49 (Tensorflow, Keras & Python)

LLMs Quantization Crash 0:58:43

LLMs Quantization Crash Course for Beginners

Quantization vs Pruning 0:19:46

Quantization vs Pruning vs Distillation: Optimizing NNs for Inference

Llama 1-bit quantization 0:06:08

Llama 1-bit quantization - why NVIDIA should be scared

New Tutorial on 0:26:53

New Tutorial on LLM Quantization w/ QLoRA, GPTQ and Llamacpp, LLama 2

Quantize any LLM 0:27:43

Quantize any LLM with GGUF and Llama.cpp

Deep Dive: Quantizing 0:40:28

Deep Dive: Quantizing Large Language Models, part 1

Understanding 4bit Quantization: 0:42:06

Understanding 4bit Quantization: QLoRA explained (w/ Colab)

LLM Explained | 0:04:17

LLM Explained | What is LLM

Quantize LLMs with 0:25:26

Quantize LLMs with AWQ: Faster and Smaller Llama 3

LLaMa GPTQ 4-Bit 0:11:03

LLaMa GPTQ 4-Bit Quantization. Billions of Parameters Made Smaller and Smarter. How Does it Work?

Quantization in Deep 0:13:04

Quantization in Deep Learning (LLMs)

LoRA - Low-rank 0:04:38

LoRA - Low-rank Adaption of AI Large Language Models: LoRA and QLoRA Explained Simply

Quantization explained with 0:50:55

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training

AWQ for LLM 0:20:40

AWQ for LLM Quantization

How to Quantize 0:26:21

How to Quantize an LLM with GGUF or AWQ

LoRA explained (and 0:17:07

LoRA explained (and a bit about precision and quantization)

QLoRA paper explained 0:11:44

QLoRA paper explained (Efficient Finetuning of Quantized LLMs)

Quantization of Large 0:09:05

Quantization of Large Language Models: A Simple Explanation

Run LLaMA on 0:09:29

Run LLaMA on small GPUs: LLM Quantization in Python

Комментарии
Автор

Most clear definition of quantization, thx!!!!

DeanCassady