filmov
tv
Understanding LLM Inference | NVIDIA Experts Deconstruct How AI Works
Показать описание
In the last eighteen months, large language models (LLMs) have become commonplace. For many people, simply being able to use AI chat tools is enough, but for data and AI practitioners, it is helpful to understand how they work.
In this session, you'll learn how large language models generate words. Our two experts from NVIDIA will present the core concepts of how LLMs work, then you'll see how large scale LLMs are developed. You'll also see how changes in model parameters and settings affect the output.
Key Takeaways:
- Learn how large language models generate text.
- Understand how changing model settings affects output.
- Learn how to choose the right LLM for your use cases.
In this session, you'll learn how large language models generate words. Our two experts from NVIDIA will present the core concepts of how LLMs work, then you'll see how large scale LLMs are developed. You'll also see how changes in model parameters and settings affect the output.
Key Takeaways:
- Learn how large language models generate text.
- Understand how changing model settings affects output.
- Learn how to choose the right LLM for your use cases.
0:55:39
Understanding LLM Inference | NVIDIA Experts Deconstruct How AI Works
0:34:14
Understanding the LLM Inference Workload - Mark Moyou, NVIDIA
0:05:34
How Large Language Models Work
0:06:05
What is AI Inference?
0:07:29
GPUs: Explained
0:30:25
Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mist...
0:03:13
Nvidia CUDA in 100 Seconds
0:01:08
Accelerate Big Model Inference: How Does it Work?
0:09:41
NVLM D 72B - Frontier Multimodal LLM - Rivals GPT-4o and Llama 405B
0:08:47
What are Generative AI models?
0:14:31
GPU VRAM Calculation for LLM Inference and Training
0:06:36
What is Retrieval-Augmented Generation (RAG)?
0:07:54
How ChatGPT Works Technically | ChatGPT Architecture
0:01:00
What is NVIDIA NIM? #ai #ml #llm #Python #artificialintelligence #software #coding #computerscience
0:12:21
Demo: Optimizing Gemma inference on NVIDIA GPUs with TensorRT-LLM
0:01:56
Getting Started with NVIDIA Torch-TensorRT
0:36:12
Deep Dive: Optimizing LLM inference
![[1hr Talk] Intro](https://i.ytimg.com/vi/zjkBMFhNj_g/hqdefault.jpg)
0:59:48
[1hr Talk] Intro to Large Language Models
0:10:30
All You Need To Know About Running LLMs Locally
0:01:31
Parameters vs Tokens: What Makes a Generative AI Model Stronger? 💪
0:02:43
Getting Started with NVIDIA Triton Inference Server
0:03:50
CPU vs GPU vs TPU explained visually
0:01:34
Mythbusters Demo GPU versus CPU
0:11:30
Demo | LLM Inference on Intel® Data Center GPU Flex Series | Intel Software
Комментарии