filmov
tv
LLM Foundations (LLM Bootcamp)
Показать описание
New course announcement ✨
We're teaching an in-person LLM bootcamp in the SF Bay Area on November 14, 2023. Come join us if you want to see the most up-to-date materials building LLM-powered products and learn in a hands-on environment.
Hope to see some of you there!
--------------------------------------------------------------------------------------------- In this video, Sergey covers the foundational ideas for large language models: core ML, the Transformer architecture, notable LLMs, and pretraining dataset composition.
00:00 Intro
00:47 Foundations of Machine Learning
12:11 The Transformer Architecture
12:57 Transformer Decoder Overview
14:27 Inputs
15:29 Input Embedding
16:51 Masked Multi-Head Attention
24:26 Positional Encoding
25:32 Skip Connections and Layer Norm
27:05 Feed-forward Layer
27:43 Transformer hyperparameters and Why they work so well
31:06 Notable LLM: BERT
32:28 Notable LLM: T5
34:29 Notable LLM: GPT
38:18 Notable LLM: Chinchilla and Scaling Laws
40:23 Notable LLM: LLaMA
41:18 Why include code in LLM training data?
42:07 Instruction Tuning
46:34 Notable LLM: RETRO
We're teaching an in-person LLM bootcamp in the SF Bay Area on November 14, 2023. Come join us if you want to see the most up-to-date materials building LLM-powered products and learn in a hands-on environment.
Hope to see some of you there!
--------------------------------------------------------------------------------------------- In this video, Sergey covers the foundational ideas for large language models: core ML, the Transformer architecture, notable LLMs, and pretraining dataset composition.
00:00 Intro
00:47 Foundations of Machine Learning
12:11 The Transformer Architecture
12:57 Transformer Decoder Overview
14:27 Inputs
15:29 Input Embedding
16:51 Masked Multi-Head Attention
24:26 Positional Encoding
25:32 Skip Connections and Layer Norm
27:05 Feed-forward Layer
27:43 Transformer hyperparameters and Why they work so well
31:06 Notable LLM: BERT
32:28 Notable LLM: T5
34:29 Notable LLM: GPT
38:18 Notable LLM: Chinchilla and Scaling Laws
40:23 Notable LLM: LLaMA
41:18 Why include code in LLM training data?
42:07 Instruction Tuning
46:34 Notable LLM: RETRO
LLM Foundations (LLM Bootcamp)
How Large Language Models Work
LLMOps (LLM Bootcamp)
Introduction to large language models
Large Language Model Bootcamp Information Session | LLM Bootcamp Information Session
LLM Explained | What is LLM
Gen AI Course | Gen AI Tutorial For Beginners
Harrison Chase - Agents Masterclass from LangChain Founder (LLM Bootcamp)
How I’d learn ML in 2024 (if I could start over)
Launch an LLM App in One Hour (LLM Bootcamp)
Create a Large Language Model from Scratch with Python – Tutorial
How To Self Study AI FAST
UX for Language User Interfaces (LLM Bootcamp)
LLM Bootcamp - Day 3 Highlights
What is Attention in LLMs? Why are large language models so powerful
How to Build an LLM from Scratch | An Overview
How I'd Learn AI in 2024 (if I could start over)
Google’s AI Course for Beginners (in 10 minutes)!
What's Next? (LLM Bootcamp)
Learn to Spell: Prompt Engineering (LLM Bootcamp)
What is Prompt Tuning?
Introduction to Architectures for LLM Applications
AI/ML Engineer path - The Harsh Truth
LLM BOOTCAMP AUGUST LAUNCH VIDEO
Комментарии