Large Language Models from scratch

preview_player
Показать описание
How do language models like chatGPT and Palm work? A short cartoon that explains transformers and the tech behind LLMs.

0:05 - autocomplete
0:44 - search query completion
1:03 - language modeling with probabilities
1:59 - time series and graphs
2:34 - text generation
3:43 - conditional probabilities
3:52 - trigrams
4:49 - universal function approximation
5:19 - neural networks
6:33 - gradient descent
7:03 - back propagation
7:24 - network capacity
Рекомендации по теме
Комментарии
Автор

This is seriously *really* good, I've not seen someone introduce high level concepts by-example so clearly (and nonchalantly!)

triton
Автор

This is so good. I can't believe it has so few views.

somethingness
Автор

This is an excellent articulation. We need part 3, 4, and 5

ivocamilleri
Автор

Finally! Someone who knows how explain complexity with simplicity.

solotron
Автор

if there is an Oscar for best tutorial on the internet, this video deserves it !

TheAkiller
Автор

These visuals were SO HELPFUL in introducing and understanding some foundational ML concepts.

SethWieder
Автор

Being able to visualize this so simply is legendary. You're doing amazing work. Subbed

JessieJussMessy
Автор

That might be the best, most concise and impactful neural network introduction I have seen to date

GregMatoga
Автор

this is excellently done, I'm very grateful for you putting this together.

saqhorov
Автор

You have made it so easy to see and understand - it puts into place all the complicated explanations that exist out there on the net.

marktahu
Автор

Wow. This is so well presented. And a different take that gets to the real intuition.

wryltxw
Автор

This was awesome. I don't think I could adequately explain how this all works yet, but it fills in so many gaps. Thank you for this video!

AncientSlugThrower
Автор

Great video. "energy function" instead of error function, but a great explanation of gradient descent and backprop in a super short time. Excellent job!

noahnazareth
Автор

I really liked your explanation of how "training a network" is performed. Made it a lot easier to understand

ericsun
Автор

possibly the best explanation of LLM i've ever seen. accurate, pointed and concise

liamcawley
Автор

Stunning video of absolutely high and underrated quality !!!!
Thanks so much, for this !

laStarchuck
Автор

This is insanely good. I've understood things in 8 minutes that I could not understand after entire classes

AVV-A
Автор

you sir, deserve my subscription. This was so good.

funnycompilations
Автор

Very clear and concise explanation! Excellent work!

gigabytechanz
Автор

I've been watching a lot of videos on LLMs and the underlying mathematics. This explanation is PHENOMENAL. Not dumbed down, not too long, and uses concepts of existing maths and graphing that cement the concept perfectly.

stratfanstl