The Transformer neural network architecture EXPLAINED. “Attention is all you need”

preview_player
Показать описание

🔗 Table of contents with links:
* 00:00 The Transformer
* 00:38 RNNs recap
* 01:14 Transformers high-level
* 02:27 The Transformer encoder
* 03:39 Self-attention compared to attention
* 04:51 Parallelisation
* 05:37 Encoding word order
* 06:13 Residual connections
* 06:35 Generating the output sequence
* 07:59 Masked word prediction
* 08:40 Self-supervised learning FTW!
* 09:08 Pre-training and fine-tuning and Probing
* 09:44 End dance ;)

▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

Hungry for more?

🔗 Links:

#AICoffeeBreak #MsCoffeeBean #TransformerinML #MachineLearning #AI #research
Рекомендации по теме
Комментарии
Автор

Residual conevtion.
I just understood why they sum those layers, thx so the main information don't lose through the process

airepublic
Автор

This is my favorite video on transformers

staffankonstholm
Автор

This is my favourite video on transformers. Everytime I want to revise the architecture quickly, I come here!

kevlyn
Автор

I agree with the general consensus in the comments your explanation of transformers has been the best I've seen. Subbed!!

mgfos
Автор

Finally got what is so special about this architecture. Thank you!

DrFerencAcs
Автор

I've trying to warp my head around this architecture for a loooong time.. Thanks Coffee Bean !

Katurha
Автор

SUBBED! I honestly enjoy this more than my favourite video game youtube videos

sfdv
Автор

Very nice explanation, easy to follow even for someone with almost no background in NLP

prachigupta
Автор

Thanks for your contribution! I think I just have to binge watch all your videos before I can do anything else today.

floriankowarsch
Автор

This is best explained video on transformers, , i have ever watched !!! Amazing work . Plz keep posting videos on such topics.

pranavkushare
Автор

thank you from japan
attention is all love

arigato
Автор

By far the best explanation on transformers. I was actually on a coffee break O_o.

lgbpinho
Автор

Easy to understand and good for beginers. Thanks for your high quality video :P

lookas
Автор

Thank you very much for this easy explanation of the complex topic! :)

abail
Автор

Best explanation everrrr.. Thank you soo much.

tejasdhagawkar
Автор

Great video. I really
Like how you put the aspects of transformers in practical context.

ababoo
Автор

Excellent explanations! Please keep the transformer and other state-of-the-art NLP videos coming ! Great quality.

vaishali_ramsri
Автор

Thanks! Best explanation on transformers I've seen so far, but I think I would have liked it if you dwelled more on the generation of the output and encoder-decoder attention. Cheers!

nerisozen
Автор

Holy Smokes... you're videos are clear and entertaining.. wow, other could learn from you. The "pseudo" bossa nova at the end helps too, me having a Brasil connection ;))

gregd
Автор

Best explanation i've seen thank you. Subbed.

flossetti