Variational Autoencoder - Model, ELBO, loss function and maths explained easily!

A complete explanation of the Variational Autoencoder, a key component in Stable Diffusion models. I will show why we need it, the idea behind the ELBO, the problems in maximizing the ELBO, the loss function and explain the math derivations step by step.

Chapters
00:00 - Introduction
00:41 - Autoencoder
02:35 - Variational Autoencoder
04:20 - Latent Space
06:06 - Math introduction
08:45 - Model definition
12:00 - ELBO
16:05 - Maximizing the ELBO
19:49 - Reparameterization Trick
22:41 - Example network
23:55 - Loss function

[Koi-vvcy]

It's the clearest explanation about VAE that I have ever seen.

[lucdemartre]

I would pay so much to have you as my teacher, that's not only the best video i've ever seen on deep leanring, but probably the most appealing way anyone ever taught me CS !

In ML topics most of the videos go to the beef of the math or the code implementation and do not care about a whole picture understanding. Your video fills that gap so nicely! Watching this video is a strong first step to understanding the topic deeply! very well done!

[chenqu]

The peps starting from 06:40 are the gem. Totally agree.

[OlenaHlushchenko]

I love this so much, this channel lands in my top 3 ML channels ever <3 I wish papers would be written at least half as clear and available as this video because why not

[egoworks]

fing masterpiece thank you man, you outdid stanford and other papers with this explanation.

[kranthikumar]

@Umar Jamil, you have explained VAE so much better compared to others. You are one of my favorite YouTube teachers.

[lucdemartre]

PLATO MENTIONED PLATO MENTIONED I LOVE YOU THAT'S THE BEST VIDEO I'VE EVER SEEN !!!

[vipulsangode]

This is the best explanation on the internet!

[JohnSmith-hexg]

Getting philosophical w/ the Cave Allegory. I love it. Great stuff.

[sandahk]

It was the best video I found to explain VAE. Thank you so much!

[miladheydari]

this is the best video on the Internet

[shuoliu]

You solved my confusion since long! Thank you !

[greyxray]

so clear! so on point! love the way you teach!

[isaz]

Thanks, this video have many explanations that are missing from other tutorials on VAE.

Like the part from 22:45 onwards. I saw a lot of other videos that didn't explain how the p and q functions were related to the encoder and decoder.
(every other tutorial felt like they started talking about VAE, and then suddenly changed subject to talk about some distribution functions for no obvious reason).

[anantmohan]

Thank you for creating such a nice explanation of VAE. When are you bringing the practical implementation video of VAE? please make a video for this as well.

[desmondteo]

Incredible explanation. Thanks for making this video. It's extremely helpful!

[shajidmughal]

Great explanation. Clean!!! Reminds me of school where our physics teacher taught everything practical and it felt so simple. subs+1👍

[vikramsandu]

Simply amazing. Thank you so much for explaining so beautifully. :)

[morgancredib-ai]

A normalizing flow video would complement this nicely