Multivariate Normal | Intuition, Introduction & Visualization | TensorFlow Probability

The Normal distribution is ubiquitous in Machine Learning and Statistics. In naturally arises in so many application scenarios. But that is not due to the univariate but due to the Multivariate Normal, i.e., a Normal that is defined over more than just one axis. Multivariate Normal Distributions with more than 1000 axes (=dimensions) are common practice.

But we need some basic linear algebra in order to understand. Still, a visual introduction is the best way to start.

In this video, we will introduce the concepts of covariance and the covariance matrix. We will see that we need the Cholesky decomposition to find the analogy to the standard deviation in order to evaluate the Normal distribution.

The last part of the video will be on how the Multivariate Normal is implemented in TensorFlow Probability. Here, we will also see what it means if the Cholesky Decomposition fails.

-------

-------

Timestamps:
00:00 Introduction
00:47 Two Normally Distributed Random Variables
01:06 Parameters for univariate Normal Distributions
01:54 Interaction by Covariances
02:56 Random Vector
03:18 Proportional PDF
06:01 Parameters of the Multivariate Normal
07:23 A 3D Surface Plot
09:10 Going into higher dimensions
09:43 The Normalization Constant
11:20 Requirements on the Parameters
12:05 Symmetric Positive Definiteness
12:31 Cholesky Decomposition
14:28 The Precision
16:50 Plot: Intro
17:47 Plot: Shifting/Moving
18:06 Plot: Changing Variance
18:41 Plot: Changing Covariance
19:32 Plot: Symmetric Positive Definiteness
20:26 TFP: Defining the Parameters
21:12 TFP: Cholesky Decomposition
21:50 TFP: when Cholesky fails
22:51 TFP: Cholesky and Standard Deviation
23:51 TFP: Defining Multivariate Normal
24:37 TFP: Sampling
24:52 TFP: The Mode
25:03 TFP: Querying (Log-) Probability
25:45 TFP: Lazy Defining
26:04 Outro

[gokuldasnellenat]

The best explanation of Multivriate Normal distribution

[tobe]

Great video with all details to understand Multivariate Normal Distribution and not osbcur formulas !

[orjihvy]

That was a really good explanation on concept and coding example.

[dargi_amorim]

Your videos are really useful. I'm watching the essential probability playlist and I plan to watch a few other playlists in your channel. Thank you very much for all you work and for sharing knowledge ! I am sincerelly grateful, sir !

[leakarrer]

Thanks! you explained the content so neat and logical, something, that my professor was unable to do..

[AnatoliiKuznietsov]

instant like and subscribe. read this chapter from Bishop, and didn't understand a shit. with your video, it's way more clear now. thx

[soumilyade]

I'm glad to have come across the channel.... ♥️
Thank You for your efforts and lucid straightforward explanations..! ♥️