Understanding weight matrices (Deep Ensemble vs Batch Ensemble vs Rank-1 BNN)- part 1

This is the part 1 of Understanding weight matrices and parameters count of different deep learning ensemble models used for Uncertainty Estimation – Deep Ensemble, Batch Ensemble & Rank-1 BNN.
In this video we are not going to cover in depth about the uncertainty estimation or the ensemble approaches. We will see for the three approaches
* On a high level how the weight matrices are defined
* Code a simple MLP for deep ensemble , batch ensemble and rank-1 BNN
* Compute the parameters for all the above
* then convince us mathematically about the number of parameters in each of this paper make sense
* and show the comparison through graph

[azadehbayani]

great explanation, thank you this video helped me a lot to understand these papers, thank you so much

[zeeshanahmad]

Thank you for such a nice explanation.