Machine Learning 24: Neural Nets - Backpropagation

In this video, we introduce the backpropagation algorithm for training neural networks via mini-batch stochastic gradient descent. We first define a computation graph and show how to translate the evaluation of a neural net into a computation graph. We then demonstrate the forward and backwards pass of the backprop algorithm and discuss how to include the evaluation of a loss function in the computation graph.