The Mean Squared Error of an Estimator and the Bias Variance Tradeoff

We define the mean squared error of an estimator. We show that the mean squared error is the sum of the variance of the estimator and the squared bias of the estimator. This proof shows that there is a tradeoff between bias and variance which cannot typically be avoided.

#mikethemathematician, #mikedabkowski, #profdabkowski