CS E4740 From Linear to Non Linear Models

Recording of a lecture that discusses how to generalize the analysis of FL methods for linear models to non-linear models, e.g., deep neural networks. The idea is to formulate the analysis in terms of the Hessian of the local loss functions. Recent work studies the Hessian for deep neural networks, such as transformer networks.