From simplicity to complexity: the double descent effect in modern machine learning

Yizhe Zhu (University of Southern California, Los Angeles, USA)

[jfjfcjcjchcjcjcj]

Is W ~ N(0, I) randomly sampled at every training iteration or is it just sampled randomly once at the beginning of the training and then stays fixed at those sampled values?