Training Dynamics and Loss Functions
摘要
In this chapter, we discuss four articles that focus on studying properties of the training process. The first one deals with the loss function used to train a network. The other three are focused on the evolution of weights during the training process and how the fractal dimension of weight trajectories is related to the generalization capacity of a network.