Training Deep Networks

Now that you have studied various Neural Network architectures, the gradient descent algorithm, and the backpropagation algorithm, let us explore some more optimization techniques and analyze their effect on the smoothness of the loss curve. You will also explore the effect of these techniques on the performance of the model.