Fundamental Technologies Supporting Deep Learning
摘要
Simply deepening neural networks leads to several challenges in learning. First and foremost, in the optimization computations of neural networks with many parameters, we cannot use efficient optimization methods utilizing second-order differentials such as Newton’s method.