Hyperparameter Tuning
摘要
While the core of DNN training involves the automated learning of model parameters, there are several parameters that cannot be numerically optimized. These are known as hyperparameters. In this chapter, we discuss the various hyperparameters that deep learning practitioners are responsible for setting, and provide general guidance on how to best configure them.