This chapter presents the hypothesis complexity concept frequently used in statistical learning theory, which is important for deriving generalization bounds for deep learning models. The hypothesis complexity characterizes the complexity of a machine learning algorithm and can be measured in terms of the Vapnik-Chervonenkis (VC) dimension, Rademacher complexity, and covering number. Intuitively, a more complex algorithm has worse generalizability. In this way, we may study the generalizability via the hypothesis complexity.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Hypothesis Complexity

  • Fengxiang He,
  • Dacheng Tao

摘要

This chapter presents the hypothesis complexity concept frequently used in statistical learning theory, which is important for deriving generalization bounds for deep learning models. The hypothesis complexity characterizes the complexity of a machine learning algorithm and can be measured in terms of the Vapnik-Chervonenkis (VC) dimension, Rademacher complexity, and covering number. Intuitively, a more complex algorithm has worse generalizability. In this way, we may study the generalizability via the hypothesis complexity.