Stochastic Gradient Descent as an Implicit Regularization

章节
发表日期：

2025年

查看全文

Fengxiang He,
Dacheng Tao

摘要

Overparameterization creates a colossal hypothesis space. Although Golowich et al. (2018) have proved generalization bounds that have explicit independence on the network size, some implicit dependence may be observed.

Overparameterization creates a colossal hypothesis space. Although Golowich et&#xa0;al. (2018) have proved generalization bounds that have explicit independence on the network size, some implicit dependence may be observed.

Stochastic Gradient Descent as an Implicit Regularization

摘要

Overparameterization creates a colossal hypothesis space. Although Golowich et al. (2018) have proved generalization bounds that have explicit independence on the network size, some implicit dependence may be observed.