Robust learning for ridge-penalized quasi-GLMs under non-identical distributions

期刊论文
出版模式：

开放获取
发表日期：

2025年11月14日

查看全文

Huiming Zhang,
Wan Tian,
Qiuran Yao,
Pengfei Wang,
Baochang Zhang

摘要

In recent years, robust estimation of model parameters has attracted considerable attention in statistics and machine learning, particularly in the context of modeling data with outliers and related inverse problems. This paper introduces a novel log-truncated minimization estimator and a corresponding stochastic gradient descent (SGD) algorithm for quasi-generalized linear models. This approach provides a robust alternative to ordinary GLMs without assuming light-tailed error distributions. For independent non-identical distributed (i.n.i.d.) data, we derive non-asymptotic excess risk and \(\ell _2\) -risk bounds using log-truncated Lipschitz losses, assuming only a finite \(\beta\) -th moment for \(\beta \in (1,2]\) . Notably, our estimator does not require higher moments or finite variance. Our contribution is to robustify the objective while allowing i.n.i.d. sampling. We also analyze the iteration complexity of SGD for finding stationary points of non-convex log-truncated minimization. Empirically, our SGD algorithm outperforms non-robust methods. We demonstrate its practical effectiveness through a real-data analysis of the German health care demand dataset using robust negative binomial regression.