<p>Medical datasets often suffer from class imbalance, causing AI models optimized via traditional Cross-Entropy (CE) loss to exhibit bias against minority classes. While direct optimization of the Area Under the Curve (AUC) mitigates this bias, it may degrade the discriminative power of learned features. Furthermore, joint optimization of CE and AUC introduces gradient conflicts due to divergent gradient surfaces, making it challenging to balance the two losses. Existing two-stage methods (CE pre-training followed by AUC fine-tuning) struggle to determine the optimal transition point for end-to-end AUC maximization. To address this, we propose DLBW, a dynamic loss balancing method that adaptively switches based on optimization uncertainty. First, a gradient balancing strategy aligns conflicting gradients to maintain synergy. Second, stochastic perturbations help parameters escape saddle points and local optima. Third, an uncertainty-aware weighting mechanism accelerates convergence while guiding models toward global optima via controlled perturbations. Experiments on two medical datasets show that DLBW outperforms CE baselines, improving AUC by 0.7%–2.6% and Precision–Recall Curve (PRC) by 2.4%–2.6%. By enhancing minority class recognition, DLBW enables equitable treatment in clinical applications such as disease diagnosis, reducing bias-induced decision risks for diverse patient populations.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

DLBW: an end-to-end multi-task adaptive gradient balancing method

  • Yayong Shi,
  • Zenghao Cui,
  • Yida Zhang,
  • Rui Wang,
  • Haiyan Zhu

摘要

Medical datasets often suffer from class imbalance, causing AI models optimized via traditional Cross-Entropy (CE) loss to exhibit bias against minority classes. While direct optimization of the Area Under the Curve (AUC) mitigates this bias, it may degrade the discriminative power of learned features. Furthermore, joint optimization of CE and AUC introduces gradient conflicts due to divergent gradient surfaces, making it challenging to balance the two losses. Existing two-stage methods (CE pre-training followed by AUC fine-tuning) struggle to determine the optimal transition point for end-to-end AUC maximization. To address this, we propose DLBW, a dynamic loss balancing method that adaptively switches based on optimization uncertainty. First, a gradient balancing strategy aligns conflicting gradients to maintain synergy. Second, stochastic perturbations help parameters escape saddle points and local optima. Third, an uncertainty-aware weighting mechanism accelerates convergence while guiding models toward global optima via controlled perturbations. Experiments on two medical datasets show that DLBW outperforms CE baselines, improving AUC by 0.7%–2.6% and Precision–Recall Curve (PRC) by 2.4%–2.6%. By enhancing minority class recognition, DLBW enables equitable treatment in clinical applications such as disease diagnosis, reducing bias-induced decision risks for diverse patient populations.