Scholarlink

Abstract <p>Variational inequalities (VIs) serve as a powerful tool for various problems. This setting can be applied to a wide range of optimization, machine learning (ML), and other challenges. At the same time, large volumes of data are essential for high performance in ML tasks, which are addressed through stochastic approaches. However, widely used SGD method suffers from a non-decreasing variance of the stochastic gradient. To resolve this issue, variance reduction techniques were developed. This approach is well-studied for minimization but less extensively for VIs. In this paper, we modify the SAGA method, known for its effectiveness in stochastic minimization, by integrating Extragradient to address VI problems. We provide a theoretical analysis of the proposed method and conduct experiments, including bilinear problems and image denoising tasks.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

ExtraSAGA: Variance Reduction Hybrid Method for Variational Inequalities

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年12月1日

查看全文
  • G. Chirkov,
  • Yu. Kabikov,
  • D. Medyakov,
  • G. Molodtsov,
  • A. Shestakov,
  • A. Beznosikov

摘要

Abstract

Variational inequalities (VIs) serve as a powerful tool for various problems. This setting can be applied to a wide range of optimization, machine learning (ML), and other challenges. At the same time, large volumes of data are essential for high performance in ML tasks, which are addressed through stochastic approaches. However, widely used SGD method suffers from a non-decreasing variance of the stochastic gradient. To resolve this issue, variance reduction techniques were developed. This approach is well-studied for minimization but less extensively for VIs. In this paper, we modify the SAGA method, known for its effectiveness in stochastic minimization, by integrating Extragradient to address VI problems. We provide a theoretical analysis of the proposed method and conduct experiments, including bilinear problems and image denoising tasks.