<p>This work presents a parallel variant of the algorithm introduced in [<i>Acceleration of block coordinate descent methods with identification strategies</i>, Comput. Optim. Appl. 72(3):609–640, 2019] to minimize the sum of a partially separable smooth convex function and a possibly nonsmooth block-separable convex function under simple constraints. The proposed method achieves higher efficiency by using a strategy to identify nonzero coordinates, thereby allowing the computational effort to be focused via a nonuniform probability distribution in block selection. Parallelization is achieved by extending theoretical results from Richtárik and Takáč [<i>Parallel coordinate descent methods for big data optimization</i>, Math. Prog. Ser. A 156:433–484, 2016]. We present convergence results and comparative numerical experiments on regularized regression problems using both synthetic and real datasets.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Parallel block coordinate descent methods with identification strategies

  • Ronaldo Lopes,
  • Sandra A. Santos,
  • Paulo J. S. Silva

摘要

This work presents a parallel variant of the algorithm introduced in [Acceleration of block coordinate descent methods with identification strategies, Comput. Optim. Appl. 72(3):609–640, 2019] to minimize the sum of a partially separable smooth convex function and a possibly nonsmooth block-separable convex function under simple constraints. The proposed method achieves higher efficiency by using a strategy to identify nonzero coordinates, thereby allowing the computational effort to be focused via a nonuniform probability distribution in block selection. Parallelization is achieved by extending theoretical results from Richtárik and Takáč [Parallel coordinate descent methods for big data optimization, Math. Prog. Ser. A 156:433–484, 2016]. We present convergence results and comparative numerical experiments on regularized regression problems using both synthetic and real datasets.