<p>We consider the minimization of additive cost function, which consists of a large number of smooth convex functions, over a large number of closed convex sets. This type of minimization arises in a number of settings, including large-scale data processing applications and distributed optimization across a finite number of agents, and statistical estimation problems. We adopt a first-order simultaneous incremental gradient method which involves taking finite number of steps sequentially along the gradients of the component functions, with intermediate adjustment of the variables after processing each component function in a cyclic order. Then, the last step or variable obtained at the end of a cycle is projected onto all the constraint sets and the new iterate is the relaxed convex combination of such projections. We prove the convergence of this algorithm from any starting point to the feasible solution of the optimization problem in the consistent case where the intersection of the convex sets is non-empty and to a weighted least squares type solution in the inconsistent case.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Simultaneous Incremental Gradient Method for Inconsistent Convex Optimization Problem

  • Thomas Katsekpor

摘要

We consider the minimization of additive cost function, which consists of a large number of smooth convex functions, over a large number of closed convex sets. This type of minimization arises in a number of settings, including large-scale data processing applications and distributed optimization across a finite number of agents, and statistical estimation problems. We adopt a first-order simultaneous incremental gradient method which involves taking finite number of steps sequentially along the gradients of the component functions, with intermediate adjustment of the variables after processing each component function in a cyclic order. Then, the last step or variable obtained at the end of a cycle is projected onto all the constraint sets and the new iterate is the relaxed convex combination of such projections. We prove the convergence of this algorithm from any starting point to the feasible solution of the optimization problem in the consistent case where the intersection of the convex sets is non-empty and to a weighted least squares type solution in the inconsistent case.