<p>Multi-task learning enhances model generalization by jointly learning from related tasks. This paper focuses on the <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\ell _{1,\infty }\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mrow> <mn>1</mn> <mo>,</mo> <mi>∞</mi> </mrow> </msub> </math></EquationSource> </InlineEquation>-norm constrained multi-task learning problem, which promotes a shared feature representation while inducing sparsity in task-specific parameters. We propose an adaptive sieving (AS) strategy to efficiently generate a solution path for multi-task Lasso problems. Each subproblem along the path is solved via an inexact semismooth Newton proximal augmented Lagrangian (<span>Ssnpal</span>) algorithm, achieving an asymptotically superlinear convergence rate. By exploiting the Karush-Kuhn-Tucker (KKT) conditions and the inherent sparsity of multi-task Lasso solutions, the <span>Ssnpal</span> algorithm solves a sequence of reduced subproblems with small dimensions. This approach enables our method to scale effectively to large problems. Numerical experiments on synthetic and real-world datasets demonstrate the superior efficiency and robustness of our algorithm compared to state-of-the-art solvers.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Adaptive Sieving with Semismooth Newton Proximal Augmented Lagrangian Algorithm for Multi-Task Lasso Problems

  • Lanyu Lin,
  • Yong-Jin Liu,
  • Bo Wang,
  • Junfeng Yang

摘要

Multi-task learning enhances model generalization by jointly learning from related tasks. This paper focuses on the \(\ell _{1,\infty }\) 1 , -norm constrained multi-task learning problem, which promotes a shared feature representation while inducing sparsity in task-specific parameters. We propose an adaptive sieving (AS) strategy to efficiently generate a solution path for multi-task Lasso problems. Each subproblem along the path is solved via an inexact semismooth Newton proximal augmented Lagrangian (Ssnpal) algorithm, achieving an asymptotically superlinear convergence rate. By exploiting the Karush-Kuhn-Tucker (KKT) conditions and the inherent sparsity of multi-task Lasso solutions, the Ssnpal algorithm solves a sequence of reduced subproblems with small dimensions. This approach enables our method to scale effectively to large problems. Numerical experiments on synthetic and real-world datasets demonstrate the superior efficiency and robustness of our algorithm compared to state-of-the-art solvers.