<p>Graphical models provide a powerful framework for representing conditional dependencies among random variables, where the precision matrix <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(\varvec{\Theta }\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="bold">Θ</mi> </mrow> </math></EquationSource> </InlineEquation> encodes these relationships. Traditional approaches like the Graphical Lasso (Glasso), which employs <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(\ell _1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation>-regularization, promote sparsity but suffer from drawbacks such as biased estimates, sensitivity to regularization parameters, and weak control over false positive edges. Conversely, <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(\ell _0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation>-based methods enforce exact sparsity, but they are either continuous surrogates of the best-subset selector, that performs poorly outside low-dimensional settings; or iterative algorithms enforcing the <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(\ell _0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation>-constraint directly, which do not immediately guarantee the preservation of positive definiteness in the domain of graphical models. To address these limitations, we introduce the Sparsity-Constrained Graphical Lasso (SCGlasso), a novel estimator that integrates an <InlineEquation ID="IEq9"> <EquationSource Format="TEX">\(\ell _0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation>-constraint with an <InlineEquation ID="IEq10"> <EquationSource Format="TEX">\(\ell _1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation>-penalty to balance sparsity and shrinkage effectively. We propose an efficient coordinate descent algorithm and establish its computational complexity and convergence to a local minimum. Through extensive simulations, we benchmark SCGlasso against state-of-the-art methods, including Glasso, Gslope, Selo, Atan and Exponential penalties. Our results demonstrate that SCGlasso achieves a competitive performance in both estimation and model selection accuracy, especially in low-sample regimes. Finally, we illustrate its practical utility on two empirical applications: gene expression data from Arabidopsis thaliana and financial returns of the Euro Stoxx&#xa0;50 constituents, where SCGlasso uncovers interpretable network structures that competing methods often fail to recover.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An \(\ell _0\)-constrained and \(\ell _1\)-regularized estimator for graphical models

  • Alessandro Fulci,
  • Sandra Paterlini,
  • Emanuele Taufer

摘要

Graphical models provide a powerful framework for representing conditional dependencies among random variables, where the precision matrix \(\varvec{\Theta }\) Θ encodes these relationships. Traditional approaches like the Graphical Lasso (Glasso), which employs \(\ell _1\) 1 -regularization, promote sparsity but suffer from drawbacks such as biased estimates, sensitivity to regularization parameters, and weak control over false positive edges. Conversely, \(\ell _0\) 0 -based methods enforce exact sparsity, but they are either continuous surrogates of the best-subset selector, that performs poorly outside low-dimensional settings; or iterative algorithms enforcing the \(\ell _0\) 0 -constraint directly, which do not immediately guarantee the preservation of positive definiteness in the domain of graphical models. To address these limitations, we introduce the Sparsity-Constrained Graphical Lasso (SCGlasso), a novel estimator that integrates an \(\ell _0\) 0 -constraint with an \(\ell _1\) 1 -penalty to balance sparsity and shrinkage effectively. We propose an efficient coordinate descent algorithm and establish its computational complexity and convergence to a local minimum. Through extensive simulations, we benchmark SCGlasso against state-of-the-art methods, including Glasso, Gslope, Selo, Atan and Exponential penalties. Our results demonstrate that SCGlasso achieves a competitive performance in both estimation and model selection accuracy, especially in low-sample regimes. Finally, we illustrate its practical utility on two empirical applications: gene expression data from Arabidopsis thaliana and financial returns of the Euro Stoxx 50 constituents, where SCGlasso uncovers interpretable network structures that competing methods often fail to recover.