<p>The reduced-rank regression (RRR) is a specific multivariate (linear) regression problem when the coefficient matrix <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="41237_2024_254_Article_IEq1.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="68" /> </InlineMediaObject> <EquationSource Format="TEX">\(C\in \mathbb {R}^{p\times q}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>C</mi> <mo>∈</mo> <msup> <mrow> <mi mathvariant="double-struck">R</mi> </mrow> <mrow> <mi>p</mi> <mo>×</mo> <mi>q</mi> </mrow> </msup> </mrow> </math></EquationSource> </InlineEquation> is required to be rank deficient, i.e. <InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="41237_2024_254_Article_IEq2.gif" Format="GIF" Height="19" Rendition="HTML" Resolution="72" Type="Linedraw" Width="189" /> </InlineMediaObject> <EquationSource Format="TEX">\(\text{ rank }(C) = r &lt;\min \{p,q\}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mspace width="0.333333em" /> <mtext>rank</mtext> <mspace width="0.333333em" /> <mo stretchy="false">(</mo> <mi>C</mi> <mo stretchy="false">)</mo> <mo>=</mo> <mi>r</mi> <mo>&lt;</mo> <mo movablelimits="true">min</mo> <mo stretchy="false">{</mo> <mi>p</mi> <mo>,</mo> <mi>q</mi> <mo stretchy="false">}</mo> </mrow> </math></EquationSource> </InlineEquation>. The available RRR methods factorize <i>C</i> in a number of ways in order to impose certain rank on <i>C</i>. The main such methods are reviewed in the first part of the paper. In addition, a new factorization-free RRR method is proposed based on the null-space of <i>C</i>. This approach is both computationally efficient, and clarifies the RRR geometry very well. The second part of the paper reviews the most popular RRR methods producing sparse regression coefficients <i>C</i>. They all achieve this goal by tuning parameters. The paper investigates an alternative of achieving sparse <i>C</i> by imposing cardinality constraints on its columns and/or rows. This tuning-free approach is computationally very simple and fast, and achieves good level of sparseness on the expense of little loss of fit. The proposed new approach for sparse <i>C</i> is illustrated and compared to existing methods on simulated and real data sets.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Overview of reduced-rank regression with dense and sparse coefficients, and a new estimation procedure

  • N. Trendafilov,
  • M. Gallo,
  • V. Simonacci,
  • V. Todorov

摘要

The reduced-rank regression (RRR) is a specific multivariate (linear) regression problem when the coefficient matrix \(C\in \mathbb {R}^{p\times q}\) C R p × q is required to be rank deficient, i.e. \(\text{ rank }(C) = r <\min \{p,q\}\) rank ( C ) = r < min { p , q } . The available RRR methods factorize C in a number of ways in order to impose certain rank on C. The main such methods are reviewed in the first part of the paper. In addition, a new factorization-free RRR method is proposed based on the null-space of C. This approach is both computationally efficient, and clarifies the RRR geometry very well. The second part of the paper reviews the most popular RRR methods producing sparse regression coefficients C. They all achieve this goal by tuning parameters. The paper investigates an alternative of achieving sparse C by imposing cardinality constraints on its columns and/or rows. This tuning-free approach is computationally very simple and fast, and achieves good level of sparseness on the expense of little loss of fit. The proposed new approach for sparse C is illustrated and compared to existing methods on simulated and real data sets.