The selection of statistical methods that can operate even on ill-conditioned problems, providing accurate estimation and supporting general inference tasks, is a central need in several applications in different domains. In this setting, two major approaches are the methods from the bridge estimation family, such as ridge regression, and the entropy-based methods, such as generalized maximum entropy estimation. Regarding these two methods, on the one hand, the appropriate choice of the shrinkage parameter in ridge regression is not always an easy task, and, on the other hand, the choice of supports for the parameters of the model is a usual difficulty with the generalized maximum entropy estimator. The RidGME estimator proposed in this work, using generalized maximum entropy with supports defined with information from the ridge trace, mitigates the weaknesses of both methodologies, revealing itself as an alternative to ridge regression on ill-conditioned models. The results from an empirical application reveal that the RidGME estimator is competitive with the best optimal choice of ridge estimators and outperforms the ordinary least squares estimator in a cross-validation root mean squared error sense. Its implementation is illustrated, and computational codes are made available to practitioners.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

RidGME Estimation and Inference in Ill-Conditioned Models

  • Pedro Macedo,
  • Jorge Cabral,
  • Vera Afreixo,
  • Francisco Macedo,
  • Mario Angelelli

摘要

The selection of statistical methods that can operate even on ill-conditioned problems, providing accurate estimation and supporting general inference tasks, is a central need in several applications in different domains. In this setting, two major approaches are the methods from the bridge estimation family, such as ridge regression, and the entropy-based methods, such as generalized maximum entropy estimation. Regarding these two methods, on the one hand, the appropriate choice of the shrinkage parameter in ridge regression is not always an easy task, and, on the other hand, the choice of supports for the parameters of the model is a usual difficulty with the generalized maximum entropy estimator. The RidGME estimator proposed in this work, using generalized maximum entropy with supports defined with information from the ridge trace, mitigates the weaknesses of both methodologies, revealing itself as an alternative to ridge regression on ill-conditioned models. The results from an empirical application reveal that the RidGME estimator is competitive with the best optimal choice of ridge estimators and outperforms the ordinary least squares estimator in a cross-validation root mean squared error sense. Its implementation is illustrated, and computational codes are made available to practitioners.