<p>In econometric analysis, researchers often encounter vast datasets that greatly reduce model efficiency. In this paper, the authors develop a sequential shrinkage estimation method for use in distributed settings. Within this framework, one dataset is split into several blocks, and each block is regarded as a node. The sequential shrinkage estimation method is implemented on the data in each block until the stopping criteria are satisfied. These sequential procedures are then integrated to produce the final results using a weighted average, which provides approximate regression result estimates for the entire dataset. The proposed method can significantly reduce the required number of samples and perform parameter estimation and variable selection while satisfying the preset accuracy requirements. In addition, the statistical properties of the parameter estimates in the proposed approach are analyzed for use in a linear regression model. Finally, numerical studies on simulated and real datasets show that the proposed method performs well.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Distributed Sequential Shrinkage Estimation

  • Haibo Lu,
  • Zhuojian Chen,
  • Zimu Chen

摘要

In econometric analysis, researchers often encounter vast datasets that greatly reduce model efficiency. In this paper, the authors develop a sequential shrinkage estimation method for use in distributed settings. Within this framework, one dataset is split into several blocks, and each block is regarded as a node. The sequential shrinkage estimation method is implemented on the data in each block until the stopping criteria are satisfied. These sequential procedures are then integrated to produce the final results using a weighted average, which provides approximate regression result estimates for the entire dataset. The proposed method can significantly reduce the required number of samples and perform parameter estimation and variable selection while satisfying the preset accuracy requirements. In addition, the statistical properties of the parameter estimates in the proposed approach are analyzed for use in a linear regression model. Finally, numerical studies on simulated and real datasets show that the proposed method performs well.