<p>Classical principal component analysis (PCA) is typically formulated under the assumption of independent observations, although many real datasets exhibit temporal, or spatial dependence. We propose a likelihood-based latent variable model that extends probabilistic PCA by introducing correlation in latent scores, thereby accommodating dependence across observations within a unified PCA framework. The model allows flexible correlation structures, including autoregressive, group-wise, and spatial forms, and parameters are estimated via an EM algorithm with closed-form updates for model parameters. The likelihood-based formulation also enables formal testing of independence across observations through likelihood ratio tests. Simulation studies show favorable finite-sample performance in rank selection, parameter estimation, and test calibration, and demonstrate improved performance over misspecified or independence-based alternatives when dependence is present. An application to temperature data further illustrates that the proposed method yields an interpretable decomposition of variability while capturing realistic temporal and spatial dependence patterns.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A latent variable approach to principal component analysis for correlated observations

  • Jae Yun Joo,
  • Seokho Lee

摘要

Classical principal component analysis (PCA) is typically formulated under the assumption of independent observations, although many real datasets exhibit temporal, or spatial dependence. We propose a likelihood-based latent variable model that extends probabilistic PCA by introducing correlation in latent scores, thereby accommodating dependence across observations within a unified PCA framework. The model allows flexible correlation structures, including autoregressive, group-wise, and spatial forms, and parameters are estimated via an EM algorithm with closed-form updates for model parameters. The likelihood-based formulation also enables formal testing of independence across observations through likelihood ratio tests. Simulation studies show favorable finite-sample performance in rank selection, parameter estimation, and test calibration, and demonstrate improved performance over misspecified or independence-based alternatives when dependence is present. An application to temperature data further illustrates that the proposed method yields an interpretable decomposition of variability while capturing realistic temporal and spatial dependence patterns.