Missing data poses challenges for machine learning applications across domains. Prevalent imputation techniques using deep learning have demonstrated limitations: GANs exhibit instability, while autoencoders tend to overfit. In real application scenarios, there are diverse types of missingness with varied missing rates, calling for an accurate and generic imputation approach. In this paper, we introduce dual corruption denoising autoencoders (DC-DAE). Our method involves two key innovations: firstly, augmenting inputs through dual corruptions during training, which prevents reliance on fixed missingness patterns and enhances generalization; secondly, employing a balanced loss function that provides control over the reconstruction of artificial missing data and the denoising of observed values. DC-DAE has a simple yet effective architecture without the complexity of attention mechanism or adversarial training. By combining corruption robustness and high-fidelity reconstruction, DC-DAE achieves both accuracy and stability. We demonstrate state-of-the-art performance on multiple tabular datasets with different missing rates, outperforming GAN, DAE, and VAE baselines under varied missingness scenarios. Our results highlight the importance of diverse and proper corruptions when designing models for imputation. The proposed plug-and-play approach offers an effective solution for ubiquitous missing data problems across domains.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Improving Generalization for Missing Data Imputation via Dual Corruption Denoising Autoencoders

  • Xu Jiao,
  • Shi Luo,
  • Yao Yang,
  • Ying Li,
  • Yiteng Zhai,
  • Nian Liu

摘要

Missing data poses challenges for machine learning applications across domains. Prevalent imputation techniques using deep learning have demonstrated limitations: GANs exhibit instability, while autoencoders tend to overfit. In real application scenarios, there are diverse types of missingness with varied missing rates, calling for an accurate and generic imputation approach. In this paper, we introduce dual corruption denoising autoencoders (DC-DAE). Our method involves two key innovations: firstly, augmenting inputs through dual corruptions during training, which prevents reliance on fixed missingness patterns and enhances generalization; secondly, employing a balanced loss function that provides control over the reconstruction of artificial missing data and the denoising of observed values. DC-DAE has a simple yet effective architecture without the complexity of attention mechanism or adversarial training. By combining corruption robustness and high-fidelity reconstruction, DC-DAE achieves both accuracy and stability. We demonstrate state-of-the-art performance on multiple tabular datasets with different missing rates, outperforming GAN, DAE, and VAE baselines under varied missingness scenarios. Our results highlight the importance of diverse and proper corruptions when designing models for imputation. The proposed plug-and-play approach offers an effective solution for ubiquitous missing data problems across domains.