Scholarlink

<p>Predictive analytics in multi-source business environments encounter significant challenges when incomplete data sources compromise analytical accuracy. This study presents transformer-based feature integration mechanisms for handling missing data in prediction tasks, validated through a representative case study of real-world business data where 47.4% of records lack engagement information due to customer behavioral patterns. Within this framework, we systematically compare four integration architectures: self-attention, dual-stream, adaptive feature weighting, and fusion integration through adaptive gating mechanisms. In the internal architecture comparison, the proposed Gated Fusion architecture demonstrated statistically significant performance improvements over all three competing variants. Finally, we benchmarked the Gated Fusion architecture against XGBoost with native missing-value handling and the SAINT tabular Transformer as external baselines. While XGBoost demonstrated highly competitive overall performance, the fusion model showed a statistically significant adaptive advantage on records with missing engagement data and outperformed SAINT across all evaluation metrics. The findings demonstrate that the proposed architecture provides a practical and adaptive solution for handling systematic missingness in the specific context of multi-source transactional prediction tasks.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Transformer-based feature integration for predictive modeling in multi-source business environments

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年6月30日

查看全文
  • Duygu Bayrak Gümüş,
  • Muhammed Kotan

摘要

Predictive analytics in multi-source business environments encounter significant challenges when incomplete data sources compromise analytical accuracy. This study presents transformer-based feature integration mechanisms for handling missing data in prediction tasks, validated through a representative case study of real-world business data where 47.4% of records lack engagement information due to customer behavioral patterns. Within this framework, we systematically compare four integration architectures: self-attention, dual-stream, adaptive feature weighting, and fusion integration through adaptive gating mechanisms. In the internal architecture comparison, the proposed Gated Fusion architecture demonstrated statistically significant performance improvements over all three competing variants. Finally, we benchmarked the Gated Fusion architecture against XGBoost with native missing-value handling and the SAINT tabular Transformer as external baselines. While XGBoost demonstrated highly competitive overall performance, the fusion model showed a statistically significant adaptive advantage on records with missing engagement data and outperformed SAINT across all evaluation metrics. The findings demonstrate that the proposed architecture provides a practical and adaptive solution for handling systematic missingness in the specific context of multi-source transactional prediction tasks.