Hybrid Transformer-CNN architecture for multivariate time series forecasting: Integrating attention mechanisms with convolutional feature extraction
摘要
Accurately forecasting time series data remains a critical challenge, particularly in financial markets where volatility and noise obscure underlying patterns. Traditional deep learning approaches often struggle to simultaneously capture local and global dependencies, limiting their effectiveness in detecting directional changes. To address these challenges, we propose an innovative hybrid model that integrates Transformers with 1D Convolutional Neural Networks (1D-CNN), leveraging their complementary strengths. The self-attention mechanism of Transformers enhances the model’s ability to capture long-term dependencies, while 1D-CNN excels at extracting local patterns and refining feature representations. Unlike conventional models that aim to predict exact values, our approach is explicitly designed to learn and detect changes in trends rather than forecasting precise numerical values. The primary motivation of this work is to improve Directional Accuracy (DA) and Signal Directional Change Detection, two critical factors for robust time series forecasting in financial applications. Our model effectively mitigates the impact of market fluctuations by enhancing trend detection and reducing false signals. Performance evaluation is conducted using specialized metrics, including DA, Trend Consistency Index (TCI), Signal Shift Error (SSE), and Precision of Trend Change (PTC), ensuring a comprehensive assessment of the model’s predictive capabilities. Experimental results demonstrate that our hybrid model significantly outperforms both custom and state-of-the-art architectures, achieving superior accuracy in detecting trend reversals and signal shifts. This research contributes to advancing time series modeling by introducing a modular, scalable, and high-precision forecasting framework, applicable across various domains.