STL-ConvTransformer: Series Decomposition and Convolution-Infused Transformer Architecture in Multivariate Time Series Anomaly Detection

In rapidly evolving industrial IT systems, the integration of sensor networks has become the cornerstone of operational workflows. These networks diligently collect data in the form of time series, where the format intertwines closely with temporal dependencies, crucial for anomaly detection models. Hence, the extraction of information in the time domain is advantageous for anomaly detection. To address this, we adopt a method of time series decomposition to delve into seasonality, trend, and residual components. Additionally, we design a novel algorithm that combines Transformer architecture with convolutional layers, focusing on subtle local dependencies within time series data. Extensive validation on three different real-world datasets highlights the robustness of our approach, demonstrating its proficiency in anomaly detection in time series materials. This underscores the advantage of combining convolutional strategies with Transformer architecture in capturing complex patterns and anomalies.