Causal Temporal Transformer: An Integrated Framework for Temporal Causal Discovery and Multi-target Prediction
摘要
This paper introduces the Causal Temporal Transformer (CTT), an end-to-end trainable transformer-based model designed for the dual tasks of causal time-series discovery and multi-target prediction. At its core, CTT employs a causal attention mechanism to distinguish and emphasize causal components while suppressing non-causal ones, thereby improving interpretability and feature relevance. Furthermore, to capture temporal dependencies with greater precision, the Lag Temporal (LT) embedding is incorporated, which facilitates the analysis of lagging characteristics intrinsic to the data. Notably, CTT can generate a causal graph that elucidates the potential causal relationships among the targeted variables and the prediction sequence, thereby enriching the interpretability of the model’s outputs. Experiments on Netsim, Kuramoto, and Lorenz-96 benchmarks demonstrate CTT’s superior causal time-series discovery capabilities, outperforming recent methods. Evaluations on ETH-UCY, nuScenes, and TrajAir datasets further show significant gains in multi-target prediction accuracy over baselines. Overall, CTT offers a robust, interpretable framework aligning inferred causal attributions with underlying drivers of multi-target time-series data.