Designing effective time-series models is challenging due to factors like complex temporal dependencies, low information density, and scalability constraints. To address these challenges, we propose TS-FourierLLM, a novel approach that integrates a frozen Large Language Models (LLMs) block as a plug-and-play frequency-domain enhancer for time-series modeling. By transferring high-level pre-trained LLM knowledge into the frequency domain, our method bridges the modality gap while avoiding fine-tuning, preserving computational efficiency. The frozen LLM block captures inter-frequency dependencies and enhances global feature representations, complementing time-series encoders. TSFourierLLM achieves up to a 3% performance improvement over state-of-the-art methods on the benchmark. These results demonstrate the effectiveness of utilizing frozen LLMs as modular and task-agnostic components for advancing time-series modeling.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

TS-FourierLLM: Frozen Frequency-Domain Large Language Blocks for Enhancing Time-Series Modeling

  • Pengfei Wang,
  • Huanran Zheng,
  • Wenjing Yue,
  • Xiaoling Wang

摘要

Designing effective time-series models is challenging due to factors like complex temporal dependencies, low information density, and scalability constraints. To address these challenges, we propose TS-FourierLLM, a novel approach that integrates a frozen Large Language Models (LLMs) block as a plug-and-play frequency-domain enhancer for time-series modeling. By transferring high-level pre-trained LLM knowledge into the frequency domain, our method bridges the modality gap while avoiding fine-tuning, preserving computational efficiency. The frozen LLM block captures inter-frequency dependencies and enhances global feature representations, complementing time-series encoders. TSFourierLLM achieves up to a 3% performance improvement over state-of-the-art methods on the benchmark. These results demonstrate the effectiveness of utilizing frozen LLMs as modular and task-agnostic components for advancing time-series modeling.