In recent years, the rapid development of deep learning has significantly improved the performance of joint source-channel coding (JSCC) in wireless image transmission. However, the current channel adaptive mechanism adopts one-size-fits-all strategy for features in different layers, making it difficult to satisfy the differentiation between the low-level details and the high-level semantics under the varying channel conditions. In addition, most existing methods extract only features in spatial domain, ignoring frequency domain which is important to wireless image transmission. In this paper, we propose a novel end-to-end Frequency Spatial Hybrid JSCC model incorporating a Channel Adaptive Attention Mechanism (CAAM). CAAM embeds real-time channel signal-to-noise ratio into the attention computation, enabling hierarchical adaptive weighting of features in different encoder layers. Furthermore, We propose a Frequency Spatial Hybrid Module with two stages, frequency-first followed by spatial processing. Extensive experimental results show that our proposed method significantly enhances image reconstruction quality across two distinct resolution datasets compared to existing methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Frequency Spatial Hybrid Joint Source-Channel Coding with Channel Adaptive Attention Mechanism

  • Enze Cui,
  • Shengjie Zhao,
  • Weichao Chen

摘要

In recent years, the rapid development of deep learning has significantly improved the performance of joint source-channel coding (JSCC) in wireless image transmission. However, the current channel adaptive mechanism adopts one-size-fits-all strategy for features in different layers, making it difficult to satisfy the differentiation between the low-level details and the high-level semantics under the varying channel conditions. In addition, most existing methods extract only features in spatial domain, ignoring frequency domain which is important to wireless image transmission. In this paper, we propose a novel end-to-end Frequency Spatial Hybrid JSCC model incorporating a Channel Adaptive Attention Mechanism (CAAM). CAAM embeds real-time channel signal-to-noise ratio into the attention computation, enabling hierarchical adaptive weighting of features in different encoder layers. Furthermore, We propose a Frequency Spatial Hybrid Module with two stages, frequency-first followed by spatial processing. Extensive experimental results show that our proposed method significantly enhances image reconstruction quality across two distinct resolution datasets compared to existing methods.