Multimodal medical image fusion has demonstrated significant potential in improving diagnostic and segmentation accuracy. However, modality heterogeneity and privacy protection requirements pose challenges to joint modeling. Existing multimodal federated learning approaches often struggle to balance communication efficiency with model generalization, limiting their practical effectiveness. To address this, we propose a wavelet decomposition-based multimodal federated learning framework, WaveFed. This method extracts key low-frequency features on the client side through wavelet decomposition, constructing compact local-global representations to reduce communication overhead. During training, a feature similarity modeling and fusion mechanism is employed to enhance structural alignment and information integration across heterogeneous modalities. In addition, a cross-modal attention module is introduced to effectively improve feature interaction and fusion at both local and global scales. Experiments on multiple joint CT and MRI segmentation tasks validate that WaveFed achieves superior segmentation performance compared to existing methods while maintaining high communication efficiency, demonstrating strong generalization and deployment potential.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

WaveFed:Wavelet-Driven Multimodal Federated Learning for Medical Data Analysis

  • Chenchen Wang,
  • Shaozhi Su,
  • Yi Hao,
  • Jiahao Yang,
  • Lingren Wang

摘要

Multimodal medical image fusion has demonstrated significant potential in improving diagnostic and segmentation accuracy. However, modality heterogeneity and privacy protection requirements pose challenges to joint modeling. Existing multimodal federated learning approaches often struggle to balance communication efficiency with model generalization, limiting their practical effectiveness. To address this, we propose a wavelet decomposition-based multimodal federated learning framework, WaveFed. This method extracts key low-frequency features on the client side through wavelet decomposition, constructing compact local-global representations to reduce communication overhead. During training, a feature similarity modeling and fusion mechanism is employed to enhance structural alignment and information integration across heterogeneous modalities. In addition, a cross-modal attention module is introduced to effectively improve feature interaction and fusion at both local and global scales. Experiments on multiple joint CT and MRI segmentation tasks validate that WaveFed achieves superior segmentation performance compared to existing methods while maintaining high communication efficiency, demonstrating strong generalization and deployment potential.