Methods based solely on images often overly rely on inter-frame information and lose crucial motion cues, resulting in performance bottlenecks for motion deblurring. Event cameras with high temporal resolution offer a promising breakthrough in the ability to effectively capture motion information. However, most existing event-based methods operate only in the spatial domain, neglecting cross-dimensional interactions and the frequency differences between event data and blurred images, leading to suboptimal fusion and limited effectiveness in handling complex blur. To address these challenges, we propose Event-driven motion deblurring based on Multidimensional Interaction and Frequency-domain Separation (EMIFS). This method mitigates information loss during cross-modal fusion and improves deblurring performance. Specifically, we design a multidimensional interaction attention module to enhance the model’s perception of complex blurred regions and improve detail restoration. In the fusion stage, we introduce a frequency-domain separation based multimodal bidirectional fusion module, enabling effective integration of complementary information from events and blurred images through frequency separation and recombination. Extensive experiments on the public GoPro and REBlur datasets demonstrate that EMIFS achieves superior deblurring performance compared to state-of-the-art methods, with PSNR gains of 0.4 dB and 0.19 dB, respectively.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Event-Driven Motion Deblurring Based on Multidimensional Interaction and Frequency-Domain Separation

  • Daojun Han,
  • Bendong Qiao,
  • Xiaoke Zhu,
  • Juntao Zhang,
  • Zhigang Han,
  • Linkun Fan,
  • Mengxin Jin

摘要

Methods based solely on images often overly rely on inter-frame information and lose crucial motion cues, resulting in performance bottlenecks for motion deblurring. Event cameras with high temporal resolution offer a promising breakthrough in the ability to effectively capture motion information. However, most existing event-based methods operate only in the spatial domain, neglecting cross-dimensional interactions and the frequency differences between event data and blurred images, leading to suboptimal fusion and limited effectiveness in handling complex blur. To address these challenges, we propose Event-driven motion deblurring based on Multidimensional Interaction and Frequency-domain Separation (EMIFS). This method mitigates information loss during cross-modal fusion and improves deblurring performance. Specifically, we design a multidimensional interaction attention module to enhance the model’s perception of complex blurred regions and improve detail restoration. In the fusion stage, we introduce a frequency-domain separation based multimodal bidirectional fusion module, enabling effective integration of complementary information from events and blurred images through frequency separation and recombination. Extensive experiments on the public GoPro and REBlur datasets demonstrate that EMIFS achieves superior deblurring performance compared to state-of-the-art methods, with PSNR gains of 0.4 dB and 0.19 dB, respectively.