The current state-of-the-art deep learning vision networks commonly employs synthetic approaches for data augmentation when confronted with scenes requiring motion blur. However, existing blur synthesis methods often fall short in accurately simulating motion blur as observed in real-world scenarios, consequently hindering the generalization capability of trained deep visual networks to real-world applications, a phenomenon known as domain shift effects [1]. To address this problem, we propose a novel non-uniform motion blur synthesis method for data augmentation. First, we randomly generate the camera’s motion trajectory using a more general six-degree-of-freedom (6-DOF) camera motion model, and then map this trajectory to pixel-level blur kernels. To efficiently perform spatially varying convolution, we employ non-negative matrix factorization (NMF) to decompose those blur kernels into a set of kernel basis and their corresponding mixing coefficients. This enables parallel execution of spatial variation convolutions, thereby significantly improving the efficiency of blur synthesis. Our experiments demonstrate consistently superior results of the proposed method on publicly available real datasets RealBlur, as well as synthetic datasets GoPro and REDS.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

6-DOF Motion Blur Synthesis and Performance Evaluation of Object Detection

  • Hanjin Yang,
  • Feng Li,
  • Lei Zhang

摘要

The current state-of-the-art deep learning vision networks commonly employs synthetic approaches for data augmentation when confronted with scenes requiring motion blur. However, existing blur synthesis methods often fall short in accurately simulating motion blur as observed in real-world scenarios, consequently hindering the generalization capability of trained deep visual networks to real-world applications, a phenomenon known as domain shift effects [1]. To address this problem, we propose a novel non-uniform motion blur synthesis method for data augmentation. First, we randomly generate the camera’s motion trajectory using a more general six-degree-of-freedom (6-DOF) camera motion model, and then map this trajectory to pixel-level blur kernels. To efficiently perform spatially varying convolution, we employ non-negative matrix factorization (NMF) to decompose those blur kernels into a set of kernel basis and their corresponding mixing coefficients. This enables parallel execution of spatial variation convolutions, thereby significantly improving the efficiency of blur synthesis. Our experiments demonstrate consistently superior results of the proposed method on publicly available real datasets RealBlur, as well as synthetic datasets GoPro and REDS.