<p>Foreign object detection (FOD) is a crucial concern in various industries, including aerospace, automotive, and manufacturing, where undetected foreign objects can cause severe damage and safety risks. Traditional FOD detection systems rely on visual inspection, radar, X-ray imaging, or acoustic sensing, but face challenges in complex and dynamic environments. In this work, we propose a novel methodology that utilizes neural radiance fields (NeRF) as a comparative baseline for foreign object detection in industrial settings. Our approach consists of two main phases: First, a photorealistic 3D reconstruction of the environment is generated using NeRF when no foreign objects are present. Then, in the detection phase, new images of the environment are captured, and their viewpoints are matched with the NeRF-rendered scene to identify discrepancies using a deep learning-based comparative model. The system utilizes a modified SNUNet-CD architecture, enhancing attention mechanisms for improved accuracy in detecting semantic changes. Experimental validation in a controlled environment demonstrates high detection accuracy, successfully identifying foreign objects of varying sizes, materials, and placements.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Foreign object detection using neural radiance field as comparative baseline

  • Claudio Lopez,
  • Martxel Eizaguirre,
  • Aiert Amundarain

摘要

Foreign object detection (FOD) is a crucial concern in various industries, including aerospace, automotive, and manufacturing, where undetected foreign objects can cause severe damage and safety risks. Traditional FOD detection systems rely on visual inspection, radar, X-ray imaging, or acoustic sensing, but face challenges in complex and dynamic environments. In this work, we propose a novel methodology that utilizes neural radiance fields (NeRF) as a comparative baseline for foreign object detection in industrial settings. Our approach consists of two main phases: First, a photorealistic 3D reconstruction of the environment is generated using NeRF when no foreign objects are present. Then, in the detection phase, new images of the environment are captured, and their viewpoints are matched with the NeRF-rendered scene to identify discrepancies using a deep learning-based comparative model. The system utilizes a modified SNUNet-CD architecture, enhancing attention mechanisms for improved accuracy in detecting semantic changes. Experimental validation in a controlled environment demonstrates high detection accuracy, successfully identifying foreign objects of varying sizes, materials, and placements.