<p>Heterogeneous change detection (HeCD) is a highly valuable yet challenging task in remote sensing. However, existing HeCD methods primarily focus on well-registered images, without considering unregistered heterogeneous image pairs, which are more common in real-world applications. In this paper, we first analyze why unregistered images significantly complicate the HeCD problem: they not only cause boundary errors in change detection but also undermine the image transformation process required for making heterogeneous images comparable. These effects are further amplified by the intrinsic complexity of HeCD. In light of this, we propose an unsupervised iterative global mapping-local searching method (IGmLs) for HeCD subject to registration errors. Specifically, IGmLs utilizes the global mapping to transform images into a common structural space to enable the comparison of heterogeneous images, and uses the local searching to reduce the direct influence of registration errors on change metrics, which is based on the analysis that misregistration would cause an unwanted increment on the change metric in unchanged region. Then, IGmLs builds a Markov random field (MRF) model to combine the global mapping and local searching processes, which enhances the robustness to misregistrations by considering spatial correlations. Finally, an iterative framework is employed to backpropagate the matching and changing results to refine the global mapping and local searching processes, which further eliminates the indirect influence of changes and misregistration on the image transformation and change metrics. Extensive experiments on five datasets have demonstrated the effectiveness of the proposed IGmLs. The codes will be released at&#xa0;<a href="https://github.com/yulisun/IGmLs">https://github.com/yulisun/IGmLs</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Iterative Global Mapping-Local Searching for Heterogeneous Change Detection with Unregistered Images

  • Yuli Sun,
  • Junzheng Wu,
  • Han Zhang,
  • Zhang Li,
  • Lin Lei,
  • Gangyao Kuang

摘要

Heterogeneous change detection (HeCD) is a highly valuable yet challenging task in remote sensing. However, existing HeCD methods primarily focus on well-registered images, without considering unregistered heterogeneous image pairs, which are more common in real-world applications. In this paper, we first analyze why unregistered images significantly complicate the HeCD problem: they not only cause boundary errors in change detection but also undermine the image transformation process required for making heterogeneous images comparable. These effects are further amplified by the intrinsic complexity of HeCD. In light of this, we propose an unsupervised iterative global mapping-local searching method (IGmLs) for HeCD subject to registration errors. Specifically, IGmLs utilizes the global mapping to transform images into a common structural space to enable the comparison of heterogeneous images, and uses the local searching to reduce the direct influence of registration errors on change metrics, which is based on the analysis that misregistration would cause an unwanted increment on the change metric in unchanged region. Then, IGmLs builds a Markov random field (MRF) model to combine the global mapping and local searching processes, which enhances the robustness to misregistrations by considering spatial correlations. Finally, an iterative framework is employed to backpropagate the matching and changing results to refine the global mapping and local searching processes, which further eliminates the indirect influence of changes and misregistration on the image transformation and change metrics. Extensive experiments on five datasets have demonstrated the effectiveness of the proposed IGmLs. The codes will be released at https://github.com/yulisun/IGmLs.