As one of the representative works, RAFT-Stereo designs an iterative strategy based on GRU and realizes the state-of-the-art (SOTA) performance. However, this iterative strategy is difficult to effectively distinguish between long-time state features and short-time state features, which leads to the coupling problem. To solve the feature coupling problem in the iterative process, we design the Mogrifier LSTM module for iterative disparity updating based on RAFT-Stereo. Specifically, we design the Mogrifier LSTM to contain the standard LSTM framework, as well as an interaction header for long and short time state sequences. We used this design for the replacement of RAFT-Stereo, and designed a refine network for the output of RAFT-Stereo to correct the disparity results.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Mogrifier LSTM Network for Iterative Stereo Matching

  • Yabo Wu,
  • Wenting Li,
  • Yujie Lu,
  • Hui Wen,
  • Siyu Xie,
  • Bufan Wang,
  • Ziyang Chen,
  • Yongjun Zhang

摘要

As one of the representative works, RAFT-Stereo designs an iterative strategy based on GRU and realizes the state-of-the-art (SOTA) performance. However, this iterative strategy is difficult to effectively distinguish between long-time state features and short-time state features, which leads to the coupling problem. To solve the feature coupling problem in the iterative process, we design the Mogrifier LSTM module for iterative disparity updating based on RAFT-Stereo. Specifically, we design the Mogrifier LSTM to contain the standard LSTM framework, as well as an interaction header for long and short time state sequences. We used this design for the replacement of RAFT-Stereo, and designed a refine network for the output of RAFT-Stereo to correct the disparity results.