Recently, several newest Depth Map Super-Resolution (DMSR) methods have incorporated depth edge prediction as auxiliary guidance into the optimization model, creating a dual-task driven unfolding network for enhancing depth edge refinement. Nevertheless, these approaches either overlook explicit dual-edge consistency constraint or merely fuse color edges with depth edges once. This oversight results in diminished generalization ability and subpar performance. To this end, we transform the DMSR problem as a triple-task optimization model explicitly constrained by dual-edge consistency. According to the Alternating Direction Method of Multipliers (ADMM) theory, the proposed model can be cast as iterative sub-optimizations for color-edge update, depth-edge update, depth map update, and augmented Lagrange multiplier update. These sub-optimizations can be further unfolded into an interpretable ADMM network. Within this network, we integrate learnable modules into the initial pure formula expansion, enabling high-throughput information transmission and thereby enhancing the network’s representational power. A large number of experiments have demonstrated that the proposed method achieves better reconstruction results as compared with several DMSR methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Dual-Edge Consistency Constrained Unfolding Network for Depth Map Super-Resolution

  • Hao Ren,
  • Lijun Zhao,
  • Jinjing Zhang,
  • Huihui Bai,
  • Anhong Wang

摘要

Recently, several newest Depth Map Super-Resolution (DMSR) methods have incorporated depth edge prediction as auxiliary guidance into the optimization model, creating a dual-task driven unfolding network for enhancing depth edge refinement. Nevertheless, these approaches either overlook explicit dual-edge consistency constraint or merely fuse color edges with depth edges once. This oversight results in diminished generalization ability and subpar performance. To this end, we transform the DMSR problem as a triple-task optimization model explicitly constrained by dual-edge consistency. According to the Alternating Direction Method of Multipliers (ADMM) theory, the proposed model can be cast as iterative sub-optimizations for color-edge update, depth-edge update, depth map update, and augmented Lagrange multiplier update. These sub-optimizations can be further unfolded into an interpretable ADMM network. Within this network, we integrate learnable modules into the initial pure formula expansion, enabling high-throughput information transmission and thereby enhancing the network’s representational power. A large number of experiments have demonstrated that the proposed method achieves better reconstruction results as compared with several DMSR methods.