Improving bi-directional recurrent network for video super-resolution with deformable motion alignment structure
摘要
Video super-resolution, which has been widely applied in ultra-high definition display, video surveillance, and robot surgery, is the recovery of high-resolution image frame sequences with distinct details and temporal continuity from low-resolution video. Thanks to advancements in deep learning, deep video super-resolution has achieved promising results. However, frame artifacts and shakiness remain key challenges that need to be addressed for further improvements in video super-resolution. In particular, it is still worthwhile to research how to properly extract the spatiotemporal features from successive video frames and efficiently fuse them in order to achieve video super-resolution with rich intra-frame details and consistent inter-frame variations. In light of this, we propose to improve bi-directional recurrent network for video super-resolution with deformable motion alignment structure in this work to precisely estimate the offsets and provide sharper image frames. Experiments demonstrate that the proposed approach outperforms current state-of-the-art methods by 0.51%. The project code is available at https://github.com/hengliusky/IBRN_VSR.