The realm of video content has witnessed exponential growth, and alongside it emerges the challenge of enhancing video quality efficiently. Traditional techniques, although valuable, often fall short of addressing the intricate details and temporal consistencies required for high-quality video upscaling. Moreover, real-time processing demands methods ensuring accuracy and swift computational speeds. Addressing these challenges, this paper introduces the STA-DCNN. This innovative architecture is rooted in combining spatial and temporal attention mechanisms to produce superior video super-resolution. The Spatio-Temporal Attention Module (STAM) acts as a cornerstone, singling out essential features across frames, while the Deep Convolutional Backbone (DCB) intensifies these frames, capitalizing on attention-informed features. Furthermore, the Temporal Memory Unit (TMU) preserves crucial aspects from preceding frames, guaranteeing a seamless video rendition. Empirical tests confirm that STA-DCNN notably surpasses its counterparts, offering an ideal balance of quality and real-time processing.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Real-Time Video Enhancement with Spatio-Temporal Attention via Deep Convolutional Neural Networks

  • Anto Bennet Maria,
  • Swaminathan Balasubramanian,
  • Rajmohan Vijayan,
  • Vijaya Krishna Sonthi,
  • Jayapratha Ramakrishnan,
  • Umamaheswari Manogaran,
  • Sudhakar Sengan

摘要

The realm of video content has witnessed exponential growth, and alongside it emerges the challenge of enhancing video quality efficiently. Traditional techniques, although valuable, often fall short of addressing the intricate details and temporal consistencies required for high-quality video upscaling. Moreover, real-time processing demands methods ensuring accuracy and swift computational speeds. Addressing these challenges, this paper introduces the STA-DCNN. This innovative architecture is rooted in combining spatial and temporal attention mechanisms to produce superior video super-resolution. The Spatio-Temporal Attention Module (STAM) acts as a cornerstone, singling out essential features across frames, while the Deep Convolutional Backbone (DCB) intensifies these frames, capitalizing on attention-informed features. Furthermore, the Temporal Memory Unit (TMU) preserves crucial aspects from preceding frames, guaranteeing a seamless video rendition. Empirical tests confirm that STA-DCNN notably surpasses its counterparts, offering an ideal balance of quality and real-time processing.