CSLD3D: A lightweight distributed video compressed sensing network based on lightweight deformable 3D convolution
摘要
In distributed video compressed sensing tasks, the intrinsic inter-frame and intra-frame correlations, along with sparsity within video sequences, are often underutilized. While deformable 3D convolutions effectively capture spatiotemporal information for video restoration, their large parameter size leads to high computational complexity, posing significant challenges for training and deployment. Focusing on these issues, we proposed a lightweight Deformable 3D Convolution applied to distributed video compressed sensing network (CSLD3D), which optimizes the model structure by constructing two branching networks for key and non-key frames in the initial reconstruction stage of each frame, while the deep reconstruction stage utilizes lightweight 3D deformable convolution to achieve further reconstruction. Extensive experiments on six standard CIF video sequences confirm that the proposed method consistently surpasses state-of-the-art approaches. Specifically, at a non-key-frame measurement rate of 0.1, CSLD3D attains an average PSNR of 37.45 dB and SSIM of 0.9476, representing a 0.90 dB improvement in PSNR over the recent WRDD method while reducing the parameter count by approximately 60%. These results demonstrate that CSLD3D achieves superior reconstruction quality with substantially lower model complexity. Code and results will be available at: https://github.com/FreshChance/LightweightDVCSNet.