<p>In this paper, a Gabor detail feature–enhanced super-resolution network is constructed concerning the biological vision mechanism to address the problem on loss of texture detail information and contextual information in the process of medical image super-resolution. The network infrastructure is a generative adversarial network consisting of a dense residual network generator and a dual-path U-Net discriminator. The Gabor Detail feature extract Module (GDfeM) is designed to address the problem of texture detail information loss by simulating the working mechanism of simple cells. Then, for the problem of insufficient texture detail generation ability of the generator, one of the convolutional blocks of the dense residual network is replaced by GDfeM; for the problem of insufficient texture detail feature extraction ability of the discriminator, aligning the structure of the main pathway U-Net, several GDfeMs and ordinary convolutional kernels are connected to build a detail feature extraction pathway in series, This pathway is connected in parallel with the main pathway through skip connections to form a dual-pathway discriminator. Meanwhile, to address the problem of missing contextual information in the process of super-resolution reconstruction of medical images, a context loss function is introduced to make the network focus on the contextual structural information of the image to reduce distortion and artifacts. Experiments show that our method has <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(PSNR\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="italic">PSNR</mi> </mrow> </math></EquationSource> </InlineEquation> values of 36.562&#xa0;dB and 35.560&#xa0;dB, <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(SSIM\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="italic">SSIM</mi> </mrow> </math></EquationSource> </InlineEquation> values of 0.921 and 0.903, and PI values of 3.820 and 2.552 for the 4× super-resolution task on the ChestX-ray8 dataset and the Kaggle Comprehensive CT Scanning Imaging dataset, respectively, and that the <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(PSNR\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="italic">PSNR</mi> </mrow> </math></EquationSource> </InlineEquation> and <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(SSIM\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="italic">SSIM</mi> </mrow> </math></EquationSource> </InlineEquation> values are not the best when compared to other methods, but the obtained PI values are the lowest among all the methods, which shows that our method plays an important role in helping to obtain high-resolution images with more complete, realistic and accurate texture details.</p> Graphical abstract <p></p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Super-resolution reconstruction of lung medical images integrating biological vision mechanisms

  • Tao Fang,
  • Linling Fang,
  • Hao Pan

摘要

In this paper, a Gabor detail feature–enhanced super-resolution network is constructed concerning the biological vision mechanism to address the problem on loss of texture detail information and contextual information in the process of medical image super-resolution. The network infrastructure is a generative adversarial network consisting of a dense residual network generator and a dual-path U-Net discriminator. The Gabor Detail feature extract Module (GDfeM) is designed to address the problem of texture detail information loss by simulating the working mechanism of simple cells. Then, for the problem of insufficient texture detail generation ability of the generator, one of the convolutional blocks of the dense residual network is replaced by GDfeM; for the problem of insufficient texture detail feature extraction ability of the discriminator, aligning the structure of the main pathway U-Net, several GDfeMs and ordinary convolutional kernels are connected to build a detail feature extraction pathway in series, This pathway is connected in parallel with the main pathway through skip connections to form a dual-pathway discriminator. Meanwhile, to address the problem of missing contextual information in the process of super-resolution reconstruction of medical images, a context loss function is introduced to make the network focus on the contextual structural information of the image to reduce distortion and artifacts. Experiments show that our method has \(PSNR\) PSNR values of 36.562 dB and 35.560 dB, \(SSIM\) SSIM values of 0.921 and 0.903, and PI values of 3.820 and 2.552 for the 4× super-resolution task on the ChestX-ray8 dataset and the Kaggle Comprehensive CT Scanning Imaging dataset, respectively, and that the \(PSNR\) PSNR and \(SSIM\) SSIM values are not the best when compared to other methods, but the obtained PI values are the lowest among all the methods, which shows that our method plays an important role in helping to obtain high-resolution images with more complete, realistic and accurate texture details.

Graphical abstract