Improved Aggregated Contextual Transformations Based on U-Net for Image Inpainting
摘要
Using Generative Adversarial Networks (GANs) techniques, significant breakthroughs have been achieved in current cutting-edge image restoration schemes for arbitrary missing regions. However, the quandary about generating unrealistic structures and hazy texture effects in high-resolution images still exists due to the lack of reasoning about the remote contextual information of the image and the loss of image details due to the convolution operation. To address the above problem, a GAN based on U-Net using improved aggregated context transformation (UAT-GAN) is proposed. An encoder-decoder in the form of U-Net was designed to build the middle layer of the generator of UAT-GAN with AOT-Plus blocks. This network improves the quality of image completion and makes the results more realistic and natural. Evaluating the model on the datasets CelebHQ, Places2, and QMUL-OpenLogo, quantitative and qualitative results demonstrate that our model can compete with advanced models in the vast majority of aspects.