RGMEF: a lightweight multi-exposure image fusion network based on retinex and gradient guidance
摘要
The goal of the multi-exposure image fusion (MEF) is to create a high dynamic range (HDR) image with balanced exposures and more details by extracting and enhancing valid information from multiple low dynamic range images with varied exposures. In recent years, deep learning has provided many solutions for MEF, and they have achieved remarkable effects. However, because of the high network complexity, these approaches often have low efficiency and limit the potential improvement of the effect. In order to fuse valuable information from different images, we introduce a lightweight but robust MEF network, which focus on the image internal characteristics rather than long-distance information. In this study, we first design a decomposed network inspired by retinex theory to extract the illumination map from an image and obtain the gradient map through Sobel operator. Subsequently, we introduce two lightweight feature extraction modules to extract image features with the guidance of illumination and gradient maps respectively, and then fuse these features to produce an HDR result through three fusion blocks. Furthermore, we design a loss function to obtain a more suitable brightness range for the current scene. Numerous comparative experiments demonstrate the superiority of our method in terms of image texture, pixel intensity, and color retention. Moreover, some ablation studies indicate that our approach has a significant adaptability to source images.