Solar Image Cloud Removal based on Improved Pix2Pix Network
Document Type
Article
Publication Date
1-1-2022
Abstract
In ground-based observations of the Sun, solar images are often affected by appearance of thin clouds, which contaminate the images and affect the scientific results from data analysis. In this paper, the improved Pixel to Pixel Network (Pix2Pix) network is used to convert polluted images to clear images to remove the cloud shadow in the solar images. By adding attention module to the model, the hidden layer of Pix2Pix model can infer the attention map of the input feature vector according to the input feature vector. And then, the attention map is multiplied by the input feature map to give different weights to the hidden features in the feature map, adaptively refine the input feature map to make the model pay attention to important feature information and achieve better recovery effect. In order to further enhance the model’s ability to recover detailed features, perceptual loss is added to the loss function. The model was tested on the full disk H-alpha images datasets provided by Huairou Solar Observing Station, National Astronomical Observatories. The experimental results show that the model can effectively remove the influence of thin clouds on the picture and restore the details of solar activity. The peak signal-to-noise ratio (PSNR) reaches 27.3012 and the learned perceptual image patch similarity (LPIPS) reaches 0.330, which is superior to the existed dehaze algorithms.
Identifier
85135003929 (Scopus)
Publication Title
Computers Materials and Continua
External Full Text Location
https://doi.org/10.32604/cmc.2022.027215
e-ISSN
15462226
ISSN
15462218
First Page
6181
Last Page
6193
Issue
3
Volume
73
Grant
KLSA202114
Fund Ref
Chinese Academy of Sciences
Recommended Citation
Zhang, Xukun; Song, Wei; Lin, Ganghua; and Shi, Yuxi, "Solar Image Cloud Removal based on Improved Pix2Pix Network" (2022). Faculty Publications. 3496.
https://digitalcommons.njit.edu/fac_pubs/3496