Algorithm development of cloud removal from solar images based on pix2pix network

Document Type

Article

Publication Date

1-1-2022

Abstract

Sky clouds affect solar observations significantly. Their shadows obscure the details of solar features in observed images. Cloud-covered solar images are difficult to be used for further research without pre-processing. In this paper, the solar image cloud removing problem is converted to an image-to-image translation problem, with a used algorithm of the Pixel to Pixel Network (Pix2Pix), which generates a cloudless solar image without relying on the physical scattering model. Pix2Pix is consists of a generator and a discriminator. The generator is a well-designed U-Net. The discriminator uses PatchGAN structure to improve the details of the generated solar image, which guides the generator to create a pseudo realistic solar image. The image generation model and the training process are optimized, and the generator is jointly trained with the discriminator. So the generation model which can stably generate cloudless solar image is obtained. Extensive experiment results onHuairou Solar Observing Station, National Astronomical Observatories, and Chinese Academy of Sciences (HSOS, NAOC and CAS) datasets show that Pix2Pix is superior to the traditional methods based on physical prior knowledge in peak signal-to-noise ratio, structural similarity, perceptual index, and subjective visual effect. The result of the PSNR, SSIM and PI are 27.2121 dB, 0.8601 and 3.3341.

Identifier

85120801245 (Scopus)

Publication Title

Computers Materials and Continua

External Full Text Location

https://doi.org/10.32604/cmc.2022.022325

e-ISSN

15462226

ISSN

15462218

First Page

3497

Last Page

3512

Issue

2

Volume

71

Grant

KLSA202114

Fund Ref

Chinese Academy of Sciences

This document is currently not available here.

Share

COinS