A Novel Dense-Attention Network for Thick Cloud Removal by Reconstructing Semantic Information

• Published in: IEEE journal of selected topics in applied earth observations and remote sensing Vol. 16; pp. 1 - 13
• Main Authors: Chen, Yuyun, Cai, Zhanchuan, Yuan, Jieyu, Wu, Lianghai
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01-01-2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: CLM; Clouds; Contamination; contextual attention module; DANet; Deep learning; dense block; Design; Earth; Image reconstruction; Image restoration; Image segmentation; Remote sensing; Removal; Restoration; Semantics; thick cloud removal; Training
• ISSN: 1939-1404; 2151-1535
• DOI: 10.1109/JSTARS.2023.3236384

The presence of thick clouds in single optical images shows the contamination of interesting objects. Besides, the difficulty of thick cloud removal is mainly the restoration of the weak boundary information from cloud-contaminated areas. Recently, many deep-learning-based frameworks were applied for cloud removal by obtain the related semantic information from the weak boundary information. However, the large-size cloud-contaminated areas lead to the artificial textures in the resulting images. Thus, obtaining the optimal semantic information from finite boundary information is the key to solve this problem. In this work, we design a deep-learning framework for cloud removal, especially large-size clouds removal (i.e., more than 30% coverage of the whole image). First, we design a cloud location model (CLM) which adopted the fully convolutional network to locate the cloud. Second, desired by theory of the coarse-to-fine restoration, we build a dense-attention network (termed as DANet) for restoring cloud contaminated areas. In the DANet, we design a dense block into the coarse network for training the features of restoring directions of each pixel from the weak boundary information. Furthermore, a contextual attention module is built into refinement network for restoring contaminated areas relying on the semantic relationship between the background and foreground information. Compared with the state-of-the-art methods, the proposed DANet achieved greater removal performances and reconstruct more natural image textures.