929
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Feature enhancement network for cloud removal in optical images by fusing with SAR images

ORCID Icon, ORCID Icon &
Pages 51-67 | Received 28 Mar 2023, Accepted 14 Nov 2023, Published online: 27 Dec 2023

References

  • Addink, E. A., and A. Stein. 1999. “A Comparison of Conventional and Geostatistical Methods to Replace Clouded Pixels in NOAA-AVHRR Images.” International Journal of Remote Sensing 20 (5): 961–977. https://doi.org/10.1080/014311699213028.
  • Angel, Y., R. Houborg, and M. F. McCabe. 2019. “Reconstructing Cloud Contaminated Pixels Using Spatiotemporal Covariance Functions and Multitemporal Hyper- Spectral Imagery.” Remote Sensing 11 (10): 1145. https://doi.org/10.3390/rs11101145.
  • Bocharov, D. A., D. P. Nikolaev, M. A. Pavlova, and V. A. Timofeev. 2022. “Cloud Shadows Detection and Compensation Algorithm on Multispectral Satellite Images for Agricultural Regions.” Journal of Communications Technology and Electronics 67 (6): 728–739. https://doi.org/10.1134/S1064226922060171.
  • Bridle, J. 1989. “Training Stochastic Model Recognition Algorithms as Networks Can Lead to Maximum Mutual Information Estimation of Parameters.” Advances in Neural Information Processing Systems 2: 211–217.
  • Cheng, Q., H. F. Shen, L. P. Zhang, Q. Q. Yuan, and C. Zeng. 2014. “Cloud Removal for Remotely Sensed Images by Similar Pixel Replacement Guided with a Spatio-Temporal MRF Model.” Isprs Journal of Photogrammetry & Remote Sensing 92:54–68. GotoISI://WOS:000337865800005. https://doi.org/10.1016/j.isprsjprs.2014.02.015.
  • Chen, S. J., W. J. Zhang, Z. Li, Y. X. Wang, and B. Zhang. 2022. “Cloud Removal with SAR-Optical Data Fusion and Graph-Based Feature Aggregation Network.” Remote Sensing 14:14. Chen, Shanjing Zhang, Wenjuan Li, Zhen Wang, Yuxi Zhang, Bing 2072-4292, GotoISI://WOS:000831948400001 https://mdpi-res.com/d_attachment/remotesensing/remotesensing-14-03374/article_deploy/remotesensing-14-03374-v2.pdf?version=1657795338. https://doi.org/10.3390/rs14143374.
  • Darbaghshahi, F. N., M. R. Mohammadi, and M. Soryani. 2022. “Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-To-Optical Image Translation.” IEEE Transactions on Geoscience & Remote Sensing 60:1–9. Darbaghshahi, Faramarz Naderi Mohammadi, Mohammad Reza Soryani, Mohsen; Soryani, Mohsen/T-1403- 2018 Naderi Darbaghshahi, Faramarz/0000-0002-5478-3341; Soryani, Mohsen/0000-0002- 8555-9617 1558-0644, https://ieeexplore.ieee.org/stampPDF/getPDF.jsp?tp=&arnumber=9627647&ref=.
  • Duan, C., J. Pan, and L. Rui. 2020. “Thick Cloud Removal of Remote Sensing Images Using Temporal Smoothness and Sparsity Regularized Tensor Optimization.” Remote Sensing 12 (20): 3446. https://doi.org/10.3390/rs12203446.
  • Ebel, P., M. Schmitt, X. X. Zhu, and Ieee. 2020. “Cloud Removal in Un Paired Sentinel-2 Imagery Using Cycle-Consistent Gan and Saroptical Data Fusion.” In IEEE International Geoscience and Remote Sensing Symposium (IGARSS), IEEE International Symposium on Geoscience and Remote Sensing IGARSS, 2065–2068. Ebel, Patrick Schmitt, Michael Zhu, Xiao Xiang 2153-6996, GotoISI://WOS:000664335302029 https://ieeexplore.ieee.org/stampPDF/getPDF.jsp?tp=&arnumber=9324060&ref=.
  • Ebel, P., X. Yajin, M. Schmitt, and X. Zhu. 2022. “SEN12MS-CR-TS: A Remote Sensing Data Set for Multi-modal Multi-temporal Cloud Removal.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. arXiv preprint arXiv:2201.09613. https://doi.org/10.1109/TGRS.2022.3146246.
  • Gladkova, I., M. D. Grossberg, F. Shahriar, G. Bonev, and P. Romanov. 2012. “Quantitative Restoration for MODIS Band 6 on Aqua.” IEEE Transactions on Geoscience & Remote Sensing 50 (6): 2409–2416. GotoISI://WOS:000304246500025. https://doi.org/10.1109/TGRS.2011.2173499.
  • Guo, Y., W. Chen, X. Feng, Y. Zhang, L. Yingchao, C. Huang, and L. Yuan. 2021. “Temporal Unmixing-Based Cloud Removal Algorithm for Optically Complex Water Images.” International Journal of Remote Sensing 42 (12): 4415–4440. https://doi.org/10.1080/01431161.2021.1892853.
  • Han, S., J. Wang, and S. Zhang. 2023. “Former-CR: A Transformer-Based Thick Cloud Removal Method with Optical and SAR Imagery.” Remote Sensing 15 (5): 1196. https://doi.org/10.3390/rs15051196.
  • Hu, G., L. Xiaoyi, and D. Liang. 2015. “Thin Cloud Removal from Remote Sensing Images Using Multidirectional Dual Tree Complex Wavelet Transform and Transfer Least Square Support Vector Regression.” Journal of Applied Remote Sensing 9 (1): 095053. https://doi.org/10.1117/1.JRS.9.095053.
  • King, M. D., W. P. M. Steven Platnick, S. A. Ackerman, and P. A. Hubanks. 2013. “Spatial and Temporal Distribution of Clouds Observed by MODIS Onboard the Terra and Aqua Satellites.” IEEE Transactions on Geoscience and Remote Sensing 51 (7): 3826–3852. https://doi.org/10.1109/TGRS.2012.2227333.
  • Li, X. H., H. F. Shen, C. Zeng, and P. H. Wu. 2012. “Restoring Aqua Modis Band 6 by Other Spectral Bands Using Compressed Sensing Theory.” In 4th Workshop on Hyperspectral Image and Signal Processing - Evolution in Remote Sensing (WHISPERS), Workshop on Hyperspectral Image and Signal Processing. GotoISI://WOS:000345747000049.
  • Li, R., S. Zheng, C. Zhang, C. Duan, S. Jianlin, L. Wang, and P. M. Atkinson. 2021. “Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 60:1–13. https://doi.org/10.1109/TGRS.2021.3093977.
  • Li, R., S. Zheng, C. Zhang, C. Duan, L. Wang, and P. M. Atkinson. 2021. “ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remotely Sensed Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 181:84–98. https://doi.org/10.1016/j.isprsjprs.2021.09.005.
  • Meraner, A., P. Ebel, X. Xiang Zhu, and M. Schmitt. 2020. “Cloud Removal in Sentinel-2 Imagery Using a Deep Residual Neural Network and SAR-Optical Data Fusion.” ISPRS Journal of Photogrammetry and Remote Sensing 166:333–346. https://doi.org/10.1016/j.isprsjprs.2020.05.013.
  • Rocha, J., and J. A. Tenedorio. 2001. “Integrating Demographic GIS and Multisensor Remote Sensing Data in Urban Land Use/Cover Maps Assembly.” In IEEE/ISPRS Joint Work- shop on Remote Sensing and Data Fusion over Urban Areas, 46–51. GotoISI://WOS: 000175227500011.
  • Rossi, R. E., J. L. Dungan, and L. R. Beck. 1994. “Kriging in the Shadows - Geo- Statistical Interpolation for Remote-Sensing.” Remote Sensing of Environment 49 (1): 32–40. GotoISI://WOS:A1994NZ54500004. https://doi.org/10.1016/0034-4257(94)90057-4.
  • Scaramuzza, P., and J. Barsi. 2005. “Landsat 7 scan line corrector-off gap-filled product development.” Proceeding of Pecora 16:23–27.
  • Shen, P., and C. Wang. 2023. “HoMenl: A Homogeneity Measure-Based Non- Local Filtering Framework for Detail-Enhanced (Pol)(in) SAR Image Denoising.” ISPRS Journal of Photogrammetry and Remote Sensing 197:212–227. https://doi.org/10.1016/j.isprsjprs.2023.01.026.
  • Van der Meer, F. 2012. “Remote-Sensing Image Analysis and Geostatistics.” International Journal of Remote Sensing 33 (18): 5644–5676. GotoISI://WOS:000303585600002. https://doi.org/10.1080/01431161.2012.666363.
  • Wang, Z., A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. 2004. “Image Quality Assessment: From Error Visibility to Structural Similarity.” IEEE Transactions on Image Processing 13 (4): 600–612. https://doi.org/10.1109/TIP.2003.819861.
  • Wen, X., Z. Pan, H. Yuxin, and J. Liu. 2022. “An Effective Network Integrating Residual Learning and Channel Attention Mechanism for Thin Cloud Removal.” IEEE Geo- Science and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3161062.
  • Xu, F., Y. Shi, P. Ebel, Y. Lei, G.-S. Xia, W. Yang, and X. Xiang Zhu. 2022. “GLF-CR: SAR-Enhanced Cloud Removal with Global–Local Fusion.” ISPRS Journal of Photogrammetry and Remote Sensing 192:268–278. https://doi.org/10.1016/j.isprsjprs.2022.08.002.
  • Yan, X., Z. Shi, L. Pei, and Y. Zhang. 2023. “IDCF: information distribution composite feature for multi-modal image registration.” International Journal of Remote Sensing 44 (6): 1939–1975. https://doi.org/10.1080/01431161.2023.2193300.
  • Yin, G., G. Mariethoz, and M. F. McCabe. 2016. “Gap-Filling of Landsat 7 Imagery Using the Direct Sampling Method.” Remote Sensing 9 (1): 12. https://doi.org/10.3390/rs9010012.
  • Zhang, X., C. Leng, Y. Hong, Z. Pei, I. Cheng, and A. Basu. 2021. “Multimodal Remote Sensing Image Registration Methods and Advancements: A Survey.” Remote Sensing 13 (24): 5128. https://doi.org/10.3390/rs13245128.
  • Zhang, X., Z. Qiu, C. Peng, and Y. Peng. 2022. “Removing Cloud Cover Interference from Sentinel-2 Imagery in Google Earth Engine by Fusing Sentinel-1 SAR Data with a CNN Model.” International Journal of Remote Sensing 43 (1): 132–147. https://doi.org/10.1080/01431161.2021.2012295.
  • Zhang, Q., Q. Yuan, L. Jie, L. Zhiwei, H. Shen, and L. Zhang. 2020. “Thick Cloud and Cloud Shadow Removal in Multitemporal Imagery Using Progressively Spatio-Temporal Patch Group Deep Learning.” ISPRS Journal of Photogrammetry and Remote Sensing 162:148–160. https://doi.org/10.1016/j.isprsjprs.2020.02.008.
  • Zhang, W., and Y. Zhao. 2023. “An Improved SIFT Algorithm for Registration Between SAR and Optical Images.” Scientific Reports 13 (1): 6346. https://doi.org/10.1038/s41598-023-33532-1.