A curvature-driven cloud removal method for remote sensing images

References

• Atkinson, P. M., P. J. Curran, and R. Webster. 1990. “Sampling Remotely Sensed Imagery for Storage, Retrieval, and Reconstruction.” The Professional Geographer 42 (3): 345–353. doi:10.1111/j.0033-0124.1990.00345.x.
   Web of Science ®Google Scholar
• Cheng, Q., H. Shen, L. Zhang, Q. Yuan, and Z. Chao. 2014. “Cloud Removal for Remotely Sensed Images by Similar Pixel Replacement Guided with a Spatio-Temporal MRF Model.” Isprs Journal of Photogrammetry & Remote Sensing 92 (jun.): 54–68. doi:10.1016/j.isprsjprs.2014.02.015.
   Google Scholar
• Criminisi, A., P. Perez, and K. Toyama. 2004. “Region Filling and Object Removal by Exemplar-Based Image Inpainting.” IEEE Transactions on Image Processing 13 (9): 1200–1212. doi:10.1109/TIP.2004.833105.
   PubMed Web of Science ®Google Scholar
• Dong, Z., M. Wang, D. Li, Y. Wang, and Z. Zhang. 2019. “Cloud Detection Method for High Resolution Remote Sensing Imagery Based on the Spectrum and Texture of Superpixels.” Photogrammetric Engineering & Remote Sensing 85 (4): 257–268. doi:10.14358/PERS.85.4.257.
   Web of Science ®Google Scholar
• Ebel, P., Y. Xu, M. Schmitt, and X. X. Zhu. 2022. “Sen12MS-CR-TS: A Remote-Sensing Data Set for Multimodal Multitemporal Cloud Removal.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–14. doi:10.1109/TGRS.2022.3146246.
   Web of Science ®Google Scholar
• Fang, Z., X. Yu, J. Pan, N. Fan, H. Wang, and J. Qi. 2021. “A Fast Image Mosaicking Method Based on Iteratively Minimizing Cloud Coverage Areas.” IEEE Geoscience and Remote Sensing Letters 18 (8): 1371–1375. doi:10.1109/LGRS.2020.2998920.
   Web of Science ®Google Scholar
• Feng, C., J. W. Ma, Q. Dai, and X. Chen. 2004. ”An Improved Method for Cloud Removal in ASTER Data Change Detection.” IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium, Anchorage, AK, USA, pp. 3387–3389 vol.5. doi: 10.1109/IGARSS.2004.1370431.
   Google Scholar
• Gladkova, I., M. D. Grossberg, F. Shahriar, G. Bonev, and P. Romanov. 2012. “Quantitative Restoration for MODIS Band 6 on Aqua.” IEEE Transactions on Geoscience and Remote Sensing 50 (6): 2409–2416. doi:10.1109/TGRS.2011.2173499.
   Web of Science ®Google Scholar
• Gong, Y. H., and O. Goksel. 2019. “Weighted Mean Curvature.” Signal Processing 164: 329–339. doi:10.1016/j.sigpro.2019.06.020.
   Web of Science ®Google Scholar
• Gong, Y. H., and I. F. Sbalzarini. 2017. “Curvature Filters Efficiently Reduce Certain Variational Energies.” IEEE Transactions on Image Processing 26 (4): 1786–1798. doi:10.1109/tip.2017.2658954.
   PubMed Web of Science ®Google Scholar
• Guillemot, C., and O. Le Meur. 2014. “Image Inpainting: Overview and Recent Advances.” Signal Processing Magazine 31 (1): 127–144. doi:10.1109/MSP.2013.2273004.
   Google Scholar
• Helmer, E. H., and B. Ruefenacht. 2005. “Cloud-Free Satellite Image Mosaics with Regression Trees and Histogram Matching.” Photogrammetric Engineering & Remote Sensing 71 (9): 1079–1089. doi:10.14358/PERS.71.9.1079.
   Web of Science ®Google Scholar
• Hu, C., L. Huo, Z. Zhang, and P. Tang. 2019. ”Automatic Cloud Removal from Multi-Temporal Landsat Collection 1 Data Using Poisson Blending.” IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan, pp. 1661–1664. doi: 10.1109/IGARSS.2019.8899849.
   Google Scholar
• Jia, J. Y., J. Sun, C. K. Tang, and H. Y. Shum. 2006. “Drag-And-Drop Pasting.” ACM Transactions on Graphics 25 (3): 631–636. doi:10.1145/1141911.1141934.
   Web of Science ®Google Scholar
• Ju, J., and D. P. Roy. 2008. “The Availability of Cloud-Free Landsat ETM+ Data Over the Conterminous United States and Globally.” Remote Sensing of Environment 112 (3): 1196–1211.
   Web of Science ®Google Scholar
• Kang, Y., L. Pan, Q. Chen, T. Zhang, S. Zhang, and Z. Liu. 2016. “Automatic Mosaicking of Satellite Imagery Considering the Clouds.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences III-3: 415–421. doi:10.5194/isprs-annals-III-3-415-2016.
   Google Scholar
• King, M. D., S. Platnick, W. P. Menzel, S. A. Ackerman, and P. A. Hubanks. 2013. “Spatial and Temporal Distribution of Clouds Observed by MODIS Onboard the Terra and Aqua Satellites.” IEEE Transactions on Geoscience & Remote Sensing 51 (7): 3826–3852. doi:10.1109/TGRS.2012.2227333.
   Web of Science ®Google Scholar
• Kulkarni, S. C., and P. P. Rege. 2020. “Pixel Level Fusion Techniques for SAR and Optical Images: A Review - ScienceDirect.” Information Fusion 59: 13–29. doi:10.1016/j.inffus.2020.01.003.
   Web of Science ®Google Scholar
• Lai, K. -H., and C. -H. Lin. 2012. ”An Optimal Boundary Determination Approach for Cloud Removal in Satellite Image.” 2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany, pp. 2241–2244. doi: 10.1109/IGARSS.2012.6351053.
   Google Scholar
• Li, M., S. C. Liew, and L. K. Kwoh. 2003. ”Producing Cloud Free and Cloud-Shadow Free Mosaic from Cloudy IKONOS Images.” IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477), Toulouse, France, pp. 3946–3948 vol. 6. doi: 10.1109/IGARSS.2003.1295323.
   Google Scholar
• Lin, C. H., P. H. Tsai, K. H. Lai, and J. Y. Chen. 2013. “Cloud Removal from Multitemporal Satellite Images Using Information Cloning.” IEEE Transactions on Geoscience & Remote Sensing 51 (1): 232–241. doi:10.1109/TGRS.2012.2197682.
   Web of Science ®Google Scholar
• Li, D., J. Shan, Z. Shao, X. Zhou, and Y. Yao. 2013. “Geomatics for Smart Cities - Concept, Key Techniques, and Applications.” Geo-Spatial Information Science 16 (1): 13–24. doi:10.1080/10095020.2013.772803.
   Google Scholar
• Li, X., H. Shen, L. Zhang, H. Zhang, and Q. Yuan. 2014. “Dead Pixel Completion of Aqua MODIS Band 6 Using a Robust M-Estimator Multiregression.” IEEE Geoscience and Remote Sensing Letters 11 (4): 768–772. doi:10.1109/LGRS.2013.2278626.
   Web of Science ®Google Scholar
• Liu, X. G., H. J. Bao, and Q. S. Peng. 2006. “Digital Differential Geometry Processing.” Journal of Computer Science and Technology 21 (5): 847–860. doi:10.1007/s11390-006-0847-5.
   Web of Science ®Google Scholar
• Li, D., M. Wang, and J. Jiang. 2021. “China’s High-Resolution Optical Remote Sensing Satellites and Their Mapping Applications.” Geo-Spatial Information Science 24 (1): 85–94. doi:10.1080/10095020.2020.1838957.
   Web of Science ®Google Scholar
• Li, J., Z. Wu, Z. Hu, J. Zhang, M. Molinier, L. Mo, and M. Molinier. 2020. “Thin Cloud Removal in Optical Remote Sensing Images Based on Generative Adversarial Networks and Physical Model of Cloud Distortion.” Isprs Journal of Photogrammetry and Remote Sensing 166: 373–389. doi:10.1016/j.isprsjprs.2020.06.021.
   Web of Science ®Google Scholar
• Li, J., Z. Wu, Q. Sheng, B. Wang, Z. Hu, S. Zheng, G. Camps-Valls, and M. Molinier. 2022. “A Hybrid Generative Adversarial Network for Weakly-Supervised Cloud Detection in Multispectral Images.” Remote Sensing of Environment 280: 113197. doi:10.1016/j.rse.2022.113197.
   PubMed Web of Science ®Google Scholar
• Maalouf, A., P. Carre, B. Augereau, and C. Fernandez-Maloigne. 2009. “A Bandelet-Based Inpainting Technique for Clouds Removal from Remotely Sensed Images.” IEEE Transactions on Geoscience & Remote Sensing 47 (7): 2363–2371. doi:10.1109/TGRS.2008.2010454.
   Web of Science ®Google Scholar
• Meng, Q., B. E. Borders, C. J. Cieszewski, and M. Madden. 2009. “Closest Spectral Fit for Removing Clouds and Cloud Shadows.” Photogrammetric Engineering & Remote Sensing 75 (5): 569–576. doi:10.14358/PERS.75.5.569.
   Web of Science ®Google Scholar
• Meng, X., H. Shen, Q. Yuan, H. Li, L. Zhang, and W. Sun. 2019. “Pansharpening for Cloud-Contaminated Very High-Resolution Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 57 (5): 2840–2854. doi:10.1109/TGRS.2018.2878007.
   Web of Science ®Google Scholar
• Meraner, A., P. Ebel, X. Zhu, and M. Schmitt. 2020. “Cloud Removal in Sentinel-2 Imagery Using a Deep Residual Neural Network and SAR-Optical Data Fusion.” Isprs Journal of Photogrammetry and Remote Sensing 166: 333–346. doi:10.1016/j.isprsjprs.2020.05.013.
   PubMed Web of Science ®Google Scholar
• Mitchell, O. R., E. J. Delp, and P. L. Chen. 1977. “Filtering to Remove Cloud Cover in Satellite Imagery.” IEEE Transactions on Geoscience Electronics 15 (3): 137–141. doi:10.1109/TGE.1977.6498971.
   Google Scholar
• Park, S., X. Guo, H. Shin, and Q. Hong. 2005. ”Shape and Appearance Repair for Incomplete Point Surfaces.” Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, Beijing, China, pp. 1260–1267 Vol. 2. doi: 10.1109/ICCV.2005.218.
   Google Scholar
• Perez, P., M. Gangnet, and A. Blake. 2003. “Poisson Image Editing.” ACM Transactions on Graphics 22 (3): 313–318. doi:10.1145/882262.882269.
   Web of Science ®Google Scholar
• Rossi, R. E., J. L. Dungan, and L. R. Beck. 1994. “Kriging in the Shadows: Geostatistical Interpolation for Remote Sensing.” Remote Sensing of Environment 49 (1): 32–40. doi:10.1016/0034-4257(94)90057-4.
   Web of Science ®Google Scholar
• Sarukkai, V., A. Jain, B. Uzkent, and S. Ermon. 2020. ”Cloud Removal in Satellite Images Using Spatiotemporal Generative Networks.” 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass, CO, USA. pp. 1785–1794. doi: 10.1109/WACV45572.2020.9093564.
   Google Scholar
• Sebastianelli, A., A. Nowakowski, E. Puglisi, M. Rosso, J. Mifdal, F. Pirri, P. P. Mathieu, and S. L. Ullo. 2021. “Spatio-Temporal SAR-Optical Data Fusion for Cloud Removal via a Deep Hierarchical Model.” arXiv preprint arXiv:2106.12226.
   Google Scholar
• Shen, H., X. Li, Q. Cheng, C. Zeng, G. Yang, H. Li, and L. Zhang. 2015. “Missing Information Reconstruction of Remote Sensing Data: A Technical Review.” IEEE Geoscience & Remote Sensing Magazine 3 (3): 61–85. doi:10.1109/MGRS.2015.2441912.
   Web of Science ®Google Scholar
• Shen, H., C. Zeng, and L. Zhang. 2011. “Recovering Reflectance of AQUA MODIS Band 6 Based on Within-Class Local Fitting.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 4 (1): 185–192. doi:10.1109/JSTARS.2010.2077620.
   Web of Science ®Google Scholar
• Shen, H., and L. Zhang. 2009. “A MAP-Based Algorithm for Destriping and Inpainting of Remotely Sensed Images.” IEEE Transactions on Geoscience and Remote Sensing 47 (5): 1492–1502. doi:10.1109/TGRS.2008.2005780.
   Web of Science ®Google Scholar
• Tao, C., S. Fu, J. Qi, and H. Li. 2022. “Thick Cloud Removal in Optical Remote Sensing Images Using a Texture Complexity Guided Self-Paced Learning Method.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–12. doi:10.1109/TGRS.2022.3157917.
   Web of Science ®Google Scholar
• Wang, Z., J. Jin, J. Liang, K. Yan, and Q. Peng. 2005. “A New Cloud Removal Algorithm for Multi-Spectral Images.“ In L. Zhang, J. Zhang, and M. Liao (Eds.), Proceedings of the MIPPR 2005: SAR Multispectral Image Process, Wuhan, China, p. 60430. doi:10.1117/12.654869.
   Google Scholar
• Wang, Z., E. P. Simoncelli, and A. C. Bovik. 2003. ”Multiscale Structural Similarity for Image Quality Assessment.” The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003, Pacific Grove, CA, USA, pp. 1398–1402 Vol. 2. doi: 10.1109/ACSSC.2003.1292216.
   Google Scholar
• Zeng, C., H. Shen, and L. Zhang. 2013. “Recovering Missing Pixels for Landsat ETM + SLC-Off Imagery Using Multi-Temporal Regression Analysis and a Regularization Method.” Remote Sensing of Environment 131: 182–194.
   Web of Science ®Google Scholar
• Zhang, Y., B. Guindon, and J. Cihlar. 2002. “An Image Transform to Characterize and Compensate for Spatial Variations in Thin Cloud Contamination of Landsat Images.” Remote Sensing of Environment 82 (2): 173–187. doi:10.1016/S0034-4257(02)00034-2.
   Web of Science ®Google Scholar
• Zhang, Q., Q. Yuan, J. Li, Z. Li, H. Shen, and L. Zhang. 2020. “Thick Cloud and Cloud Shadow Removal in Multitemporal Imagery Using Progressively Spatio-Temporal Patch Group Deep Learning.” Isprs Journal of Photogrammetry and Remote Sensing 162: 148–160. doi:10.1016/j.isprsjprs.2020.02.008.
   Web of Science ®Google Scholar
• Zhang, Q., Q. Yuan, Z. Li, F. Sun, and L. Zhang. 2021. “Combined Deep Prior with Low-Rank Tensor SVD for Thick Cloud Removal in Multitemporal Images.” Isprs Journal of Photogrammetry and Remote Sensing 177: 161–173. doi:10.1016/j.isprsjprs.2021.04.021.
   Web of Science ®Google Scholar
• Zhang, Q., Q. Yuan, C. Zeng, X. Li, and Y. Wei. 2018. “Missing Data Reconstruction in Remote Sensing Image with a Unified Spatial–Temporal–Spectral Deep Convolutional Neural Network.” IEEE Transactions on Geoscience and Remote Sensing 56 (8): 4274–4288. doi:10.1109/TGRS.2018.2810208.
   Web of Science ®Google Scholar
• Zhou, W., and A. C. Bovik. 2002. “A Universal Image Quality Index.” IEEE Signal Processing Letters 9 (3): 81–84. doi:10.1109/97.995823.
   Web of Science ®Google Scholar
• Zhu, W., and T. Chan. 2012. “Image Denoising Using Mean Curvature of Image Surface.” SIAM Journal on Imaging Sciences 5 (1): 1–32. doi:10.1137/110822268.
   Web of Science ®Google Scholar