280
Views
1
CrossRef citations to date
0
Altmetric
Research Article

A transformer-based cloud detection approach using Sentinel 2 imageries

, ORCID Icon & ORCID Icon
Pages 3194-3208 | Received 27 Feb 2023, Accepted 12 May 2023, Published online: 06 Jun 2023

References

  • Aleissaee, A. A., A. Kumar, R. Muhammad Anwer, S. Khan, H. Cholakkal, G.S. Xia, and others. 2022. “Transformers in Remote Sensing: A Survey.” ArXiv Preprint ArXiv:2209.01206.
  • Aybar, C., L. Ysuhuaylas, J. Loja, K. Gonzales, F. Herrera, L. Bautista, R. Yali, et al. 2022. “CloudSen12 - a Global Dataset for Semantic Understanding of Cloud and Cloud Shadow in Sentinel-2.” Zenodo. doi: 10.5281/zenodo.7034410.
  • Caraballo-Vega, J. A., M. L. Carroll, C. S. R. Neigh, M. Wooten, B. Lee, A. Weis, M. Aronne, W. G. Alemu, and Z. Williams. 2022. “Optimizing WorldView-2,-3 Cloud Masking Using Machine Learning Approaches.” Remote Sensing of Environment 284: 113332. Elsevier: 113332. doi:10.1016/j.rse.2022.113332.
  • Carion, N., F. Massa, G. Synnaeve, N. Usunier, A. Kirillov, and S. Zagoruyko. 2020. “End-To-End Object Detection with Transformers.” In European Conference on Computer Vision, 213–229. doi:10.1007/978-3-030-58452-8_13.
  • Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, et al. 2020. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” ArXiv Preprint ArXiv:2010.11929.
  • European Space Agency (ESA). 2022. “Open Access Hub, Scihub.Copernicus.eu.” https://scihub.copernicus.eu/.
  • Fang, C., K. Jia, P. Liu, and L. Zhang. 2019. “Research on Cloud Recognition Technology Based on Transfer Learning.” In 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 791–796. doi:10.1109/APSIPAASC47483.2019.9023267.
  • Gawlikowski, J., P. Ebel, M. Schmitt, and X. Xiang Zhu. 2022. “Explaining the Effects of Clouds on Remote Sensing Scene Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15. IEEE: 9976–9986.
  • Han, K., Y. Wang, H. Chen, X. Chen, J. Guo, Z. Liu, Y. Tang, et al. 2022. “A Survey on Vision Transformer.” IEEE Transactions on Pattern Analysis and Machine Intelligence. IEEE. doi:10.1109/TPAMI.2022.3152247.
  • Jeppesen, J. H., R. Hylsberg Jacobsen, F. Inceoglu, and T. S. Toftegaard. 2019. “Fadil Inceoglu, and Thomas Skjødeberg ToftegaardA Cloud Detection Algorithm for Satellite Imagery Based on Deep Learning.” Remote Sensing of Environment 229: 247–259. Elsevier. doi:10.1016/j.rse.2019.03.039.
  • Jun, L., W. Zhaocong, H. Zhongwen, C. Jian, S. Luo, L. Mou, X. Xiang Zhu, and M. Molinier. 2021. “A Lightweight Deep Learning-Based Cloud Detection Method for Sentinel-2A Imagery Fusing Multiscale Spectral and Spatial Features.” IEEE Transactions on Geoscience and Remote Sensing 60. IEEE: 1–19. doi:10.1109/TGRS.2021.3069641.
  • Kai, H., D. Zhang, M. Xia, M. Qian, and B. Chen. 2022. “LCDNet: Light-Weighted Cloud Detection Network for High-Resolution Remote Sensing Images.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. IEEE. doi:10.1109/JSTARS.2022.3181303.
  • Kang, W., X. Zunxiao, X. Lyu, and P. Ren. 2022. “Cloud Detection with Boundary Nets.” Isprs Journal of Photogrammetry & Remote Sensing 186: 218–231. Elsevier. doi:10.1016/j.isprsjprs.2022.02.010.
  • Kingma, D. P., and B. Jimmy 2014. “Adam: A Method for Stochastic Optimization.” ArXiv Preprint ArXiv:1412.6980.
  • Liu, Z., J. Yang, W. Wang, and Z. Shi. 2023. “Cloud Detection Methods for Remote Sensing Images: A Survey.” Chinese Space Science and Technology 43 (1): 1.
  • Main-Knorn, M., B. Pflug, J. Louis, V. Debaecker, U. Müller-Wilm, and F. Gascon. 2017. “Sen2Cor for Sentinel-2.” Image and Signal Processing for Remote Sensing XXIII 10427: 1042704.
  • Nan, M., L. Sun, C. Zhou, and H. Yawen. 2021. “Cloud Detection Algorithm for Multi-Satellite Remote Sensing Imagery Based on a Spectral Library and 1D Convolutional Neural Network.” Remote Sensing 13 (16): 3319. Multidisciplinary Digital Publishing Institute. doi:10.3390/rs13163319.
  • Papoutsis, I., N. Ioannis Bountos, A. Zavras, D. Michail, and C. Tryfonopoulos. 2023. “Benchmarking and Scaling of Deep Learning Models for Land Cover Image Classification.” Isprs Journal of Photogrammetry & Remote Sensing 195: 250–268. Elsevier. doi:10.1016/j.isprsjprs.2022.11.012.
  • Qiu, S., Z. Zhu, and H. Binbin. 2019. “Fmask 4.0: Improved Cloud and Cloud Shadow Detection in Landsats 4–8 and Sentinel-2 Imagery.” Remote Sensing of Environment 231: 111205. Elsevier: 111205. doi:10.1016/j.rse.2019.05.024.
  • Richter, R., J. Louis, and B. Berthelot. 2012. “Sentinel-2 MSI – Level 2A Products Algorithm Theoretical Basis Document.” European Space Agency 49 (0): 1–72.
  • Roy, R., M. R. Ahan, V. Soni, and A. Chittora. 2021. “Towards Automatic Transformer-Based Cloud Classification and Segmentation.” In NeurIPS 2021 Workshop on Tackling Climate Change with Machine Learning, Montreal, Canada, 60. https://hal.science/hal-03453957
  • “Sen2Cor v2.11.” STEP. https://step.esa.int/main/snap-supported-plugins/sen2cor/sen2cor-v2-11/.
  • Shtym, T., O. Wold, M. Domnich, K. Voormansik, M. Rohtsalu, J. Truupõld, N. Murin, et al. 2022. “KappaSet: Sentinel-2 KappaZeta Cloud and Cloud Shadow Masks.” Zenodo. doi: 10.5281/zenodo.7100327.
  • Singh, R., M. Biswas, and M. Pal. 2022. “Cloud Detection Using Sentinel 2 Imageries: A Comparison of XGBoost, RF, SVM, and CNN Algorithms.” Geocarto International 0 (0): 1–32. Taylor & Francis. doi:10.1080/10106049.2022.2146211.
  • Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. 2017. “Attention is All You Need.” Advances in Neural Information Processing Systems 30: 1–11.
  • Xian, L., X. Yang, L. Xutao, L. Shijian, Y. Yunming, and Y. Ban. 2022. “GCDB-UNet: A Novel Robust Cloud Detection Approach for Remote Sensing Images.” Knowledge-Based Systems 238: 107890. Elsevier: 107890. doi:10.1016/j.knosys.2021.107890.
  • Xuemei, L., Y. Huping, and S. Qiu. 2022. “Cloud Contaminated Multispectral Remote Sensing Image Enhancement Algorithm Based on MobileNet.” Remote Sensing 14 (19). MDPI: 4815.
  • Xu, K., K. Guan, J. Peng, Y. Luo, and S. Wang. 2019. “DeepMask: An Algorithm for Cloud and Cloud Shadow Detection in Optical Satellite Remote Sensing Images Using Deep Residual Network.” ArXiv Preprint ArXiv:1911.03607.
  • Yansheng, L., W. Chen, Y. Zhang, C. Tao, R. Xiao, and Y. Tan. 2020. “Accurate Cloud Detection in High-Resolution Remote Sensing Imagery by Weakly Supervised Deep Learning.” Remote Sensing of Environment 250: 112045. Elsevier: 112045. doi:10.1016/j.rse.2020.112045.
  • Zhang, G., X. Gao, J. Yang, Y. Yang, M. Tan, X. Jie, and Y. Wang. 2022. “A Multi-Task Driven and Reconfigurable Network for Cloud Detection in Cloud-Snow Coexistence Regions from Very-High-Resolution Remote Sensing Images.” International Journal of Applied Earth Observation and Geoinformation 114: 103070. Elsevier: 103070. doi:10.1016/j.jag.2022.103070.
  • Zhang, W., S. Jin, L. Zhou, X. Xie, F. Wang, L. Jiang, Y. Zheng, Q. Peixin, L. Guohou, and X. Pan. 2022. “Multi-Feature Embedded Learning SVM for Cloud Detection in Remote Sensing Images.” Computers & Electrical Engineering 102: 108177. Elsevier: 108177. doi:10.1016/j.compeleceng.2022.108177.
  • Zhang, B., Y. Zhang, L. Yansheng, Y. Wan, and Y. Yao. 2022. “CloudVit: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection.” IEEE Geoscience and Remote Sensing Letters. IEEE. doi:10.1109/LGRS.2022.3233122.
  • Zhang, Z., X. Zhiwei, C. Liu, Q. Tian, and Y. Wang. 2022. “Cloudformer: Supplementary Aggregation Feature and Mask-Classification Network for Cloud Detection.” Applied Sciences 12 (7). MDPI: 3221.
  • Zhiwei, L., H. Shen, Q. Cheng, Y. Liu, S. You, and H. Zongyi. 2019. “Deep Learning Based Cloud Detection for Medium and High Resolution Remote Sensing Images of Different Sensors.” Isprs Journal of Photogrammetry & Remote Sensing 150: 197–212. Elsevier. doi:10.1016/j.isprsjprs.2019.02.017.
  • Zhiwei, L., H. Shen, Q. Weng, Y. Zhang, P. Dou, and L. Zhang. 2022. “Cloud and Cloud Shadow Detection for Optical Satellite Imagery: Features, Algorithms, Validation, and Prospects.” Isprs Journal of Photogrammetry & Remote Sensing 188: 89–108. Elsevier. doi:10.1016/j.isprsjprs.2022.03.020.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.