Synthesis and evaluation of seamless, large-scale, multispectral satellite images using Generative Adversarial Networks on land use and land cover and Sentinel-2 data

References

• Abady, L., M. Barni, A. Garzelli, and B. Tondi. 2020. “GAN Generation of Synthetic Multispectral Satellite Images.” Image and Signal Processing for Remote Sensing XXVI, edited by C. Notarnicola, F. Bovenga, L. Bruzzone, F. Bovolo, J. A. Benediktsson, E. Santi, and N. Pierdicca. 19. SPIE. https://www.spiedigitallibrary.org/conference-proceedings-of-spie/11533/2575765/GAN-generation-of-synthetic-multispectral-satellite-images/10.1117/12.2575765.full.
   Google Scholar
• Abady, L., J. Horváth, B. Tondi, E. J. Delp, and M. Barni. 2022. “Manipulation and Generation of Synthetic Satellite Images Using Deep Learning Models.” Journal of Applied Remote Sensing 16 (4). https://doi.org/10.1117/1.JRS.16.046504.
   Web of Science ®Google Scholar
• Adegun, A., S. Viriri, and J. Tapamo. 2023. “Review of Deep Learning Methods for Remote Sensing Satellite Images Classification: Experimental Survey and Comparative Analysis.” Journal of Big Data 10 (1). https://doi.org/10.1186/s40537-023-00772-x.
   Google Scholar
• Benjdira, B., Y. Bazi, A. Koubaa, and K. Ouni. 2019. “Unsupervised Domain Adaptation Using Generative Adversarial Networks for Semantic Segmentation of Aerial Images.” Remote Sensing 11 (11): 1369. https://doi.org/10.3390/rs11111369.
   Web of Science ®Google Scholar
• Borji, A. 2022. “Pros and Cons of GAN Evaluation Measures: New Developments.” Computer Vision and Image Understanding 215:103329. https://doi.org/10.1016/j.cviu.2021.103329.
   Web of Science ®Google Scholar
• Cai, G., H. Ren, L. Yang, N. Zhang, M. Du, and C. Wu. 2019. “Detailed Urban Land Use Land Cover Classification at the Metropolitan Scale Using a Three-Layer Classification Scheme.” Sensors (Basel, Switzerland) 19 (14): 14. https://doi.org/10.3390/s19143120.
   Web of Science ®Google Scholar
• Campos-Taberner, M., F. Javier García-Haro, B. Martínez, E. Izquierdo-Verdiguier, C. Atzberger, G. Camps-Valls, and M. Amparo Gilabert. 2020. “Understanding Deep Learning in Land Use Classification Based on Sentinel-2 Time Series.” Scientific Reports 10 (1): 17188. https://doi.org/10.1038/s41598-020-74215-5.
   PubMed Web of Science ®Google Scholar
• Chang, C.-I. 1999. “Spectral Information Divergence for Hyperspectral Image Analysis.” IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS’99 (Cat. No. 99CH36293), 509–11. IEEE.
   Google Scholar
• Chang, C.-I. 2000. “An Information-Theoretic Approach to Spectral Variability, Similarity, and Discrimination for Hyperspectral Image Analysis.” IEEE Transactions on Information Theory 46 (5): 1927–20. https://doi.org/10.1109/18.857802.
   Web of Science ®Google Scholar
• Couclelis, H. 1986. “Artificial Intelligence in Geography: Conjectures on the Shape of Things to Come.” The Professional Geographer 38 (1): 1–11. https://doi.org/10.1111/j.0033-0124.1986.00001.x.
   Web of Science ®Google Scholar
• Elmes, A., H. Alemohammad, R. Avery, J. E. Kelly Caylor, L. Fishgold, M. Friedl, M. Friedl, et al. 2020. “Accounting for Training Data Error in Machine Learning Applied to Earth Observations.” Remote Sensing 12 (6): 1034. https://doi.org/10.3390/rs12061034.
   Web of Science ®Google Scholar
• ESRI. 2020. “Deep Learning Libraries Installers for ArcGIS.” Accessed January 30, 2024. Unpublished manuscript. https://github.com/Esri/deep-learning-frameworks.
   Google Scholar
• European Commission. 2020. Mapping Guide V6.3 for a European Urban Atlas. Accessed 25 October. https://land.copernicus.eu/en/technical-library/urban_atlas_2012_2018_mapping_guide/@@download/file.
   Google Scholar
• European Environment Agency. 2020. “Urban Atlas Land Cover/Land Use 2018 (Vector).” Europe. Jul, 6–Yearly.
   Google Scholar
• Foster, D. 2020. Generatives Deep Learning: Maschinen Das Malen, Schreiben Und Komponieren Beibringen. 1. Auflage. Heidelberg: O’Reilly.
   Google Scholar
• Gong, Y., F. Zhang, X. Jia, Z. Mao, X. Huang, and D. Li. 2022. “Instance Segmentation in Very High Resolution Remote Sensing Imagery Based on Hard-To-Segment Instance Learning and Boundary Shape Analysis.” Remote Sensing 14 (1): 23. https://doi.org/10.3390/rs14010023.
   Web of Science ®Google Scholar
• Goodfellow, I., J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. 2014. “Generative Adversarial Networks.” stat.ML 1–9. https://doi.org/10.48550/arXiv.1406.2661.
   Google Scholar
• Gorelick, N., M. Hancher, M. Dixon, S. Ilyushchenko, D. Thau, and R. Moore. 2017. “Google Earth Engine: Planetary-Scale Geospatial Analysis for Everyone.” Remote Sensing of Environment 202:18–27. https://doi.org/10.1016/j.rse.2017.06.031.
   Web of Science ®Google Scholar
• He, W., and Z. Jiang. 2023. “Uncertainty Quantification of Deep Learning for Spatiotemporal Data: Challenges and Opportunities.” cs.LG 1–5. https://doi.org/10.48550/arXiv.2311.02485.
   Google Scholar
• Heusel, M., H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter. 2017. “GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium.” https://doi.org/10.48550/arXiv.1706.08500.
   Google Scholar
• He, C., Y. Zhao, J. Dong, and Y. Xiang. 2022. “Use of GAN to Help Networks to Detect Urban Change Accurately.” Remote Sensing 14 (21): 5448. https://doi.org/10.3390/rs14215448.
   Web of Science ®Google Scholar
• He, W., J. Zhe, K. Marcus, X. Yiqun, J. Xiaowei, Y. Da, and Z. Yang. 2022. “Quantifying and Reducing Registration Uncertainty of Spatial Vector Labels on Earth Imagery.” In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, edited by A. Zhang and H. Rangwala, 554–564. New York, NY, USA: ACM.
   Google Scholar
• Hou, B., Q. Liu, H. Wang, and Y. Wang. 2020. “From W-Net to CDGAN: Bi-Temporal Change Detection via Deep Learning Techniques.” IEEE Transactions on Geoscience & Remote Sensing 58 (3): 1790–1802. https://doi.org/10.48550/arXiv.2003.06583.
   Web of Science ®Google Scholar
• Isola, P., J. Zhu, T. Park, and A. Efros. 2017 “Unpaired Image-To-Image Translation Using Cycle-Consistent Adversarial Networks.” In IEEE International Conference on Computer Vision (ICCV), 2242–2251. https://doi.org/10.1109/ICCV.2017.244.
   Google Scholar
• Isola, P., J.-Y. Zhu, T. Zhou, and A. E. Alexei. 2016. “Image-To-Image Translation with Conditional Adversarial Networks” cs.CV 1–17. https://doi.org/10.48550/arXiv.1611.07004.
   Google Scholar
• Ji, S., D. Wang, and M. Luo. 2021. “Generative Adversarial Network-Based Full-Space Domain Adaptation for Land Cover Classification from Multiple-Source Remote Sensing Images.” IEEE Transactions on Geoscience & Remote Sensing 59 (5): 3816–3828. https://doi.org/10.1109/TGRS.2020.3020804.
   Web of Science ®Google Scholar
• JRC. 2021. Eurocropmap 2018. Accessed January 16, 2024. Unpublished manuscript. https://publications.jrc.ec.europa.eu/repository/handle/JRC125312.
   Google Scholar
• Lang, L., K. Xu, Q. Zhang, and D. Wang. 2021. “Fast and Accurate Object Detection in Remote Sensing Images Based on Lightweight Deep Neural Network.” Sensors (Basel, Switzerland) 21 (16): 5460. https://doi.org/10.3390/s21165460.
   PubMed Web of Science ®Google Scholar
• Lebedev, M. A., Y. V. Vizilter, O. V. Vygolov, V. A. Knyaz, and A. Y. Rubis. 2018. “Change Detection in Remote Sensing Images Using Conditional Adversarial Networks.” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII-2:565–571. https://doi.org/10.5194/isprs-archives-XLII-2-565-2018.
   Google Scholar
• Li, J., Z. Chen, X. Zhao, and L. Shao. 2020. “MapGAN: An Intelligent Generation Model for Network Tile Maps.” Sensors (Basel, Switzerland) 20 (11): 3119. https://doi.org/10.3390/s20113119.
   PubMed Web of Science ®Google Scholar
• Liu, B., Z. Li, J. Li, H. Zhao, W. Liu, Y. Li, Y. Wang, H. Chen, and W. Cao. 2021. “Saliency-Guided Remote Sensing Image Super-Resolution.” Remote Sensing 13 (24): 5144. https://doi.org/10.3390/rs13245144.
   Web of Science ®Google Scholar
• Liu, Y., D. Minh Nguyen, N. Deligiannis, W. Ding, and A. Munteanu. 2017. “Hourglass-ShapeNetwork Based Semantic Segmentation for High Resolution Aerial Imagery.” Remote Sensing 9 (6): 522. https://doi.org/10.3390/rs9060522.
   Web of Science ®Google Scholar
• Li, Z., Y. Wang, N. Zhang, Y. Zhang, Z. Zhao, D. Xu, G. Ben, and Y. Gao. 2022. “Deep Learning-Based Object Detection Techniques for Remote Sensing Images: A Survey.” Remote Sensing 14 (10): 2385. https://doi.org/10.3390/rs14102385.
   Web of Science ®Google Scholar
• Lu, H., Q. Liu, X. Liu, and Y. Zhang. 2021. “A Survey of Semantic Construction and Application of Satellite Remote Sensing Images and Data.” Journal of Organizational and End User Computing 33 (6): 1–20. https://doi.org/10.4018/JOEUC.20211101.oa29.
   Web of Science ®Google Scholar
• Lv, J., Q. Shen, M. Lv, Y. Li, L. Shi, and P. Zhang. 2023. “Deep Learning-Based Semantic Segmentation of Remote Sensing Images: A Review.” Frontiers in Ecology and Evolution: 11. https://doi.org/10.3389/fevo.2023.1201125.
   Web of Science ®Google Scholar
• Mandal, V., A. Rashid Mussah, P. Jin, and Y. Adu-Gyamfi. 2020. “Artificial Intelligence-Enabled Traffic Monitoring System.” Sustainability 12 (21): 9177. https://doi.org/10.3390/su12219177.
   Web of Science ®Google Scholar
• Mateo-García, G., V. Laparra, C. Requena-Mesa, and L. Gómez-Chova. 2021. “Generative Adversarial Networks in the Geosciences.” In Deep Learning for the Earth Sciences: A Comprehensive Approach to Remote Sensing, Climate Science, and Geosciences, edited by G. Camps-Valls, D. Tuia, X. X. Zhu, and M. Reichstein, 24–36. S.l: JOHN WILEY.
   Google Scholar
• Mirza, M., and S. Osindero. 2014. “Conditional Generative Adversarial Nets.” cs.LG 1–7. https://doi.org/10.48550/arXiv.1411.1784.
   Google Scholar
• Persson, A. 2021. GitHub Repository - Aladdin Persson.” Unpublished manuscript, last modified December 19, 2023. https://github.com/aladdinpersson.
   Google Scholar
• Qiu, C., L. Mou, M. Schmitt, and X. X. Zhu. 2019. “Local Climate Zone-Based Urban Land Cover Classification from Multi-Seasonal Sentinel-2 Images with a Recurrent Residual Network.” ISPRS Journal of Photogrammetry and Remote Sensing: Official Publication of the International Society for Photogrammetry and Remote Sensing (ISPRS) 154:151–162. https://doi.org/10.1016/j.isprsjprs.2019.05.004.
   PubMed Web of Science ®Google Scholar
• Qiu, C., X. Tong, M. Schmitt, B. Bechtel, and X. X. Zhu. 2020. “Multilevel Feature Fusion-Based CNN for Local Climate Zone Classification from Sentinel-2 Images: Benchmark Results on the So2Sat LCZ42 Dataset.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 13:2793–2806. https://doi.org/10.1109/JSTARS.2020.2995711.
   Web of Science ®Google Scholar
• Rosentreter, J., R. Hagensieker, and B. Waske. 2020. “Towards Large-Scale Mapping of Local Climate Zones Using Multitemporal Sentinel 2 Data and Convolutional Neural Networks.” Remote Sensing of Environment 237:111472. https://doi.org/10.1016/j.rse.2019.111472.
   Web of Science ®Google Scholar
• Schmitt, M., L. Haydn Hughes, C. Qiu, and X. Xiang Zhu. 2019. “SEN12MS: A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusion.” http://arxiv.org/pdf/1906.07789.pdf.
   Google Scholar
• Siracusa, G., D. Seychell, and M. Bugeja. 2021. “Blending Output from Generative Adversarial Networks to Texture High-Resolution 2D Town Maps for Roleplaying Games.” In 2021 IEEE Conference on Games (CoG), University of Copenhagen (virtual), 1–8. IEEE.
   Google Scholar
• Soto, P. J., G. A. O. P. Costa, R. Q. Feitosa, P. N. Happ, M. X. Ortega, J. Noa, C. A. Almeida, and C. Heipke. 2020. “Domain Adaptation with CYCLEGAN for Change Detection in the Amazon Forest.” International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLIII-B3-2020:1635–1643. https://doi.org/10.5194/isprs-archives-XLIII-B3-2020-1635-2020.
   Google Scholar
• Szegedy, C., V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. 2015. “Rethinking the Inception Architecture for Computer Vision” cs.CV 1–10. https://doi.org/10.48550/arXiv.1512.00567.
   Google Scholar
• Wang, D., C.-T. Lu, and Y. Fu. 2022. “Towards Automated Urban Planning: When Generative and ChatGPT-Like AI Meets Urban Planning.” ACM Transactions on Spatial Algorithms and Systems 1 (1): 1–19. https://doi.org/10.48550/arXiv.2304.03892.
   Google Scholar
• Wu, A. N., and F. Biljecki. 2022. “GANmapper: Geographical Data Translation.” International Journal of Geographical Information Science 36 (7): 1394–1422. https://doi.org/10.1080/13658816.2022.2041643.
   Web of Science ®Google Scholar
• Wurm, M., A. Droin, T. Stark, C. Geiß, W. Sulzer, and H. Taubenböck. 2021. “Deep Learning-Based Generation of Building Stock Data from Remote Sensing for Urban Heat Demand Modeling.” IJGI 10 (1): 23. https://doi.org/10.3390/ijgi10010023.
   Google Scholar
• Yang, F., X. Yuan, J. Ran, W. Shu, Y. Zhao, A. Qin, and C. Gao. 2021. “Accurate Instance Segmentation for Remote Sensing Images via Adaptive and Dynamic Feature Learning.” Remote Sensing 13 (23): 4774. https://doi.org/10.3390/rs13234774.
   Web of Science ®Google Scholar
• Zhang, Y., Y. Yin, R. Zimmermann, G. Wang, J. Varadarajan, and S. Ng. 2020. “An Enhanced GAN Model for Automatic Satellite-To-Map Image Conversion.” IEEE Access 8:176704–176716. https://doi.org/10.1109/ACCESS.2020.3025008.
   Web of Science ®Google Scholar
• Zhao, B., S. Zhang, C. Xu, Y. Sun, and C. Deng. 2021. “Deep Fake Geography? When Geospatial Data Encounter Artificial Intelligence.” Cartography and Geographic Information Science 48 (4): 338–352. https://doi.org/10.1080/15230406.2021.1910075.
   Web of Science ®Google Scholar
• Zhu, F., C. Wang, B. Zhu, C. Sun, and C. Qi. 2023. “An Improved Generative Adversarial Networks for Remote Sensing Image Super-Resolution Reconstruction via Multi-Scale Residual Block.” The Egyptian Journal of Remote Sensing and Space Science 26 (1): 151–160. https://doi.org/10.1016/j.ejrs.2022.12.008.
   Web of Science ®Google Scholar