Combination of super-resolution reconstruction and SGA-Net for marsh vegetation mapping using multi-resolution multispectral and hyperspectral images

References

• Aiazzi, B., S. Baronti, F. Lotti, and M. Selva. 2009. “A Comparison Between Global and Context-Adaptive Pansharpening of Multispectral Images.” IEEE Geoscience and Remote Sensing Letters 6 (2): 302–306. https://doi.org/10.1109/LGRS.2008.2012003.
   Web of Science ®Google Scholar
• Allen, Cameron, Graciela Metternicht, and Thomas Wiedmann. 2019. “Prioritising SDG Targets: Assessing Baselines, Gaps and Interlinkages.” Sustainability Science 14 (2): 421–438. https://doi.org/10.1007/s11625-018-0596-8.
   Web of Science ®Google Scholar
• Alparone, Luciano, Stefano Baronti, Bruno Aiazzi, and Andrea Garzelli. 2016. “Spatial Methods for Multispectral Pansharpening: Multiresolution Analysis Demystified.” IEEE Transactions on Geoscience and Remote Sensing 54 (5): 2563–2576. https://doi.org/10.1109/TGRS.2015.2503045.
   Web of Science ®Google Scholar
• Cai, Weiwei, and Zhanguo Wei. 2022. “Remote Sensing Image Classification Based on a Cross-Attention Mechanism and Graph Convolution.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. https://doi.org/10.1109/lgrs.2020.3026587.
   Web of Science ®Google Scholar
• Chai, Dengfeng, Shawn Newsam, and Jingfeng Huang. 2020. “Aerial Image Semantic Segmentation Using DCNN Predicted Distance Maps.” ISPRS Journal of Photogrammetry and Remote Sensing 161 (March): 309–322. https://doi.org/10.1016/j.isprsjprs.2020.01.023.
   Google Scholar
• Chen, Zhao, Hanye Pu, Bin Wang, and Geng-Ming Jiang. 2014. “Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods.” IEEE Geoscience and Remote Sensing Letters 11 (8): 1418–1422. https://doi.org/10.1109/LGRS.2013.2294476.
   Web of Science ®Google Scholar
• Cui, Binge, Haoqing Zhang, Wei Jing, Huifang Liu, and Jianming Cui. 2022. “SRSe-Net: Super-Resolution-Based Semantic Segmentation Network for Green Tide Extraction.” Remote Sensing 14 (3): 710. https://doi.org/10.3390/rs14030710.
   Web of Science ®Google Scholar
• Davidson, Scott J, Emily Dazé, Eunji Byun, Dean Hiler, Markus Kangur, Julie Talbot, Sarah A Finkelstein, and Maria Strack. 2022. “The Unrecognized Importance of Carbon Stocks and Fluxes from Swamps in Canada and the USA.” Environmental Research Letters 17 (5): 053003. https://doi.org/10.1088/1748-9326/ac63d5.
   Web of Science ®Google Scholar
• Davidson, Nick C., and C. Max Finlayson. 2018. “Extent, Regional Distribution and Changes in Area of Different Classes of Wetland.” Marine and Freshwater Research 69 (10): 1525. https://doi.org/10.1071/MF17377.
   Web of Science ®Google Scholar
• Deng, Jie, Xuan Lv, Lujia Yang, Baoqiang Zhao, Congying Zhou, Ziqian Yang, Jiarui Jiang, et al. 2022. “Assessing Macro Disease Index of Wheat Stripe Rust Based on Segformer with Complex Background in the Field.” Sensors 22 (15): 5676. https://doi.org/10.3390/s22155676.
   PubMed Web of Science ®Google Scholar
• Dong, Chao, Chen Change Loy, Kaiming He, and Xiaoou Tang. 2016. “Image Super-Resolution Using Deep Convolutional Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 38 (2): 295–307. https://doi.org/10.1109/TPAMI.2015.2439281.
   PubMed Web of Science ®Google Scholar
• Fu, Bolin, Yeqiao Wang, Anthony Campbell, Ying Li, Bai Zhang, Shubai Yin, Zefeng Xing, and Xiaomin Jin. 2017. “Comparison of Object-Based and Pixel-Based Random Forest Algorithm for Wetland Vegetation Mapping Using High Spatial Resolution GF-1 and SAR Data.” Ecological Indicators 73 (February): 105–117. https://doi.org/10.1016/j.ecolind.2016.09.029.
   Google Scholar
• Fu, Bolin, Pingping Zuo, Man Liu, Guiwen Lan, Hongchang He, Zhinan Lao, Ya Zhang, Donglin Fan, and Ertao Gao. 2022. “Classifying Vegetation Communities Karst Wetland Synergistic Use of Image Fusion and Object-Based Machine Learning Algorithm with Jilin-1 and UAV Multispectral Images.” Ecological Indicators 140 (July): 108989. https://doi.org/10.1016/j.ecolind.2022.108989.
   Google Scholar
• Ghimire, Prakash, Deng Lei, and Nie Juan. 2020. “Effect of Image Fusion on Vegetation Index Quality—A Comparative Study from Gaofen-1, Gaofen-2, Gaofen-4, Landsat-8 OLI and MODIS Imagery.” Remote Sensing 12 (10): 1550. https://doi.org/10.3390/rs12101550.
   Web of Science ®Google Scholar
• Hamdi, Zayd Mahmoud, Melanie Brandmeier, and Christoph Straub. 2019. “Forest Damage Assessment Using Deep Learning on High Resolution Remote Sensing Data.” Remote Sensing 11 (17): 1976. https://doi.org/10.3390/rs11171976.
   Web of Science ®Google Scholar
• Hendrycks, Dan, and Kevin Gimpel. 2016. “Gaussian error linear units (gelus).” arXiv preprint arXiv:1606.08415.
   Google Scholar
• Hore, Alain, and Djemel Ziou. 2010. “Image Quality Metrics: PSNR vs. SSIM.” 2010 20th International Conference on Pattern Recognition. IEEE, https://doi.org/10.1109/icpr.2010.579.
   Google Scholar
• Jaderberg, Max, Karen Simonyan, Andrew Zisserman, and Koray Kavukcuoglu. 2015. “Spatial Transformer Networks.” https://arxiv.org/abs/1506.02025.
   Google Scholar
• Jamali, Ali, and Masoud Mahdianpari. 2022. “Swin Transformer and Deep Convolutional Neural Networks for Coastal Wetland Classification Using Sentinel-1, Sentinel-2, and LiDAR Data.” Remote Sensing 14 (2): 359. https://doi.org/10.3390/rs14020359.
   Web of Science ®Google Scholar
• Jia, Mingming, Zongming Wang, Dehua Mao, Chunying Ren, Kaishan Song, Chuanpeng Zhao, Chao Wang, Xiangming Xiao, and Yeqiao Wang. 2023. “Mapping Global Distribution of Mangrove Forests at 10-m Resolution.” Science Bulletin 68 (12): 1306–1316. https://doi.org/10.1016/j.scib.2023.05.004.
   PubMed Web of Science ®Google Scholar
• Khan, Atiya, Amol D. Vibhute, Shankar Mali, and C. H. Patil. 2022. “A Systematic Review on Hyperspectral Imaging Technology with a Machine and Deep Learning Methodology for Agricultural Applications.” Ecological Informatics 69 (July): 101678. https://doi.org/10.1016/j.ecoinf.2022.101678.
   Google Scholar
• Ledig, Christian, Lucas Theis, Ferenc Huszar, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, et al. 2017. “Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network.” 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, https://doi.org/10.1109/cvpr.2017.19.
   Google Scholar
• Li, Huixuan, Cuizhen Wang, Yuxin Cui, and Michael Hodgson. 2021. “Mapping Salt Marsh Along Coastal South Carolina Using U-Net.” ISPRS Journal of Photogrammetry and Remote Sensing 179 (September): 121–132. https://doi.org/10.1016/j.isprsjprs.2021.07.011.
   Google Scholar
• Li, Xiang, Wenhai Wang, Xiaolin Hu, and Jian Yang. 2019. “Selective Kernel Networks.” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, https://doi.org/10.1109/cvpr.2019.00060.
   Google Scholar
• Lipton, Zachary C., Charles Elkan, and Balakrishnan Naryanaswamy. 2014. “Optimal Thresholding of Classifiers to Maximize F1 Measure.” Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2014, Nancy, France, September 15-19, 2014. Proceedings, Part II 14, pp. 225–239, Springer Berlin Heidelberg.
   Google Scholar
• Liu, Tao, and Amr Abd-Elrahman. 2018. “Deep Convolutional Neural Network Training Enrichment Using Multi-View Object-Based Analysis of Unmanned Aerial Systems Imagery for Wetlands Classification.” ISPRS Journal of Photogrammetry and Remote Sensing 139 (May): 154–170. https://doi.org/10.1016/j.isprsjprs.2018.03.006.
   Google Scholar
• Liu, Man, Bolin Fu, Shuyu Xie, Hongchang He, Feiwu Lan, Yuyang Li, Peiqing Lou, and Donglin Fan. 2021. “Comparison of Multi-Source Satellite Images for Classifying Marsh Vegetation Using DeepLabV3 Plus Deep Learning Algorithm.” Ecological Indicators 125 (June): 107562. https://doi.org/10.1016/j.ecolind.2021.107562.
   Google Scholar
• Ma, Jiayi, Wei Yu, Chen Chen, Pengwei Liang, Xiaojie Guo, and Junjun Jiang. 2020. “Pan-GAN: An Unsupervised Pan-Sharpening Method for Remote Sensing Image Fusion.” Information Fusion 62 (October): 110–120. https://doi.org/10.1016/j.inffus.2020.04.006.
   Google Scholar
• Magnússon, Rúna Í., Juul Limpens, David Kleijn, Ko van Huissteden, Trofim C. Maximov, Sylvain Lobry, and Monique M.P.D. Heijmans. 2021. “Shrub Decline and Expansion of Wetland Vegetation Revealed by Very High Resolution Land Cover Change Detection in the Siberian Lowland Tundra.” Science of The Total Environment 782 (August): 146877. https://doi.org/10.1016/j.scitotenv.2021.146877.
   Google Scholar
• Mahdianpari, Masoud, Bahram Salehi, Fariba Mohammadimanesh, Saeid Homayouni, and Eric Gill. 2019. “The First Wetland Inventory Map of Newfoundland at a Spatial Resolution of 10 m Using Sentinel-1 and Sentinel-2 Data on the Google Earth Engine Cloud Computing Platform.” Remote Sensing 11 (1): 43. https://doi.org/10.3390/rs11010043.
   Web of Science ®Google Scholar
• Mallinis, Georgios, Nikos Koutsias, Maria Tsakiri-Strati, and Michael Karteris. 2008. “Object-based classification using Quickbird imagery for delineating forest vegetation polygons in a Mediterranean test site.” ISPRS Journal of Photogrammetry and Remote Sensing 63 (2): 237–250. https://doi.org/10.1016/j.isprsjprs.2007.08.007.
   Web of Science ®Google Scholar
• Mao, Dehua, Zongming Wang, Baojia Du, Lin Li, Yanlin Tian, Mingming Jia, Yuan Zeng, Kaishan Song, Ming Jiang, and Yeqiao Wang. 2020. “National Wetland Mapping in China: A New Product Resulting from Object-Based and Hierarchical Classification of Landsat 8 OLI Images.” ISPRS Journal of Photogrammetry and Remote Sensing 164 (June): 11–25. https://doi.org/10.1016/j.isprsjprs.2020.03.020.
   Google Scholar
• Marmolin, Hans. 1986. “Subjective MSE Measures.” IEEE Transactions on Systems, Man, and Cybernetics 16 (3): 486–489. https://doi.org/10.1109/TSMC.1986.4308985.
   Web of Science ®Google Scholar
• Masoud, Khairiya Mudrik, Claudio Persello, and Valentyn A. Tolpekin. 2020. “Delineation of Agricultural Field Boundaries from Sentinel-2 Images Using a Novel Super-Resolution Contour Detector Based on Fully Convolutional Networks.” Remote Sensing 12 (1): 59. https://doi.org/10.3390/rs12010059.
   Web of Science ®Google Scholar
• Milletari, Fausto, Nassir Navab, and Seyed-Ahmad Ahmadi. 2016. “V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation.” 2016 Fourth International Conference on 3D Vision (3DV). IEEE, https://doi.org/10.1109/3dv.2016.79.
   Google Scholar
• Nasser Mohamed Eid, Asmaa, C. O. Olatubara, T. A. Ewemoje, Haitham Farouk, and Mohamed Talaat El-Hennawy. 2020. “Coastal Wetland Vegetation Features and Digital Change Detection Mapping Based on Remotely Sensed Imagery: El-Burullus Lake, Egypt.” International Soil and Water Conservation Research 8 (1): 66–79. https://doi.org/10.1016/j.iswcr.2020.01.004.
   Web of Science ®Google Scholar
• Pham, Hanh Nguyen, Kinh Bac Dang, Thanh Vinh Nguyen, Ngoc Cuong Tran, Xuan Quy Ngo, Duc Anh Nguyen, Thi Thanh Hai Phan, Thu Thuy Nguyen, Wenshan Guo, and Huu Hao Ngo. 2022. “A New Deep Learning Approach Based on Bilateral Semantic Segmentation Models for Sustainable Estuarine Wetland Ecosystem Management.” Science of The Total Environment 838 (September): 155826. https://doi.org/10.1016/j.scitotenv.2022.155826.
   PubMedGoogle Scholar
• Ren, Haoyu, Mostafa El-Khamy, and Jungwon Lee. 2017. “Image Super Resolution Based on Fusing Multiple Convolution Neural Networks.” 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, https://doi.org/10.1109/cvprw.2017.142.
   Google Scholar
• Soufi, Omar, Zineb Aarab, and Fatima-Zahra Belouadha. 2022. “Benchmark of Deep Learning Models for Single Image Super-Resolution (SISR).” 2022 2nd International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET). IEEE, https://doi.org/10.1109/iraset52964.2022.9738274.
   Google Scholar
• Sun, Chao, Sergio Fagherazzi, and Yongxue Liu. 2018. “Classification Mapping of Salt Marsh Vegetation by Flexible Monthly NDVI Time-Series Using Landsat Imagery.” Estuarine, Coastal and Shelf Science 213 (November): 61–80. https://doi.org/10.1016/j.ecss.2018.08.007.
   Google Scholar
• Taddeo, Sophie, Iryna Dronova, and Nicholas Depsky. 2019. “Spectral Vegetation Indices of Wetland Greenness: Responses to Vegetation Structure, Composition, and Spatial Distribution.” Remote Sensing of Environment 234 (December): 111467. https://doi.org/10.1016/j.rse.2019.111467.
   Google Scholar
• Tang, Jing, Ying Li, Bolin Fu, Xiaomin Jin, Gao Yang, and Xing Zhang. 2022. “Spatial–Temporal Changes in the Degradation of Marshes Over the Past 67 Years.” Scientific Reports 12 (1), https://doi.org/10.1038/s41598-022-10104-3.
   Google Scholar
• Wang, Pin, En Fan, and Peng Wang. 2021a. “Comparative analysis of image classification algorithms based on traditional machine learning and deep learning.” Pattern Recognition Letters 141: 61–67. https://doi.org/10.1016/j.patrec.2020.07.042.
   Web of Science ®Google Scholar
• Wang, Shizun, Ming Lu, Kaixin Chen, Jiaming Liu, Xiaoqi Li, Chuang Zhang, and Ming Wu. 2021b. “SamplingAug: On the Importance of Patch Sampling Augmentation for Single Image Super-Resolution.” . https://arxiv.org/abs/2111.15185.
   Google Scholar
• Wang, Xintao, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Yu Qiao, and Chen Change Loy. 2019. “ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks.” In Lecture Notes in Computer Science, 63–79. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-11021-5_5
   Google Scholar
• Weerts, Hilde JP, Andreas C. Mueller, and Joaquin Vanschoren. 2020. “Importance of Tuning Hyperparameters of Machine Learning Algorithms.” arXiv preprint arXiv:2007.07588.
   Google Scholar
• Wu, Yuxin, and Kaiming He. 2018. “Group Normalization.” In Computer Vision – ECCV 2018, 3–19. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-01261-8_1.
   Google Scholar
• Xie, Enze, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M. Alvarez, and Ping Luo. 2021. “SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers.” Advances in Neural Information Processing Systems 34: 12077–12090.
   Google Scholar
• Yu, Xiaofei, Shanshan Ding, Yuanchun Zou, Zhenshan Xue, Xianguo Lyu, and Guoping Wang. 2018. “Review of Rapid Transformation of Floodplain Wetlands in Northeast China: Roles of Human Development and Global Environmental Change.” Chinese Geographical Science 28 (4): 654–664. https://doi.org/10.1007/s11769-018-0957-3.
   Web of Science ®Google Scholar
• Zhang, Hao, Jiayi Ma, Chen Chen, and Xin Tian. 2020. “NDVI-Net: A Fusion Network for Generating High-Resolution Normalized Difference Vegetation Index in Remote Sensing.” ISPRS Journal of Photogrammetry and Remote Sensing 168 (October): 182–196. https://doi.org/10.1016/j.isprsjprs.2020.08.010.
   Google Scholar
• Zhang, Qian, Guang Yang, and Guixu Zhang. 2022. “Collaborative Network for Super-Resolution and Semantic Segmentation of Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–12. https://doi.org/10.1109/tgrs.2021.3099300.
   Web of Science ®Google Scholar
• Zhong, Jinying, Bin Yang, Guoyu Huang, Fei Zhong, and Zhongze Chen. 2016. “Remote Sensing Image Fusion with Convolutional Neural Network.” Sensing and Imaging 17 (11). https://doi.org/10.1007/s11220-016-0135-6
   Google Scholar
• Zhu, Zhiqin, Hongpeng Yin, Yi Chai, Yanxia Li, and Guanqiu Qi. 2018. “A Novel Multi-Modality Image Fusion Method Based on Image Decomposition and Sparse Representation.” Information Sciences 432 (March): 516–529. https://doi.org/10.1016/j.ins.2017.09.010.
   Google Scholar
• Zi, Wenjie, Wei Xiong, Hao Chen, Jun Li, and Ning Jing. 2021. “SGA-Net: Self-Constructing Graph Attention Neural Network for Semantic Segmentation of Remote Sensing Images.” Remote Sensing 13 (21): 4201. https://doi.org/10.3390/rs13214201.
   Web of Science ®Google Scholar