1,967
Views
0
CrossRef citations to date
0
Altmetric
Articles

Semantic segmentation for remote sensing images based on an AD-HRNet model

ORCID Icon, ORCID Icon, , ORCID Icon &
Pages 2376-2399 | Received 10 Oct 2022, Accepted 10 Dec 2022, Published online: 19 Dec 2022

References

  • Alqurashi, Abdullah, and Lalit Kumar. 2013. “Investigating the Use of Remote Sensing and GIS Techniques to Detect Land Use and Land Cover Change: A Review.” Advances in Remote Sensing 2 (2): 193–204. doi:10.4236/ars.2013.22022.
  • Badrinarayanan, Vijay, Alex Kendall, and Roberto Cipolla. 2017. “Segnet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (12): 2481–2495. doi:10.1109/TPAMI.2016.2644615.
  • Bayanlou, Mohammad R., and Mehdi Khoshboresh-Masouleh. 2021. “Multi-Task Learning from Fixed-Wing UAV Images for 2D/3D City Modeling.” ArXiv 2109:00918.
  • Chen, Liang-Chieh, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille. 2017. “Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected Crfs.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (4): 834–848. doi:10.1109/TPAMI.2017.2699184.
  • Chen, Liang-Chieh, George Papandreou, Florian Schroff, and Hartwig Adam. 2017. “Rethinking Atrous Convolution for Semantic Image Segmentation.” ArXiv 1706:05587.
  • Ching, Travers, Daniel S. Himmelstein, Brett K. Beaulieu-Jones, Alexandr A. Kalinin, Brian T. Do, Gregory P. Way, Enrico Ferrero, Paul-Michael Agapow, Michael Zietz, and Michael M. Hoffman. 2018. “Opportunities and Obstacles for Deep Learning in Biology and Medicine.” Journal of The Royal Society Interface 15 (141): 20170387. doi:10.1098/rsif.2017.0387.
  • Dai, Jifeng, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, and Yichen Wei. 2017. “Deformable Convolutional Networks.” In 2017 IEEE International Conference on Computer Vision(ICCV), 764–773. doi:10.1109/ICCV.2017.89.
  • Deng, Zhipeng, Hao Sun, Shilin Zhou, Juanping Zhao, Lin Lei, and Huanxin Zou. 2018. “Multi-Scale Object Detection in Remote Sensing Imagery with Convolutional Neural Networks.” ISPRS Journal of Photogrammetry and Remote Sensing 145: 3–22. doi:10.1016/j.isprsjprs.2018.04.003.
  • Diakogiannis, Foivos I., François Waldner, Peter Caccetta, and Chen Wu. 2020. “ResUNet-a: A Deep Learning Framework for Semantic Segmentation of Remotely Sensed Data.” ISPRS Journal of Photogrammetry and Remote Sensing 162: 94–114. doi:10.1016/j.isprsjprs.2020.01.013.
  • Dong, Laigen, and Jie Shan. 2013. “A Comprehensive Review of Earthquake-Induced Building Damage Detection with Remote Sensing Techniques.” ISPRS Journal of Photogrammetry and Remote Sensing 84: 85–99. doi:10.1016/j.isprsjprs.2013.06.011.
  • Dosovitskiy, Alexey, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, and Sylvain Gelly. 2020. “An Image Is Worth 16 × s16 Words: Transformers for Image Recognition at Scale.” ArXiv 2010:11929.
  • Du, Shouji, Shihong Du, Bo Liu, and Xiuyuan Zhang. 2021. “Incorporating DeepLabv3+ and Object-Based Image Analysis for Semantic Segmentation of Very High Resolution Remote Sensing Images.” International Journal of Digital Earth 14 (3): 357–378. doi:10.1080/17538947.2020.1831087.
  • Dubey, Abhimanyu, Nikhil Naik, Devi Parikh, Ramesh Raskar, and César A. Hidalgo. 2016. “Deep Learning the City: Quantifying Urban Perception at a Global Scale.” In 2016 European Conference on Computer Vision(ECCV), 196–212. doi:10.1007/978-3-319-46448-0_12.
  • Fu, Jun, Jing Liu, Haijie Tian, Yong Li, Yongjun Bao, Zhiwei Fang, and Hanqing Lu. 2019. “Dual Attention Network for Scene Segmentation.” In Proceedings 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR 2019), 3141–3149. doi:10.1109/CVPR.2019.00326.
  • Gribbon, Kim T., and Donald G. Bailey. 2004. “A Novel Approach to Real-Time Bilinear Interpolation.” In Proceedings. DELTA 2004. Second IEEE International Workshop on Electronic Design, Test and Applications, 126–131. doi:10.1109/DELTA.2004.10055.
  • Grigorescu, Sorin, Bogdan Trasnea, Tiberiu Cocias, and Gigel Macesanu. 2020. “A Survey of Deep Learning Techniques for Autonomous Driving.” Journal of Field Robotics 37 (3): 362–386. doi:10.1002/rob.21918.
  • Guo, Meng-Hao, Tian-Xing Xu, Jiang-Jiang Liu, Zheng-Ning Liu, Peng-Tao Jiang, Tai-Jiang Mu, Song-Hai Zhang, Ralph R. Martin, Ming-Ming Cheng, and Shi-Min Hu. 2022. “Attention Mechanisms in Computer Vision: A Survey.” Computational Visual Media 8: 331–368. doi:10.1007/s41095-022-0271-y.
  • He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. “Deep Residual Learning for Image Recognition.” In Proceedings 2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 770–778. doi:10.1109/CVPR.2016.90.
  • Hu, Jie, Li Shen, and Gang Sun. 2018. “Squeeze-and-Excitation Networks.” In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2011–2023. DOI: 10.1109/TPAMI.2019.2913372.
  • Huang, Zilong, Xinggang Wang, Lichao Huang, Chang Huang, Yunchao Wei, and Wenyu Liu. 2019. “Ccnet: Criss-Cross Attention for Semantic Segmentation.” In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). doi:10.1109/TPAMI.2020.3007032.
  • Joyce, Karen E., Stella E. Belliss, Sergey v Samsonov, Stephen J. McNeill, and Phil J. Glassey. 2009. “A Review of the Status of Satellite Remote Sensing and Image Processing Techniques for Mapping Natural Hazards and Disasters.” Progress in Physical Geography 33 (2): 183–207. doi:10.1177/0309133309339563.
  • Kampffmeyer, Michael, Arnt-Borre Salberg, and Robert Jenssen. 2016. “Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks.” In Proceedings 2016 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops(CVPRW), 680–688. doi:10.1109/CVPRW.2016.90.
  • Ke, Yan, and Rahul Sukthankar. 2004. “PCA-SIFT: A More Distinctive Representation for Local Image Descriptors.” In Proceedings 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR), II-II. doi:10.1109/CVPR.2004.1315206.
  • Kemker, Ronald, Carl Salvaggio, and Christopher Kanan. 2018. “Algorithms for Semantic Segmentation of Multispectral Remote Sensing Imagery Using Deep Learning.” ISPRS Journal of Photogrammetry and Remote Sensing 145: 60–77. doi:10.1016/j.isprsjprs.2018.04.014.
  • Kerr, Jeremy T., and Marsha Ostrovsky. 2003. “From Space to Species: Ecological Applications for Remote Sensing.” Trends in Ecology & Evolution 18 (6): 299–305. doi:10.1016/S0169-5347(03)00071-5
  • Khoshboresh-Masouleh, Mehdi, Fatemeh Alidoost, and Hossein Arefi. 2020. “Multiscale Building Segmentation Based on Deep Learning for Remote Sensing RGB Images from Different Sensors.” Journal of Applied Remote Sensing 14 (3): 034503. doi:10.1117/1.JRS.14.034503.
  • Leichtle, Tobias, Christian Geiß, Tobia Lakes, and Hannes Taubenböck. 2017. “Class Imbalance in Unsupervised Change Detection – A Diagnostic Analysis from Urban Remote Sensing.” International Journal of Applied Earth Observation and Geoinformation 60: 83–98. doi:10.1016/j.jag.2017.04.002.
  • Li, Xiangtai, Hao He, Xia Li, Duo Li, Guangliang Cheng, Jianping Shi, Lubin Weng, Yunhai Tong, and Zhouchen Lin. 2021. “PointFlow: Flowing Semantics through Points for Aerial Image Segmentation.” In Proceedings 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR), 4215–4224. doi:10.1109/CVPR46437.2021.00420.
  • Li, Deren, Yuan Yao, and S. H. A. O. Zhenfeng. 2015. “Big Data in Smart Cities.” Science China Information Sciences 58: 1–12. doi:10.1007/s11432-015-5396-5.
  • Liu, Runrui, Fei Tao, Xintao Liu, Jiaming Na, Hongjun Leng, Junjie Wu, and Tong Zhou. 2022. “RAANet: A Residual ASPP with Attention Framework for Semantic Segmentation of High-Resolution Remote Sensing Images.” Remote Sensing 14 (13): 3109. doi:10.3390/rs14133109.
  • Liu, Shuai, Lu Zhang, Huchuan Lu, and You He. 2021. “Center-Boundary Dual Attention for Oriented Object Detection in Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–14. doi:10.1109/TGRS.2021.3069056.
  • Long, Jonathan, Evan Shelhamer, and Trevor Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (4): 640–651. doi:10.1109/TPAMI.2016.2572683.
  • Ma, Ningning, Xiangyu Zhang, Hai-Tao Zheng, and Jian Sun. 2018. “Shufflenet v2: Practical Guidelines for Efficient CNN Architecture Design.” In Proceedings 2018 European Conference on Computer Vision (ECCV), 122–138. doi:10.1007/978-3-030-01264-9_8.
  • Meng, Xiaoliang, Yuechi Yang, Libo Wang, Teng Wang, Rui Li, and Ce Zhang. 2022. “Class-Guided Swin Transformer for Semantic Segmentation of Remote Sensing Imagery.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. doi:10.1109/LGRS.2022.3215200.
  • Panda, Durga P., and Azriel Rosenfeld. 1978. “Image Segmentation by Pixel Classification in (Gray Level, Edge Value) Space.” IEEE Transactions on Computers 27 (09): 875–879. doi:10.1109/TC.1978.1675208.
  • Park, Jongchan, Sanghyun Woo, Joon-Young Lee, and In So Kweon. 2018. “Bam: Bottleneck Attention Module.” ArXiv:1807.06514.
  • Plath, Nils, Marc Toussaint, and Shinichi Nakajima. 2009. “Multi-Class Image Segmentation Using Conditional Random Fields and Global Classification.” In Proceedings of the 26th Annual International Conference on Machine Learning, 817–824. doi:10.1145/1553374.1553479.
  • Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” Medical Image Computing and Computer-Assisted Intervention(MICCAI 9351: 234–241. doi:10.1007/978-3-319-24574-4_28.
  • Seong, Seonkyeong, and Jaewan Choi. 2021. “Semantic Segmentation of Urban Buildings Using a High-Resolution Network (HRNet) with Channel and Spatial Attention Gates.” Remote Sensing 13 (16): 3087. doi:10.3390/rs13163087.
  • Shi, Jianbo, and Jitendra Malik. 2000. “Normalized Cuts and Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 22 (8): 888–905. doi:10.1109/34.868688.
  • Song, Wen, Wei Song, Haihong Gu, and Fuping Li. 2020. “Progress in the Remote Sensing Monitoring of the Ecological Environment in Mining Areas.” International Journal of Environmental Research and Public Health 17 (6): 1846. doi:10.3390/ijerph17061846.
  • Sun, Ke, Bin Xiao, Dong Liu, and Jingdong Wang. 2019. “Deep High-Resolution Representation Learning for Human Pose Estimation.” In Proceedings 2019, IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR), 5686–5696. doi:10.1109/CVPR.2019.00584.
  • Sun, Ke, Yang Zhao, Borui Jiang, Tianheng Cheng, Bin Xiao, Dong Liu, Yadong Mu, Xinggang Wang, Wenyu Liu, and Jingdong Wang. 2019. “High-Resolution Representations for Labeling Pixels and Regions.” ArXiv 1904:04514.
  • Treml, Michael, José Arjona-Medina, Thomas Unterthiner, Rupesh Durgesh, Felix Friedmann, Peter Schuberth, Andreas Mayr, Martin Heusel, Markus Hofmarcher, and Michael Widrich. 2016. Speeding up Semantic Segmentation for Autonomous Driving.
  • Wang, Panqu, Pengfei Chen, Ye Yuan, Ding Liu, Zehua Huang, Xiaodi Hou, and Garrison Cottrell. 2018. “Understanding Convolution for Semantic Segmentation.” In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), 1451–1460. doi:10.1109/WACV.2018.00163.
  • Wang, Xiaolong, Ross Girshick, Abhinav Gupta, and Kaiming He. 2018. “Non-local Neural Networks.” In Proceedings 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 7794–7803. doi:10.1109/CVPR.2018.00813.
  • Wang, Xiaoyu, Tony X. Han, and Shuicheng Yan. 2009. “An HOG-LBP Human Detector with Partial Occlusion Handling.” In 2009 IEEE 12th International Conference on Computer Vision(ICCV), 32–39. doi:10.1109/ICCV.2009.5459207.
  • Wang, Libo, Rui Li, Ce Zhang, Shenghui Fang, Chenxi Duan, Xiaoliang Meng, and Peter M. Atkinson. 2022. “UNetFormer: A UNet-Like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 190: 196–214. doi:10.1016/j.isprsjprs.2022.06.008.
  • Woo, Sanghyun, Jongchan Park, Joon-Young Lee, and In So Kweon. 2018. “Cbam: Convolutional Block Attention Module.” In Proceedings 2018 European Conference on Computer Vision (ECCV), 3–19. doi:10.1007/978-3-030-01234-2_1.
  • Xu, Zhiyong, Weicun Zhang, Tianxiang Zhang, and Jiangyun Li. 2020. “HRCNet: High-Resolution Context Extraction Network for Semantic Segmentation of Remote Sensing Images.” Remote Sensing 13 (1): 71. doi:10.3390/rs13010071.
  • Yuan, Yuhui, Xiaokang Chen, Xilin Chen, and Jingdong Wang. 2019. “Segmentation Transformer: Object-Contextual Representations for Semantic Segmentation.” ArXiv 1909:11065.
  • Zhang, Jing, Shaofu Lin, Lei Ding, and Lorenzo Bruzzone. 2020. “Multi-Scale Context Aggregation for Semantic Segmentation of Remote Sensing Images.” Remote Sensing 12 (4): 701. doi:10.3390/rs12040701.
  • Zhang, Qing-Long, and Yu-Bin Yang. 2021. “Sa-Net: Shuffle Attention for Deep Convolutional Neural Networks.” In 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2235–2239. doi:10.1109/ICASSP39728.2021.9414568.
  • Zhang, Fan, Bolei Zhou, Liu Liu, Yu Liu, Helene H. Fung, Hui Lin, and Carlo Ratti. 2018. “Measuring Human Perceptions of a Large-Scale Urban Region Using Machine Learning.” Landscape and Urban Planning 180: 148–160. doi:10.1016/j.landurbplan.2018.08.020.
  • Zhu, Xiao Xiang, Devis Tuia, Lichao Mou, Gui-Song Xia, Liangpei Zhang, Feng Xu, and Friedrich Fraundorfer. 2017. “Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources.” IEEE Geoscience and Remote Sensing Magazine 5 (4): 8–36. doi:10.1109/MGRS.2017.2762307.