3,620
Views
46
CrossRef citations to date
0
Altmetric
Research Article

Dual attention deep fusion semantic segmentation networks of large-scale satellite remote-sensing images

, , , , , , & show all
Pages 3583-3610 | Received 27 Sep 2020, Accepted 16 Dec 2020, Published online: 11 Feb 2021

References

  • Baatz, M., and S. A. Multiresolution Segmentation: An Optimization Approach for High Quality Multi-scale Image Segmentation. Beitrge zum AGIT-Symposium, Salzburg, Austria, 2000, 12–23.
  • Badrinarayanan, V., A. Kendall, C. R. SegNet:, and A. Deep Convolutional. 2017. “Encoder-Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (12): 2481–2495. doi:10.1109/TPAMI.2016.2644615.
  • Blaschke, T., Hay G. J., Kelly M., et al. 2014. “Geographic Object-based Image Analysis–towards a New Paradigm”. ISPRS Journal of Photogrammetry & Remote Sensing 87: 180–191. 10.1016/j.isprsjprs.2013.09.014.
  • Chen, L. C., Papandreou G., Kokkinos I., et al. 2018. “DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (4): 834–848. DOI:10.1109/TPAMI.2017.2699184.
  • Chen, L. C., Zhu Y., Papandreou G., et al. “Encoder-decoder with Atrous Separable Convolution for Semantic Image Segmentation”. Proc. 15th European Conference on Computer Vision (ECCV), 2018, 833–851.
  • Comaniciu, D., and P. Meer. 2002. “Mean Shift: A Robust Approach toward Feature Space Analysis.” IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (5): 603–619. doi:10.1109/34.1000236.
  • Fauvel, M., Tarabalka Y., Benediktsson J. A., et al. 2013. “Advances in Spectral-spatial Classification of Hyperspectral Images.” Proc. IEEE 101 (3): 652–675. DOI:10.1109/JPROC.2012.2197589.
  • Foivos, D., François W., Peter C., et al. 2020. “ResUNet-A: A Deep Learning Framework for Semantic Segmentation of Remotely Sensed Data”. ISPRS Journal of Photogrammetry & Remote Sensing 162: 94–114. 10.1016/j.isprsjprs.2020.01.013.
  • Foody, G. M., and A. Mathur. 2004. “A Relative Evaluation of Multiclass Image Classification by Support Vector Machines.” IEEE Transactions on Geoscience and Remote Sensing 42 (6): 1335–1343. doi:10.1109/TGRS.2004.827257.
  • Gu, W., Z. H. Lv, and M. Hao. 2017. “Change Detection Method for Remote Sensing Images Based on an Improved Markov Random Field.” Multimedia Tools and Applications 76 (17): 17719–17734. doi:10.1007/s11042-015-2960-3.
  • He, T. D., and S. X. Wang. 2020. “Multi-spectral Remote Sensing Land-cover Classification Based on Deep Learning Methods.” Journal of Supercomputing. early access. doi:10.1007/s11227-020-03377-w.
  • Henry, C. J., Storie C. D., Palaniappan M., et al. 2019. “Automated LULC Map Production Using Deep Neural Networks.” International Journal of Remote Sensing 40 (11): 4416–4440. DOI:10.1080/01431161.2018.1563840.
  • Hinton, G., Vinyals O., and Dean J. 2015. “Distilling the Knowledge.” In A Neural Network. Proceedings of NIPS Deep Learning Workshop. Preprint at https://arxiv.org/abs/1503.02531.
  • Hu J., Li S., Samuel A., et al. “Squeeze-and-Excitation Networks”. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42 (8), 2018. 10.1109/TPAMI.2019.2913372
  • Itti, L., C. Koch, and E. Niebur. 1998. “A Model of Saliency-based Visual Attention for Rapid Scene Analysis.” IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (11): 1254–1259. doi:10.1109/34.730558.
  • Keiller N., Maruro D. M., Jocelyn C., et al. 2019. “Dynamic Multicontext Segmentation of Remote Sensing Images Based on Convolutional Networks.” IEEE Transactions on Geoscience and Remote Sensing 57 (10): 7503–7520. DOI:10.1109/TGRS.2019.2913861.
  • Kussul, N., M. Lavreniuk, S. Skakun, and A. Shelestov. 2017. “Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data.” IEEE Geosci. Remote Sens. Lett 14 (5): 778–782. doi:10.1109/LGRS.2017.2681128.
  • LeCun Y., Boser B. E., Denker J. S., et al. 1989. “Backpropagation Applied to Handwritten Zip Code Recognition.” Neural Computation 1 (4): 541–551. DOI:10.1162/neco.1989.1.4.541.
  • Li H., Qiu K. J., Li C., et al. “SCAttNet: Semantic Segmentation Network with Spatial and Channel Attention Mechanism for High-Resolution Remote Sensing Images”. IEEE Geoscience and Remote Sensing Letters, 2020: 1–5 ( Early Access).
  • Li J., Li Y. F., He L., et al. 2020. “Spatio-temporal Fusion for Remote Sensing Data: An Overview and New Benchmark.” Sci. China Inf. Sci. 63 (4): 140301. DOI:10.1007/s11432-019-2785-y.
  • Li X., Lyu X., Tong Y., et al. 2019. “An Object-Based River Extraction Method via Optimized Transductive Support Vector Machine for Multi-Spectral Remote-Sensing Images”. IEEE Access 7: 46165–46175. 10.1109/ACCESS.2019.2908232.
  • LiX., Xu F., Lyu X., et al. 2020. “A Remote-Sensing Image Pan-Sharpening Method Based on Multi-Scale Channel Attention Residual Network”. IEEE Access 8: 27163–27177. 10.1109/ACCESS.2020.2971502.
  • Lin T. Y., Priya G., Ross G., et al. 2020. “Focal Loss for Dense Object Detection.” IEEE Transactions on Pattern Analysis and Machine Intelligence 42 (2): 318–327. DOI:10.1109/TPAMI.2018.2858826.
  • Long, J., E. Shelhamer, and T. Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (4): 640–651.
  • Lyu, H., H. Lu, and L. Mou. 2016. “Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection.” Remote Sens. 8 (6): 506. doi:10.3390/rs8060506.
  • Ma J. J., Wu L. L., Tang X., et al. 2020. “Building Extraction of Aerial Images by a Global and Multi-Scale Encoder-Decoder Network.” Remote Sensing 12 (15): 2350. DOI:10.3390/rs12152350.
  • Makantasis K., Karantzalos K., Doulamis A.,et al. 2015. “Deep Supervised Learning for Hyperspectral Data Classification through Convolutional Neural Networks.” Proc. IEEE Int. Geosci. Remote Sens. Symp. 4959–4962.
  • Marcos D., Hamid R., and Tuia D. 2016. “Geospatial Correspondence for Multimodal Registration.” Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR) 5091–5100.
  • Marmanis D., Schindler K., Wegner J. D., et al. 2018. “Classification with an Edge: Improving Semantic with Boundary Detection”. ISPRS Journal of Photogrammetry & Remote Sensing 135: 158–172. 10.1016/j.isprsjprs.2017.11.009.
  • Marmanis, D., K. Schindler, J. D. Wegner, S. Galliani, M. Datcu, and U. Stilla. 2018. “Classification with an Edge: Improving Semantic Image Segmentation with Boundary Detection.” ISPRS Journal of Photogrammetry & Remote Sensing 135: 158–172. doi:10.1016/j.isprsjprs.2017.11.009.
  • Maurizio, C., and L. S. Gordon. 2002. “Control of Goal-directed and Stimulus-driven Attention in the Brain.” Nature Reviews. Neuroscience 3 (3): 201–215. doi:10.1038/nrn755.
  • Ozdarici, A., and K. Schindler. 2015. “Mapping of Agricultural Crops from Single High-resolution Multispectral Imagesdata-driven Smoothing Vs.” Parcel-based Smoothing. Remote Sensing 7 (5): 5611–5638. doi:10.3390/rs70505611.
  • Rawat, W., and Z. Wang. 2017. “Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review.” Neural Computation 29 (9): 2352–2449. doi:10.1162/neco_a_00990.
  • Reichstein M., Camps-Valls G., Stevens B., et al. 2019. “Deep Learning and Process Understanding for Data-driven Earth System Science.” Nature 566 (7743): 195–204. DOI:10.1038/s41586-019-0912-1.
  • Romero, A., C. Gatta, and G. Camps-Valls. 2016. “Unsupervised Deep Feature Extraction for Remote Sensing Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 54 (3): 1349–1362. doi:10.1109/TGRS.2015.2478379.
  • Ronneberger, O., P. Fischer, and B. T. U-Net:. 2015. “Convolutional Networks for Biomedical Image Segmentation.” Medical Image Computing and Computer-Assisted Intervention 9351: 234–241.
  • Shi H., Chen L., Bi F., et al. “Accurate Urban Area Detection in Remote Sensing Images”. IEEE Geosci. Remote Sens. Lett, 2015, 12 (9), 1948-1952.
  • Simonyan K., Zisserman A. Very Deep Convolutional Networks for Large-Scale Image Recognition. Proc. International Conference on Learning Representations (ICLR), San Diego, USA, 2015.
  • Su, J. M., L. X. Yang, and W. P. Jing. 2019. “U-Net Based Semantic Segmentation Method for High Resolution Remote Sensing Image.” Computer Engineering and Applications 55 (7): 207–213.
  • Tian Z., He T., Shen C. H.. et al. “Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation”. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Los Angeles, USA, 2019.
  • Tong X. Y., Xia G. S., Shen H. F., et al. 2020. “Land-cover Classification with High-resolution Remote Sensing Images Using Transferable Deep Models”. Remote Sensing of Environment 237: 11132. 10.1016/j.rse.2019.111322.
  • Vincent L., and Soille P.. 1991. “Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations.” IEEE Transactions on Pattern Analysis and Machine Intelligence 583–598.
  • Volpi, M., G. Camps-Valls, and D. Tuia. 2015. “Spectral Alignment of Cross-sensor Images with Automated Kernel Canonical Correlation Analysis.” ISPRS Journal of Photogrammetry & Remote Sensing 107: 50–63. doi:10.1016/j.isprsjprs.2015.02.005.
  • Wang F., Jiang M., Qian C., et al. “Residual Attention Network for Image Classification”. Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, 2017.
  • Wang H. Z., Wang Y., Zhang Q., et al. 2017. “Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images.” Remote Sensing 9 (5): 446. DOI:10.3390/rs9050446.
  • Wegner J. D., Branson S., Hall D., et al. “Cataloging Public Objects Using Aerial and Street-level images—Urban Trees”. Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, 2016, 6014–6023.
  • Weng L. G., Xu Y. M., Xia M., et al. 2020. “Water Areas Segmentation from Remote Sensing Images Using a Separable Residual SegNet Network.” ISPRS International Journal of Geo-information 9 (4): 256. DOI:10.3390/ijgi9040256.
  • Wold, S., K. Esbensen, and P. Geladi. 1987. “Principal Component Analysis.” Chemometrics and Intelligent Labora-tory Systems 2 (1–3): 37–52. doi:10.1016/0169-7439(87)80084-9.
  • Zhang F., Du B., and Zhang L.. 2016. “Scene Classification via a Gradient Boosting Random Convolutional Network Framework.” IEEE Transactions on Geoscience and Remote Sensing 54 (3): 1793.
  • Zhang J., Lin S. F., Ding L., et al. 2020. “Multi-Scale Context Aggregation for Semantic Segmentation of Remote Sensing Images.” Remote Sensing 12 (4): 701. DOI:10.3390/rs12040701.
  • Zhao, W., and S. Du. 2016. “Spectral–spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach.” IEEE Transactions on Geoscience and Remote Sensing 54 (8): 4544–4554. doi:10.1109/TGRS.2016.2543748.
  • Zhao X.,Wang H., Wu J., et al. 2020. “Remote Sensing Image Segmentation Using Geodesic-kernel Functions and Multi-feature Spaces”. Pattern Recognition 104: 107333. 10.1016/j.patcog.2020.107333.
  • Zheng, C., Y. Zhang, and L. G. Wang. 2016. “Multilayer Semantic Segmentation of Remote-sensing Imagery Using a Hybrid Object-based Markov Random Field Model.” International Journal of Remote Sensing 37 (23): 5505–5532. doi:10.1080/01431161.2016.1244364.
  • Zhong, Y. F., J. Wang, and J. Zhao. 2020. “Adaptive Conditional Random Field Classification Framework Based on Spatial Homogeneity for High-resolution Remote Sensing Imagery.” Remote Sensing Letters 11 (6): 515–524. doi:10.1080/2150704X.2020.1731768.
  • Zhu J. Z., Shi Q., Chen F. E., et al. 2016. “Research Status and Development Trends of Remote Sensing Big Data.” Journal of Image and Graphics 21 (11): 1425–1439.
  • Zhu X. X., Devis T., Mou L. C., et al. 2017. “Deep Learning in Remote Sensing.” IEEE Geoscience and Remote Sensing Magazine 5 (4): 8–36. DOI:10.1109/MGRS.2017.2762307.