Advanced search
Publication Cover
Geo-spatial Information Science Volume 25, 2022 - Issue 2
Submit an article Journal homepage
6,417
Views
47
CrossRef citations to date
0
Altmetric
Research Article

Land cover classification from remote sensing images based on multi-scale fully convolutional network

Rui Lia School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, ChinaORCID Iconhttps://orcid.org/0000-0001-7858-3160View further author information
ORCID Icon,
Shunyi Zhenga School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, ChinaORCID Iconhttps://orcid.org/0000-0001-5594-3493View further author information
ORCID Icon,
Chenxi Duanb Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente, Enschede, The Netherlands;c The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, ChinaCorrespondence[email protected]
ORCID Iconhttps://orcid.org/0000-0003-0056-3295View further author information
ORCID Icon,
Libo Wanga School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, ChinaORCID Iconhttps://orcid.org/0000-0001-8096-6531View further author information
ORCID Icon &
Ce Zhangd Lancaster Environment Centre, Lancaster University, Lancaster, UK;e UK Centre for Ecology & Hydrology, Lancaster, UKORCID Iconhttps://orcid.org/0000-0001-5100-3584View further author information
ORCID Icon
Pages 278-294 | Received 19 Oct 2020, Accepted 07 Dec 2021, Published online: 07 Jan 2022

References

  • Badrinarayanan, V., A. Kendall, and R. Cipolla. 2017. “SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (12): 2481–2495. doi:10.1109/TPAMI.2016.2644615.
  • Basso, B., and L. Liu. 2019. “Seasonal Crop Yield Forecast: Methods, Applications, and Accuracies.” In Advances in Agronomy, 201–255. Cambridge, MA: Elsevier.
  • Chen, L.-C., Y. Zhu, G. Papandreou, F. Schroff, and H. Adam. 2018. “Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation.” 15th European Conference on Computer Vision (ECCV), Munich, Germany, September 8–14.
  • Chen, L., J. Liu, H. Li, W. Zhan, B. Zhou, and Q. Li. 2020. “Dual Context Prior and Refined Prediction for Semantic Segmentation.” Geo-Spatial Information Science 1–13. doi:10.1080/10095020.2020.1785957.
  • Dela Torre, D.M.G., J. Gao, and C. Macinnis-Ng. 2021. “Remote Sensing-based Estimation of Rice Yields Using Various Models: A Critical Review.” Geo-spatial Information Science 1–24. doi:10.1080/10095020.2021.1936656.
  • Du, Q., and I.C. Chein. 2001. “A Linear Constrained Distance-based Discriminant Analysis for Hyperspectral Image Classification.” Pattern Recognition 34 (2): 361–373. doi:10.1016/S0031-3203(99)00215-0.
  • Duan, C., J. Pan, and R. Li. 2020. “Thick Cloud Removal of Remote Sensing Images Using Temporal Smoothness and Sparsity Regularized Tensor Optimization.” Remote Sensing 12 (20): 3446(3426). doi:10.3390/rs12203446.
  • Gao, B.-C. 1996. “NDWI—A Normalized Difference Water Index for Remote Sensing of Vegetation Liquid Water from Space.” Remote Sensing of Environment 58 (3): 257–266. doi:10.1016/S0034-4257(96)00067-3.
  • Georganos, S., T. Grippa, S. Vanhuysse, M. Lennert, M. Shimoni, and E. Wolff. 2018. “Very High Resolution Object-Based Land Use-Land Cover Urban Classification Using Extreme Gradient Boosting.” IEEE Geoscience and Remote Sensing Letters 15 (4): 607–611. doi:10.1109/LGRS.2018.2803259.
  • Gong, Z., H. Lin, D. Zhang, Z. Luo, J. Zelek, Y. Chen, A. Nurunnabi, C. Wang, and J. Li. 2020. “A Frustum-based Probabilistic Framework for 3D Object Detection by Fusion of LiDAR and Camera Data.” ISPRS Journal of Photogrammetry and Remote Sensing 159: 90–100. doi:10.1016/j.isprsjprs.2019.10.015.
  • Hamraz, H., N.B. Jacobs, M.A. Contreras, and C.H. Clark. 2019. “Deep Learning for Conifer/deciduous Classification of Airborne LiDAR 3D Point Clouds Representing Individual Trees.” ISPRS Journal of Photogrammetry and Remote Sensing 158: 219–230. doi:10.1016/j.isprsjprs.2019.10.011.
  • Heipke, C., and F. Rottensteiner. 2020. “Deep Learning for Geometric and Semantic Tasks in Photogrammetry and Remote Sensing.” Geo-spatial Information Science 23 (1): 10–19. doi:10.1080/10095020.2020.1718003.
  • Huete, A. 1988. “A Soil-adjusted Vegetation Index (SAVI). Remote Sensing of Environment.” Remote Sensing of Environment 25: 295–309. doi:10.1016/0034-4257(88)90106-X.
  • Interdonato, R., D. Ienco, R. Gaetano, and K. Ose. 2019. “DuPLO: A DUal View Point Deep Learning Architecture for Time Series classificatiOn.” ISPRS Journal of Photogrammetry and Remote Sensing 149: 91–104. doi:10.1016/j.isprsjprs.2019.01.011.
  • Ioffe, S., and C. Szegedy. 2015. “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift.” arXiv Preprint arXiv:1502.03167.
  • Jegou, S., M. Drozdzal, D. Vazquez, A. Romero, and Y. Bengio. 2017. “The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation.” 2017 IEEE Conference on Computer Vision and Pattern Recognition: Workshops (CVPRW), Loa Alamitos, CA, July 21–26.
  • Ji, S., C. Zhang, A. Xu, Y. Shi, and Y. Duan. 2018. “3D Convolutional Neural Networks for Crop Classification with Multi-temporal Remote Sensing Images.” Remote Sensing 10 (1): 75. doi:10.3390/rs10010075.
  • Ji, S., Z. Zhang, C. Zhang, S. Wei, M. Lu, and Y. Duan. 2020. “Learning Discriminative Spatiotemporal Features for Precise Crop Classification from Multi-temporal Satellite Images.” International Journal of Remote Sensing 41 (8): 3162–3174. doi:10.1080/01431161.2019.1699973.
  • Li, H., C. Wang, C. Zhong, A. Su, C. Xiong, J. Wang, and J. Liu. 2017. “Mapping Urban Bare Land Automatically from Landsat Imagery with a Simple Index.” Remote Sensing 9 (3): 249. doi:10.3390/rs9030249.
  • Li, R., C. Duan, S. Zheng, C. Zhang, and P.M. Atkinson. 2021a. “MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images.” IEEE Geoscience and Remote Sensing Letters. doi:10.1109/LGRS.2021.3052886.
  • Li, R., S. Zheng, C. Duan, J. Su, and C. Zhang. 2021b. “Multistage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images.” IEEE Geoscience and Remote Sensing Letters. doi:10.1109/LGRS.2021.3063381.
  • Li, R., S. Zheng, C. Duan, Y. Yang, and X. Wang. 2020. “Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network.” Remote Sensing 12 (3): 582. doi:10.3390/rs12030582.
  • Li, R., S. Zheng, C. Zhang, C. Duan, J. Su, L. Wang, and P.M. Atkinson. 2021d. “Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing. doi:10.1109/TGRS.2021.3093977.
  • Li, R., S. Zheng, C. Zhang, C. Duan, L. Wang, and P.M. Atkinson. 2021c. “ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remotely Sensed Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 181: 84–98. doi:10.1016/j.isprsjprs.2021.09.005.
  • Li, Z., L. Jiao, B. Zhang, G. Xu, and J. Liu. 2021e. “Understanding the Pattern and Mechanism of Spatial Concentration of Urban Land Use, Population and Economic Activities: A Case Study in Wuhan, China.” Geo-spatial Information Science 1–17. doi:10.1080/10095020.2021.1978276.
  • Liu, Q., M. Kampffmeyer, R. Jenssen, and A.-B. Salberg. 2020. “Dense Dilated Convolutions’ Merging Network for Land Cover Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (9): 6309–6320. doi:10.1109/TGRS.2020.2976658.
  • Liu, W., A. Rabinovich, and A.C. Berg. 2015. “Parsenet: Looking Wider to See Better.” arXiv Preprint arXiv:1506.04579.
  • Matikainen, L., K. Karila, J. Hyyppa, P. Litkey, E. Puttonen, and E. Ahokas. 2017. “Object-based Analysis of Multispectral Airborne Laser Scanner Data for Land Cover Classification and Map Updating.” ISPRS Journal of Photogrammetry and Remote Sensing 128: 298–313. doi:10.1016/j.isprsjprs.2017.04.005.
  • Maulik, U., and I. Saha. 2010. “Automatic Fuzzy Clustering Using Modified Differential Evolution for Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 48 (9): 3503–3510. doi:10.1109/TGRS.2010.2047020.
  • Mohammadimanesh, F., B. Salehi, M. Mahdianpari, E. Gill, and M. Molinier. 2019. “A New Fully Convolutional Neural Network for Semantic Segmentation of Polarimetric SAR Imagery in Complex Land Cover Ecosystem.” ISPRS Journal of Photogrammetry and Remote Sensing 151: 223–236. doi:10.1016/j.isprsjprs.2019.03.015.
  • Oktay, O., J. Schlemper, L.L. Folgoc, M. Lee, M. Heinrich, K. Misawa, K. Mori, S. McDonagh, N.Y. Hammerla, and B. Kainz. 2018. “Attention U-net: Learning Where to Look for the Pancreas.” arXiv Preprint arXiv:1804.03999.
  • Pelletier, C., G.I. Webb, and F. Petitjean. 2019. “Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series.” Remote Sensing 11 (5): 523. doi:10.3390/rs11050523.
  • Prins, A.J., and A. Van Niekerk. 2020. “Crop Type Mapping Using LiDAR, Sentinel-2 and Aerial Imagery with Machine Learning Algorithms.” Geo-Spatial Information Science 1–13. doi:10.1080/10095020.2020.1782776.
  • Qi, Y., S. Chodron Drolma, X. Zhang, J. Liang, H. Jiang, J. Xu, and T. Ni. 2020. “An Investigation of the Visual Features of Urban Street Vitality Using a Convolutional Neural Network.” Geo-spatial Information Science 23 (4): 341–351. doi:10.1080/10095020.2020.1847002.
  • Ramli, M.F., and K.N. Tahar. 2020. “Homogeneous Tree Height Derivation from Tree Crown Delineation Using Seeded Region Growing (SRG) Segmentation.” Geo-spatial Information Science 23 (3): 195–208. doi:10.1080/10095020.2020.1805366.
  • Ronneberger, O., P. Fischer, and T. Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” Medical Image Computing and Computer-Assisted Intervention - MICCAI 2015. 18th International Conference, Munich, Germany, October 5–9.
  • Rußwurm, M., and M. Körner. 2018. “Multi-temporal Land Cover Classification with Sequential Recurrent Encoders.” ISPRS International Journal of Geo-Information 7 (4): 129. doi:10.3390/ijgi7040129.
  • Rustowicz, R., R. Cheong, L. Wang, S. Ermon, M. Burke, and D. Lobell. 2019. “Semantic Segmentation of Crop Type in Africa: A Novel Dataset and Analysis of Deep Learning Methods.” 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2019, Long Beach, CA, June 16–20.
  • Rutherford, G., A. Guisan, and N. Zimmermann. 2007. “Evaluating Sampling Strategies and Logistic Regression Methods for Modelling Complex Land Cover Changes.” Journal of Applied Ecology 44 (2): 414–424. doi:10.1111/j.1365-2664.2007.01281.x.
  • Sainte Fare Garnot, V., L. Landrieu, S. Giordano, and N. Chehata. 2020. “Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention.” 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, June 13–19.
  • Sang, Q., Y. Zhuang, S. Dong, G. Wang, and H. Chen. 2019. “FRF-Net: Land Cover Classification from Large-scale VHR Optical Remote Sensing Images.” IEEE Geoscience and Remote Sensing Letters 17 (6): 1057–1061. doi:10.1109/LGRS.2019.2938555.
  • Shao, Z., W. Wu, and D. Li. 2021. “Spatio-temporal-spectral Observation Model for Urban Remote Sensing.” Geo-spatial Information Science 1–15. doi:10.1080/10095020.2020.1864232.
  • Shao, Z., W. Zhou, X. Deng, M. Zhang, and Q. Cheng. 2020. “Multilabel Remote Sensing Image Retrieval Based on Fully Convolutional Network.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13: 318–328. doi:10.1109/JSTARS.2019.2961634.
  • Tatsumi, K., Y. Yamashiki, M.A.C. Torres, and C.L.R. Taipe. 2015. “Crop Classification of Upland Fields Using Random Forest of Time-series Landsat 7 ETM+ Data.” Computers and Electronics in Agriculture 115: 171–179. doi:10.1016/j.compag.2015.05.001.
  • Tong, X.-Y., G.-S. Xia, Q. Lu, H. Shen, S. Li, S. You, and L. Zhang. 2020. “Land-cover Classification with High-resolution Remote Sensing Images Using Transferable Deep Models.” Remote Sensing of Environment 237: 111322. doi:10.1016/j.rse.2019.111322.
  • Tucker, C.J. 1979. “Red and Photographic Infrared Linear Combinations for Monitoring Vegetation.” Remote Sensing of Environment 8 (2): 127–150. doi:10.1016/0034-4257(79)90013-0.
  • Wang, G., J. Li, W. Sun, B. Xue, A. Yinglan, and T. Liu. 2019a. “Non-point Source Pollution Risks in a Drinking Water Protection Zone Based on Remote Sensing Data Embedded within a Nutrient Budget Model.” Water Research 157: 238–246. doi:10.1016/j.watres.2019.03.070.
  • Wang, L., R. Li, C. Duan, C. Zhang, X. Meng, and S. Fang. 2021a. “A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images.” arXiv Preprint arXiv:2104.12137.
  • Wang, L., R. Li, D. Wang, C. Duan, T. Wang, and X. Meng. 2021b. “Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images.” Remote Sensing 13 (16). doi:10.3390/rs13163065.
  • Wang, P., L. Zhang, G. Zhang, H. Bi, M. Dalla Mura, and J. Chanussot. 2019b. “Superresolution Land Cover Mapping Based on Pixel-, Subpixel-, and Superpixel-scale Spatial Dependence with Pansharpening Technique.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (10): 4082–4098. doi:10.1109/JSTARS.2019.2939670.
  • Wu, C.-Y., C. Feichtenhofer, H. Fan, K. He, P. Krahenbuhl, and R. Girshick. 2019. “Long-Term Feature Banks for Detailed Video Understanding.” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, June 15–20.
  • Wu, H., Z. Gui, and Z. Yang. 2020. “Geospatial Big Data for Urban Planning and Urban Management.” Geo-Spatial Information Science 23 (4): 273–274. doi:10.1080/10095020.2020.1854981.
  • Xu, H. 2006. “Modification of Normalised Difference Water Index (NDWI) to Enhance Open Water Features in Remotely Sensed Imagery.” International Journal of Remote Sensing 27 (14): 3025–3033. doi:10.1080/01431160600589179.
  • Yang, C., Q. Zhan, S. Gao, and H. Liu. 2020. “Characterizing the Spatial and Temporal Variation of the Land Surface Temperature Hotspots in Wuhan from a Local Scale.” Geo-spatial Information Science 23 (4): 327–340. doi:10.1080/10095020.2020.1834882.
  • Yu, C., J. Wang, C. Peng, C. Gao, G. Yu, and N. Sang. 2018. “BiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation.” Computer Vision. 15th European Conference (ECCV 2018), Munich, Germany, September 8–14.
  • Zafari, A., R. Zurita-Milla, and E. Izquierdo-Verdiguier. 2020. “Land Cover Classification Using Extremely Randomized Trees: A Kernel Perspective.” IEEE Geoscience and Remote Sensing Letters 17 (10): 1702–1706. doi:10.1109/LGRS.2019.2953778.
  • Zhang, C., X. Pan, H. Li, A. Gardiner, I. Sargent, J. Hare, and P.M. Atkinson. 2018. “A Hybrid MLP-CNN Classifier for Very Fine Resolution Remotely Sensed Image Classification.” ISPRS Journal of Photogrammetry and Remote Sensing 140: 133–144. doi:10.1016/j.isprsjprs.2017.07.014.
  • Zhang, C., Y. Han, F. Li, S. Gao, D. Song, H. Zhao, K. Fan, and Y.N. Zhang. 2019a. “A New CNN-Bayesian Model for Extracting Improved Winter Wheat Spatial Distribution from GF-2 Imagery.” Remote Sensing 11 (6): 619. doi:10.3390/rs11060619.
  • Zhang, J., L. Feng, and F. Yao. 2014. “Improved Maize Cultivated Area Estimation over a Large Scale Combining MODIS–EVI Time Series Data and Crop Phenological Information.” ISPRS Journal of Photogrammetry and Remote Sensing 94: 102–113. doi:10.1016/j.isprsjprs.2014.04.023.
  • Zhang, Z., Y. Liu, T. Liu, Z. Lin, and S. Wang. 2019b. “DAGN: A Real-time UAV Remote Sensing Image Vehicle Detection Framework.” IEEE Geoscience and Remote Sensing Letters 17 (11): 1884–1888. doi:10.1109/LGRS.2019.2956513.
  • Zhao, H., and X. Chen. 2005. “Use of Normalized Difference Bareness Index in Quickly Mapping Bare Areas from TM/ETM+.” 2005 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2005, Seoul, Korea, July 25–29.
  • Zhong, L., L. Hu, and H. Zhou. 2019. “Deep Learning Based Multi-temporal Crop Classification.” Remote Sensing of Environment 221: 430–443. doi:10.1016/j.rse.2018.11.032.
  • Zhong, Y., A. Ma, Y. Soon Ong, Z. Zhu, and L. Zhang. 2018. “Computational Intelligence in Optical Remote Sensing Image Processing.” Applied Soft Computing 64: 75–93. doi:10.1016/j.asoc.2017.11.045.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.