1,037
Views
4
CrossRef citations to date
0
Altmetric
Research Article

Weighted split-flow network auxiliary with hierarchical multitasking for urban land use classification of high-resolution remote sensing images

, , , &
Pages 6721-6740 | Received 23 Jun 2022, Accepted 24 Oct 2022, Published online: 25 Nov 2022

References

  • Cai, S., and D. Liu. 2013. “A Comparison of Object-Based and Contextual Pixel-Based Classifications Using High and Medium Spatial Resolution Images.” Remote Sensing Letters 4 (10): 998–1007. doi:10.1080/2150704X.2013.828180.
  • Castelo-Cabay, M., J. A. Piedra-Fernandez, and R. Ayala. 2022. “Deep Learning for Land Use and Land Cover Classification from the Ecuadorian Paramo.” International Journal of Digital Earth 15 (1): 1001–1017. doi:10.1080/17538947.2022.2088872.
  • Chatfield, K., V. Lempitsky, A. Vedaldi, and A. Zisserman. 2011. “The Devil is in the Details: An Evaluation of Recent Feature Encoding Methods.” Paper presented at the 22nd British Machine Vision Conference, Univ Dundee, Dundee, SCOTLAND, August 29 September 02.
  • Chen, Z. Q., C. D. Du, L. J. Huang, D. Li, H. G. He, and Ieee. 2018. “Improving Image Classification Performance with Automatically Hierarchical Label Clustering.” Paper presented at the 24th International Conference on Pattern Recognition (ICPR), Chinese Acad Sci, Inst Automat, Beijing, PEOPLES R CHINA August 20–24.
  • Cheng, G., Z. Li, X. Yao, L. Guo, and Z. Wei. 2017. “Remote Sensing Image Scene Classification Using Bag of Convolutional Features.” IEEE Geoscience and Remote Sensing Letters 14 (10): 1735–1739. doi:10.1109/LGRS.2017.2731997.
  • Chen, K.-L., C.-H. Lee, H. Garudadri, and B. D. Rao. 2021. “ResNests and DenseNests: Block-Based DNN Models with Improved Representation Guarantees.” Advances in Neural Information Processing Systems 34: 3413–3424.
  • Chen, W., X. Li, H. He, and L. Wang. 2017a. “A Review of Fine-Scale Land Use and Land Cover Classification in Open-Pit Mining Areas by Remote Sensing Techniques.” Remote Sensing 10 (1): 15. doi:10.3390/rs10010015.
  • Chen, Y., J. Li, H. Xiao, X. Jin, S. Yan, and J. Feng. 2017b. “Dual Path Networks.” Advances in Neural Information Processing Systems 30: 4470–4478.
  • Dong, M. R., L. P. Wei, J. D. Lu, W. B. Li, S. Z. Lu, J. W. Huang, S. S. Li, F. S. Luo, and J. L. Nie. 2019. “Quantitative Analysis of LIBS Coal Heat Value Based on K-CV Parameter Optimization Support Vector Machine.” Spectroscopy and Spectral Analysis 39 (7): 2202–2209. doi:10.3964/j.issn.1000-0593(2019)07-2202-08.
  • Gao, S.-H., M.-M. Cheng, K. Zhao, X.-Y. Zhang, M.-H. Yang, and P. Torr. 2019. “Res2net: A New Multi-Scale Backbone Architecture.” IEEE Transactions on Pattern Analysis and Machine Intelligence 43 (2): 652–662. doi:10.1109/TPAMI.2019.2938758.
  • GB 50137-2011. 2011. “Code for Classification of Urban Land Use and Planning Standards of Development Land.”
  • Girma, A., A. Homaifar, M. N. Mahmoud, X. Y. Yan, M. Sarkar, and Ieee. 2021. “DA(2)-Net : Diverse & Adaptive Attention Convolutional Neural Network.” Paper presented at the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Electr Network, Melbourne, Australia, October 17–20.
  • Guo, M. H., T. X. Xu, J. J. Liu, Z. N. Liu, P. T. Jiang, T. J. Mu, S. H. Zhang, R. R. Martin, M. M. Cheng, and S. M. Hu. 2022. “Attention Mechanisms in Computer Vision: A Survey.” Computational Visual Media 8 (3): 331–368. doi:10.1007/s41095-022-0271-y.
  • Helber, P., B. Bischke, A. Dengel, and D. Borth. 2019. “Eurosat: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (7): 2217–2226. doi:10.1109/JSTARS.2019.2918242.
  • Huang, B., B. Zhao, and Y. Song. 2018. “Urban Land-Use Mapping Using a Deep Convolutional Neural Network with High Spatial Resolution Multispectral Remote Sensing Imagery.” Remote Sensing of Environment 214: 73–86. doi:10.1016/j.rse.2018.04.050.
  • Hu, J., L. Shen, S. Albanie, G. Sun, and E. H. Wu. 2020. “Squeeze-And-Excitation Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 42 (8): 2011–2023. doi:10.1109/tpami.2019.2913372.
  • Jozdani, S. E., B. Alan Johnson, and D. Chen. 2019. “Comparing Deep Neural Networks, Ensemble Classifiers, and Support Vector Machine Algorithms for Object-Based Urban Land Use/Land Cover Classification.” Remote Sensing 11 (14): 1713. doi:10.3390/rs11141713.
  • Kaiming, H., X. Zhang, S. Ren, and J. Sun. 2015. “Delving Deep into Rectifiers: Surpassing Human-Level Performance on Imagenet Classification.” Paper presented at the Proceedings of the IEEE international conference on computer vision, Santiago, Chile 13–16.
  • Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. “Imagenet Classification with Deep Convolutional Neural Networks.” Advances in Neural Information Processing Systems 60 (6): 84–90.
  • Liu, Q., R. Hang, H. Song, and Z. Li. 2017. “Learning Multiscale Deep Features for High-Resolution Satellite Image Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (1): 117–126. doi:10.1109/TGRS.2017.2743243.
  • Liu, Y., Z. Li, and X. Yang. 2018. “Application of Improved Convolution Neural Network in Remote Sensing Image Classification.” Journal of Computer Applications 38 (4): 949–954.
  • Liu, Y. J., G. F. Luo, F. Dong, and Ieee. 2019. “Convolutional Network Model Using Hierarchical Prediction and Its Application in Clothing Image Classification.” Paper presented at the 3rd International Conference on Data Science and Business Analytics (ICDSBA), Galatasaray Univ, Istanbul, TURKEY, October 11–12.
  • Liu, J., W. Yang, S. Tan, and Z. Wang. 2013. “Remote Sensing Image Classification Based on Random Projection Super-Pixel Segmentation.” Paper presented at the MIPPR 2013: Remote Sensing Image Processing, Geographic Information Systems, and Other Applications, Wuhan, China, 8921. doi:10.1117/12.2032363.
  • Macarringue, L. S., D. Luis Bolfe, and P. Roberto Mendes Pereira. 2022. “Developments in Land Use and Land Cover Classification Techniques in Remote Sensing: A Review.” Journal of Geographic Information System 14 (1): 28. doi:10.4236/jgis.2022.141001.
  • Malinverni, E. S., A. N. Tassetti, A. Mancini, P. Zingaretti, E. Frontoni, and A. Bernardini. 2011. “Hybrid Object-Based Approach for Land Use/Land Cover Mapping Using High Spatial Resolution Imagery.” International Journal of Geographical Information Science 25 (6): 1025–1043. doi:10.1080/13658816.2011.566569.
  • Mohammady, M., H. R. Moradi, H. Zeinivand, and A. Temme. 2015. “A Comparison of Supervised, Unsupervised and Synthetic Land Use Classification Methods in the North of Iran.” International Journal of Environmental Science and Technology 12 (5): 1515–1526. doi:10.1007/s13762-014-0728-3.
  • Muavhi, N. 2020. “Evaluation of Effectiveness of Supervised Classification Algorithms in Land Cover Classification Using ASTER Images-A Case Study from the Mankweng (Turfloop) Area and Its Environs, Limpopo Province, South Africa.” South African Journal of Geomatics 9 (1): 61–74. doi:10.4314/sajg.v9i1.5.
  • Neyns, R., and F. Canters. 2022. “Mapping of Urban Vegetation with High-Resolution Remote Sensing: A Review.” Remote Sensing 14 (4). doi:10.3390/rs14041031.
  • Pan, X., and J. Zhao. 2018. “High-Resolution Remote Sensing Image Classification Method Based on Convolutional Neural Network and Restricted Conditional Random Field.” Remote Sensing 10 (6). doi:10.3390/rs10060920.
  • Radosavovic, I., R. Prateek Kosaraju, R. Girshick, K. He, and P. Dollár. 2020. “Designing Network Design Spaces.” Paper presented at the Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Seattle, USA, 10425–10433. doi:10.1109/CVPR42600.2020.01044.
  • Rajesh, S., T. G. Nisia, S. Arivazhagan, and R. Abisekaraj. 2020. “Land Cover/Land Use Mapping of LISS IV Imagery Using Object-Based Convolutional Neural Network with Deep Features.” Journal of the Indian Society of Remote Sensing 48 (1): 145–154. doi:10.1007/s12524-019-01064-9.
  • Ribeiro, A., and C. C. Fonte. 2015. “A Methodology for Assessing Openstreetmap Degree of Coverage for Purposes of Land Cover Mapping.” Paper presented at the ISPRS Geospatial Week,La Grande Motte, France, September 28 - October 03, 2: 297–303.
  • Sehra, S. S., J. Singh, and H. S. Rai. 2017. “Using Latent Semantic Analysis to Identify Research Trends in OpenStreetmap.” ISPRS International Journal of Geo-Information 6 (7). doi:10.3390/ijgi6070195.
  • Shackelford, A. K., and C. H. Davis. 2003. “A Combined Fuzzy Pixel-Based and Object-Based Approach for Classification of High-Resolution Multispectral Data Over Urban Areas.” IEEE Transactions on Geoscience and Remote Sensing 41 (10): 2354–2363. doi:10.1109/tgrs.2003.815972.
  • Shi, J., Z. Li, S. H. Ying, C. F. Wang, Q. P. Liu, Q. Zhang, and P. K. Yan. 2019. “MR Image Super-Resolution via Wide Residual Networks with Fixed Skip Connection.” IEEE Journal of Biomedical and Health Informatics 23 (3): 1129–1140. doi:10.1109/jbhi.2018.2843819.
  • Shim, H., S. Luca, D. Lowet, B. Vanrumste, and Acm. 2020. “Data Augmentation and Semi-Supervised Learning for Deep Neural Networks-Based Text Classifier.” Paper presented at the 35th Annual ACM Symposium on Applied Computing (SAC), Czech Tech Univ, ELECTR NETWORK, Brno, Czech Republic, March 1119–1126.
  • Taleai, M., A. Sharifi, R. Sliuzas, and M. Mesgari. 2007. “Evaluating the Compatibility of Multi-Functional and Intensive Urban Land Uses.” International Journal of Applied Earth Observation and Geoinformation 9 (4): 375–391. doi:10.1016/j.jag.2006.12.002.
  • Ting, P. J., S. J. Ruan, and L. P. H. Li. 2021. “Environmental Noise Classification with Inception-Dense Blocks for Hearing Aids.” Sensors 21 (16): 5406. doi:10.3390/s21165406.
  • Vandenhende, S., S. Georgoulis, W. Van Gansbeke, M. Proesmans, D. X. Dai, and L. Van Gool. 2022. “Multi-Task Learning for Dense Prediction Tasks: A Survey.” IEEE Transactions on Pattern Analysis and Machine Intelligence 44 (7): 3614–3633. doi:10.1109/tpami.2021.3054719.
  • Wang, C.-Y., H.-Y. Mark Liao, W. Yueh-Hua, P.-Y. Chen, J.-W. Hsieh, and I.-H. Yeh. 2020. “CSPNet: A New Backbone That Can Enhance Learning Capability of CNN.” Paper presented at the Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, Seattle, USA, 390–391.
  • Woo, S. H., J. Park, J. Y. Lee, and I. S. Kweon. 2018. “CBAM: Convolutional Block Attention Module.” Paper presented at the 15th European Conference on Computer Vision (ECCV), Munich, GERMANY, September 08–14.
  • Wu, Q., R. F. Zhong, W. J. Zhao, H. Fu, and K. Song. 2017. “A Comparison of Pixel-Based Decision Tree and Object-Based Support Vector Machine Methods for Land-Cover Classification Based on Aerial Images and Airborne Lidar Data.” International Journal of Remote Sensing 38 (23): 7176–7195. doi:10.1080/01431161.2017.1371864.
  • Xiao, Z. F., Q. Liu, G. F. Tang, and X. F. Zhai. 2015. “Elliptic Fourier Transformation-Based Histograms of Oriented Gradients for Rotationally Invariant Object Detection in Remote-Sensing Images.” International Journal of Remote Sensing 36 (2): 618–644. doi:10.1080/01431161.2014.999881.
  • Xie, S., R. Girshick, P. Dollár, Z. Tu, and K. He. 2017. “Aggregated Residual Transformations for Deep Neural Networks.” Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, USA, 1492–1500.
  • Yang, C., F. Rottensteiner, and C. Heipke. 2018. “Classification of Land Cover and Land Use Based on Convolutional Neural Networks.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences 4 (3): 251–258. doi:10.5194/isprs-annals-IV-3-251-2018.
  • Yang, C., F. Rottensteiner, and C. Heipke. 2019. “Towards Better Classification of Land Cover and Land Use Based on Convolutional Neural Networks.” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 42-2/W13 42 (2/W13): 139–146. doi:10.5194/isprs-archives-XLII-2-W13-139-2019.
  • Yang, C., F. Rottensteiner, and C. Heipke. 2021. “A Hierarchical Deep Learning Framework for the Consistent Classification of Land Use Objects in Geospatial Databases.” ISPRS Journal of Photogrammetry and Remote Sensing 177: 38–56. doi:10.1016/j.isprsjprs.2021.04.022.
  • Yu, T., X. Li, Y. F. Cai, M. M. Sun, P. Li, and I. Comp Soc. 2022. “S-2-MLP: Spatial-Shift MLP Architecture for Vision.” Paper presented at the 22nd IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, USA, January 3615–3624.
  • Zhang, X., Z. Gao, L. Jiao, and H. Zhou. 2017. “Multifeature Hyperspectral Image Classification with Local and Nonlocal Spatial Information via Markov Random Field in Semantic Space.” IEEE Transactions on Geoscience and Remote Sensing 56 (3): 1409–1424. doi:10.1109/TGRS.2017.2762593.
  • Zhang, P. B., Y. H. Ke, Z. X. Zhang, M. L. Wang, P. Li, and S. Y. Zhang. 2018a. “Urban Land Use and Land Cover Classification Using Novel Deep Learning Models Based on High Spatial Resolution Satellite Imagery.” Sensors 18 (11). doi:10.3390/s18113717.
  • Zhang, J., T. Li, X. Lu, and Z. Cheng. 2016. “Semantic Classification of High-Resolution Remote-Sensing Images Based on Mid-Level Features.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 9 (6): 2343–2353. doi:10.1109/JSTARS.2016.2536943.
  • Zhang, C., J. B. Lu, L. X. Yang, and C. G. Li. 2021. “CAAGP: Rethinking Channel Attention with Adaptive Global Pooling for Liver Tumor Segmentation.” Computers in Biology and Medicine 138. doi:10.1016/j.compbiomed.2021.104875.
  • Zhang, C., I. Sargent, X. Pan, H. P. Li, A. Gardiner, J. Hare, and P. M. Atitinson. 2018b. “An Object-Based Convolutional Neural Network (OCNN) for Urban Land Use Classification.” Remote Sensing of Environment 216: 57–70. doi:10.1016/j.rse.2018.06.034.
  • Zhu, Q., X. Sun, Y. Zhong, and L. Zhang. 2019. “High-Resolution Remote Sensing Image Scene Understanding: A Review.” Paper presented at the IEEE International Geoscience and Remote Sensing Symposium(IGARSS), Yokohama, Japan.
  • Zou, X., Z. Wang, Q. Li, and W. Sheng. 2019. “Integration of Residual Network and Convolutional Neural Network Along with Various Activation Functions and Global Pooling for Time Series Classification.” Neurocomputing 367: 39–45. doi:10.1016/j.neucom.2019.08.023.