134
Views
0
CrossRef citations to date
0
Altmetric
Research article

A lightweight convolution neural network based on joint features for Remote Sensing scene image classification

, , &
Pages 6615-6641 | Received 15 Feb 2023, Accepted 08 Oct 2023, Published online: 09 Nov 2023

References

  • Cao, Y., J. Xu, S. Lin, F. Wei, and H. Hu. 2019. “GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond.” 2019 IEEE/cvf International Conference On Computer Vision Workshops (iccvw), 1971–1980. https://doi.org/10.1109/ICCVW.2019.00246.
  • Cheng, G., J. Han, and X. Lu. 2017. “Remote Sensing Image Scene Classification: Benchmark and State of the Art.” Processing IEEE 105 (10): 1865–1883. https://doi.org/10.1109/JPROC.2017.2675998.
  • Cheng, G., Z. Li, J. Han, X. Yao, and L. Guo. 2018. “Exploring Hierarchical Convolutional Features for Hyperspectral Image Classifification.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 56 (11): 6712–6722. https://doi.org/10.1109/TGRS.2018.2841823.
  • Cheng, G., C. Yang, X. Yao, L. Guo, and J. Han. 2018. “When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 56 (5): 2811–2821. https://doi.org/10.1109/TGRS.2017.2783902.
  • Chen, L. C., G. Papandreou, F. Schroff, and H. Adam. 2017. “Rethinking Atrous Convolution for Semantic Image Segmentation.” arXiv: 1706,05587v3. https://doi.org/10.48550/arXiv.1706.05587.
  • Fu, J., J. Liu, H. Tian, Y. Li, Y. Bao, Z. Fang, and H. Lu. 2019. “Dual Attention Network for Scene Segmentation.” arXiv: 1809,02983v4. https://doi.org/10.48550/arXiv.1809.02983.
  • Han, J., D. Zhang, G. Cheng, L. Guo, and J. Ren. 2015. “Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 53 (6): 3325–3337. https://doi.org/10.1109/TGRS.2014.2374218.
  • He, N., L. Fang, S. Li, J. Plaza, and A. Plaza. 2020. “Skip-Connected Covariance Network for Remote Sensing Scene Classifification.” IEEE Transactions on Neural Networks and Learning Systems 31 (5): 1461–1474. https://doi.org/10.1109/TNNLS.2019.2920374.
  • He, K., X. Zhang, S. Ren, and J. Sun 2016 “Deep Residual Learning for Image Recognition.” Proceedings of the IEEE conference on computer vision and pattern Recognition (CVPR), SC USA, 770–778.
  • Howard, A. G., M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam. 2017. “MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications.” arXiv 1704.04861. [Online].https://arxiv.org/abs/1704.04861.
  • Hua, Y., L. Mou, and X. X. Zhu. 2019. “Recurrently Exploring Class-Wise Attention in a Hybrid Convolutional and Bidirectional LSTM Network for Multi-Label Aerial Image Classification.” ISPRS Journal of Photogrammetry and Remote Sensing 149:188–199. https://doi.org/10.1016/j.isprsjprs.2019.01.015.
  • Hua, Y., L. Mou, and X. X. Zhu. 2020. “Relation Network for Multilabel Aerial Image Classification.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 58 (7): 4558–4572. https://doi.org/10.1109/TGRS.2019.2963364.
  • Jing, W., Q. Ren, J. Zhou, and H. A. Song. 2020. “AutoRsisc: Automatic Design of Neural Architecture for Remote Sensing Image Scene Classification.” Pattern Recognition Letters 140:186–192. https://doi.org/10.1016/j.patrec.2020.09.034.
  • Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2017. “ImageNet Classification with Deep Convolutional Neural Networks.” Communications of the ACM 60 (6): 84–90. https://doi.org/10.1145/3065386.
  • Liang, L., W. Zhao, X. Hao, Y. Yang, K. Yang, L. Liang, and Q. Yang. 2020. “Image Registration Using Two-Layer Cascade Reciprocal Pipeline and Context-Aware Dissimilarity Measure.” Neurocomputing 371:1–14. https://doi.org/10.1016/j.neucom.2019.06.101.
  • Li, J., D. Lin, Y. Wang, G. Xu, Y. Zhang, C. Ding, and Y. Zhou. 2020. “Deep Discriminative Representation Learning with Attention Map for Scene Classifification.” Remote Sensing of Environment 12:1366. https://doi.org/10.3390/rs12091366.
  • Lin, T. Y., P. Dollar, R. Grishick, K. He, B. Hariharan, and S. Belongie. 2017. “Feature Pyramid Networks for Object Detection.” arXiv: 1612,03144v2. https://doi.org/10.48550/arXiv.1612.03144.
  • Li, B., W. Su, H. Wu, R. Li, W. Zhang, W. Qin, and S. Zhang. 2019. “Aggregated Deep Fisher Feature for VHR Remote Sensing Scene Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (9): 3508–3523. https://doi.org/10.1109/JSTARS.2019.2934165.
  • Liu, W., D. Anguelov, D. Erhan, C. Szegedy, S. Reed, Y. C. Fu, and A. C. Berg. 2016. “SSD: Single Shot MultiBox Detector.” arXiv 1512.02325v5. https://doi.org/10.1007/978-3-319-46448-0_2.
  • Liu, J. J., Q. Hou, M. M. Cheng, J. Feng, and J. Jiang 2019. “A Simple Pooling-Based Design for Real-Time Salient Object Detection.” Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA, 3917–3926.
  • Liu, B. D., J. Meng, W. Y. Xie, S. Shao, Y. Li, and Y. Wang. 2019. “Weighted Spatial Pyramid Matching Collaborative Representation for Remote-Sensing-Image Scene Classification.” Remote Sensing of Environment 11 (5): 518. Art. no. https://doi.org/10.3390/rs11050518.
  • Liu, W., A. Rabinovich, and A. C. Berg. 2015. “ParseNet: Looking Wider to See Better.” arXiv: 1506,04579v2. https://doi.org/10.48550/arXiv.1506.04579.
  • Liu, Y., Y. Zhong, F. Fei, Q. Zhu, and Q. Qin. 2018. “Scene Classification Based on a Deep Random-Scale Stretched Convolutional Neural Network.” Remote Sensing of Environment 10 (3): 444. Art. no. https://doi.org/10.3390/rs10030444.
  • Liu, Y., Y. Zhong, and Q. Qin. 2018. “Scene Classification Based on Multiscale Convolutional Neural Network.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 56 (12): 7109–7121. https://doi.org/10.1109/TGRS.2018.2848473.
  • Liu, X., Y. Zhou, J. Zhao, R. Yao, B. Liu, and Y. Zheng. 2019. “Siamese Convolutional Neural Networks for Remote Sensing Scene Classification.” IEEE Geoscience and Remote Sensing Letters 16 (8): 1200–1204. https://doi.org/10.1109/LGRS.2019.2894399.
  • Li, W., Z. Wang, Y. Wang, J. Wu, J. Wang, Y. Jia, and G. Gui. 2020. “Classification of High-Spatial-Resolution Remote Sensing Scenes Method Using Transfer Learning and Deep Convolutional Neural Network.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13:1986–1995. https://doi.org/10.1109/JSTARS.2020.2988477.
  • Lu, X., W. Ji, X. Li, and X. Zheng. 2019. “Bidirectional Adaptive Feature Fusion for Remote Sensing Scene Classification.” Neurocomputing 328:135–146. https://doi.org/10.1016/j.neucom.2018.03.076.
  • Lu, X., H. Sun, and X. Zheng. 2019. “A Feature Aggregation Convolutional Neural Network for Remote Sensing Scene Classifification.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 57 (10): 7894–7906. https://doi.org/10.1109/TGRS.2019.2917161.
  • Maaten, L. V. D., and G. Hinton. 2008. “Visualizing Data using t-SNE.” Journal of Machine Learning Research 9:2579–2605. https://doi.org/10.48550/arXiv.2108.01301.
  • Mahanand, S., M. D. Behera, P. S. Roy, P. Kumar, S. K. Barik, and P. K. Srivatava. 2021. “Satellite Based Fraction of Absorbed Photosynthetically Active Radiation is Congruent with Plant Diversity in India.” Remote Sensing 13 (159): 1–18. https://doi.org/10.3390/rs13020159.
  • Najibi, M., P. Samangouei, R. Chellappa, and L. Davis. 2017. “SSH: Single Stage Headless Face Detector.” arXiv: 1708,03979. https://doi.org/10.48550/arXiv.1708.03979.
  • Selvaraju, R. R., M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra 2017. “Grad-Cam: Visual Explanations from Deep Networks via Gradient-Based Localization.” Proceedings of the IEEE International Conference on Computer Vision(ICCV), Venice, Italy, 618–626.
  • Shi, C., T. Wang, and L. Wang. 2020. “Branch Feature Fusion Convolution Network for Remote Sensing Scene Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13:5194–5210. https://doi.org/10.1109/JSTARS.2020.3018307.
  • Shi, C., X. Zhao, and L. Wang. 2021. “A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification.” Remote Sensing of Environment 13 (10): 1950. https://doi.org/10.3390/rs13101950.
  • Simonyan, K., and A. Zisserman. 2015. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” arXiv: 1409,1556. [Online] https://arxiv.org/abs/1409.1556.
  • Sun, H., S. Li, X. Zheng, and X. Lu. 2020. “Remote Sensing Scene Classification by Gated Bidirectional Network.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 58 (1): 82–96. https://doi.org/10.1109/TGRS.2019.2931801.
  • Szegedy, C., W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. “Going Deeper with Convolutions.” arXiv: 1409,4842. https://doi.org/10.48550/arXiv.1409.4842.
  • Tan, Q., Y. Liu, X. Chen, and G. Yu. 2017. “Multi-Label Classification Based on Low Rank Representation for Image Annotation.” Remote Sensing 9 (2): 109. https://doi.org/10.3390/rs9020109.
  • Tasar, O., Y. Tarabalka, and P. Alliez. 2019. “Incremental Learning for Semantic Segmentation of Large-Scale Remote Sensing Data.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (9): 3524–3537. https://doi.org/10.1109/JSTARS.2019.2925416.
  • Wang, P., P. Chen, Y. Yuan, D. Liu, Z. Huang, X. Hou, and G. Cottrell 2018. “Understanding Convolution for Semantic Segmentation. In 2018 IEEE winter conference on applications of computer vision (WACV), Lake Tahoe, NV, USA, 1451–1460.
  • Wang, X., S. Wang, C. Ning, and H. Zhou. 2021. “Enhanced Feature Pyramid Network with Deep Semantic Embedding for Remote Sensing Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 59 (9): 7918–7932. https://doi.org/10.1109/TGRS.2020.3044655.
  • Wang, X., X. Xiong, and C. Ning. 2019. “Multi-Label Remote Sensing Scene Classification Using Multi-Bag Integration.” Institute of Electrical and Electronics Engineers Access 7:120399–120410. https://doi.org/10.1109/ACCESS.2019.2937188.
  • Wu, X., D. Hong, J. Tian, J. Chanussot, W. Li, and R. Tao. 2019. “ORSIm Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-Frequency Channel Features.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 57 (7): 5146–5158. https://doi.org/10.1109/TGRS.2019.2897139.
  • Xia, G. S., J. Hu, F. Hu, B. Shi, X. Bai, Y. Zhong, and L. Zhang. 2017. “AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classifification.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 55 (7): 3965–3981. https://doi.org/10.1109/TGRS.2017.2685945.
  • Xia, G. S., W. Yang, J. Delon, Y. Gousseau, H. Sun, and H. Maitre 2018. “Structural High-Resolution Satellite Image Indexing.” Proceeding ISPRS Commission VII Mid-Term Symposium ′100 Years ISPRS, Vienna, Austria 38:298–303.
  • Yang, Y., and S. Newsam 2010. “Bag-Of-Visual-Words and Spatial Extensions for Land-Use Classifification.” In Proceedings of the 18th SIGSPA-TIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA, 3–5 November, 270.
  • Zhang, W., P. Tang, and L. Zhao. 2019. “Remote Sensing Image Scene Classification Using CNN-Capsnet.” Remote Sensing of Environment 11 (5): 494. Art. no. https://doi.org/10.3390/rs11050494.
  • Zhang, K., Z. Zhang, Z. Li, and Y. Qiao. 2016. “Joint Face Detection and Alignment Using Multi-Task Cascaded Convolutional Networks.” arXiv: 1604,02878v1 23:1499–1503. https://doi.org/10.1109/LSP.2016.2603342.
  • Zhang, B., Y. Zhang, and S. Wang. 2019. “A Lightweight and Discriminative Model for Remote Sensing Scene Classification with Multidilation Pooling Module.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (8): 2636–2653. https://doi.org/10.1109/JSTARS.2019.2919317.
  • Zhao, B., Y. Zhong, G. S. Xia, and L. Zhang. 2016. “Dirichlet-Derived Multiple Topic Scene Classification Model for High Spatial Resolution Remote Sensing Imagery.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 54 (4): 2108–2123. https://doi.org/10.1109/TGRS.2015.2496185.
  • Zhong, Y., F. Fei, and L. Zhang. 2016. “Large Patch Convolutional Neural Networks for the Scene Classification of High Spatial Resolution Imagery.” Journal of Applied Remote Sensing 10 (2): 25006. Art. no. https://doi.org/10.1117/1.JRS.10.025006.
  • Zhou, B., A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba. 2014. “Object Detectors Emerge in Deep Scene Cnns.” arXiv 1412 (3): 6856.
  • Zhou, Z. H., M. L. Zhang, S. J. Huang, and Y. F. Li. 2012. “Multi-Instance Multi-Label Learning.” Artificial Intelligence 176 (1): 2291–2320. https://doi.org/10.1016/j.artint.2011.10.002.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.