165
Views
4
CrossRef citations to date
0
Altmetric
Research Article

Lightweight Spatial-Spectral Network Based on 3D-2D Multi-Group Feature Extraction Module for Hyperspectral Image Classification

, , , &
Pages 3607-3634 | Received 18 Jan 2023, Accepted 31 May 2023, Published online: 04 Jul 2023

References

  • B, L., P. D. Dao, J. Liu, Y. He, and J. Shang. 2020. “Recent Advances of Hyperspectral Imaging Technology and Applications in Agriculture.” Remote Sensing 12 (16): 2659–2702. https://doi.org/10.3390/rs12162659.
  • Benediktsson, J. A., J. A. Palmason, and J. R. Sveinsson. 2005. “Classification of Hyperspectral Data from Urban Areas Based on Extended Morphological Profiles.” IEEE Transactions on Geoscience and Remote Sensing 43 (3): 480–491. https://doi.org/10.1109/TGRS.2004.842478.
  • Camps-Valls, G., D. Tuia, Bruzzone, L., Benediktsson, JA. 2014. “Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods.” IEEE Signal Processing Magazine 31 (1): 45–54. https://doi.org/10.1109/MSP.2013.2279179.
  • Chen, Y., H. Jiang, C. Li, X. Jia, and P. Ghamisi. 2016. “Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 54 (10): 6232–6251. https://doi.org/10.1109/TGRS.2016.2584107.
  • Cui, B., X. M. Dong, Q. Zhan, J. Peng, and W. Sun. 2021. “Lite Depthwise Net: A Lightweight Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2021.3062372.
  • Dang, L., P. Pang, and J. Lee. 2020. “DepthWise Separable Convolution Neural Network with Residual Connection for Hyperspectral Image Classification.” Remote Sensing 12 (20): 3408. https://doi.org/10.3390/rs12203408.
  • Dang, L. X., L. B. Weng, W. C. Dong, S. Li, and Y. Hou. 2022. “Spectral-Spatial Attention Transformer with Dense Connection for Hyperspectral Image Classification.” Computational Intelligence and Neuroscience. https://doi.org/10.1155/2022/7071485.
  • Du, B., L. Ru, Wu, C., Zhang, L.P. 2019. “Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 57 (12): 9976–9992. https://doi.org/10.1109/TGRS.2019.2930682.
  • Fang, B., Y. Li, H. Zhang, and J. Chan. 2019. “Hyperspectral Images Classification Based on Dense Convolutional Networks with Spectral-Wise Attention Mechanism.” Remote Sensing 11 (2): 159. https://doi.org/10.3390/rs11020159.
  • Feng, F., S. Wang, C. Wang, and J. Zhang. 2019. “Learning Deep Hierarchical Spatial–Spectral Features for Hyperspectral Image Classification Based on Residual 3D-2D CNN.” Sensors 19 (23): 5276. https://doi.org/10.3390/s19235276.
  • Feng, J., H. Yu, L. Wang, X. Cao, X. Zhang, and L. Jiao. 2019. “Classification of Hyperspectral Images Based on Multiclass Spatial–Spectral Generative Adversarial Networks.” IEEE Transactions on Geoscience and Remote Sensing 57 (8): 5329–5343. https://doi.org/10.1109/TGRS.2019.2899057.
  • Gao, H. M., Y. W. Miao, X. Y. Cao, and C. M. Li. 2021. “Densely Connected Multiscale Attention Network for Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14:2563–2576. https://doi.org/10.1109/JSTARS.2021.3056124.
  • Gao, H. M., Y. Yang, C. M. Li, L. Gao, and B. Zhang. 2021. “Multiscale Residual Network with Mixed Depthwise Convolution for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (4): 3396–3408. https://doi.org/10.1109/TGRS.2020.3008286.
  • Ghamisi, P., E. Maggiori, S. Li, R. Souza, Y. Tarablaka, G. Moser, A. De Giorgi, et al. 2018. “New Frontiers in Spectral-Spatial Hyperspectral Image Classification: The Latest Advances Based on Mathematical Morphology, Markov Random Fields, Segmentation, Sparse Representation, and Deep Learning.” IEEE Geoscience and Remote Sensing Magazine 6 (3): 10–43. https://doi.org/10.1109/MGRS.2018.2854840.
  • Ghamisi, P., N. Yokoya, J. Li, W. Liao, S. Liu, J. Plaza, B. Rasti, et al. 2017. “Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art.” IEEE Geoscience and Remote Sensing Magazine 5 (4): 37–78. https://doi.org/10.1109/MGRS.2017.2762087.
  • Gong, Z., P. Zhong, Y. Yu, W. Hu, and S. Li. 2019. “A CNN with Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 57 (6): 3599–3618. https://doi.org/10.1109/TGRS.2018.2886022.
  • Guo, H., J. J. Liu, Z. Y. Xiao, and L. Xiao. 2020. “Deep CNN-Based Hyperspectral Image Classification Using Discriminative Multiple Spatial-Spectral Feature Fusion.” Remote Sensing Letters 11 (9): 827–836. https://doi.org/10.1080/2150704X.2020.1779374.
  • He, X., Y. S. Chen, and Z. H. Lin. 2021. “Spatial-Spectral Transformer for Hyperspectral Image Classification.” Remote Sensing 13 (3): 498. https://doi.org/10.3390/rs13030498.
  • He, M., B. Li, and H. Chen 2017. Multi-Scale 3D Deep Convolutional Neural Network for Hyperspectral Image Classification. In 2017 IEEE International Conference on Image Processing (ICIP), Beijing, People's Republic of China, 3904–3908.
  • He, K. M., X. Y. Zhang, S. Q. Ren, and J. Sun 2016. Deep Residual Learning for Image Recognition. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)770–778. https://doi.org/10.1109/CVPR.2016.90
  • Hong, D.F., X. Wu, P. Ghamisi, J. Chanussot, N. Yokoya, and X. X. Zhu. 2020. “Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (6): 3791–3808. https://doi.org/10.1109/TGRS.2019.2957251.
  • Hou, B., H. T, and L. Jiao. 2015. “Spectral–Spatial Classification of Hyperspectral Data Using 3-D Morphological Profile.” IEEE Geoscience & Remote Sensing Letters 12 (12): 2364–2368. https://doi.org/10.1109/LGRS.2015.2476498.
  • Howard, A. G., M. L. Zhu, B. Chen, D. Kalenichenko, W. J. Wang, T. Weyand, M. Andreetto, and H. Adam. 2017. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 17 Apr. arXiv:1704.04861v1 [cs.CV].
  • Hu, W., Y. Huang, W. Li, F. Zhang, and H. Li. 2015. “Deep Convolutional Neural Networks for Hyperspectral Image Classification.” Journal of Sensors 2015:1–12. 2015. https://doi.org/10.1155/2015/258619.
  • Hu, J., S. Li, A. Samuel, G. Sun, and E. H. Wu. 2019. “Squeeze-And-Excitation Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 42 (8): 2011–2023. https://doi.org/10.1109/TPAMI.2-019.2913372.
  • Jia, S., J. Hu, J. Zhu, X. Jia, and Q. Li. 2017. “Three-Dimensional Local Binary Patterns for Hyperspectral Imagery Classification.” IEEE Transactions on Geoscience & Remote Sensing 55 (4): 2399–2413. https://doi.org/10.1109/TGRS.2016.2642951.
  • Krizhevsky, A., I. Sutskever, and E. G. Hinton. 2017. “ImageNet Classification with Deep Convolutional Neural Networks.” Communications of the ACM 60 (6): 84–90. https://doi.org/10.1145/3065386.
  • Kumar, B., O. Dikshit, A. Gupta, and M. K. Singh. 2020. “Feature Extraction for Hyperspectral Image Classification: A Review.” International Journal of Remote Sensing 41 (16): 6248–6287. https://doi.org/10.1080/01431161.2020.1736732.
  • LeCun, Y., Y. Bengio, and G. Hinton. 2005. “Deep Learning.” Nature 521 (7553): 436–444. https://doi.org/10.1038/nature14539.
  • Lee, H., and H. Kwon. 2017. “Going Deeper with Contextual CNN for Hyperspectral Image Classification.” IEEE Transactions on Image Process 26 (10): 4843–4855. https://doi.org/10.1109/TIP.2017.2725580.
  • Li, X., M. Ding, and A. Pižurica 2019. Group Convolutional Neural Networks for Hyperspectral Image Classification. IEEE International Conference on Image Processing (ICIP) 639–643. https://doi.org/10.1109/ICIP.2019.8803839.
  • Liu, H., W. Li, X. G. Xia, M. M. Zhang, C. Z. Gao, and R. Tao. 2022. Central Attention Network for Hyperspectral Imagery Classification. IEEE Transactions on Neural Networks and Learning Systems, https://doi.org/10.1109/TNNLS.2022.3155114.
  • Li, L., J. Yin, X. Jia, S. Li, and B. Han. 2020. “Joint Spatial-Spectral Attention Network for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 18 (10): 1816–1820. https://doi.org/10.1109/LGRS.2020.3007811.
  • Li, Y., H. K. Zhang, Q. Shen 2017. “Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network.” Remote Sensing 9 (1): 67. https://doi.org/10.3390/rs9010067.
  • Li, R., S. Zheng, C. Duan, Y. Yang, and X. Wang. 2020. “Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network.” Remote Sensing 12 (3): 582. https://doi.org/10.3390/rs12030582.
  • Ma, X., H. Wang, and J. Geng. 2016. “Spectral-Spatial Classification of Hyperspectral Image Based on Deep Auto-Encoder.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 9 (9): 4073–4085. https://doi.org/10.1109/JSTARS.2016.2517204.
  • Melgani, F., and B. Lorenzo. 2004. “Classification of Hyperspectral Remote Sensing Images with Support Vector Machines.” IEEE Transactions on Geoscience and Remote Sensing 42 (8): 1778–1790. https://doi.org/10.1109/TGRS.2004.831865.
  • Paoletti, M., J. Haut, R. Fernandez-Beltran, J. Plaza, A. Plaza, J. Li, and F. Pla. 2019. “Capsule Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 57 (4): 2145–2160. https://doi.org/10.1109/TGRS.2018.2871782.
  • Rasti, B., D. Hong, R. Hang, P. Ghamisi, X. Kang, J. Chanussot, J. A. Benediktsson, et al. 2020. “Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep: Overview and Toolbox.” IEEE Geoscience and Remote Sensing Magazine 8 (4): 60–88. https://doi.org/10.1109/MGRS.2020.2979764.
  • Roy, S. K., G. Krishna, S. R. Dubey, and B. B. Chaudhuri. 2020. “HybridSn: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification IEEE Geoscience and Remote Sensing Letters.” IEEE Geoscience and Remote Sensing Letters 17 (2): 277–281. https://doi.org/10.1109/LGRS.2019.2918719.
  • Song, W., S. Li, L. Fang, and T. Lu. 2018. “Hyperspectral Image Classification with Deep Feature Fusion Network.” IEEE Transactions on Geoscience and Remote Sensing 56 (6): 3173–3184. https://doi.org/10.1109/TGRS.2018.2794326.
  • Sun, G., X. Zhang, X. Jia, J. Ren, A. Zhang, Y. Yao, and H. Zhao. 2020. “Deep Fusion of Localized Spectral Features and Multi-Scale Spatial Features for Effective Classification of Hyperspectral Images.” International Journal of Applied Earth Observation and Geoinformation 91:102157. https://doi.org/10.1016/j.jag.2020.102157.
  • Wang, W., S. Dou, Z. Jiang, and L. Sun. 2018. “A Fast Dense Spectral–Spatial Convolution Network Framework for Hyperspectral Images Classification.” Remote Sensing 10 (7): 1068. https://doi.org/10.3390/rs10071068.
  • Yan, J., D. Zhai, Y. Niu, X. Liu, and J. Jiang. 2020. “Multi-Scale Depthwise Separable Convolutional Neural Network for Hyperspectral Image Classification.” International Forum on Digital TV and Wireless Multimedia Communications 171–185. https://doi.org/10.1007/978-981-15-3341-9_15.
  • Ye, R., F. Liu, and L. Zhang. 2019. “3D Depthwise Convolution: Reducing Model Parameters in 3D Vision Tasks.” Advances in Artificial Intelligence 11489:186–199. https://doi.org/10.1007/978-3-030-18305-9_15.
  • Zhang, Y. G., J. P. Chen, et al. 2019. “Application of Hyper-Spectral Remote Sensing in Soil Heavy Metal Pollution Monitoring.” Journal of Geology 43 (3): 491–498.
  • Zhang, J. J., Z. Meng, F. Zhao, H. Liu, and Z. Chang. 2022. “Convolution Transformer Mixer for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3208935.
  • Zhang, X., Y. Sun, K. Jiang, C. Li, L. Jiao, and H. Zhou. 2018. “Spatial Sequential Recurrent Neural Networks for Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (11): 4141–4155. https://doi.org/10.1109/JSTARS.2018.2844873.
  • Zhao, Z., D. Hu, H. Wang, and X. Yu. 2022. “Convolutional Transformer Network for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3169815.
  • Zhong, P., Z. Gong, S. Li, and C. B. Schönlieb. 2017. “Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 55 (6): 3516–3530. https://doi.org/10.1109/TGRS.2017.2675902.
  • Zhong, Z., J. Li, Z. Luo, and M. Chapman. 2018. “Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework.” IEEE Transactions on Geoscience and Remote Sensing 56 (2): 847–858. https://doi.org/10.1109/TGRS.2017.2755542.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.