262
Views
0
CrossRef citations to date
0
Altmetric
Research Article

A multi-scale multi-channel CNN introducing a channel-spatial attention mechanism hyperspectral remote sensing image classification method

, &
Article: 2353290 | Received 25 Oct 2023, Accepted 06 May 2024, Published online: 27 May 2024

References

  • Asker, M. E. (2023). Hyperspectral image classification method based on squeeze-and-excitation networks, depthwise separable convolution and multibranch feature fusion. Earth Science Informatics, 16(2), 1427–20. https://doi.org/10.1007/s12145-023-00982-0
  • Awad, M. (2014). Sea water chlorophyll-a estimation using hyperspectral images and supervised artificial neural network. Ecological Informatics, 24, 60–68. https://doi.org/10.1016/j.ecoinf.2014.07.004
  • Camps-Valls, G., Gomez-Chova, L., Munoz-Mari, J., Vila-Frances, J., & Calpe-Maravilla, J. (2006). Composite kernels for hyperspectral image classification. IEEE Geoscience & Remote Sensing Letters, 3(1), 93–97. https://doi.org/10.1109/LGRS.2005.857031
  • Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014). Deep learning-based classification of hyperspectral data. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 7(6), 2094–2107. https://doi.org/10.1109/JSTARS.2014.2329330
  • Dong, S., Feng, W., Quan, Y., Dauphin, G., Gao, L., & Xing, M. (2022). Deep ensemble CNN method based on sample expansion for hyperspectral image classification. IEEE Transactions on Geoscience & Remote Sensing, 60, 1–15. Art no. 5531815. https://doi.org/10.1109/TGRS.2022.3183189
  • Du, Q. D., Zhang, L. Z., Zhang, B. Z., Tong, X., Du, P., & Chanussot, J. (2013). Foreword to the special issue on hyperspectral remote sensing: Theory, methods, and applications. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 6(2), 459–465. https://doi.org/10.1109/JSTARS.2013.2257422
  • Fakhrullin, R., Nigamatzyanova, L., & Fakhrullina, G. (2021). Dark-field/hyperspectral microscopy for detecting nanoscale particles in environmental nanotoxicology research. Science of the Total Environment, 772, 145478. https://doi.org/10.1016/j.scitotenv.2021.145478
  • Fang, B., Han, G., Zheng, X., & He, J. (2021). Hyperspectral image classification using multi-channel lightweight CNN ensemble framework based on band clustering. ICMLCA 2021; 2nd International Conference on Machine Learning and Computer Application (pp. 1–6). Shenyang, China.
  • Feng, J., Wu, X., Shang, R., Sui, C., Li, J., Jiao, L., & Zhang, X. (2021, June). Attention multibranch convolutional neural network for hyperspectral image classification based on adaptive region search. IEEE Transactions on Geoscience and Remote Sensing, 59(6), 5054–5070. https://doi.org/10.1109/TGRS.2020.3011943
  • Firat, H., Asker, M. E., Bayindir, M. İ., & Hanbay, D. (2023). 3D residual spatial–spectral convolution network for hyperspectral remote sensing image classification. Neural Computing & Applications, 35(6), 4479–4497. https://doi.org/10.1007/s00521-022-07933-8
  • Gevaert, C. M., Suomalainen, J., Tang, J., & Kooistra, L. (2015, June). Generation of spectral–temporal response surfaces by combining multispectral satellite and hyperspectral UAV imagery for precision agriculture applications. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 8(6), 3140–3146. https://doi.org/10.1109/JSTARS.2015.2406339
  • Ghaderizadeh, S., Abbasi-Moghadam, D., Sharifi, A., Zhao, N., & Tariq, A. (2021). Hyperspectral image classification using a hybrid 3D-2D convolutional neural networks. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14, 7570–7588. https://doi.org/10.1109/JSTARS.2021.3099118
  • Hang, R., Li, Z., Liu, Q., Ghamisi, P., & Bhattacharyya, S. S. (2021, March). Hyperspectral image classification with attention-aided CNNs. IEEE Transactions on Geoscience and Remote Sensing, 59(3), 2281–2293. https://doi.org/10.1109/TGRS.2020.3007921
  • Jiang, J., Ma, J., Chen, C., Wang, Z., Cai, Z., & Wang, L. (2018, August). SuperPCA: A superpixelwise PCA approach for unsupervised feature extraction of hyperspectral imagery. IEEE Transactions on Geoscience & Remote Sensing, 56(8), 4581–4593. https://doi.org/10.1109/TGRS.2018.2828029
  • Li, W., Chen, C., Su, H., & Du, Q. (2015, July). Local binary patterns and extreme learning machine for hyperspectral imagery classification. IEEE Transactions on Geoscience and Remote Sensing, 53(7), 3681–3693. https://doi.org/10.1109/TGRS.2014.2381602
  • Li, T., Zhang, X., Zhang, S., & Wang, L. (2022). Self-supervised learning with a dual-branch ResNet for hyperspectral image classification. IEEE Geoscience & Remote Sensing Letters, 19, 1–5. Art no. 5512905. https://doi.org/10.1109/LGRS.2021.3107321
  • Li, N., Zhao, X., Ma, B., & Zou, X. (2018). A visual attention model based on human visual cognition[C/OL]//advances in brain inspired cognitive systems. Springer.
  • Li, R., Zheng, Zheng, S., Duan, C., Yang, Y., & Wang, X. (2020). Classification of hyperspectral image based on double-branch dual-attention mechanism network. Remote Sensing, 12(3), 582. https://doi.org/10.3390/rs12030582
  • Lu, P., Jiang, X., Zhang, Y., Liu, X., Cai, Z., Jiang, J., & Plaza, A. (2023). Spectral–spatial and superpixelwise unsupervised linear discriminant analysis for feature extraction and classification of hyperspectral images. IEEE Transactions on Geoscience & Remote Sensing, 61, 1–15. Art no. 5530515. https://doi.org/10.1109/TGRS.2023.3330474
  • Melgani, F., & Bruzzone, L. (2004). Classification of hyperspectral remote sensing images with support vector machines[J/OL]. IEEE Transactions on Geoscience & Remote Sensing, 42(8), 1778–1790. https://doi.org/10.1109/TGRS.2004.831865
  • Pei, S., Song, H., & Lu, Y. (2022). Small sample hyperspectral image classification method based on dual-channel spectral enhancement network[J/OL]. Electronics, 11(16), 2540. https://doi.org/10.3390/electronics11162540
  • Pi, W., Du, J., Bi, Y., Gao, X., & Zhu, X. (2021). 3D-CNN based UAV hyperspectral imagery for grassland degradation indicator ground object classification research - ScienceDirect. Ecological Informatics, 62, 62. https://doi.org/10.1016/j.ecoinf.2021.101278
  • Qing, Y., & Liu, W. (2021). Hyperspectral image classification based on multi-scale residual network with attention mechanism. Remote Sensing, 13(3), 335. https://doi.org/10.3390/rs13030335
  • Roy, S. K., Manna, S., Song, T., & Bruzzone, L. (2021, September). Attention-based adaptive spectral–spatial kernel ResNet for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 59(9), 7831–7843. https://doi.org/10.1109/TGRS.2020.3043267
  • Roy, S. K., Mondal, R., Paoletti, M. E., Haut, J. M., & Plaza, A. (2021). Morphological convolutional neural networks for hyperspectral image classification. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 14, 8689–8702. https://doi.org/10.1109/JSTARS.2021.3088228
  • Shi, C., Liao, D., Zhang, T., & Wang, L. (2022). Hyperspectral image classification based on 3D coordination attention mechanism network. Remote Sensing, 14(3), 608. https://doi.org/10.3390/rs14030608
  • Slavkovikj, V., Verstockt, S., Neve, W. D., Hoecke, S. V., & Walle, R. V. (2015, October 26–30). Hyperspectral image classification with convolutional neural networks. ACM International Conference on Multimedia (ACMMM), Brisbane.
  • Villa, A., Benediktsson, J. A., Chanussot, J., & Jutten, C. (2011). Hyperspectral image classification with independent component discriminant analysis. IEEE Transactions on Geoscience & Remote Sensing, 49(12), 4865–4876. https://doi.org/10.1109/TGRS.2011.2153861
  • Voulodimos, A., Doulamis, N., & Doulamis, A. (2018). Deep learning for computer vision: A brief review. Computational intelligence and neuroscience.
  • Wang, Z., & He, B. (2011). Locality perserving projections algorithm for hyperspectral image dimensionality reduction. 19th International Conference on Geoinformatics (pp. 1–4). Shanghai, China. https://doi.org/10.1109/GeoInformatics.2011.5980790
  • Woo, S., Park, J., Lee, J. Y. (2018). CBAM: Convolutional block attention module[j]. Springer.
  • Xie, J., Hua, J., Chen, S., Wu, P., Gao, P., Sun, D., Lyu, Z., Lyu, S., Xue, X., & Lu, J. (2023). HyperSFormer: A transformer-based end-to-end hyperspectral image classification method for crop classification. Remote Sensing, 15(14), 3491. https://doi.org/10.3390/rs15143491
  • Xu, Y., Zhang, L., & Du, B. (2018). Spectral–spatial unified networks for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing (pp. 1–17).
  • Xu, M., Zhao, Y., Liang, Y., & Ma, X. (2022). Hyperspectral image classification based on class-incremental learning with knowledge distillation. Remote Sensing, 14(11), 2556. https://doi.org/10.3390/rs14112556
  • Yang, X., Ye, Y., Li, X., Lau, R. Y. K., Zhang, X., & Huang, X. (2018, September). Hyperspectral image classification with deep learning models. IEEE Transactions on Geoscience and Remote Sensing, 56(9), 5408–5423. https://doi.org/10.1109/TGRS.2018.2815613
  • Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018). Recent trends in deep learning based natural language processing [review article]. IEEE Computational Intelligence Magazine, 13(3), 55–75. https://doi.org/10.1109/MCI.2018.2840738
  • Zahisham, Z., Lim, K. M., Koo, V. C., Chan, Y. K., & Lee, C. P. (2023). 2SRS: Two-stream residual separable convolution neural network for hyperspectral image classification. IEEE Geoscience & Remote Sensing Letters, 20, 1–5. Art no. 5501505. https://doi.org/10.1109/LGRS.2023.3241720
  • Zhai, H., Zhao, J., & Zhang, H. (2022). Double attention based multilevel one-dimensional convolution neural network for hyperspectral image classification. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 15, 3771–3787. https://doi.org/10.1109/JSTARS.2022.3162423
  • Zhang, H., Li, Y., Zhang, Y., & Shen, Q. (2017a). Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network. Remote Sensing Letters, 8(5), 438–447. https://doi.org/10.1080/2150704X.2017.1280200
  • Zhang, H., Li, Y., Zhang, Y., & Shen, Q. (2017b). Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network. Remote Sensing Letters, 8(5), 438–447. https://doi.org/10.1080/2150704X.2017.1280200
  • Zheng, Y., Liu, S., Chen, H., Bruzzone, L., Ye, F., Qin, C., Wei, Z., Plaza, J., Li, J., & Plaza, A. (2024). Hybrid FusionNet: A hybrid feature fusion framework for multisource high-resolution remote sensing image classification. IEEE Transactions on Geoscience & Remote Sensing, 62, 1–14. Art no. 5401714. https://doi.org/10.1109/TGRS.2024.3385316
  • Zhong, Z., Li, J., Luo, Z., & Chapman, M. (2018, February). Spectral–spatial residual network for hyperspectral image classification: A 3-D deep learning framework. IEEE Transactions on Geoscience and Remote Sensing, 56(2), 847–858. https://doi.org/10.1109/TGRS.2017.2755542