Hyperspectral image classification based on local feature decoupling and hybrid attention SpectralFormer network

References

• Ahmad, M., A. Khan, M. Mazzara, S. Distefano, M. Ali, and M. Sarfraz. 2022. “A Fast and Compact 3-D CNN for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2020.3043710.
   Web of Science ®Google Scholar
• Ahmad, M., S. Shabbir, S. Roy, D. Hong, X. Wu, J. Yao, A. Khan, M. Mazzara, S. Distefano, and J. Chanussot. 2022. “Hyperspectral Image Classification—Traditional to Deep Models: A Survey for Future Prospects.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 15:968–999. https://doi.org/10.1109/JSTARS.2021.3133021.
   Web of Science ®Google Scholar
• Ayas, S., and E. Tunc-Gormus. 2022. “SpectralSwin: A Spectral-Swin Transformer Network for Hyperspectral Image Classification.” International Journal of Remote Sensing 43 (11): 4025–4044. https://doi.org/10.1080/01431161.2022.2105668.
   Web of Science ®Google Scholar
• Bakheet, S., and A. Al-Hamadi. 2021. “A Framework for Instantaneous Driver Drowsiness Detection Based on Improved HOG Features and Naïve Bayesian Classification.” Brain Sciences 11 (2): 240. https://doi.org/10.3390/brainsci11020240.
   PubMed Web of Science ®Google Scholar
• Bhatti, U. A., Z. Yu, J. Chanussot, Z. Zeeshan, L. Yuan, W. Luo, S. A. Nawaz, M. A. Bhatti, Q. U. Ain, and A. Mehmood. 2022. “Local Similarity-Based Spatial–Spectral Fusion Hyperspectral Image Classification with Deep CNN and Gabor Filtering.” IEEE Transactions on Geoscience & Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2021.3090410.
   Web of Science ®Google Scholar
• Cao, X., H. Lin, S. Guo, T. Xiong, and L. Jiao. 2023. “Transformer-Based Masked Autoencoder with Contrastive Loss for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2023.3315678.
   Web of Science ®Google Scholar
• Chen, Y., H. Jiang, C. Li, X. Jia, and P. Ghamisi. 2016. “Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 54 (10): 6232–6251. https://doi.org/10.1109/TGRS.2016.2584107.
   Web of Science ®Google Scholar
• Dalal, N., and B. Triggs. 2005. “Histograms of Oriented Gradients for Human Detection.” In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), CA, USA, 886–893.
   Google Scholar
• Dong, Y., J. Cordonnier, and A. Loukas. 2021. “Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth.” https://arxiv.org/abs/2103.03404.
   Google Scholar
• Dong, Y., Q. Liu, B. Du, and L. Zhang. 2022. “Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Image Processing 31:1559–1572. https://doi.org/10.1109/TIP.2022.3144017.
   PubMed Web of Science ®Google Scholar
• Dosovitskiy, A., Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, and Uszkoreit J. 2020. “An Image is Worth 16 × 16 Words: Transformers for Image Recognition at Scale.” https://arxiv.org/abs/2010.11929.
   Google Scholar
• Graham, B., El-Nouby A, Touvron H, Stock P, Joulin A, Jégou H, Douze M. 2021. “LeViT: A Vision Transformer in ConvNet’s Clothing for Faster Inference.” https://arxiv.org/abs/2104.01136.
   Google Scholar
• He, X., Y. Chen, and P. Ghamisi. 2022. “Dual Graph Convolutional Network for Hyperspectral Image Classification with Limited Training Samples.” IEEE Transactions on Geoscience and Remote Sensing 60:1–18. https://doi.org/10.1109/TGRS.2022.3230846.
   Web of Science ®Google Scholar
• Heo, B., S. Yun, D. Han, S. Chun, J. Choe, and S. Oh. 2021. “Rethinking Spatial Dimensions of Vision Transformers.” https://arxiv.org/abs/2103.16302.
   Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Identity Mappings in Deep Residual Networks.” https://arxiv.org/abs/1603.05027.
   Google Scholar
• Hong, D., Z. Han, J. Yao, L. Gao, B. Zhang, A. Plaza, and J. Chanussot. 2022. “SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers.” IEEE Transactions on Geoscience and Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2022.3172371.
   Web of Science ®Google Scholar
• Hou, S., H. Shi, X. Cao, X. Zhang, and L. Jiao. 2022. “Hyperspectral Imagery Classification Based on Contrastive Learning.” IEEE Transactions on Geoscience & Remote Sensing 60:1–13. https://doi.org/10.1109/TGRS.2022.3215431.
   Web of Science ®Google Scholar
• Hu, W., Y. Huang, L. Wei, F. Zhang, and H. Li. 2015. “Deep Convolutional Neural Networks for Hyperspectral Image Classification.” Journal of Sensors 2015:1–12. https://doi.org/10.1155/2015/258619.
   Web of Science ®Google Scholar
• Jia, S., J. Hu, J. Zhu, X. Jia, and Q. Li. 2017. “Three-Dimensional Local Binary Patterns for Hyperspectral Imagery Classification.” IEEE Transactions on Geoscience & Remote Sensing 55 (4): 2399–2413. https://doi.org/10.1109/TGRS.2016.2642951.
   Web of Science ®Google Scholar
• Jia, S., S. Zhu, Z. Wang, M. Xu, W. Wang, and Y. Guo. 2023. “Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution.” IEEE Transactions on Geoscience and Remote Sensing 61:1–15. https://doi.org/10.1109/TGRS.2023.3250640.
   Web of Science ®Google Scholar
• LeCun, Y., Y. Bengio, and G. Hinton. 2015. “Deep learning.” Nature 521 (7553): 436–444. https://doi.org/10.1038/nature14539.
   PubMed Web of Science ®Google Scholar
• Li, G., Q. Fang, L. Zha, X. Gao, and N. Zheng. 2022. “HAM: Hybrid Attention Module in Deep Convolutional Neural Networks for Image Classification.” Pattern Recognition 129:129. https://doi.org/10.1016/j.patcog.2022.108785.
   Web of Science ®Google Scholar
• Li, W., Y. Fu, S. Fan, M. Xin, and H. Bai. 2023. “DCI-PGCN: Dual-Channel Interaction Portable Graph Convolutional Network for Landslide Detection.” IEEE Transactions on Geoscience & Remote Sensing 61:1–16. https://doi.org/10.1109/TGRS.2023.3273623.
   Web of Science ®Google Scholar
• Li, W., Q. Liu, S. Fan, H. Bai, and M. Xin. 2023. “Multistage Superpixel-Guided Hyperspectral Image Classification with Sparse Graph Attention Networks.” IEEE Transactions on Geoscience & Remote Sensing 61:1–18. https://doi.org/10.1109/TGRS.2023.3304716.
   Web of Science ®Google Scholar
• Li, W., Q. Liu, S. Fan, C. Xu, and H. Bai. 2023. “Dual-Stream GNN Fusion Network for Hyperspectral Classification.” Applied Intelligence 53 (22): 26542–26567. https://doi.org/10.1007/s10489-023-04960-3.
   Web of Science ®Google Scholar
• Luo, F., T. Guo, Z. Lin, J. Ren, and X. Zhou. 2020. “Semisupervised Hypergraph Discriminant Learning for Dimensionality Reduction of Hyperspectral Image.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13:4242–4256. https://doi.org/10.1109/JSTARS.2020.3011431.
   Web of Science ®Google Scholar
• Maaten, L., and G. Hinton. 2008. “Visualizing data using t-SNE.” Journal of Machine Learning Research 9 (2605): 2579–2605.
   Google Scholar
• Mei, S., C. Song, M. Ma, and F. Xu. 2022. “Hyperspectral Image Classification Using Group Aware Hierarchical Transformer.” IEEE Transactions on Geoscience and Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2022.3207933.
   Web of Science ®Google Scholar
• Mohan, A., and M. Venkatesan. 2020. “HybridCNN Based Hyperspectral Image Classification Using Multiscale Spatiospectral Features.” Infrared Physics & Technology 108:108. https://doi.org/10.1016/j.infrared.2020.103326.
   Web of Science ®Google Scholar
• Pang, Y., Y. Yuan, X. Li, and J. Pan. 2011. “Efficient HOG human detection.” Signal Processing 91 (4): 773–781. https://doi.org/10.1016/j.sigpro.2010.08.010.
   Web of Science ®Google Scholar
• Peng, Y., Y. Zhang, B. Tu, Q. Li, and W. Li. 2022. “Spatial–Spectral Transformer with Cross Attention for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2022.3203476.
   Web of Science ®Google Scholar
• Roy, S., G. Krishna, S. Dubey, and B. Chaudhuri. 2020. “HybridSn: Exploring 3-D–2- D CNN Feature Hierarchy for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 17 (2): 277–281. https://doi.org/10.1109/LGRS.2019.2918719.
   Web of Science ®Google Scholar
• Shi, H., G. Cao, Y. Zhang, Z. Ge, Y. Liu, and D. Yang. 2023. “F3Net: Fast Fourier Filter Network for Hyperspectral Image Classification.” IEEE Transactions on Instrumentation and Measurement 72:1–18. https://doi.org/10.1109/TIM.2023.3277100.
   PubMed Web of Science ®Google Scholar
• Sun, L., G. Zhao, Y. Zheng, and Z. Wu. 2022. “Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2022.3231215.
   Web of Science ®Google Scholar
• Tang, H., Y. Li, Z. Huang, L. Zhang, and W. Xie. 2022. “Fusion of Multidimensional CNN and Handcrafted Features for Small-Sample Hyperspectral Image Classification.” Remote Sensing 14 (15): 3796. https://doi.org/10.3390/rs14153796.
   Web of Science ®Google Scholar
• Vaswani, A., Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, and Polosukhin I. 2017. “Attention is All You Need.” https://arxiv.org/abs/1706.03762.
   Google Scholar
• Wang, J., W. Li, M. Zhang, R. Tao, and J. Chanussot. 2023. “Remote-Sensing Scene Classification via Multistage Self-Guided Separation Network.” IEEE Transactions on Geoscience and Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2023.3335484.
   Web of Science ®Google Scholar
• Wu, K., J. Fan, P. Ye, and M. Zhu. 2023. “Hyperspectral Image Classification Using Spectral–Spatial Token Enhanced Transformer with Hash-Based Positional Embedding.” IEEE Transactions on Geoscience and Remote Sensing 61:1–16. https://doi.org/10.1109/TGRS.2023.3258488.
   Web of Science ®Google Scholar
• Xie, E., N. Chen, J. Peng, W. Sun, Q. Du, and X. You. 2023. “Semantic and Spatial-Spectral Feature Fusion Transformer Network for the Classification of Hyperspectral Image.” CAAI Transactions on Intelligence Technology 8 (4): 1308–1322. https://doi.org/10.1049/cit2.12201.
   Google Scholar
• Xie, Z., P. Duan, W. Liu, X. Kang, X. Wei, and S. Li. 2023. “Feature Consistency-Based Prototype Network for Open-Set Hyperspectral Image Classification.” IEEE Transactions on Neural Networks and Learning Systems 1–11. https://doi.org/10.1109/TNNLS.2022.3232225.
   Web of Science ®Google Scholar
• Xuan, G., Q. Li, Y. Shao, and Y. Shi. 2022. “Early Diagnosis and Pathogenesis Monitoring of Wheat Powdery Mildew Caused by Blumeria Graminis Using Hyperspectral Imaging.” Computers and Electronics in Agriculture 197:106921. https://doi.org/10.1016/j.compag.2022.106921.
   Web of Science ®Google Scholar
• Xue, Z., Z. Liu, and M. Zhang. 2023. “DSR-GCN: Differentiated-Scale Restricted Graph Convolutional Network for Few-Shot Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 61:1–18. https://doi.org/10.1109/TGRS.2023.3253248.
   Web of Science ®Google Scholar
• Xu, J., J. Zhao, and C. Liu. 2022. “An Effective Hyperspectral Image Classification Approach Based on Discrete Wavelet Transform and Dense CNN.” IEEE Geoscience and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3181627.
   Web of Science ®Google Scholar
• Yang, X., W. Cao, Y. Lu, and Y. Zhou. 2022. “Hyperspectral Image Transformer Classification Networks.” IEEE Transactions on Geoscience and Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2022.3171551.
   Web of Science ®Google Scholar
• Ye, M., C. Ji, H. Chen, L. Lei, H. Lu, and Y. Qian. 2020. “Residual Deep PCA-Based Feature Extraction for Hyperspectral Image Classification.” Neural Computing and Applications 32 (18): 14287–14300. https://doi.org/10.1007/s00521-019-04503-3.
   Web of Science ®Google Scholar
• Yu, W., L. Gao, H. Huang, Y. Shen, and G. Shen. 2023. “HI2D2FNet: Hyperspectral Intrinsic Image Decomposition Guided Data Fusion Network for Hyperspectral and LiDAR Classification.” IEEE Transactions on Geoscience & Remote Sensing 61:1–15. https://doi.org/10.1109/TGRS.2023.3308109.
   Web of Science ®Google Scholar
• Zhang, M., W. Li, Y. Zhang, R. Tao, and Q. Du. 2023. “Hyperspectral and LiDar Data Classification Based on Structural Optimization Transmission.” IEEE Transactions on Cybernetics 53 (5): 3153–3164. https://doi.org/10.1109/TCYB.2022.3169773.
   PubMed Web of Science ®Google Scholar
• Zhang, M., W. Li, X. Zhao, H. Liu, R. Tao, and Q. Du. 2023. “Morphological Transformation and Spatial-Logical Aggregation for Tree Species Classification Using Hyperspectral Imagery.” IEEE Transactions on Geoscience & Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2022.3233847.
   Web of Science ®Google Scholar
• Zhang, J., Z. Meng, F. Zhao, H. Liu, and Z. Chang. 2022. “Convolution Transformer Mixer for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3208935.
   Web of Science ®Google Scholar
• Zhang, T., X. Zhang, X. Ke, C. Liu, X. Xu, X. Zhan, C. Wang, et al. 2022. “HOG-ShipCLSNet: A Novel Deep Learning Network with HOG Feature Fusion for SAR Ship Classification.” IEEE Transactions on Geoscience & Remote Sensing 60:1–22. https://doi.org/10.1109/TGRS.2021.3082759.
   Web of Science ®Google Scholar
• Zhao, Z., D. Hu, H. Wang, and X. Yu. 2022. “Convolutional Transformer Network for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3169815.
   Web of Science ®Google Scholar
• Zhao, Y., Z. Zhang, N. Zhang, X. Xu, and Z. Gao. 2022. “Nonlinear Spatial Decoupling Strategy and Deformable Convnets V2 for Hyperspectral Image Classification.” Geocarto International 37 (27): 18150–18171. https://doi.org/10.1080/10106049.2022.2138564.
   Web of Science ®Google Scholar
• Zhou, D., B Kang, X Jin, L Yang, X Lian, Z Jiang, Q Hou, J Feng. 2021. “DeepViT: Towards deeper vision transformer.” https://arxiv.org/abs/2103.11886.
   Google Scholar
• Zhou, J., S. Zeng, G. Gao, Y. Chen, and Y. Tang. 2023. “A Novel Spatial–Spectral Pyramid Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 61:1–14. https://doi.org/10.1109/TGRS.2023.3336053.
   Web of Science ®Google Scholar
• Zhu, M., L. Jiao, F. Liu, S. Yang, and J. Wang. 2021. “Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (1): 449–462. https://doi.org/10.1109/TGRS.2020.2994057.
   Web of Science ®Google Scholar