Dual-input ultralight multi-head self-attention learning network for hyperspectral image classification

References

• Ailong, M., Y. Zhong, B. Zhao, H. Jiao, and L. Zhang. 2016. “Semisupervised Subspace-Based DNA Encoding and Matching Classifier for Hyperspectral Remote Sensing Imagery.” IEEE Transactions on Geoscience and Remote Sensing 54 (8): 4402–4418. https://doi.org/10.1109/TGRS.2016.2541022.
   Web of Science ®Google Scholar
• Alex, K., I. Sutskever, and G. E. Hinton. 2017. “ImageNet Classification with Deep Convolutional Neural Networks.” Communications of the ACM 60 (6): 84–90. https://doi.org/10.1145/3065386.
   Web of Science ®Google Scholar
• Audebert, N., B. Le Saux, and S. Lefevre. 2019. “Deep Learning for Classification of Hyperspectral Data: A Comparative Review.” IEEE Geoscience and Remote Sensing Magazine 7 (2): 159–173. https://doi.org/10.1109/MGRS.2019.2912563.
   Web of Science ®Google Scholar
• Bandos, T. V., L. Bruzzone, and G. Camps-Valls. 2009. “Classification of Hyperspectral Images with Regularized Linear Discriminant Analysis.” IEEE Transactions on Geoscience and Remote Sensing 47 (3): 862–873. https://doi.org/10.1109/TGRS.2008.2005729.
   Web of Science ®Google Scholar
• Cheng, C., L. Hong, J. Peng, W. Cui, and L. Zhang. 2022. “Deep High-Order Tensor Convolutional Sparse Coding for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–11. https://doi.org/10.1109/TGRS.2021.3134682.
   Web of Science ®Google Scholar
• Chen, Y., H. Jiang, L. Chunyang, X. Jia, and P. Ghamisi. 2016. “Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 54 (10): 6232–6251. https://doi.org/10.1109/TGRS.2016.2584107.
   Web of Science ®Google Scholar
• Dalponte, H. O. Michele, Gobakken, D. Dalponte, E. Ørka, D. Gobakken, T. Gianelle, and E. Næsset. 2013. “Tree Species Classification in Boreal Forests with Hyperspectral Data.” IEEE Transactions on Geoscience & Remote Sensing 51 (5): 2632–2645. https://doi.org/10.1109/TGRS.2012.2216272.
   Web of Science ®Google Scholar
• Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, et al. 2020. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” CoRR, Abs/2010.11929. doi:https://arxiv.org/abs/2010.11929.
   Google Scholar
• Friedman, J. H. 1989. “Regularized Discriminant Analysis.” Journal of the American Statistical Association 84 (405): 165–175. Taylor & Francis. https://doi.org/10.1080/01621459.1989.10478752.
   Web of Science ®Google Scholar
• Fulin, X., G. Zhang, C. Song, H. Wang, and S. Mei. 2023. “Multiscale and Cross-Level Attention Learning for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 61:1–15. https://doi.org/10.1109/TGRS.2023.3235819.
   Google Scholar
• Gao, H., M. Zhu, X. Wang, L. Chenming, and X. Shufang. 2023. “Lightweight Spatial-Spectral Network Based on 3D-2D Multi-Group Feature Extraction Module for Hyperspectral Image Classification.” International Journal of Remote Sensing 44 (11): 3607–3634. Taylor & Francis. https://doi.org/10.1080/01431161.2023.2224099.
   Web of Science ®Google Scholar
• Girshick, R. B. 2015. “Fast R-CNN.” 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 1440–1448.
   Google Scholar
• Guo, Y., L. Lu, and S. Zhu. 2023. “Novel Accelerated Methods for Convolution Neural Network with Matrix Core.” The Journal of Supercomputing, May. https://doi.org/10.1007/s11227-023-05399-6.
   Google Scholar
• Hamida, B., A. B. Amina, P. Lambert, and C. Ben Amar. 2018. “3-D Deep Learning Approach for Remote Sensing Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (8): 4420–4434. https://doi.org/10.1109/TGRS.2018.2818945.
   Web of Science ®Google Scholar
• Hang, R., Q. Liu, Y. Sun, X. Yuan, H. Pei, J. Plaza, and A. Plaza. 2017. “Robust Matrix Discriminative Analysis for Feature Extraction from Hyperspectral Images.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (5): 2002–2011. https://doi.org/10.1109/JSTARS.2017.2658948.
   Web of Science ®Google Scholar
• Heidari, S., M. Ghasemi, Y. Geun Kim, W. Carole-Jean, and S. Vrudhula. 2022. “Camdnn: Content-Aware Mapping of a Network of Deep Neural Networks on Edge Mpsocs.” IEEE Transactions on Computers, 1–12. https://doi.org/10.1109/TC.2022.3207137.
   Google Scholar
• Hong, D., L. Gao, J. Yao, B. Zhang, A. Plaza, and J. Chanussot. 2021. “Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (7): 5966–5978. https://doi.org/10.1109/TGRS.2020.3015157.
   Web of Science ®Google Scholar
• Hong, D., N. Yokoya, J. Chanussot, X. Jian, and X. Xiang Zhu. 2021. “Joint and Progressive Subspace Analysis (JPSA) with Spatial–Spectral Manifold Alignment for Semisupervised Hyperspectral Dimensionality Reduction.” IEEE Transactions on Cybernetics 51 (7): 3602–3615. https://doi.org/10.1109/TCYB.2020.3028931.
   PubMed Web of Science ®Google Scholar
• Hong, D., N. Yokoya, and X. Xiang Zhu. 2017. “Learning a Robust Local Manifold Representation for Hyperspectral Dimensionality Reduction.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (6): 2960–2975. https://doi.org/10.1109/JSTARS.2017.2682189.
   Web of Science ®Google Scholar
• Jolliffe, I. 2005. “Principal Component Analysis.” In Encyclopedia of Statistics in Behavioral Science. John Wiley & Sons, Ltd. ht tps://do i.org/ doi:10.1002/0470013192.bsa501.
   Google Scholar
• Jyun-Yi, W., Y. Cheng, F. Szu-Wei, C.-T. Liu, S.-Y. Chien, and Y. Tsao. 2019. “Increasing Compactness of Deep Learning Based Speech Enhancement Models with Parameter Pruning and Quantization Techniques.” IEEE Signal Processing Letters 26 (12): 1887–1891. https://doi.org/10.1109/LSP.2019.2951950.
   Web of Science ®Google Scholar
• Kaiming, H., G. Gkioxari, P. Dollár, and R. B. Girshick. 2017. “Mask R-CNN.” 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 2980–2988.
   Google Scholar
• Kaiming, H., X. Zhang, S. Ren, and J. Sun. 2015. “Deep Residual Learning for Image Recognition.” arXiv. http://arxiv.org/abs/1512.03385.
   Google Scholar
• LeCun, Y., Y. Bengio, and G. Hinton. 2015. “Deep Learning.” Nature 521 (7553): 436–444. https://doi.org/10.1038/nature14539.
   PubMed Web of Science ®Google Scholar
• LeCun, Y., B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. 1989. “Backpropagation Applied to Handwritten Zip Code Recognition.” Neural Computation 1 (4): 541–551. https://doi.org/10.1162/neco.1989.1.4.541.
   Web of Science ®Google Scholar
• Le Cun, Y., B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. 1989. “Handwritten Digit Recognition with a Back-Propagation Network.” In Proceedings of the 2nd International Conference on Neural Information Processing Systems 396–404. NIPS’89 Cambridge MA, USA: MIT Press.
   Google Scholar
• Liu, Z., Y. Lin, Y. Cao, H. Han, Y. Wei, Z. Zhang, S. Lin, and B. Guo. 2021. “Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows.” arXiv. http://arxiv.org/abs/2103.14030.
   Google Scholar
• Liu, J., W. Zhihua, D. Feng, M. Zhang, W. Xinxuan, X. Yao, Y. Dianhai, M. Yanjun, F. Zhao, and D. Dou. 2023. “HeterPS: Distributed Deep Learning with Reinforcement Learning Based Scheduling in Heterogeneous Environments.” Future Generation Computer Systems 148 (November): 106–117. https://doi.org/10.1016/j.future.2023.05.032.
   Google Scholar
• Makantasis, K., K. Karantzalos, A. Doulamis, and N. Doulamis. 2015. “Deep Supervised Learning for Hyperspectral Data Classification Through Convolutional Neural Networks.” In 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 4959–4962. Milan: IEEE. https://doi.org/10.1109/IGARSS.2015.7326945.
   Google Scholar
• Mattia, M., G. Camps-Valls, and L. Bruzzone. 2009. “A Composite Semisupervised Svm for Classification of Hyperspectral Images.” IEEE Geoscience and Remote Sensing Letters 6 (2): 234–238. https://doi.org/10.1109/LGRS.2008.2009324.
   Web of Science ®Google Scholar
• Mei, S., J. Jingyu, B. Qianqian, J. Hou, D. Qian, and L. Wei 2016. “Integrating Spectral and Spatial Information into Deep Convolutional Neural Networks for Hyperspectral Classification.” In 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 5067–5070. Beijing, China: IEEE. https://doi.org/10.1109/IGARSS.2016.7730321.
   Google Scholar
• Mei, S., X. Li, X. Liu, H. Cai, and Q. Du. 2022. “Hyperspectral Image Classification Using Attention-Based Bidirectional Long Short-Term Memory Network.” IEEE Transactions on Geoscience and Remote Sensing 60:1–12. https://doi.org/10.1109/TGRS.2021.3102034.
   Web of Science ®Google Scholar
• Mei, S., C. Song, M. Ma, and F. Xu. 2022. “Hyperspectral Image Classification Using Group-Aware Hierarchical Transformer.” IEEE Transactions on Geoscience and Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2022.3207933.
   Web of Science ®Google Scholar
• Meng, L., J. E. Fowler, and L. Jing. 2019. “Spatial Functional Data Analysis for the Spatial–Spectral Classification of Hyperspectral Imagery.” IEEE Geoscience and Remote Sensing Letters 16 (6): 942–946. https://doi.org/10.1109/LGRS.2018.2884077.
   Web of Science ®Google Scholar
• Mingyi, H., B. Li, and H. Chen. 2017. “Multi-Scale 3D Deep Convolutional Neural Network for Hyperspectral Image Classification.” In 2017 IEEE International Conference on Image Processing (ICIP), 3904–3908. Beijing: IEEE. https://doi.org/10.1109/ICIP.2017.8297014.
   Google Scholar
• Mishu, S. Z., B. Ahmed, M. A. Ali Hossain, and M. P. Palash Uddin. 2020. “Effective Subspace Detection Based on the Measurement of Both the Spectral and Spatial Information for Hyperspectral Image Classification.” International Journal of Remote Sensing 41 (19): 7541–7564. Taylor & Francis. https://doi.org/10.1080/01431161.2020.1763502.
   Web of Science ®Google Scholar
• Palsson, F., J. R. Sveinsson, M. Orn Ulfarsson, and J. Atli Benediktsson. 2015. “Model-Based Fusion of Multi- and Hyperspectral Images Using Pca and Wavelets.” IEEE Transactions on Geoscience and Remote Sensing 53 (5): 2652–2663. https://doi.org/10.1109/TGRS.2014.2363477.
   Web of Science ®Google Scholar
• Ren, S., K. He, R. Girshick, and J. Sun. 2017. “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (6): 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031.
   PubMed Web of Science ®Google Scholar
• Roy, S. K., G. Krishna, S. Ram Dubey, and B. B. Chaudhuri. 2020. “HybridSn: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 17 (2): 277–281. https://doi.org/10.1109/LGRS.2019.2918719.
   Web of Science ®Google Scholar
• Roy, S. K., S. Manna, S. Ram Dubey, and B. Baran Chaudhuri. 2019. “LiSHT: Non-Parametric Linearly Scaled Hyperbolic Tangent Activation Function for Neural Networks.” ArXiv abs/1901.05894.
   Google Scholar
• Shen, Z., M. Zhang, H. Zhao, Y. Shuai, and L. Hongsheng 2020. “Efficient Attention: Attention with Linear Complexities.” arXiv. http://arxiv.org/abs/1812.01243.
   Google Scholar
• Simonyan, K., and A. Zisserman. 2015. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” arXiv. http://arxiv.org/abs/1409.1556.
   Google Scholar
• Si Salah, Ait-Aoudia, A. Rezgui, S. E. Goldin, H. Si Salah, and S. Ait-Aoudia. 2019. “Change Detection in Urban Areas from Remote Sensing Data: A Multidimensional Classification Scheme.” International Journal of Remote Sensing 40 (17): 6635–6679. Taylor & Francis. https://doi.org/10.1080/01431161.2019.1583394.
   Web of Science ®Google Scholar
• Song, W., S. Li, L. Fang, and T. Lu. 2018. “Hyperspectral Image Classification with Deep Feature Fusion Network.” IEEE Transactions on Geoscience and Remote Sensing 56 (6): 3173–3184. https://doi.org/10.1109/TGRS.2018.2794326.
   Web of Science ®Google Scholar
• Sun, L., G. Zhao, Y. Zheng, W. Zebin, Y. Ban, X. Li, B. Zhang, and A. Plaza. 2022. “Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–16. https://doi.org/10.1109/TGRS.2022.3231215.
   Web of Science ®Google Scholar
• Tan, X., K. Gao, B. Liu, F. Yumeng, and L. Kang. 2021. “Deep Global-Local Transformer Network Combined with Extended Morphological Profiles for Hyperspectral Image Classification.” Journal of Applied Remote Sensing 15 (3): 038509. https://doi.org/10.1117/1.JRS.15.038509.
   Web of Science ®Google Scholar
• Wang, Z., M. Wen, X. Yuedong, Y. Zhou, J. Hui Wang, and L. Zhang. 2023. “Communication Compression Techniques in Distributed Deep Learning: A Survey.” Journal of Systems Architecture 142 (June): 102927. https://doi.org/10.1016/j.sysarc.2023.102927.
   Web of Science ®Google Scholar
• Wang, W., E. Xie, L. Xiang, D.-P. Fan, K. Song, D. Liang, L. Tong, P. Luo, and L. Shao. 2021. “Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions.” arXiv. http://arxiv.org/abs/2102.12122.
   Google Scholar
• Wei, H., Y. Huang, L. Wei, F. Zhang, and L. Hengchao. 2015. “Deep Convolutional Neural Networks for Hyperspectral Image Classification.” Journal of Sensors 2015:1–12. https://doi.org/10.1155/2015/258619.
   Web of Science ®Google Scholar
• Yang, X., W. Zebin, J. Chanussot, and Z. Wei. 2020. “Hyperspectral Images Super-Resolution via Learning High-Order Coupled Tensor Ring Representation.” IEEE Transactions on Neural Networks and Learning Systems 31 (11): 4747–4760. https://doi.org/10.1109/TNNLS.2019.2957527.
   PubMed Web of Science ®Google Scholar
• Yang, X., W. Zebin, and Z. Wei. 2015. “Spectral–Spatial Classification of Hyperspectral Image Based on Low-Rank Decomposition.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8 (6): 2370–2380. https://doi.org/10.1109/JSTARS.2015.2434997.
   Web of Science ®Google Scholar
• Yue, J., W. Zhao, S. Mao, and H. Liu. 2015. “Spectral–Spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks.” Remote Sensing Letters 6 (6): 468–477. Taylor & Francis. https://doi.org/10.1080/2150704X.2015.1047045.
   Web of Science ®Google Scholar
• Zhang, X., L. Liu, X. Chen, Y. Gao, and M. Jiang. 2021. “Automatically Monitoring Impervious Surfaces Using Spectral Generalization and Time Series Landsat Imagery from 1985 to 2020 in the Yangtze River Delta.” Journal of Remote Sensing 2021. January 2021/9873816. https://doi.org/10.34133/2021/9873816.
   Google Scholar
• Zhong, Y., M. Ailong, Y. Soon Ong, Z. Zhu, and L. Zhang. 2018. “Computational Intelligence in Optical Remote Sensing Image Processing.” Applied Soft Computing 64 (March): 75–93. https://doi.org/10.1016/j.asoc.2017.11.045.
   Google Scholar
• Zhuang, B., J. Liu, Z. Pan, H. Haoyu, Y. Weng, and C. Shen. 2023. “A Survey on Efficient Training of Transformers.” arXiv. http://arxiv.org/abs/2302.01107.
   Google Scholar
• Zhu, M., L. Jiao, F. Liu, S. Yang, and J. Wang. 2021. “Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (1): 449–462. https://doi.org/10.1109/TGRS.2020.2994057.
   Web of Science ®Google Scholar
• Zhu, X. X., D. Tuia, L. Mou, G.-S. Xia, L. Zhang, X. Feng, and F. Fraundorfer. 2017. “Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources.” IEEE Geoscience and Remote Sensing Magazine 5 (4): 8–36. https://doi.org/10.1109/MGRS.2017.2762307.
   Web of Science ®Google Scholar