Weighted residual self-attention graph-based transformer for spectral–spatial hyperspectral image classification

References

• Baevski, A., and M. Auli. 2018. “Adaptive Input Representations for Neural Language Modeling.” arXiv preprint arXiv:1809.10853.
   Google Scholar
• Cariou, C., and K. Chehdi. 2016. “A New K-Nearest Neighbor Density-Based Clustering Method and Its Application to Hyperspectral Images.” In in Proc. IGARSS, Beijing, China, 6161–6164. IEEE.
   Google Scholar
• Cheng, G., Z. Li, J. Han, X. Yao, and L. Guo. 2018. “Exploring Hierarchical Convolutional Features for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (11): 6712–6722. doi:10.1109/TGRS.2018.2841823.
   Web of Science ®Google Scholar
• Chen, Y., H. Jiang, L. Chunyang, X. Jia, and P. Ghamisi. 2016. “Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 54 (10): 6232–6251. doi:10.1109/TGRS.2016.2584107.
   Web of Science ®Google Scholar
• Chen, Y., Z. Lin, X. Zhao, G. Wang, and Y. Gu. 2014. “Deep Learning-Based Classification of Hyperspectral Data.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7 (6): 2094–2107. doi:10.1109/JSTARS.2014.2329330.
   Web of Science ®Google Scholar
• Chen, Y., N. M. Nasrabadi, and T. D. Tran. 2011. “Hyperspectral Image Classification Using Dictionary-Based Sparse Representation.” IEEE Transactions on Geoscience and Remote Sensing 49 (10): 3973–3985. doi:10.1109/TGRS.2011.2129595.
   Web of Science ®Google Scholar
• Chen, Y., X. Zhao, and X. Jia. 2015. “Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8 (6): 2381–2392. doi:10.1109/JSTARS.2015.2388577.
   Web of Science ®Google Scholar
• Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, et al. 2020. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” arXiv preprint arXiv:2010.11929.
   Google Scholar
• Frohn, R. C. 2018. Remote Sensing for Landscape Ecology: New Metric Indicators for Monitoring, Modeling, and Assessment of Ecosystems. Boca Raton, Florida, USA: CRC Press.
   Google Scholar
• Gevaert, C. M., J. Suomalainen, J. Tang, and L. Kooistra. 2015. “Generation of Spectral–Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture Applications.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8 (6): 3140–3146. doi:10.1109/JSTARS.2015.2406339.
   Web of Science ®Google Scholar
• Ham, J., Y. Chen, M. M. Crawford, and J. Ghosh. 2005. “Investigation of the Random Forest Framework for Classification of Hyperspectral Data.” IEEE Transactions on Geoscience and Remote Sensing 43 (3): 492–501. doi:10.1109/TGRS.2004.842481.
   Web of Science ®Google Scholar
• Hang, R., Q. Liu, D. Hong, and P. Ghamisi. 2019. “Cascaded Recurrent Neural Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 57 (8): 5384–5394. doi:10.1109/TGRS.2019.2899129.
   Web of Science ®Google Scholar
• He, X., Y. Chen, and Z. Lin. 2021. “Spatial-Spectral Transformer for Hyperspectral Image Classification.” Remote Sensing 13 (3): 498. doi:10.3390/rs13030498.
   Web of Science ®Google Scholar
• Hendrycks, D., and K. Gimpel. 2016. “Gaussian Error Linear Units (Gelus).” arXiv preprint arXiv:1606.08415.
   Google Scholar
• He, Z., K. Xia, P. Ghamisi, H. Yuhen, S. Fan, and Z. Baokai. 2022. “HyperVitgan: Semisupervised Generative Adversarial Network with Transformer for Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15: 6053–6068. doi:10.1109/JSTARS.2022.3192127.
   Web of Science ®Google Scholar
• Hong, D., L. Gao, J. Yao, B. Zhang, A. Plaza, and J. Chanussot. 2020. “Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (7): 5966–5978. doi:10.1109/TGRS.2020.3015157.
   Web of Science ®Google Scholar
• Hong, D., Z. Han, J. Yao, L. Gao, B. Zhang, A. Plaza, and J. Chanussot. 2021. “SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–15. doi:10.1109/TGRS.2021.3130716.
   Web of Science ®Google Scholar
• Hu, W., Y. Huang, L. Wei, F. Zhang, and L. Hengchao. 2015. “Deep Convolutional Neural Networks for Hyperspectral Image Classification.” Journal of Sensors 2015: 1–12. 2015, doi:10.1155/2015/258619.
   Web of Science ®Google Scholar
• Jiao, L., M. Liang, H. Chen, S. Yang, H. Liu, and X. Cao. 2017. “Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 55 (10): 5585–5599. doi:10.1109/TGRS.2017.2710079.
   Web of Science ®Google Scholar
• Kong, Y., X. Wang, and Y. Cheng. 2018. “Spectral–Spatial Feature Extraction for HSI Classification Based on Supervised Hypergraph and Sample Expanded CNN.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (11): 4128–4140. doi:10.1109/JSTARS.2018.2869210.
   Web of Science ®Google Scholar
• Kruse, F. A., J. W. Boardman, and J. F. Huntington. 2003. “Comparison of Airborne Hyperspectral Data and EO-1 Hyperion for Mineral Mapping.” IEEE Transactions on Geoscience and Remote Sensing 41 (6): 1388–1400. doi:10.1109/TGRS.2003.812908.
   Web of Science ®Google Scholar
• Kwak, C., and A. Clayton-Matthews. 2002. “Multinomial Logistic Regression.” Nursing Research 51 (6): 404–410. doi:10.1097/00006199-200211000-00009.
   PubMed Web of Science ®Google Scholar
• Lee, K., H. Chang, L. Jiang, H. Zhang, T. Zhuowen, and C. Liu. 2021. “Simultaneous Electrical Bio-Impedance Plethysmography at Different Body Parts: Continuous and Non-Invasive Monitoring of Pulse Wave Velocity.” IEEE Transactions on Biomedical Circuits and Systems 15 (5): 1027–1038. arXiv preprint arXiv:2107.04589. doi:10.1109/TBCAS.2021.3115021.
   PubMed Web of Science ®Google Scholar
• Liang, M., L. Jiao, S. Yang, F. Liu, B. Hou, and H. Chen. 2018. “Deep Multiscale Spectral-Spatial Feature Fusion for Hyperspectral Images Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (8): 2911–2924. doi:10.1109/JSTARS.2018.2836671.
   Web of Science ®Google Scholar
• Lin, Z., Y. Chen, X. Zhao, and G. Wang. 2013. “Spectral-Spatial Classification of Hyperspectral Image Using Autoencoders.” In 2013 9th international conference on information, Communications & Signal Processing, Tainan, Taiwan, China, 1–5. IEEE.
   Google Scholar
• Li, T., J. Zhang, and Y. Zhang. 2014. “Classification of Hyperspectral Image Based on Deep Belief Networks.” In in Proc. ICIP, Paris, France, 5132–5136. IEEE.
   Google Scholar
• Loshchilov, I., and F. Hutter. 2017. “LM-CMA: An Alternative to L-BFGS for Large-Scale Black Box Optimization.” Evolutionary Computation 25 (1): 143–171. arXiv preprint arXiv:1711.05101. doi:10.1162/EVCO_a_00168.
   PubMed Web of Science ®Google Scholar
• Luo, Y., J. Zou, C. Yao, X. Zhao, L. Tao, and G. Bai. 2018. “HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image.” In 2018 International Conference on Audio, Language and Image Processing (ICALIP), Shanghai, China, 464–469. IEEE.
   Google Scholar
• Mei, S., J. Jingyu, J. Hou, X. Li, and D. Qian. 2017. “Learning Sensor-Specific Spatial-Spectral Features of Hyperspectral Images via Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 55 (8): 4520–4533. doi:10.1109/TGRS.2017.2693346.
   Web of Science ®Google Scholar
• Melgani, F., and L. Bruzzone. 2004. “Classification of Hyperspectral Remote Sensing Images with Support Vector Machines.” IEEE Transactions on Geoscience and Remote Sensing 42 (8): 1778–1790. doi:10.1109/TGRS.2004.831865.
   Web of Science ®Google Scholar
• Mou, L., P. Ghamisi, and X. Xiang Zhu. 2017. “Deep Recurrent Neural Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 55 (7): 3639–3655. doi:10.1109/TGRS.2016.2636241.
   Web of Science ®Google Scholar
• Qing, Y., W. Liu, L. Feng, and W. Gao. 2021. “Improved Transformer Net for Hyperspectral Image Classification.” Remote Sensing 13 (11): 2216. doi:10.3390/rs13112216.
   Web of Science ®Google Scholar
• Qin, A., Z. Shang, J. Tian, Y. Wang, T. Zhang, and Y. Yan Tang. 2018. “Spectral–Spatial Graph Convolutional Networks for Semisupervised Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 16 (2): 241–245. doi:10.1109/LGRS.2018.2869563.
   Web of Science ®Google Scholar
• Rasti, B., D. Hong, R. Hang, P. Ghamisi, X. Kang, J. Chanussot, and J. Atli Benediktsson. 2020. “Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep: Overview and Toolbox.” IEEE Geoscience and Remote Sensing Magazine 8 (4): 60–88. doi:10.1109/MGRS.2020.2979764.
   Web of Science ®Google Scholar
• Roy, S. K., G. Krishna, S. Ram Dubey, and B. B. Chaudhuri. 2019. “HybridSn: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 17 (2): 277–281. doi:10.1109/LGRS.2019.2918719.
   Web of Science ®Google Scholar
• Roy, S. K., S. Manna, T. Song, and L. Bruzzone. 2020. “Attention-Based Adaptive Spectral–Spatial Kernel ResNet for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (9): 7831–7843. doi:10.1109/TGRS.2020.3043267.
   Web of Science ®Google Scholar
• Song, W., L. Shutao, L. Fang, and L. Ting. 2018. “Hyperspectral Image Classification with Deep Feature Fusion Network.” IEEE Transactions on Geoscience and Remote Sensing 56 (6): 3173–3184. doi:10.1109/TGRS.2018.2794326.
   Web of Science ®Google Scholar
• Sun, L., G. Zhao, Y. Zheng, W. Zebin, K. Gao, and L. Ding. 2022. “Spectral-Spatial Feature Tokenization Transformer for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–17. doi:10.1109/TGRS.2022.3221534.
   Web of Science ®Google Scholar
• Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. 2017. “Attention is All You Need.” Advances in Neural Information Processing Systems 30.
   Google Scholar
• Wang, Q., L. Bei, T. Xiao, J. Zhu, L. Changliang, D. F. Wong, and L. S. Chao. 2019. “Learning Deep Transformer Models for Machine Translation.” arXiv preprint arXiv:1906.01787.
   Google Scholar
• Wang, W., S. Dou, Z. Jiang, and L. Sun. 2018. “A Fast Dense Spectral–Spatial Convolution Network Framework for Hyperspectral Images Classification.” Remote Sensing 10 (7): 1068. doi:10.3390/rs10071068.
   Web of Science ®Google Scholar
• Wan, S., S. Pan, P. Zhong, X. Chang, J. Yang, and C. Gong. 2021. “Dual Interactive Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–14. doi:10.1109/TGRS.2021.3075223.
   Web of Science ®Google Scholar
• Wu, H., and S. Prasad. 2017. “Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification.” IEEE Transactions on Image Processing 27 (3): 1259–1270. doi:10.1109/TIP.2017.2772836.
   PubMed Web of Science ®Google Scholar
• Xu, X., L. Wei, Q. Ran, D. Qian, L. Gao, and B. Zhang. 2017. “Multisource Remote Sensing Data Classification Based on Convolutional Neural Network.” IEEE Transactions on Geoscience and Remote Sensing 56 (2): 937–949. doi:10.1109/TGRS.2017.2756851.
   Web of Science ®Google Scholar
• Yang, J., Y.Q. Zhao, and J. Cheung-Wai Chan. 2017. “Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification.” IEEE Transactions on Geoscience and Remote Sensing 55 (8): 4729–4742. doi:10.1109/TGRS.2017.2698503.
   Web of Science ®Google Scholar
• Yue, J., W. Zhao, S. Mao, and H. Liu. 2015. “Spectral–Spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks.” Remote Sensing Letters 6 (6): 468–477. doi:10.1080/2150704X.2015.1047045.
   Web of Science ®Google Scholar
• Zhan, Y., H. Dan, Y. Wang, and Y. Xianchuan. 2017. “Semisupervised Hyperspectral Image Classification Based on Generative Adversarial Networks.” IEEE Geoscience and Remote Sensing Letters 15 (2): 212–216. doi:10.1109/LGRS.2017.2780890.
   Web of Science ®Google Scholar
• Zhang, L., L. Zhang, and B. Du. 2016. “Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art.” IEEE Geoscience and Remote Sensing Magazine 4 (2): 22–40. doi:10.1109/MGRS.2016.2540798.
   Web of Science ®Google Scholar
• Zhao, W., and D. Shihong. 2016. “Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach.” IEEE Transactions on Geoscience and Remote Sensing 54 (8): 4544–4554. doi:10.1109/TGRS.2016.2543748.
   Web of Science ®Google Scholar
• Zhong, Z., L. Jonathan, Z. Luo, and M. Chapman. 2017. “Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework.” IEEE Transactions on Geoscience and Remote Sensing 56 (2): 847–858. doi:10.1109/TGRS.2017.2755542.
   Web of Science ®Google Scholar
• Zhou, P., J. Han, G. Cheng, and B. Zhang. 2019. “Learning Compact and Discriminative Stacked Autoencoder for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 57 (7): 4823–4833. doi:10.1109/TGRS.2019.2893180.
   Web of Science ®Google Scholar
• Zhou, F., R. Hang, Q. Liu, and X. Yuan. 2019. “Hyperspectral Image Classification Using Spectral-Spatial LSTMs.” Neurocomputing 328: 39–47. doi:10.1016/j.neucom.2018.02.105.
   Web of Science ®Google Scholar
• Zhu, L., Y. Chen, P. Ghamisi, and J. Atli Benediktsson. 2018. “Generative Adversarial Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (9): 5046–5063. doi:10.1109/TGRS.2018.2805286.
   Web of Science ®Google Scholar
• Zhu, X. X., D. Tuia, L. Mou, G.S. Xia, L. Zhang, X. Feng, and F. Fraundorfer. 2017. “Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources.” IEEE Geoscience and Remote Sensing Magazine 5 (4): 8–36. doi:10.1109/MGRS.2017.2762307.
   Web of Science ®Google Scholar