Multi-granularity vision transformer via semantic token for hyperspectral image classification

References

• Ba, J. L., J. Ryan Kiros, and G. E. Hinton. 2016. “Layer Normalization.” arXiv preprint arXiv:1607.06450.
   Google Scholar
• Chen, C.F.R, Q. Fan, and R. Panda. 2021. “CrossVit: Cross-Attention Multi-Scale Vision Transformer for Image Classification.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 357–366.
   Google Scholar
• Chen, Y., H. Jiang, C. Li, X. Jia, and P. Ghamisi. 2016. “Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 54 (10): 6232–6251. doi:10.1109/TGRS.2016.2584107.
   Web of Science ®Google Scholar
• Crosta, A. P., and J. M. MOORE. 1989. “Geological Mapping Using Landsat Thematic Mapper Imagery in Almeria Province, South-East Spain.” International Journal of Remote Sensing 10 (3): 505–514. doi:10.1080/01431168908903888.
   Web of Science ®Google Scholar
• Dehghani, M., S. Gouws, O. Vinyals, J. Uszkoreit, and Ł. Kaiser. 2018. “Universal Transformers.” arXiv preprint arXiv:1807.03819.
   Google Scholar
• Devlin, J., M.-W. Chang, K. Lee, and K. Toutanova. 2018. “Bert: Pre-Training of Deep Bidirectional Transformers for Language Understanding.” arXiv preprint arXiv:1810.04805.
   Google Scholar
• Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, et al. 2020. ”An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” arXiv preprint arXiv:2010.11929.
   Google Scholar
• Ehrlich, D., J.E. Estes, and A. Singh. 1994. “Applications of NOAA-AVHRR 1km Data for Environmental Monitoring.” International Journal of Remote Sensing 15 (1): 145–161. doi:10.1080/01431169408954056.
   Web of Science ®Google Scholar
• Gao, K., B. Liu, Z. Xue, X. Zuo, Y. Sun, M. Dai, et al. 2021. ”Deep Transformer Network for Hyperspectral Image Classification.” Academic Journal of Computing & Information Science 4 (7): 11–17.
   Google Scholar
• Hamida, A. B., A. Benoit, P. Lambert, and C. Ben Amar. 2018. “3-D Deep Learning Approach for Remote Sensing Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (8): 4420–4434. doi:10.1109/TGRS.2018.2818945.
   Web of Science ®Google Scholar
• Han, K., A. Xiao, E. Wu, J. Guo, C. Xu, and Y. Wang. 2021. “Transformer in Transformer.” Advances in Neural Information Processing Systems 34: 15908–15919.
   Google Scholar
• Hendrycks, D., and K. Gimpel. 2016. “Gaussian Error Linear Units (Gelus).” arXiv preprint arXiv:1606.08415.
   Google Scholar
• He, J., L. Zhao, H. Yang, M. Zhang, and W. Li. 2020. “HSI-BERT: Hyperspectral Image Classification Using the Bidirectional Encoder Representation from Transformers.” IEEE Transactions on Geoscience and Remote Sensing 58 (1): 165–178. doi:10.1109/TGRS.2019.2934760.
   Web of Science ®Google Scholar
• Hong, D., Z. Han, J. Yao, L. Gao, B. Zhang, A. Plaza, and J. Chanussot. 2021. “SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–15. doi:10.1109/TGRS.2021.3130716.
   Web of Science ®Google Scholar
• Hoogendoorn, S.P., H. J. Van Zuylen, M. Schreuder, B. Gorte, and G. Vosselman. 2003. “Microscopic Traffic Data Collection by Remote Sensing.” Transportation Research Record 1855 (1): 121–128. doi:10.3141/1855-15.
   Google Scholar
• Hu, W.-S., L. Heng-Chao, L. Pan, W. Li, R. Tao, and Q. Du. 2020. “Spatial–Spectral Feature Extraction via Deep ConvLstm Neural Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (6): 4237–4250. doi:10.1109/TGRS.2019.2961947.
   Web of Science ®Google Scholar
• Hu, W., Y. Huang, L. Wei, F. Zhang, and H. Li. 2015. “Deep Convolutional Neural Networks for Hyperspectral Image Classification.” Journal of Sensors 2015: 1–12. doi:10.1155/2015/258619.
   Web of Science ®Google Scholar
• Lee, H., and H. Kwon. 2017. “Going Deeper with Contextual CNN for Hyperspectral Image Classification.” IEEE Transactions on Image Processing 26 (10): 4843–4855. doi:10.1109/TIP.2017.2725580.
   PubMed Web of Science ®Google Scholar
• Pan, Z., J. Huang, and F. Wang. 2013. “Multi Range Spectral Feature Fitting for Hyperspectral Imagery in Extracting Oilseed Rape Planting Area.” International Journal of Applied Earth Observation and Geoinformation 25: 21–29. doi:10.1016/j.jag.2013.03.002.
   Web of Science ®Google Scholar
• Qing, Y., W. Liu, L. Feng, and W. Gao. 2021. “Improved Transformer Net for Hyperspectral Image Classification.” Remote Sensing 13 (11): 2216. doi:10.3390/rs13112216.
   Web of Science ®Google Scholar
• Roy, S. K., G. Krishna, S. Ram Dubey, and B. B. Chaudhuri. 2019. “HybridSn: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 17 (2): 277–281. doi:10.1109/LGRS.2019.2918719.
   Web of Science ®Google Scholar
• Shutao, L., W. Song, L. Fang, Y. Chen, P. Ghamisi, and J. A. Benediktsson. 2019. “Deep Learning for Hyperspectral Image Classification: An Overview.” IEEE Transactions on Geoscience and Remote Sensing 57 (9): 6690–6709. doi:10.1109/TGRS.2019.2907932.
   Web of Science ®Google Scholar
• Sun, L., G. Zhao, Y. Zheng, and Z. Wu. 2022. “Spectral–Spatial Feature Tokenization Transformer for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–14. doi:10.1109/TGRS.2022.3144158.
   Web of Science ®Google Scholar
• Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. 2017. “Attention is All You Need.” Advances in Neural Information Processing Systems 30: 5998–6008.
   Google Scholar
• Wang, X., R. Girshick, A. Gupta, and K. He. 2018. “Non-Local Neural Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, Utah, USA, 7794–7803.
   Google Scholar
• Wang, J., S. Guo, R. Huang, L. Li, X. Zhang, and L. Jiao. 2021. “Dual-Channel Capsule Generation Adversarial Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–16. doi:10.1109/TGRS.2020.3044312.
   Web of Science ®Google Scholar
• Wan, S., C. Gong, P. Zhong, B. Du, L. Zhang, and J. Yang. 2019. “Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (5): 3162–3177. doi:10.1109/TGRS.2019.2949180.
   Web of Science ®Google Scholar
• Yue, X., S. Sun, Z. Kuang, M. Wei, P. H. Torr, W. Zhang, and D. Lin. 2021. “Vision Transformer with Progressive Sampling.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 387–396.
   Google Scholar
• Zhang, X., Y. Sun, K. Jiang, C. Li, L. Jiao, and H. Zhou. 2018. “Spatial Sequential Recurrent Neural Network for Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (11): 4141–4155. doi:10.1109/JSTARS.2018.2844873.
   Web of Science ®Google Scholar
• Zheng, X., T. Gong, X. Li, and X. Lu. 2021. “Generalized Scene Classification from Small-Scale Datasets with Multitask Learning.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–11. doi:10.1109/TGRS.2021.3116147.
   Web of Science ®Google Scholar
• Zhong, Z., Y. Li, L. Ma, J. Li, and W.-S. Zheng. 2021. “Spectral–Spatial Transformer Network for Hyperspectral Image Classification: A Factorized Architecture Search Framework.” IEEE Transactions on Geoscience and Remote SensingIeee Transactions on Geoscience and Remote Sensing 60: 1–15. doi:10.1109/TGRS.2021.3115699.
   Web of Science ®Google Scholar
• Zhu, J., L. Fang, and P. Ghamisi. 2018. “Deformable Convolutional Neural Networks for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 15 (8): 1254–1258. doi:10.1109/LGRS.2018.2830403.
   Web of Science ®Google Scholar