Hyperspectral image classification by integrating attention-based LSTM and hybrid spectral networks

References

• Abdulsamad, T., F. Chen, Y. Xue, Y. Wang, L. Yang, and D. Zeng. 2021. “Hyperspectral Image Classification Based on Spectral and Spatial Information Using ResNet with Channel Attention.” Optical and Quantum Electronics 53 (3): 1–20. doi:10.1007/s11082-020-02671-4.
   Web of Science ®Google Scholar
• Abidin, M. A. A. M., H. Z. M. Shafri, M. M. A. Al-Habshi, and N. S. N. Shaharum. 2021. ”Evaluating the Performance of the State-Of-The-Art HybridSn Deep Learning Algorithm for Airborne Hyperspectral Image Classification.” In IOP Conference Series: Earth and Environmental Science (Vol. 767, No. 1, 012019). IOP Publishing.
   Google Scholar
• Audebert, N., B. Le Saux, and S. Lefèvre. 2019. “Deep Learning for Classification of Hyperspectral Data: A Comparative Review.” IEEE Geoscience and Remote Sensing Magazine 7 (2): 159–173. doi:10.1109/MGRS.2019.2912563.
   Web of Science ®Google Scholar
• Borzov, S. M. and O. I. Potaturkin. 2018. “Spectral-Spatial Methods for Hyperspectral Image Classification. Review.” Optoelectronics, Instrumentation and Data Processing 54 (6): 582–599. doi:10.3103/S8756699018060079.
   Web of Science ®Google Scholar
• Cai, W., B. Liu, Z. Wei, M. Li, and J. Kan. 2021. “TARDB-Net: Triple-Attention Guided Residual Dense and BiLstm Networks for Hyperspectral Image Classification.” Multimedia Tools and Applications 80 (7): 11291–11312. doi:10.1007/s11042-020-10188-x.
   Web of Science ®Google Scholar
• Cho, Y., S. W. Song, J. Sung, Y. S. Jeong, C. R. Park, and H. M. Kim. 2017. “Hyperspectral Depth-Profiling with Deep Raman Spectroscopy for Detecting Chemicals in Building Materials.” The Analyst 142 (19): 3613–3619. doi:10.1039/C7AN00894E.
   PubMed Web of Science ®Google Scholar
• Ding, Y., X. Zhao, Z. Zhang, W. Cai, and N. Yang. 2021. Graph Sample and Aggregate-Attention Network for Hyperspectral Image Classification. IEEE Geoscience and Remote Sensing Letters doi:10.1109/LGRS.2021.3062944.
   Google Scholar
• Dong, Z., Y. Cai, Z. Cai, X. Liu, Z. Yang, and M. Zhuge. 2020. Cooperative Spectral-Spatial Attention Dense Network for Hyperspectral Image Classification. IEEE Geoscience and Remote Sensing Letters. doi:10.1109/LGRS.2020.2989437
   Google Scholar
• Fang, B., Y. Li, H. Zhang, and J. C. W. Chan. 2019. “Hyperspectral Images Classification Based on Dense Convolutional Networks with Spectral-Wise Attention Mechanism.” Remote Sensing 11 (2): 159. doi:10.3390/rs11020159.
   Web of Science ®Google Scholar
• Feng, F., S. Wang, C. Wang, and J. Zhang. 2019. “Learning Deep Hierarchical Spatial–spectral Features for Hyperspectral Image Classification Based on Residual 3D-2D CNN.” Sensors 19 (23): 5276. doi:10.3390/s19235276.
   PubMed Web of Science ®Google Scholar
• Feng, J., D. Li, J. Gu, X. Cao, R. Shang, X. Zhang, and L. Jiao. 2021. “Deep Reinforcement Learning for Semisupervised Hyperspectral Band Selection.” In IEEE Transactions on Geoscience and Remote Sensing doi:10.1109/TGRS.2021.3049372
   Google Scholar
• Gao, H., Y. Yang, D. Yao, and C. Li. 2019. “Hyperspectral Image Classification with Pre-Activation Residual Attention Network.” IEEE Access 7: 176587–176599. doi:10.1109/ACCESS.2019.2957163.
   Web of Science ®Google Scholar
• Gao, H., Y. Miao, X. Cao, and C. Li. 2021. “Densely Connected Multiscale Attention Network for Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14: 2563–2576. doi:10.1109/JSTARS.2021.3056124.
   Web of Science ®Google Scholar
• Ghassemi, M., H. Ghassemian, and M. Imani. 2021. “Hyperspectral Image Classification by Optimizing Convolutional Neural Networks Based on Information Theory and 3D-Gabor Filters.” International Journal of Remote Sensing 42 (11): 4380–4410. doi:10.1080/01431161.2021.1892854.
   Web of Science ®Google Scholar
• Gong, H., T. Mu, Q. Li, F. Han, A. Tuniyazi, and H. Li, … H. Dai. 2021. ”Hyperspectral Image Classification Using 3D-2D CNN with Multi-Scale Information Extraction and Fusion Module.” In Fourth International Conference on Photonics and Optical Engineering (Vol. 11761 1176116). International Society for Optics and Photonics.
   Google Scholar
• Gwon, Y., D. Kim, and H. You. 2020. “A Standardized Procedure on Building Spectral Library for Hazardous Chemicals Mixed in River Flow Using Hyperspectral Image.” Journal of Korea Water Resources Association 53 (10): 845–859.
   Google Scholar
• Hamida, A. B., A. Benoit, P. Lambert, and C. B. Amar. 2018. “3-D Deep Learning Approach for Remote Sensing Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (8): 4420–4434. doi:10.1109/TGRS.2018.2818945.
   Web of Science ®Google Scholar
• Hang, R., Z. Li, Q. Liu, P. Ghamisi, and S. S. Bhattacharyya. 2020. “Hyperspectral Image Classification with Attention-Aided Cnns.” IEEE Transactions on Geoscience and Remote Sensing 59 (3): 2281–2293. doi:10.1109/TGRS.2020.3007921.
   Web of Science ®Google Scholar
• Haut, J. M., M. E. Paoletti, J. Plaza, A. Plaza, and J. Li. 2019. “Visual Attention-Driven Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 57 (10): 8065–8080. doi:10.1109/TGRS.2019.2918080.
   Web of Science ®Google Scholar
• He, L., J. Li, C. Liu, and S. Li. 2017. “Recent Advances on Spectral–spatial Hyperspectral Image Classification: An Overview and New Guidelines.” IEEE Transactions on Geoscience and Remote Sensing 56 (3): 1579–1597. doi:10.1109/TGRS.2017.2765364.
   Web of Science ®Google Scholar
• Imani, M. and H. Ghassemian. 2020. “An Overview on Spectral and Spatial Information Fusion for Hyperspectral Image Classification: Current Trends and Challenges.” Information Fusion 59: 59–83. doi:10.1016/j.inffus.2020.01.007.
   Web of Science ®Google Scholar
• Jia, S., S. Jiang, Z. Lin, N. Li, M. Xu, and S. Yu. 2021. “A Survey: Deep Learning for Hyperspectral Image Classification with Few Labeled Samples.” Neurocomputing 448: 179–204. doi:10.1016/j.neucom.2021.03.035.
   Web of Science ®Google Scholar
• Kumar, B., O. Dikshit, A. Gupta, and M. K. Singh. 2020. “Feature Extraction for Hyperspectral Image Classification: A Review.” International Journal of Remote Sensing 41 (16): 6248–6287. doi:10.1080/01431161.2020.1736732.
   Web of Science ®Google Scholar
• Li, J., R. Cui, B. Li, R. Song, Y. Li, and Q. Du. 2019. “Hyperspectral Image Super-Resolution with 1D–2D Attentional Convolutional Neural Network.” Remote Sensing 11 (23): 2859. doi:10.3390/rs11232859.
   Web of Science ®Google Scholar
• Li, J., R. Cui, B. Li, R. Song, Y. Li, Y. Dai, and Q. Du. 2020. “Hyperspectral Image Super-Resolution by Band Attention Through Adversarial Learning.” IEEE Transactions on Geoscience and Remote Sensing 58 (6): 4304–4318. doi:10.1109/TGRS.2019.2962713.
   Web of Science ®Google Scholar
• Lu, J., H. Liu, Y. Yao, S. Tao, Z. Tang, and J. Lu. 2020. ”HSI Road: A Hyper Spectral Image Dataset for Road Segmentation.” In 2020 IEEE International Conference on Multimedia and Expo (ICME), 1–6. IEEE.
   Google Scholar
• Makantasis, K., K. Karantzalos, A. Doulamis, and N. Doulamis. 2015. ”Deep Supervised Learning for Hyperspectral Data Classification Through Convolutional Neural Networks.” In 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 4959–4962. IEEE.
   Google Scholar
• Maschler, J., C. Atzberger, and M. Immitzer. 2018. “Individual Tree Crown Segmentation and Classification of 13 Tree Species Using Airborne Hyperspectral Data.” Remote Sensing 10 (8): 1218. doi:10.3390/rs10081218.
   Web of Science ®Google Scholar
• Mei, X., E. Pan, Y. Ma, X. Dai, J. Huang, F. Fan, and J. Ma. 2019. “Spectral-Spatial Attention Networks for Hyperspectral Image Classification.” Remote Sensing 11 (8): 963. doi:10.3390/rs11080963.
   Web of Science ®Google Scholar
• Miyoshi, G. T., M. D. S. Arruda, L. P. Osco, J. Marcato Junior, D. N. Gonçalves, and N. N. Imai, … W. N. Gonçalves. 2020. “A Novel Deep Learning Method to Identify Single Tree Species in UAV-Based Hyperspectral Images.” Remote Sensing 12 (8): 1294. doi:10.3390/rs12081294.
   Web of Science ®Google Scholar
• Mou, L. and X. X. Zhu. 2019. “Learning to Pay Attention on Spectral Domain: A Spectral Attention Module-Based Convolutional Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (1): 110–122. doi:10.1109/TGRS.2019.2933609.
   Web of Science ®Google Scholar
• Pham, T. T., M. A. Takalkar, M. Xu, D. T. Hoang, H. A. Truong, E. Dutkiewicz, and S. Perry. 2019. ”Airborne Object Detection Using Hyperspectral Imaging: Deep Learning Review.” In International Conference on Computational Science and Its Applications, 306–321. Cham: Springer.
   Google Scholar
• Qing, Y. and W. Liu. 2021. “Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism.” Remote Sensing 13 (3): 335. doi:10.3390/rs13030335.
   Web of Science ®Google Scholar
• Qu, L., X. Zhu, J. Zheng, and L. Zou. 2021. “Triple-Attention-Based Parallel Network for Hyperspectral Image Classification.” Remote Sensing 13 (2): 324. doi:10.3390/rs13020324.
   Web of Science ®Google Scholar
• Roy, S. K., G. Krishna, S. R. Dubey, and B. B. Chaudhuri. 2019. “HybridSn: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 17 (2): 277–281. doi:10.1109/LGRS.2019.2918719.
   Web of Science ®Google Scholar
• Sawant, S. S. and M. Prabukumar. 2018. “A Review on Graph-Based Semi-Supervised Learning Methods for Hyperspectral Image Classification.” The Egyptian Journal of Remote Sensing and Space Science 23(2):243-248. doi:10.1016/j.ejrs.2018.11.001
   Web of Science ®Google Scholar
• Shao, Y., J. Lan, Y. Liang, and J. Hu. 2021. “Residual Networks with Multi-Attention Mechanism for Hyperspectral Image Classification.” Arabian Journal of Geosciences 14 (4): 1–19. doi:10.1007/s12517-021-06516-6.
   Google Scholar
• Shi, Q., X. Tang, T. Yang, R. Liu, and L. Zhang. 2021. “Hyperspectral Image Denoising Using a 3-D Attention Denoising Network.” In IEEE Transactions on Geoscience and Remote Sensing. doi:10.1109/TGRS.2020.3045273
   Google Scholar
• Sun, H., X. Zheng, X. Lu, and S. Wu. 2019. “Spectral–spatial Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (5): 3232–3245. doi:10.1109/TGRS.2019.2951160.
   Web of Science ®Google Scholar
• Wang, D., R. Vinson, M. Holmes, G. Seibel, A. Bechar, S. Nof, and Y. Tao. 2019. “Early Detection of Tomato Spotted Wilt Virus by Hyperspectral Imaging and Outlier Removal Auxiliary Classifier Generative Adversarial Nets (OR-AC-GAN).” Scientific Reports 9 (1): 1–14. doi:10.1038/s41598-018-37186-2.
   PubMed Web of Science ®Google Scholar
• Wei, L., Z. Yuan, Y. Zhong, L. Yang, X. Hu, and Y. Zhang. 2019. “An Improved Gradient Boosting Regression Tree Estimation Model for Soil Heavy Metal (Arsenic) Pollution Monitoring Using Hyperspectral Remote Sensing.” Applied Sciences 9 (9): 1943. doi:10.3390/app9091943.
   Google Scholar
• Woo, S., J. Park, J. Y. Lee, and I. S. Kweon. 2018. “Cbam: Convolutional Block Attention Module.” In Proceedings of the European Conference on Computer Vision (ECCV), 3–19.
   Google Scholar
• Wu, S., J. Zhang, and C. Zhong. 2019. ”Multiscale Spectral-Spatial Unified Networks for Hyperspectral Image Classification.” In IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium Yokohama, Japan, 2706–2709. IEEE.
   Google Scholar
• Xu, Q., Y. Xiao, D. Wang, and B. Luo. 2020. “CSA-MSO3DCNN: Multiscale Octave 3D CNN with Channel and Spatial Attention for Hyperspectral Image Classification.” Remote Sensing 12 (1): 188. doi:10.3390/rs12010188.
   Web of Science ®Google Scholar
• Xue, Z., X. Yu, B. Liu, X. Tan, and X. Wei. 2021. “HResNetam: Hierarchical Residual Network with Attention Mechanism for Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14: 3566–3580. doi:10.1109/JSTARS.2021.3065987.
   Web of Science ®Google Scholar
• Yang, C., L. Bruzzone, H. Zhao, Y. Tan, and R. Guan. 2018. “Superpixel-Based Unsupervised Band Selection for Classification of Hyperspectral Images.” IEEE Transactions on Geoscience and Remote Sensing 56 (12): 7230–7245. doi:10.1109/TGRS.2018.2849443.
   Web of Science ®Google Scholar
• Yang, B., H. Li, and Z. Guo. 2020. “Learning a Deep Similarity Network for Hyperspectral Image Classification.” In IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 4(1): 128–137. doi:10.1109/JSTARS.2011.2116769 .
   Google Scholar
• Yu, C., R. Han, M. Song, C. Liu, and C. I. Chang. 2020. “A Simplified 2D-3D CNN Architecture for Hyperspectral Image Classification Based on Spatial–spectral Fusion.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13: 2485–2501. doi:10.1109/JSTARS.2020.2983224.
   Web of Science ®Google Scholar
• Zagoruyko, S. and N. Komodakis. 2016.”Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer.” arXiv preprint arXiv:1612.03928.
   Google Scholar
• Zhang, H., Y. Li, Y. Zhang, and Q. Shen. 2017. “Spectral-Spatial Classification of Hyperspectral Imagery Using a Dual-Channel Convolutional Neural Network.” Remote Sensing Letters 8 (5): 438–447. doi:10.1080/2150704X.2017.1280200.
   Web of Science ®Google Scholar
• Zhang, C., J. Yue, and Q. Qin. 2020. “Global Prototypical Network for Few-Shot Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13: 4748–4759.‏. doi:10.1109/JSTARS.2020.3017544.
   Web of Science ®Google Scholar
• Zhang, H., J. Lan, and Y. Guo. 2021. “A Dense Spatial–spectral Attention Network for Hyperspectral Image Band Selection.” Remote Sensing Letters 12 (1): 1–13. doi:10.1080/2150704X.2020.1836425.
   Web of Science ®Google Scholar
• Zhao, W. and S. Du. 2016. “Spectral–spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach.” IEEE Transactions on Geoscience and Remote Sensing 54 (8): 4544–4554. doi:10.1109/TGRS.2016.2543748.
   Web of Science ®Google Scholar
• Zhao, C., X. Li, and H. Zhu. 2017. “Hyperspectral Anomaly Detection Based on Stacked Denoising Autoencoders.” Journal of Applied Remote Sensing 11 (4): 042605. doi:10.1117/1.JRS.11.042605.
   Web of Science ®Google Scholar
• Zhao, C., X. Wan, G. Zhao, B. Cui, W. Liu, and B. Qi. 2017. “Spectral-Spatial Classification of Hyperspectral Imagery Based on Stacked Sparse Autoencoder and Random Forest.” European Journal of Remote Sensing 50 (1): 47–63. doi:10.1080/22797254.2017.1274566.
   Web of Science ®Google Scholar
• Zhao, L., Y. Zeng, P. Liu, and G. He. 2020. “Band Selection via Explanations from Convolutional Neural Networks.” IEEE Access 8: 56000–56014. doi:10.1109/ACCESS.2020.2981475.
   Web of Science ®Google Scholar
• Zhao, L., T. Jiang, Y. Liu, T. Zhou, and Y. Peng. 2021. “Joint Spectral-Spatial Hyperspectral Classification Based on Transfer Learning (SSTL) from Red-Green-Blue (RGB) Images.” International Journal of Remote Sensing 42 (11): 4023–4041. doi:10.1080/01431161.2021.1883199.
   Web of Science ®Google Scholar
• Zheng, Y., J. Li, Y. Li, J. Guo, X. Wu, and J. Chanussot. 2020. “Hyperspectral Pansharpening Using Deep Prior and Dual Attention Residual Network.” IEEE Transactions on Geoscience and Remote Sensing 58 (11): 8059–8076. doi:10.1109/TGRS.2020.2986313.
   Web of Science ®Google Scholar
• Zhu, M., L. Jiao, F. Liu, S. Yang, and J. Wang. 2020. “Residual Spectral–spatial Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (1): 449–462. doi:10.1109/TGRS.2020.2994057.
   Web of Science ®Google Scholar