824
Views
0
CrossRef citations to date
0
Altmetric
Articles

Classification of hyperspectral images using fusion of CNN and MiniGCN with SVM

, , , &
Pages 3601-3617 | Received 14 Feb 2023, Accepted 21 Jun 2023, Published online: 13 Sep 2023

References

  • Anand, R., S. Veni, and J. Aravinth. 2021. “Robust Classification Technique for Hyperspectral Images Based on 3D-Discrete Wavelet Transform.” Remote Sensing 13 (7), doi:10.3390/rs13071255.
  • Anderson, James R., Ernest E. Hardy, John T. Roach, and Richard E. Witmer. 1976. “Land Use and Land Cover Classification System for Use with Remote Sensor Data.” U S Geol Surv, Prof Pap 964. doi:10.3133/PP964.
  • Audebert, Nicolas, Bertrand Le Saux, and Sebastien Lefevre. 2019. “Deep Learning for Classification of Hyperspectral Data: A Comparative Review.” IEEE Geoscience and Remote Sensing Magazine 7 (2), doi:10.1109/MGRS.2019.2912563.
  • Benediktsson, Jón Atli, Jón Aevar Palmason, and Johannes R. Sveinsson. 2005. “Classification of Hyperspectral Data from Urban Areas Based on Extended Morphological Profiles.” IEEE Transactions on Geoscience and Remote Sensing 43, doi:10.1109/TGRS.2004.842478.
  • Bioucas-Dias, José M., Antonio Plaza, Nicolas Dobigeon, Mario Parente, Qian Du, Paul Gader, and Jocelyn Chanussot. 2012. “Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, doi:10.1109/JSTARS.2012.2194696.
  • Bruna, Joan, Wojciech Zaremba, Arthur Szlam, and Yann LeCun. 2014. “Spectral Networks and Deep Locally Connected Networks on Graphs.” 2nd International Conference on Learning Representations, ICLR 2014 - Conference Track Proceedings.
  • Chen, Yushi, Hanlu Jiang, Chunyang Li, Xiuping Jia, and Pedram Ghamisi. 2016. “Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 54 (10), doi:10.1109/TGRS.2016.2584107.
  • Chen, Yushi, Zhouhan Lin, Xing Zhao, Gang Wang, and Yanfeng Gu. 2014. “Deep Learning-Based Classification of Hyperspectral Data.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7 (6), doi:10.1109/JSTARS.2014.2329330.
  • Chen, Yi, Nasser M. Nasrabadi, and Trac D. Tran. 2011. “Hyperspectral Image Classification Using Dictionary-Based Sparse Representation.” IEEE Transactions on Geoscience and Remote Sensing 49 (10 PART 2), doi:10.1109/TGRS.2011.2129595.
  • Chen, Yushi, Xing Zhao, and Xiuping Jia. 2015. “Spectral-Spatial Classification of Hyperspectral Data Based on Deep Belief Network.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8 (6), doi:10.1109/JSTARS.2015.2388577.
  • Defferrard, Michaël, Xavier Bresson, and Pierre Vandergheynst. 2016. “Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering.” In Advances in Neural Information Processing Systems.
  • Ding, Yun, Yuanyuan Guo, Yanwen Chong, Shaoming Pan, and Jinpeng Feng. 2021. “Global Consistent Graph Convolutional Network for Hyperspectral Image Classification.” IEEE Transactions on Instrumentation and Measurement 70), doi:10.1109/TIM.2021.3056750.
  • Ding, Yun, Shaoming Pan, and Yanwen Chong. 2020. “Robust Spatial-Spectral Block-Diagonal Structure Representation with Fuzzy Class Probability for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (3), doi:10.1109/TGRS.2019.2948361.
  • Dong, Yanni, Quanwei Liu, Bo Du, and Liangpei Zhang. 2022. “Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Image Processing 31: 1559–1572. doi:10.1109/TIP.2022.3144017.
  • Gao, Lianru, Danfeng Hong, Jing Yao, Bing Zhang, Paolo Gamba, and Jocelyn Chanussot. 2021. “Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning.” IEEE Transactions on Geoscience and Remote Sensing 59 (3), doi:10.1109/TGRS.2020.3000684.
  • Ghamisi, Pedram, Naoto Yokoya, Jun Li, Wenzhi Liao, Sicong Liu, Javier Plaza, Behnood Rasti, and Antonio Plaza. 2017. “Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art.” IEEE Geoscience and Remote Sensing Magazine, doi:10.1109/MGRS.2017.2762087.
  • Gong, Zhiqiang, Ping Zhong, Yang Yu, Weidong Hu, and Shutao Li. 2019. “A CNN with Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 57 (6), doi:10.1109/TGRS.2018.2886022.
  • Gori, Marco, Gabriele Monfardini, and Franco Scarselli. 2005. “A new Model for Learning in Graph Domains.” In Proceedings of the International Joint Conference on Neural Networks. Vol. 2, doi:10.1109/IJCNN.2005.1555942.
  • Hamilton, William L., Rex Ying, and Jure Leskovec. 2017. “Inductive Representation Learning on Large Graphs.” Advances in Neural Information Processing Systems 2017-December.
  • Hanachi, Refka, Akrem Sellami, Imed Riadh Farah, and Mauro Dalla Mura. 2022. “Multi Spectral-Spatial Gabor Feature Fusion Based On End-To-End Deep Learning For Hyperspectral Image Classification.” In 2022 12th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), 1–6. IEEE. doi:10.1109/WHISPERS56178.2022.9955105.
  • Hang, Renlong, Qingshan Liu, Danfeng Hong, and Pedram Ghamisi. 2019. “Cascaded Recurrent Neural Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 57 (8), doi:10.1109/TGRS.2019.2899129.
  • Hang, Renlong, Feng Zhou, Qingshan Liu, and Pedram Ghamisi. 2021. “Classification of Hyperspectral Images via Multitask Generative Adversarial Networks.” IEEE Transactions on Geoscience and Remote Sensing 59 (2): 1424–1436. doi:10.1109/TGRS.2020.3003341.
  • Hong, Danfeng, Lianru Gao, Jing Yao, Bing Zhang, Antonio Plaza, and Jocelyn Chanussot. 2021. “Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (7), doi:10.1109/TGRS.2020.3015157.
  • Hong, Danfeng, Xin Wu, Pedram Ghamisi, Jocelyn Chanussot, Naoto Yokoya, and Xiao Xiang Zhu. 2020. “Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (6), doi:10.1109/TGRS.2019.2957251.
  • Hong, Danfeng, Naoto Yokoya, Jocelyn Chanussot, and Xiao Xiang Zhu. 2019. “An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing.” IEEE Transactions on Image Processing 28 (4), doi:10.1109/TIP.2018.2878958.
  • Hong, Danfeng, Naoto Yokoya, Gui Song Xia, Jocelyn Chanussot, and Xiao Xiang Zhu. 2020. “X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data.” ISPRS Journal of Photogrammetry and Remote Sensing 167), doi:10.1016/j.isprsjprs.2020.06.014.
  • Hu, Wei, Yangyu Huang, Li Wei, Fan Zhang, and Hengchao Li. 2015. “Deep Convolutional Neural Networks for Hyperspectral Image Classification.” Journal of Sensors 2015), doi:10.1155/2015/258619.
  • Huang, Rong, Danfeng Hong, Yusheng Xu, Wei Yao, and Uwe Stilla. 2020. “Multi-Scale Local Context Embedding for LiDAR Point Cloud Classification.” IEEE Geoscience and Remote Sensing Letters 17 (4), doi:10.1109/LGRS.2019.2927779.
  • Izenman, Alan J. 2008. Modern Multivariate Statistical Techniques. New York, NY: Springer New York. doi:10.1007/978-0-387-78189-1.
  • Kang, Jian, Danfeng Hong, Jialin Liu, Gerald Baier, Naoto Yokoya, and Begum Demir. 2021. “Learning Convolutional Sparse Coding on Complex Domain for Interferometric Phase Restoration.” IEEE Transactions on Neural Networks and Learning Systems 32 (2), doi:10.1109/TNNLS.2020.2979546.
  • Kipf, Thomas N., and Max Welling. 2017. “Semi-Supervised Classification with Graph Convolutional Networks.” 5th International Conference on Learning Representations, ICLR 2017 - Conference Track Proceedings.
  • Lee, Hyungtae, and Heesung Kwon. 2017. “Going Deeper with Contextual CNN for Hyperspectral Image Classification.” IEEE Transactions on Image Processing 26 (10), doi:10.1109/TIP.2017.2725580.
  • Li, Shutao, Weiwei Song, Leyuan Fang, Yushi Chen, Pedram Ghamisi, and Jon Atli Benediktsson. 2019. “Deep Learning for Hyperspectral Image Classification: An Overview.” IEEE Transactions on Geoscience and Remote Sensing 57 (9), doi:10.1109/TGRS.2019.2907932.
  • Li, Wei, Guodong Wu, Fan Zhang, and Qian Du. 2017. “Hyperspectral Image Classification Using Deep Pixel-Pair Features.” IEEE Transactions on Geoscience and Remote Sensing 55 (2), doi:10.1109/TGRS.2016.2616355.
  • Li, Ying, Haokui Zhang, and Qiang Shen. 2017. “Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network.” Remote Sensing 9 (1), doi:10.3390/rs9010067.
  • Licciardi, Giorgio, Prashanth Reddy Marpu, Jocelyn Chanussot, and Jon Atli Benediktsson. 2012. “Linear Versus Nonlinear PCA for the Classification of Hyperspectral Data Based on the Extended Morphological Profiles.” IEEE Geoscience and Remote Sensing Letters 9 (3), doi:10.1109/LGRS.2011.2172185.
  • Liu, Sicong, Qian Du, Xiaohua Tong, Alim Samat, and Lorenzo Bruzzone. 2019. “Unsupervised Change Detection in Multispectral Remote Sensing Images via Spectral-Spatial Band Expansion.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (9), doi:10.1109/JSTARS.2019.2929514.
  • Liu, Sicong, Daniele Marinelli, Lorenzo Bruzzone, and Francesca Bovolo. 2019. “A Review of Change Detection in Multitemporal Hyperspectral Images: Current Techniques, Applications, and Challenges.” IEEE Geoscience and Remote Sensing Magazine, doi:10.1109/MGRS.2019.2898520.
  • Liu, Qingshan, Feng Zhou, Renlong Hang, and Xiaotong Yuan. 2017. “Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification.” Remote Sensing 9 (12), doi:10.3390/rs9121330.
  • Luo, Yanan, Jie Zou, Chengfei Yao, Xiaosong Zhao, Tao Li, and Gang Bai. 2018. “HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image.” ICALIP 2018 - 6th International Conference on Audio, Language and Image Processing, doi:10.1109/ICALIP.2018.8455251.
  • Makantasis, Konstantinos, Konstantinos Karantzalos, Anastasios Doulamis, and Nikolaos Doulamis. 2015. “Deep Supervised Learning for Hyperspectral Data Classification Through Convolutional Neural Networks.” In International Geoscience and Remote Sensing Symposium (IGARSS). Vol. 2015-November, doi:10.1109/IGARSS.2015.7326945.
  • Monti, Federico, Davide Boscaini, Jonathan Masci, Emanuele Rodolà, Jan Svoboda, and Michael M. Bronstein. 2016. “Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, November.
  • Mou, Lichao, Pedram Ghamisi, and Xiao Xiang Zhu. 2018. “Unsupervised Spectral-Spatial Feature Learning via Deep Residual Conv-Deconv Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (1), doi:10.1109/TGRS.2017.2748160.
  • Mou, Lichao, Xiaoqiang Lu, Xuelong Li, and Xiao Xiang Zhu. 2020. “Nonlocal Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (12), doi:10.1109/TGRS.2020.2973363.
  • Paoletti, Mercedes E., Juan M. Haut, Nuno S. Pereira, Javier Plaza, and Antonio Plaza. 2021. “Ghostnet for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (12), doi:10.1109/TGRS.2021.3050257.
  • Peng, Jiangtao, and Qian Du. 2017. “Robust Joint Sparse Representation Based on Maximum Correntropy Criterion for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 55 (12), doi:10.1109/TGRS.2017.2743110.
  • Peng, Jiangtao, Weiwei Sun, and Qian Du. 2019. “Self-Paced Joint Sparse Representation for the Classification of Hyperspectral Images.” IEEE Transactions on Geoscience and Remote Sensing 57 (2), doi:10.1109/TGRS.2018.2865102.
  • Rodriguez, Paul, Janet Wiles, and Jeffrey L. Elman. 1999. “A Recurrent Neural Network That Learns to Count.” Connection Science 11 (1), doi:10.1080/095400999116340.
  • Sadad, Tariq, Asim Munir, Tanzila Saba, and Ayyaz Hussain. 2018. “Fuzzy C-Means and Region Growing Based Classification of Tumor from Mammograms Using Hybrid Texture Feature.” Journal of Computational Science, doi:10.1016/j.jocs.2018.09.015.
  • Saha, Sudipan, Lichao Mou, Xiao Xiang Zhu, Francesca Bovolo, and Lorenzo Bruzzone. 2021. “Semisupervised Change Detection Using Graph Convolutional Network.” IEEE Geoscience and Remote Sensing Letters 18 (4), doi:10.1109/LGRS.2020.2985340.
  • Samat, Alim, Claudio Persello, Sicong Liu, Erzhu Li, Zelang Miao, and Jilili Abuduwaili. 2018. “Classification of VHR Multispectral Images Using ExtraTrees and Maximally Stable Extremal Region-Guided Morphological Profile.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (9), doi:10.1109/JSTARS.2018.2824354.
  • Sawant, Shrutika S., and Prabukumar Manoharan. 2020. “Unsupervised Band Selection Based on Weighted Information Entropy and 3D Discrete Cosine Transform for Hyperspectral Image Classification.” International Journal of Remote Sensing 41 (10), doi:10.1080/01431161.2019.1711242.
  • Sha, Anshu, Bin Wang, Xiaofeng Wu, and Liming Zhang. 2021. “Semisupervised Classification for Hyperspectral Images Using Graph Attention Networks.” IEEE Geoscience and Remote Sensing Letters 18 (1): 157–161. doi:10.1109/LGRS.2020.2966239.
  • Shahraki, Farideh Foroozandeh, and Saurabh Prasad. 2019. “Graph Convolutional Neural Networks for Hyperspectral Data Classification.” 2018 IEEE Global Conference on Signal and Information Processing, GlobalSIP 2018 - Proceedings. doi:10.1109/GlobalSIP.2018.8645969.
  • Slavkovikj, Viktor, Steven Verstockt, Wesley De Neve, Sofie Van Hoecke, and Rik Van de Walle. 2015. “Hyperspectral Image Classification with Convolutional Neural Networks.” In Proceedings of the 23rd ACM International Conference on Multimedia, Vol. 219, 1159–1162. New York, NY, USA: ACM. doi:10.1145/2733373.2806306.
  • Wan, Sheng, Chen Gong, Ping Zhong, Shirui Pan, Guangyu Li, and Jian Yang. 2021. “Hyperspectral Image Classification with Context-Aware Dynamic Graph Convolutional Network.” IEEE Transactions on Geoscience and Remote Sensing 59 (1), doi:10.1109/TGRS.2020.2994205.
  • Wang, Jianing, Runhu Huang, Siying Guo, Linhao Li, Minghao Zhu, Shuyuan Yang, and Licheng Jiao. 2021. “NAS-Guided Lightweight Multiscale Attention Fusion Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (10), doi:10.1109/TGRS.2021.3049377.
  • Wang, Wenning, Xuebin Liu, and Xuanqin Mou. 2021. “Data Augmentation and Spectral Structure Features for Limited Samples Hyperspectral Classification.” Remote Sensing 13 (4), doi:10.3390/rs13040547.
  • Wang, Li, Jiangtao Peng, and Weiwei Sun. 2019. “Spatial-Spectral Squeeze-and-Excitation Residual Network for Hyperspectral Image Classification.” Remote Sensing 11 (7), doi:10.3390/RS11070884.
  • Wu, Xin, Danfeng Hong, Jocelyn Chanussot, Yang Xu, Ran Tao, and Yue Wang. 2020. “Fourier-Based Rotation-Invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection.” IEEE Geoscience and Remote Sensing Letters 17 (2), doi:10.1109/LGRS.2019.2919755.
  • Wu, Hao, and Saurabh Prasad. 2017. “Convolutional Recurrent Neural Networks ForHyperspectral Data Classification.” Remote Sensing 9 (3), doi:10.3390/rs9030298.
  • Xiaofei He, Deng Cai, Shuicheng Yan, and Hong-Jiang Zhang. 2005. “Neighborhood Preserving Embedding.” In Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, 1208-1213 Vol. 2. IEEE. doi:10.1109/ICCV.2005.167.
  • Xu, Bingbing, Huawei Shen, Qi Cao, Keting Cen, and Xueqi Cheng. 2019. “Graph Convolutional Networks Using Heat Kernel for Semi-Supervised Learning.” In IJCAI International Joint Conference on Artificial Intelligence Vol. 2019-August, doi:10.24963/ijcai.2019/267.
  • Yang, Xiaofei, Yunming Ye, Xutao Li, Raymond Y.K. Lau, Xiaofeng Zhang, and Xiaohui Huang. 2018. “Hyperspectral Image Classification with Deep Learning Models.” IEEE Transactions on Geoscience and Remote Sensing 56 (9), doi:10.1109/TGRS.2018.2815613.
  • Ying, Rex, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, and Jure Leskovec. 2018. “Graph Convolutional Neural Networks for Web-Scale Recommender Systems.” Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, doi:10.1145/3219819.3219890.
  • Zhang, Ziwei, Peng Cui, and Wenwu Zhu. 2022a. “Deep Learning on Graphs: A Survey.” IEEE Transactions on Knowledge and Data Engineering 34 (1), doi:10.1109/TKDE.2020.2981333.
  • Zhang, Yuxiang, Wei Li, Weidong Sun, Ran Tao, and Qian Du. 2023a. “Single-Source Domain Expansion Network for Cross-Scene Hyperspectral Image Classification.” IEEE Transactions on Image Processing 32: 1498–1512. doi:10.1109/TIP.2023.3243853.
  • Zhang, Yuxiang, Wei Li, Ran Tao, Jiangtao Peng, Qian Du, and Zhaoquan Cai. 2021. “Cross-Scene Hyperspectral Image Classification With Discriminative Cooperative Alignment.” IEEE Transactions on Geoscience and Remote Sensing 59 (11): 9646–9660. doi:10.1109/TGRS.2020.3046756.
  • Zhang, Yuxiang, Wei Li, Mengmeng Zhang, Ying Qu, Ran Tao, and Hairong Qi. 2021. “Topological Structure and Semantic Information Transfer Network for Cross-Scene Hyperspectral Image Classification.” IEEE Transactions on Neural Networks and Learning Systems, 2817–2830. doi:10.1109/TNNLS.2021.3109872.
  • Zhang, Yuxiang, Wei Li, Mengmeng Zhang, Shuai Wang, Ran Tao, and Qian Du. 2022. “Graph Information Aggregation Cross-Domain Few-Shot Learning for Hyperspectral Image Classification.” IEEE Transactions on Neural Networks and Learning Systems, 1–14. doi:10.1109/TNNLS.2022.3185795.
  • Zhang, Yuxiang, Kang Liu, Yanni Dong, Ke Wu, and Xiangyun Hu. 2020. “Semisupervised Classification Based on SLIC Segmentation for Hyperspectral Image.” IEEE Geoscience and Remote Sensing Letters 17 (8), doi:10.1109/LGRS.2019.2945546.
  • Zhang, Minghua, Hongling Luo, Wei Song, Haibin Mei, and Cheng Su. 2021. “Spectral-Spatial Offset Graph Convolutional Networks for Hyperspectral Image Classification.” Remote Sensing 13 (21): 4342. doi:10.3390/rs13214342.
  • Zhang, Yuxiang, Mengmeng Zhang, Wei Li, Shuai Wang, and Ran Tao. 2023. “Language-Aware Domain Generalization Network for Cross-Scene Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 61: 1–12. doi:10.1109/TGRS.2022.3233885.
  • Zhao, Zhong Qiu, Peng Zheng, Shou Tao Xu, and Xindong Wu. 2019. “Object Detection with Deep Learning: A Review.” IEEE Transactions on Neural Networks and Learning Systems, doi:10.1109/TNNLS.2018.2876865.
  • Zhu, Lin, Yushi Chen, Pedram Ghamisi, and Jón Atli Benediktsson. 2018. “Generative Adversarial Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (9).