A new deep learning approach for classification of hyperspectral images: feature and decision level fusion of spectral and spatial features in multiscale CNN

References

• Andrejchenko V, Liao W, Philips W, Scheunders P. 2019. Decision fusion framework for hyperspectral image classification based on markov and conditional random fields. Remote Sensing. 11(6):624.
   Web of Science ®Google Scholar
• Aptoula E, Ozdemir MC, Yanikoglu B. 2016. Deep learning with attribute profiles for hyperspectral image classification. IEEE Ieee Geosci Remote Sensing Lett. 13(12):1970–1974.
   Web of Science ®Google Scholar
• Atkinson PM, Tatnall AR. 1997. Introduction neural networks in remote sensing. Int J Remote Sens . 18(4):699–709.
   Web of Science ®Google Scholar
• Benediktsson JA, Palmason JA, Sveinsson JR. 2005. Classification of hyperspectral data from urban areas based on extended morphological profiles. IEEE Trans Geosci Remote Sensing. 43(3):480–491.
   Web of Science ®Google Scholar
• Benediktsson JA, Sveinsson JR. 2003. Multisource remote sensing data classification based on consensus and pruning. IEEE Trans Geosci Remote Sensing. 41(4):932–936.
   Web of Science ®Google Scholar
• Bruzzone L, Prieto DF. 1999. A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images. IEEE Trans Geosci Remote Sensing. 37(2):1179–1184.
   Web of Science ®Google Scholar
• Cao X, Li R, Wen L, Feng J, Jiao L. 2018. Deep multiple feature fusion for hyperspectral image classification. IEEE J Sel Top Appl Earth Observations Remote Sensing. 11(10):3880–3891.
   Web of Science ®Google Scholar
• Chen Y, Jiang H, Li C, Jia X, Ghamisi P. 2016. Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans Geosci Remote Sensing. 54(10):6232–6251.
   Web of Science ®Google Scholar
• Chen Yi, Li Z, Ghamisi P, Jia X, Li G, Tang L. 2017. Hyperspectral images classification with Gabor filtering and convolutional neural network. IEEE Geosci Remote Sensing Lett. 14(12):2355–2359.
   Web of Science ®Google Scholar
• Chen Y, Lin Z, Zhao X, Wang G, Gu Y. 2014. Deep learning-based classification of hyperspectral data. IEEE J Sel Top Appl Earth Observations Remote Sensing. 7(6):2094–2107.
   Web of Science ®Google Scholar
• Chen Y, Zhu K, Zhu L, He X, Ghamisi P, Benediktsson JA. 2019. Automatic design of convolutional neural network for hyperspectral image classification. IEEE Trans Geosci Remote Sensing. 57(9):7048–7066.
   Web of Science ®Google Scholar
• Dalla MM, Villa A, Benediktsson JA, Chanussot J, Bruzzone L. 2011. Classification of hyperspectral images by using extended morphological attribute profiles and independent component analysis. IEEE Geosci Remote Sensing Lett. 8(3):542–546.
   Web of Science ®Google Scholar
• Fang L, Li S, Kang X, Benediktsson JA. 2014. Spectral–spatial hyperspectral image classification via multiscale adaptive sparse representation.IEEE Transactions on Geoscience and Remote Sensing. 52(12):7738–7749.
   Web of Science ®Google Scholar
• Fauvel M, Benediktsson JA, Chanussot J, Sveinsson JR. 2008. Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles. IEEE Trans Geosci Remote Sensing. 46(11):3804–3814.
   Web of Science ®Google Scholar
• Fauvel M. 2007. Spectral and spatial methods for the classification of urban remote sensing data [PhD diss].
   Google Scholar
• Ferrari RJ, Rangayyan RM, Desautels JL, Frère AF. 2001. Analysis of asymmetry in mammograms via directional filtering with Gabor wavelets. IEEE Trans Med Imaging. 20(9):953–964.
   PubMed Web of Science ®Google Scholar
• Gan C, Wang N, Yang Y, Yeung D, Hauptmann AG. 2015. Devnet: A deep event network for multimedia event detection and evidence recounting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 2568–2577.
   Google Scholar
• Gao Q, Lim S, Jia X. 2018. Hyperspectral image classification using convolutional neural networks and multiple feature learning. Remote Sensing. 10(2):299.
   Web of Science ®Google Scholar
• Hinton GE, Salakhutdinov RR. 2006. Reducing the dimensionality of data with neural networks. Science. 313(5786):504–507.
   PubMed Web of Science ®Google Scholar
• Hornik K. 1991. Approximation capabilities of multilayer feed-forward networks. Neural Netw. 4(2):251–257.
   Web of Science ®Google Scholar
• Hu W, Huang Y, Wei L, Zhang F, Li H. 2015. Deep convolutional neural networks for hyperspectral image classification. J Sens. https://doi.org/10.1155/2015/258619.
   Google Scholar
• Kang X, Li S, Benediktsson JA. 2014. Spectral–spatial hyperspectral image classification with edge-preserving filtering. IEEE Trans Geosci Remote Sensing. 52(5):2666–2677.
   Web of Science ®Google Scholar
• Kang X, Li C, Li S, Lin H. 2018. Classification of hyperspectral images by Gabor filtering based deep network. IEEE J Sel Top Appl Earth Observations Remote Sensing. 11(4):1166–1178.
   Web of Science ®Google Scholar
• Krizhevsky A, Sutskever I, Hinton GE. 2012. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems. 25:1097–1105.
   Google Scholar
• Kumar B, Dikshit O. 2017. Hyperspectral image classification based on morphological profiles and decision fusion. Int J Remote Sens. 38(20):5830–5854.
   Web of Science ®Google Scholar
• Le RN, Bengio Y. 2010. Deep belief networks are compact universal approximators. Neural Comput. 22(8):2192–2207.
   Web of Science ®Google Scholar
• Liang X, Xu C, Shen X, Yang J, Liu S, Tang J, Lin L, Yan S. 2015. Human parsing with contextualized convolutional neural network. In Proceedings of the IEEE International Conference on Computer Vision: p. 1386–1394.
   Google Scholar
• Li W, Chen C, Su H, Du Q. 2015. Local binary patterns and extreme learning machine for hyperspectral imagery classification. IEEE Trans Geosci Remote Sensing. 53(7):3681–3693.
   Web of Science ®Google Scholar
• Li Y, Zhang H, Shen Q. 2017. Spectral–spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sensing. 9(1):67.
   Web of Science ®Google Scholar
• Maghsoudi Y, Alimohammadi A, Zoej MV, Mojaradi B. 2006. Weighted combination of multiple classifiers for the classification of hyperspectral images using a genetic algorithm. In SPRS Commiss. VII, Mid-term Symp. Remote Sens: Pixels Processes, Enschede, the Netherlands.
   Google Scholar
• Miao Z, Shi W. 2016. A new methodology for spectral-spatial classification of hyperspectral images. J Sens . 2016:1–12.
   Web of Science ®Google Scholar
• Mirzapour F, Ghassemian H. 2015. Improving hyperspectral image classification by combining spectral, texture, and shape features. Int J Remote Sens. 36(4):1070–1096.
   Web of Science ®Google Scholar
• Mirzapour F, Ghassemian H. 2016. Moment-based feature extraction from high spatial resolution hyperspectral images. Int J Remote Sens. 37(6):1349–1361.
   Web of Science ®Google Scholar
• Mirzapour F, Ghassemian H. 2013. Using GLCM and Gabor filters for classification of PAN images.In 2013 21st Iranian Conference on Electrical Engineering (ICEE), 1–6.
   Google Scholar
• Mu C, Guo Z, Liu Y. 2020. A Multiscale and Multi-Level Spectral-Spatial Feature Fusion Network for Hyperspectral Image Classification. Remote Sensing. 12(1):125.
   Web of Science ®Google Scholar
• Ojala T, Pietikainen M, Maenpaa T. 2002. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Machine Intell. 24(7):971–987.
   Web of Science ®Google Scholar
• Pan B, Shi Z, Xu X. 2017. R-VCANet: A new deep-learning-based hyperspectral image classification method. IEEE J Sel Top Appl Earth Observations Remote Sensing. 10(5):1975–1986.
   Web of Science ®Google Scholar
• Paoletti ME, Haut JM, Plaza J, Plaza A. 2018. A new deep convolutional neural network for fast hyperspectral image classification. ISPRS J Photogramm Remote Sens. 145:120–147.
   Web of Science ®Google Scholar
• Prasad S, Bruce LM. 2008. Decision fusion with confidence-based weight assignment for hyperspectral target recognition. IEEE Trans Geosci Remote Sensing. 46(5):1448–1456.
   Web of Science ®Google Scholar
• Richard MD, Lippmann RP. 1991. Neural network classifiers estimate Bayesian a posteriori probabilities. Neural Comput. 3(4):461–483.
   PubMed Web of Science ®Google Scholar
• Roy SK, Krishna G, Dubey SR, Chaudhuri BB. 2020. HybridSN: Exploring 3-D–2-D CNN feature hierarchy for hyperspectral image classification. IEEE Geosci Remote Sensing Lett. 17(2):277–281.
   Web of Science ®Google Scholar
• Salakhutdinov R, Hinton G. 2009. Deep boltzmann machines. Artificial Intelligence and Statistics. Proceedings of Machine Learning Research 5:448–455.
   Google Scholar
• Sharifi O, Mokhtarzade M, Beirami BA. 2020. A Deep Convolutional Neural Network based on Local Binary Patterns of Gabor Features for Classification of Hyperspectral Images. In 2020 International Conference on Machine Vision and Image Processing (MVIP), IEEE: 1–5.
   Google Scholar
• Uchaev DV, Moscow State University of Geodesy and Cartography 2019. Development of the Method of Spectral-Spatial Classification of Hyperspectral Images Based on Local Multifractal Analysis and the Support Vector Machine. Sovr Probl Dzz Kosm. 16(1):46–57.
   Google Scholar
• Xu Y, Du B, Zhang L, Cerra D, Pato M, Carmona E, Prasad S, Yokoya N, Hänsch R, Saux BL. 2019. Advanced Multi-Sensor Optical Remote Sensing for Urban Land Use and Land Cover Classification: Outcome of the 2018 IEEE GRSS Data Fusion Contest. IEEE Ieee J Sel Top Appl Earth Observations Remote Sensing. 12(6):1709–1724..
   Web of Science ®Google Scholar
• Xu Y, Du B, Zhang F, Zhang L. 2018.Hyperspectral image classification via a random patches network.ISPRS J Photogramm Remote Sens. 142:344–357.
   Web of Science ®Google Scholar
• Xu C, Lu C, Liang X, Gao J, Zheng W, Wang T, Yan S. 2016. Multi-loss regularized deep neural network. IEEE Trans Circuits Syst Video Technol. 26(12):2273–2283.
   Web of Science ®Google Scholar
• Xu Q, Xiao Y, Wang D, Luo B. 2020.Csa-mso3dcnn: Multiscale octave 3d cnn with channel and spatial attention for hyperspectral image classification. Remote Sensing. 12(1):188.
   Web of Science ®Google Scholar
• Ye Z, Bai L, Nian Y. 2017. Decision fusion for hyperspectral image classification based on multiple features and locality-preserving analysis. European Journal of Remote Sensing. 50(1):166–178.
   Web of Science ®Google Scholar
• Ye Z, Tan L, Bai L. 2017. Hyperspectral image classification based on spectral-spatial feature extraction. In 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP): 1–4.
   Google Scholar
• Yu S, Jia S, Xu C. 2017.Convolutional neural networks for hyperspectral image classification. Neurocomputing. 219:88–98.
   Web of Science ®Google Scholar
• Yue J, Zhao W, Mao S, Liu H. 2015. Spectral–spatial classification of hyperspectral images using deep convolutional neural networks. Remote Sensing Letters. 6(6):468–477.
   Web of Science ®Google Scholar
• Zheng Z, Cao J. 2019. Fusion High-and-Low-Level Features via Ridgelet and Convolutional Neural Networks for Very High-Resolution Remote Sensing Imagery Classification. IEEE Access. 7:118472–118483.
   Google Scholar
• Zuo Z, Shuai B, Wang G, Liu X, Wang X, Wang B, Chen Y. 2016. Learning contextual dependence with convolutional hierarchical recurrent neural networks. IEEE Trans Image Process. 25(7):2983–2996.
   PubMed Web of Science ®Google Scholar