Hyperspectral image classification by optimizing convolutional neural networks based on information theory and 3D-Gabor filters

References

• Agarwal, A., T. El-Ghazawi, H. El-Askary, and J. Le-Moigne. 2007. “Efficient hierarchical-PCA Dimension Reduction for Hyperspectral Imagery.” Paper presented at the 2007 IEEE International Symposium on Signal Processing and Information Technology, Giza, Egypt.
   Google Scholar
• Aptoula, E., M. C. Ozdemir, and B. Yanikoglu. 2016. “Deep Learning with Attribute Profiles for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 13 (12): 1970–1974. doi:10.1109/LGRS.2016.2619354.
   Web of Science ®Google Scholar
• Barnett, L., and A. K. Seth. 2014. “The MVGC Multivariate Granger Causality Toolbox: A New Approach to Granger-causal Inference.” Journal of Neuroscience Methods 223: 50–68. doi:10.1016/j.jneumeth.2013.10.018.
   PubMed Web of Science ®Google Scholar
• Bau, T. C., and G. Healey. 2009. “Rotation and Scale Invariant Hyperspectral Classification Using 3D Gabor Filters.” Paper presented at the Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XV, Orlando, Florida, United States.
   Google Scholar
• Bau, T. C., S. Sarkar, and G. Healey. 2010. “Hyperspectral Region Classification Using a Three-dimensional Gabor Filterbank.” IEEE Transactions on Geoscience and Remote Sensing 48 (9): 3457–3464. doi:10.1109/TGRS.2010.2046494.
   Web of Science ®Google Scholar
• Benediktsson, J. A., and P. Ghamisi. 2015. Spectral-spatial Classification of Hyperspectral Remote Sensing Images. Norwood, MA: Artech House.
   Google Scholar
• Cao, X., F. Zhou, L. Xu, D. Meng, Z. Xu, and J. Paisley. 2018. “Hyperspectral Image Classification with Markov Random Fields and a Convolutional Neural Network.” IEEE Transactions on Image Processing 27 (5): 2354–2367. doi:10.1109/TIP.2018.2799324.
   PubMed Web of Science ®Google Scholar
• Chen, Y., L. Zhu, P. Ghamisi, X. Jia, G. Li, and L. Tang. 2017. “Hyperspectral Images Classification with Gabor Filtering and Convolutional Neural Network.” IEEE Geoscience and Remote Sensing Letters 14 (12): 2355–2359. doi:10.1109/LGRS.2017.2764915.
   Web of Science ®Google Scholar
• Clausi, D. A., and M. Ed Jernigan. 2000. “Designing Gabor Filters for Optimal Texture Separability.” Pattern Recognition 33 (11): 1835–1849. doi:10.1016/S0031-3203(99)00181-8.
   Web of Science ®Google Scholar
• Cover, T. M., and J. A. Thomas. 2012. Elements of Information Theory: Hoboken, NJ: John Wiley & Sons.
   Google Scholar
• Eghbalian, S., and H. Ghassemian. 2018. “Multi Spectral Image Fusion by Deep Convolutional Neural Network and New Spectral Loss Function.” International Journal of Remote Sensing 39 (12): 3983–4002. doi:10.1080/01431161.2018.1452074.
   Web of Science ®Google Scholar
• Fields, R. 2017. “Hyperspectral Image Segmentation with Markov Random Fields and a Convolutional Neural Network.”
   Google Scholar
• Gabor, D. 1946. “Theory of Communication. Part 1: The Analysis of Information.” Journal of the Institution of Electrical Engineers-Part III: Radio and Communication Engineering 93 (26): 429–441.
   Google Scholar
• Gao, Q., and S. Lim. 2019. “Classification of Hyperspectral Images with Convolutional Neural Networks and Probabilistic Relaxation.” Computer Vision and Image Understanding 188: 102801. doi:10.1016/j.cviu.2019.102801.
   Web of Science ®Google Scholar
• Gao, Q., S. Lim, and X. Jia. 2019. “Spectral–spatial Hyperspectral Image Classification Using a Multiscale Conservative Smoothing Scheme and Adaptive Sparse Representation.” IEEE Transactions on Geoscience and Remote Sensing 57 (10): 7718–7730. doi:10.1109/TGRS.2019.2915809.
   Web of Science ®Google Scholar
• Ghassemi, M., H. Ghassemian, and M. Imani. 2018. “Deep Belief Networks for Feature Fusion in Hyperspectral Image Classification.” Paper presented at the 2018 IEEE International Conference on Aerospace Electronics and Remote Sensing Technology (ICARES), Bali, Indonesia.
   Google Scholar
• Golipour, M., H. Ghassemian, and F. Mirzapour. 2016. “Integrating Hierarchical Segmentation Maps with MRF Prior for Classification of Hyperspectral Images in a Bayesian Framework.” IEEE Transactions on Geoscience and Remote Sensing 54 (2): 805–816. doi:10.1109/TGRS.2015.2466657.
   Web of Science ®Google Scholar
• Golub, G. H. 1996. “CF vanLoan, Matrix Computations.” The Johns Hopkins.
   Google Scholar
• Goodfellow, I., Y. Bengio, and A. Courville. 2016. Deep Learning. Hoboken, NJ: MIT press.
   Google Scholar
• Granger, C. W. J. 1969. “Investigating Causal Relations by Econometric Models and Cross-spectral Methods.” Econometrica: Journal of the Econometric Society 37 (3): 424–438. doi:10.2307/1912791.
   Web of Science ®Google Scholar
• Guyon, I., and A. Elisseeff. 2003. “An Introduction to Variable and Feature Selection.” Journal of Machine Learning Research 3 (Mar): 1157–1182.
   Google Scholar
• Hughes, G. 1968. “On the Mean Accuracy of Statistical Pattern Recognizers.” IEEE Transactions on Information Theory 14 (1): 55–63. doi:10.1109/TIT.1968.1054102.
   Web of Science ®Google Scholar
• Imani, M., and H. Ghassemian. 2016. “Hyperspectral Images Classification by Spectral-spatial Processing.” Paper presented at the 2016 8th International Symposium on Telecommunications (IST), Tehran, Iran.
   Google Scholar
• Jia, S., L. Shen, and Q. Li. 2014. “Gabor Feature-based Collaborative Representation for Hyperspectral Imagery Classification.” IEEE Transactions on Geoscience and Remote Sensing 53 (2): 1118–1129.
   Web of Science ®Google Scholar
• Jimenez-Rodriguez, L. O., E. Arzuaga-Cruz, and M. Vélez-Reyes. 2007. “Unsupervised Linear Feature-extraction Methods and Their Effects in the Classification of High-dimensional Data.” IEEE Transactions on Geoscience and Remote Sensing 45 (2): 469–483. doi:10.1109/TGRS.2006.885412.
   Web of Science ®Google Scholar
• Johnson, W. B., and J. Lindenstrauss. 1984. “Extensions of Lipschitz Mappings into a Hilbert Space.” Contemporary Mathematics 26 (189–206): 1.
   Google Scholar
• Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. “Imagenet Classification with Deep Convolutional Neural Networks.” Paper presented at the Advances in neural information processing systems, Stateline, Nevada, United States.
   Google Scholar
• Kumar, S., J. Ghosh, and M. M. Crawford. 2001. “Best-bases Feature Extraction Algorithms for Classification of Hyperspectral Data.” IEEE Transactions on Geoscience and Remote Sensing 39 (7): 1368–1379. doi:10.1109/36.934070.
   Web of Science ®Google Scholar
• Kwak, N. 2008. “Principal Component Analysis Based on L1-norm Maximization.” IEEE Transactions on Pattern Analysis and Machine Intelligence 30 (9): 1672–1680. doi:10.1109/TPAMI.2008.114.
   PubMed Web of Science ®Google Scholar
• LeCun, Y., L. Bottou, Y. Bengio, and P. Haffner. 1998. “Gradient-based Learning Applied to Document Recognition.” Proceedings of the IEEE 86 (11): 2278–2324. doi:10.1109/5.726791.
   Web of Science ®Google Scholar
• Liang, S. D. 2018a. “Optimization for Deep Convolutional Neural Networks: How Slim Can It Go?” IEEE Transactions on Emerging Topics in Computational Intelligence: 171-179.
   Google Scholar
• Liang, S. D. 2018b. “Smart and Fast Data Processing for Deep Learning in Internet of Things: Less Is More.” IEEE Internet of Things Journal 6 (4): 5981–5989. doi:10.1109/JIOT.2018.2864579.
   Web of Science ®Google Scholar
• Luan, S., C. Chen, B. Zhang, J. Han, and J. Liu. 2018. “Gabor Convolutional Networks.” IEEE Transactions on Image Processing 27 (9): 4357–4366. doi:10.1109/TIP.2018.2835143.
   PubMed Web of Science ®Google Scholar
• Martínez-usómartinez-uso, A., F. Pla, J. M. Sotoca, and P. García-Sevilla. 2007. “Clustering-based Hyperspectral Band Selection Using Information Measures.” IEEE Transactions on Geoscience and Remote Sensing 45 (12): 4158–4171. doi:10.1109/TGRS.2007.904951.
   Web of Science ®Google Scholar
• Mirzapour, F., and H. Ghassemian. 2015. “Improving Hyperspectral Image Classification by Combining Spectral, Texture, and Shape Features.” International Journal of Remote Sensing 36 (4): 1070–1096. doi:10.1080/01431161.2015.1007251.
   Web of Science ®Google Scholar
• Mura, D., J. A. B. Mauro, B. Waske, and L. Bruzzone. 2010. “Extended Profiles with Morphological Attribute Filters for the Analysis of Hyperspectral Data.” International Journal of Remote Sensing 31 (22): 5975–5991. doi:10.1080/01431161.2010.512425.
   Web of Science ®Google Scholar
• Paoletti, M. E., J. M. Haut, J. Plaza, and A. Plaza. 2019. “Deep Learning Classifiers for Hyperspectral Imaging: A Review.” ISPRS Journal of Photogrammetry and Remote Sensing 158: 279–317.
   Web of Science ®Google Scholar
• Sarwar, S. S., P. Panda, and K. Roy. 2017. “Gabor Filter Assisted Energy Efficient Fast Learning Convolutional Neural Networks.”. Paper presented at the 2017 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED), Taipei, Taiwan, pp. 1-6.
   Google Scholar
• Shannon, C. E. 1956. “The Bandwagon.” IRE Transactions on Information Theory 2 (1): 3. doi:10.1109/TIT.1956.1056774.
   Web of Science ®Google Scholar
• Shannon, C. E. 2001. “A Mathematical Theory of Communication.” ACM SIGMOBILE Mobile Computing and Communications Review 5 (1): 3–55. doi:10.1145/584091.584093.
   Google Scholar
• Shen, L., and S. Jia. 2011. “Three-dimensional Gabor Wavelets for Pixel-based Hyperspectral Imagery Classification.” IEEE Transactions on Geoscience and Remote Sensing 49 (12): 5039–5046. doi:10.1109/TGRS.2011.2157166.
   Web of Science ®Google Scholar
• Shwartz-Ziv, R., and N. Tishby. 2017. “Opening the Black Box of Deep Neural Networks via Information.” arXiv Preprint arXiv:1703.00810: 1-19.
   Google Scholar
• Strang, G., G. Strang, G. Strang, and G. Strang. 1993. Introduction to Linear Algebra. Vol. 3. Wellesley, MA: Wellesley-Cambridge Press.
   Google Scholar
• Tishby, N., and N. Zaslavsky. 2015. “Deep Learning and the Information Bottleneck Principle.” Paper presented at the 2015 IEEE Information Theory Workshop (ITW), Jerusalem, Israel.
   Google Scholar
• Wiener, N. 1956. “The theory of prediction. Modern mathematics for engineers.” New York: McGraw-Hill.
   Google Scholar
• Wu, Y., L. Li, and L. Li. 2018. “Chi-Square Test Neural Network: A New Binary Classifier Based on Backpropagation Neural Network.” arXiv Preprint arXiv:1809.01079: 1-5.
   Google Scholar
• Yao, H., L. Chuyi, H. Dan, and Y. Weiyu. 2016. “Gabor Feature Based Convolutional Neural Network for Object Recognition in Natural Scene.” Paper presented at the Information Science and Control Engineering (ICISCE), 2016 3rd International Conference on, Beijing, China.
   Google Scholar
• Yeung, R. W. 2008. Information Theory and Network Coding. Boston: Springer Science & Business Media.
   Google Scholar
• Yeung, R. W. 2012. A First Course in Information Theory. Boston: Springer Science & Business Media.
   Google Scholar
• Yu, S., S. Jia, and C. Xu. 2017. “Convolutional Neural Networks for Hyperspectral Image Classification.” Neurocomputing 219: 88–98.
   Web of Science ®Google Scholar
• Zeiler, M. D., and R. Fergus. 2014. “Visualizing and Understanding Convolutional Networks.” Paper presented at the European conference on computer vision, Zurich, Switzerland..
   Google Scholar
• Zhang, G., R. Zhang, G. Zhou, and X. Jia. 2018. “Hierarchical Spatial Features Learning with Deep CNNs for Very High-resolution Remote Sensing Image Classification.” International Journal of Remote Sensing 39 (18): 5978–5996. doi:10.1080/01431161.2018.1506593.
   Web of Science ®Google Scholar
• Zhong, P., P. Zhang, and R. Wang. 2008. “Dynamic Learning of SMLR for Feature Selection and Classification of Hyperspectral Data.” IEEE Geoscience and Remote Sensing Letters 5 (2): 280–284.
   Web of Science ®Google Scholar