1,356
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Spatial-spectral dual path hyperspectral image super-resolution reconstruction network based on spectral response functions

, , , &
Article: 2157497 | Received 19 Jul 2022, Accepted 22 Nov 2022, Published online: 20 Dec 2022

References

  • Akgun T, Altunbasak Y, Mersereau RM. 2005. Super-resolution reconstruction of hyperspectral images. IEEE Trans Image Process. 14(11):1860–1875.
  • Arun PV, Buddhiraju KM, Porwal A, Chanussot J. 2020. Cnn based spectral super-resolution of remote sensing images. Signal Proces. 169:107394.
  • Chen Y, Liu L, Phonevilay V, Gu K, Xia R, Xie J, Zhang Q, Yang K. 2021. Image super-resolution reconstruction based on feature map attention mechanism. Appl Intell. 51(7):4367–4380.
  • Chen Y, Xu L, Fang Y, Peng J, Yang W, Wong A, Clausi DA. 2020a. Unsupervised bayesian subpixel mapping of hyperspectral imagery based on band-weighted discrete spectral mixture model and markov random field. IEEE Geosci Remote Sens Lett. 18(1):162–166.
  • Chen J, Zhu Q, Zhong Y, Guan Q, Zhang L, Li D. 2020b. Urban scenes change detection based on multi-scale irregular bag of visual features for high spatial resolution imagery. In IGARSS 2020-2020 IEEE International Geoscience and Remote Sensing Symposium, IEEE, p. 1197–1200.
  • Dian R, Li S. 2019. Hyperspectral image super-resolution via subspace-based low tensor multi-rank regularization. IEEE Trans on Image Process. 28(10):5135–5146.
  • Dian R, Li S, Guo A, Fang L. 2018. Deep hyperspectral image sharpening. IEEE Trans Neural Netw Learn Syst. 29(11):5345–5355.
  • Dian R, Li S, Kang X. 2021. Regularizing hyperspectral and multispectral image fusion by cnn denoiser. IEEE Trans Neural Netw Learn Syst. 32(3):1124–1135.
  • Dong X, Sun X, Jia X, Xi Z, Gao L, Zhang B. 2021. Remote sensing image super-resolution using novel dense-sampling networks. IEEE Trans Geosci Remote Sens. 59(2):1618–1633.
  • Dong C, Loy CC, He K, Tang X. 2014. Learning a deep convolutional network for image super-resolution. in: European conference on computer vision, Springer, pp. 184–199.
  • Dou X, Li C, Shi Q, Liu M. 2020. Super-resolution for hyperspectral remote sensing images based on the 3d attention-srgan network. Remote Sens. 12(7):1204.
  • Galliani S, Lanaras C, Marmanis D, Baltsavias E, Schindler K. 2017. Learned spectral super-resolution, arXiv preprint arXiv:1703.09470.
  • Gong M, Duan Y, Li H. 2020. Group self-paced learning with a time-varying regularizer for unsupervised change detection. IEEE Trans Geosci Remote Sens. 58(4):2481–2493.
  • Hang R, Li Z, Liu Q, Bhattacharyya SS. 2020. Prinet: a prior driven spectral super-resolution network. in 2020 IEEE International Conference on Multimedia and Expo (ICME), IEEE, pp. 1–6.
  • He K, Zhang X, Ren S, Sun J. 2016. Deep residual learning for image recognition. in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 770–778.
  • Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. 2017. Densely connected convolutional networks. in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 4700–4708.
  • Hu J, Li Y, Xie W. 2017. Hyperspectral image super-resolution by spectral difference learning and spatial error correction. IEEE Geosci Remote Sens Lett. 14(10):1825–1829.
  • Hu J, Tang Y, Fan S. 2020. Hyperspectral image super resolution based on multiscale feature fusion and aggregation network with 3-d convolution. IEEE J Sel Top Appl Earth Observ Remote Sens. 13:5180–5193.
  • Jiang J, Sun H, Liu X, Ma J. 2020. Learning spatial-spectral prior for super-resolution of hyperspectral imagery. IEEE Trans Comput Imaging. 6:1082–1096.
  • Jiang D, Zhang S, Dai L, et al. 2022. Multi-scale generative adversarial network for image super-resolution. Soft Comput. 26(8):3631–3641.
  • Khan MJ, Khan HS, Yousaf A, Khurshid K, Abbas A. 2018. Modern trends in hyperspectral image analysis: a review. IEEE Access. 6:14118–14129.
  • Kwan C, Choi JH, Chan SH, Zhou J, Budavari B. 2018. A super-resolution and fusion approach to enhancing hyperspectral images. Remote Sens. 10(9):1416.
  • Lanaras C, Baltsavias E, Schindler K. 2015. Hyperspectral super-resolution by coupled spectral unmixing. in Proceedings of the IEEE International Conference on Computer Vision, p. 3586–3594.
  • Lan R, Sun L, Liu Z, Lu H, Pang C, Luo X. 2021. Madnet: a fast and lightweight network for single-image super resolution. IEEE Trans Cybern. 51(3):1443–1453.
  • Lan R, Sun L, Liu Z, Lu H, Su Z, Pang C, Luo X. 2021. Cascading and enhanced residual networks for accurate single-image super-resolution. IEEE Trans Cybern. 51(1):115–125.
  • Li J, Cui R, Li B, Song R, Li Y, Du Q. 2019. Hyperspectral image super-resolution with 1d–2d attentional convolutional neural network. Remote Sens. 11(23):2859.
  • Li B, Dai Y, He M. 2018. Monocular depth estimation with hierarchical fusion of dilated cnns and soft-weighted-sum inference. Pattern Recogn. 83:328–339.
  • Li S, Dian R, Fang L, Bioucas-Dias JM. 2018. Fusing hyperspectral and multispectral images via coupled sparse tensor factorization. IEEE Trans on Image Process. 27(8):4118–4130.
  • Li Y, Du Z, Wu S, Wang Y, Wang Z, Zhao X, Zhang F. 2021. Progressive split-merge super resolution for hyperspectral imagery with group attention and gradient guidance. ISPRS J Photogram Remote Sens. 182:14–36.
  • Liu D, Li J, Yuan Q. 2021. A spectral grouping and attention-driven residual dense network for hyperspectral image super-resolution. IEEE Trans Geosci Remote Sens. 59(9):7711–7725.
  • Liu B, Yu X, Zhang P, Tan X, Wang R, Zhi L. 2018. Spectral–spatial classification of hyperspectral image using three-dimensional convolution network. J Appl Remote Sens. 12:016005.
  • Li Q, Wang Q, Li X. 2021. Exploring the relationship between 2d/3d convolution for hyperspectral image super-resolution. IEEE Trans Geosci Remote Sens. 59(10):8693–8703.
  • Li J, Wu C, Song R, Xie W, Ge C, Li B, Li Y. 2021. Hybrid 2-d–3-d deep residual attentional network with structure tensor constraints for spectral super-resolution of rgb images. IEEE Trans Geosci Remote Sens. 59(3):2321–2335.
  • Lu X, Yang D, Zhang J, Jia F. 2021. Hyperspectral image super-resolution based on spatial correlation-regularized unmixing convolutional neural network. Remote Sens. 13(20):4074.
  • Luo X, Yin J, Luo X, Jia X. 2019. A novel adversarial based hyperspectral and multispectral image fusion. Remote Sens. 11(5):492.
  • Mei S, Jiang R, Li X, Du Q. 2020. Spatial and spectral joint super-resolution using convolutional neural network. IEEE Trans Geosci Remote Sens. 58(7):4590–4603.
  • Mei S, Yuan X, Ji J, Zhang Y, Wan S, Du Q. 2017. Hyperspectral image spatial super-resolution via 3d full convolutional neural network. Remote Sens. 9(11):1139.
  • Obukhov A, Rakhuba M, Liniger A, Huang Z, Georgoulis S, Dai D, Van Gool L. 2021. Spectral tensor train parameterization of deep learning layers. in International Conference on Artificial Intelligence and Statistics, PMLR, p. 3547–3555.
  • Paul S, Kumar DN. 2021. Transformation of multispectral data to quasi-hyperspectral data using convolutional neural network regression. IEEE Trans Geosci Remote Sens. 59(4):3352–3368.
  • Qu J, Lei J, Li Y, Dong W, Zeng Z, Chen D. 2018. Structure tensor-based algorithm for hyperspectral and panchromatic images fusion. Remote Sens. 10(3):373.
  • Qu J, Xu Y, Dong W, Li Y, Du Q. 2022. Dual-branch difference amplification graph convolutional network for hyperspectral image change detection. IEEE Trans Geosci Remote Sens. 60:1–12.
  • Wan W, Guo W, Huang H, Liu J. 2020. Nonnegative and nonlocal sparse tensor factorization-based hyperspectral image super-resolution. IEEE Trans Geosci Remote Sens. 58(12):8384–8394.
  • Wang Y, Chen X, Han Z, He S. 2017. Hyperspectral image super-resolution via nonlocal low-rank tensor approximation and total variation regularization. Remote Sens. 9(12):1286.
  • Wang Z, Chen J, Hoi SC. 2021. Deep learning for image super-resolution: a survey. IEEE Trans Pattern Anal Mach Intell. 43(10):3365–3387.
  • Wang X, Ma J, Jiang J. 2022. Hyperspectral image super-resolution via recurrent feedback embedding and spatial–spectral consistency regularization. IEEE Trans Geosci Remote Sens. 60:1–13.
  • Xie W, Jia X, Li Y, Lei J. 2019. Hyperspectral image super-resolution using deep feature matrix factorization. IEEE Trans Geosci Remote Sens. 57(8):6055–6067.
  • Yan L, Wang X, Zhao M, Kaloorazi M, Chen J, Rahardja S. 2020. Reconstruction of hyperspectral data from rgb images with prior category information. IEEE Trans Comput Imaging. 6:1070–1081.
  • Yang Y, Qi Y. 2021. Image super-resolution via channel attention and spatial graph convolutional network. Pattern Recogn. 112:107798.
  • Yang J, Zhao Y-Q, Chan JC-W, Xiao L. 2019. A multi-scale wavelet 3d-cnn for hyperspectral image super-resolution. Remote Sens. 11(13):1557.
  • Yuan Y, Zheng X, Lu X. 2017. Hyperspectral image superresolution by transfer learning. IEEE J Sel Top Appl Earth Observ Remote Sens. 10(5):1963–1974.
  • Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y. 2018. Image super-resolution using very deep residual channel attention networks. in Proceedings of the European Conference on Computer Vision (ECCV), p. 286–301.
  • Zhang W, Li X, Zhao L. 2018. A fast hyperspectral feature selection method based on band correlation analysis. IEEE Geosci Remote Sens Lett. 15(11):1750–1754.
  • Zhang D, Shao J, Li X, Shen HT. 2021. Remote sensing image super-resolution via mixed high-order attention network. IEEE Trans Geosci Remote Sens. 59(6):5183–5196.
  • Zhang L, Zhang L. 2022. Artificial intelligence for remote sensing data analysis: a review of challenges and opportunities. IEEE Geosci Remote Sens Mag. 10(2):270–294.
  • Zhao M, Ning J, Hu J, Li T. 2021. Hyperspectral image super-resolution under the guidance of deep gradient information. Remote Sens. 13(12):2382.
  • Zheng X, Yuan Y, Lu X. 2017. Dimensionality reduction by spatial–spectral preservation in selected bands. IEEE Trans Geosci Remote Sens. 55(9):5185–5197.
  • Zhi L, Yu X, Liu B, Wei X. 2019. A dense convolutional neural network for hyperspectral image classification. Remote Sens Lett. 10(1):59–66.
  • Zhu Q, Deng W, Zheng Z, Zhong Y, Guan Q, Lin W, Zhang L, Li D. 2021b. A spectral-spatial-dependent global learning framework for insufficient and imbalanced hyperspectral image classification. IEEE Trans Cybern. 52(11):11709–11723.
  • Zhu Q, Guo X, Deng W, Shi S, Guan Q, Zhong Y, Zhang L, Li D. 2022b. Land-use/land-cover change detection based on a siamese global learning framework for high spatial resolution remote sensing imagery. ISPRS J Photogram Remote Sens. 184:63–78.
  • Zhu Q, Sun Y, Guan Q, Wang L, Lin W. 2022a. A weakly pseudo-supervised decorrelated subdomain adaptation framework for cross-domain land-use classification. IEEE Trans Geosci Remote Sens. 60:1–13.
  • Zhu Q, Wang L, Chen J, Zeng W, Zhong Y, Guan Q, Yang Z. 2021a. S 3 trm: spectral-spatial unmixing of hyperspectral imagery based on sparse topic relaxation-clustering model. IEEE Trans Geosci Remote Sens. 60:1–13.