Local-aware coupled network for hyperspectral image super-resolution

References

• Aiazzi, B., S. Baronti, and M. Selva. 2007. “Improving Component Substitution Pansharpening Through Multivariate Regression of MS + Pan Data.” IEEE Transactions on Geoscience and Remote Sensing 45 (10): 3230–17. https://doi.org/10.1109/TGRS.2007.901007.
   Web of Science ®Google Scholar
• Akhtar, N., F. Shafait, and A. Mian. 2015. “Bayesian Sparse Representation for Hyperspectral Image Super Resolution.” In IEEE Conference on Computer Vision and Pattern Recognition, Boston, June, 3631–3640.
   Google Scholar
• Arun, P. V., K. M. Buddhiraju, A. Porwal, and J. Chanussot. 2020. “CNN-Based Super-Resolution of Hyperspectral Images.” IEEE Transactions on Geoscience and Remote Sensing 58 (9): 6106–6121. https://doi.org/10.1109/TGRS.2020.2973370.
   Web of Science ®Google Scholar
• Borsoi, R. A., T. Imbiriba, and J. C. M. Bermudez. 2019. “Super-Resolution for Hyperspectral and Multispectral Image Fusion Accounting for Seasonal Spectral Variability.” IEEE Transactions on Image Processing 29:116–127. https://doi.org/10.1109/TIP.2019.2928895.
   PubMed Web of Science ®Google Scholar
• Brown, A. J., S. J. Hook, A. M. Baldridge, J. K. Crowley, N. T. Bridges, B. J. Thomson, G. M. Marion, C. R. S. Filho, and J. L. Bishop. 2010. “Hydrothermal Formation of Clay-Carbonate Alteration Assemblages in the Nili Fossae Region of Mars.” Earth and Planetary Science Letters 297 (1–2): 174–182. https://doi.org/10.1016/j.epsl.2010.06.018.
   Web of Science ®Google Scholar
• Chen, H., X. He, L. Qing, L. Qing, Y. Wu, C. Ren, R. Sheriff, and C. Zhu. 2022. “Real-World Single Image Super-Resolution: A Brief Review.” Information Fusion 79:124–145. https://doi.org/10.1016/j.inffus.2021.09.005.
   Web of Science ®Google Scholar
• Chen, N., L. Sui, B. Zhang, H. He, K. Gao, Y. Li, J. Junior, and J. Li. 2021. “Fusion of Hyperspectral-Multispectral Images Joining Spatial-Spectral Dual-Dictionary and Structured Sparse Low-Rank Representation.” International Journal of Applied Earth Observation and Geoinformation 104:102570. https://doi.org/10.1016/j.jag.2021.102570.
   Web of Science ®Google Scholar
• Dian, R., and S. Li. 2019. “Hyperspectral Image Super-Resolution via Subspace-Based Low Tensor Multi-Rank Regularization.” IEEE Transactions on Image Processing 28 (10): 5135–5146. https://doi.org/10.1109/TIP.2019.2916734.
   Web of Science ®Google Scholar
• Dong, W., F. Fu, G. Shi, X. Cao, J. Wu, G. Li, and X. Li. 2016. “Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation.” IEEE Transactions on Image Processing 25 (5): 2337–2352. https://doi.org/10.1109/TIP.2016.2542360.
   PubMed Web of Science ®Google Scholar
• Donovan, S. D., D. A. MacLean, Y. Zhang, M. B. Lavigne, and J. A. Kershaw. 2021. “Evaluating Annual Spruce Budworm Defoliation Using Change Detection of Vegetation Indices Calculated from Satellite Hyperspectral Imagery.” Remote Sensing of Environment 253:112204. https://doi.org/10.1016/j.rse.2020.112204.
   Web of Science ®Google Scholar
• Eismann, M. T., and R. C. Hardie. 2004. ““Application of the Stochastic Mixing Model to Hyperspectral Resolution Enhancement.” IEEE Transactions on Geoscience and Remote Sensing 42 (9): 1924–1933. https://doi.org/10.1109/TGRS.2004.830644.
   Web of Science ®Google Scholar
• Fu, Y., T. Zhang, Y. Zheng, D. Zhang, and H. Huang. 2019. “Hyperspectral Image Super-Resolution with Optimized RGB Guidance.” In IEEE Conference on Computer Vision and Pattern Recognition, Los Angeles, June, 11661–11670.
   Google Scholar
• Gomez, R. B., A. Jazaeri, and M. Kafatos. 2001. “Wavelet-Based Hyperspectral and Multispectral Image Fusion.“ In Geo-Spatial Image and Data Exploitation II, June, Orlando, FL, United States , 36–42. https://doi.org/10.1117/12.428249.
   Google Scholar
• Han, X. H., Y. Zheng, and Y. W. Chen. 2019. “Multi-Level and Multi-Scale Spatial and Spectral Fusion CNN for Hyperspectral Image Super-Resolution.” In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Korea (South), October, 4330–4339. http://dx.doi.org/10.1109/ICCVW.2019.00533.
   Google Scholar
• He, W., Y. Chen, N. Yokoya, C. Li, and B. Zhao. 2022. ““Hyperspectral Super-Resolution via Coupled Tensor Ring Factorization.” Pattern Recognition 122:108280. https://doi.org/10.1016/j.patcog.2021.108280.
   Web of Science ®Google Scholar
• He, S., H. Zhou, Y. Wang, W. Cao, and Z. Han. 2016. “Super-Resolution Reconstruction of Hyperspectral Images via Low Rank Tensor Modeling and Total Variation Regularization.” In IEEE International Geoscience and Remote Sensing Symposium (IGARSS)Beijing, July, 6962–6965.
   Google Scholar
• Hong, S. M., K. H. Cho, S. Park, T. Kang, M. S. Kim, G. Nam, and J. Pyo. 2022. “Estimation of Cyanobacteria Pigments in the Main Rivers of South Korea Using Spatial Attention Convolutional Neural Network with Hyperspectral Imagery.” GIScience & Remote Sensing 59 (1): 547–567. https://doi.org/10.1080/15481603.2022.2037887.
   Web of Science ®Google Scholar
• Hong, D., N. Yokoya, N. Ge, J. Chanussot, and X. Zhu. 2019. ““Learnable Manifold Alignment (LeMa): A Semi-Supervised Cross-Modality Learning Framework for Land Cover and Land Use Classification.” Isprs Journal of Photogrammetry & Remote Sensing 147:193–205. https://doi.org/10.1016/j.isprsjprs.2018.10.006.
   PubMed Web of Science ®Google Scholar
• Huang, H., J. Yu, and W. Sun. 2014. “Super-Resolution Mapping via Multi-Dictionary Based Sparse Representation.” In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, May, 3523–3527.
   Google Scholar
• Irmak, H., G. B. Akar, and S. E. Yukse. 2018. “A Map-Based Approach for Hyperspectral Imagery Super-Resolution.” IEEE Transactions on Image Processing 27 (6): 2942–2951. https://doi.org/10.1109/TIP.2018.2814210.
   Web of Science ®Google Scholar
• Jiang, J., H. Sun, X. Liu, and J. Ma. 2020. “Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery.” IEEE Transactions on Computational Imaging 6:1082–1096. https://doi.org/10.1109/TCI.2020.2996075.
   Web of Science ®Google Scholar
• Li, S., R. Dian, L. Fang, and J. M. Bioucas-Dias. 2018. “Fusing Hyperspectral and Multispectral Images via Coupled Sparse Tensor Factorization.” IEEE Transactions on Image Processing 27 (8): 4118–4130. https://doi.org/10.1109/TIP.2018.2836307.
   Web of Science ®Google Scholar
• Liu, J. 2000. “Smoothing Filter-Based Intensity Modulation: A Spectral Preserve Image Fusion Technique for Improving Spatial Details.” International Journal of Remote Sensing 21 (18): 3461–3472. https://doi.org/10.1080/014311600750037499.
   Web of Science ®Google Scholar
• Liu, D., J. Li, and Q. Yuan. 2021. “A Spectral Grouping and Attention-Driven Residual Dense Network for Hyperspectral Image Super-Resolution.” IEEE Transactions on Geoscience and Remote Sensing 59 (9): 7711–7725. https://doi.org/10.1109/TGRS.2021.3049875.
   Web of Science ®Google Scholar
• Liu, J., Z. Wu, L. Xiao, and X. Wu. 2022. ““Model Inspired Autoencoder for Unsupervised Hyperspectral Image Super-Resolution.” IEEE Transactions on Geoscience and Remote Sensing 60:1–12. https://doi.org/10.1109/TGRS.2022.3143156.
   Web of Science ®Google Scholar
• Li, Q., Q. Wang, and X. Li. 2021. “Exploring the Relationship Between 2D/3D Convolution for Hyperspectral Image Super-Resolution.” IEEE Transactions on Geoscience and Remote Sensing 59 (10): 8693–8703. https://doi.org/10.1109/TGRS.2020.3047363.
   Web of Science ®Google Scholar
• Li, K., W. Zhang, D. Yu, and X. Tian. 2022. “HyperNet: A Deep Network for Hyperspectral, Multispectral, and Panchromatic Image Fusion.” ISPRS Journal of Photogrammetry and Remote Sensing 188:30–44. https://doi.org/10.1016/j.isprsjprs.2022.04.001.
   Web of Science ®Google Scholar
• Mei, S., X. Yuan, J. Ji, Y. Zhang, S. Wan, and Q. Du. 2017. “Hyperspectral Image Spatial Super-Resolution via 3D Full Convolutional Neural Network.” Remote Sensing 9 (11): 1139. https://doi.org/10.3390/rs9111139.
   Web of Science ®Google Scholar
• Moreira, L. C. J., A. D. S. Teixeira, and L. S. Galvão. 2015. “Potential of Multispectral and Hyperspectral Data to Detect Saline-Exposed Soils in Brazil.” GIScience & Remote Sensing 52 (4): 416–436. https://doi.org/10.1080/15481603.2015.1040227.
   Web of Science ®Google Scholar
• Ou, X., L. Liu, B. Tu, G. Zhang, and Z. Xu. 2022. “A CNN Framework with Slow-Fast Band Selection and Feature Fusion Grouping for Hyperspectral Image Change Detection.” IEEE Transactions on Geoscience and Remote Sensing 60:1–16. https://doi.org/10.1109/TGRS.2022.3156041.
   Web of Science ®Google Scholar
• Palsson, F., J. R. Sveinsson, and M. O. Ulfarsson. 2017. “Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network.” IEEE Geoscience and Remote Sensing Letters 14 (5): 639–643. https://doi.org/10.1109/LGRS.2017.2668299.
   Web of Science ®Google Scholar
• Quan, Y., M. Li, Y. Hao, J. Liu, and B. Wang. 2023. “Tree Species Classification in a Typical Natural Secondary Forest Using UAV-Borne LiDar and Hyperspectral Data.” GIScience & Remote Sensing 60 (1): 2171706. https://doi.org/10.1080/15481603.2023.2171706.
   Web of Science ®Google Scholar
• Qu, Y., H. Qi, and C. Kwan. 2018. “Unsupervised Sparse Dirichlet-Net for Hyperspectral Image Super-Resolution.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Long Beach, June, 2511–2520.
   Google Scholar
• Qu, Y., H. Qi, C. Kwan, N. Yokoya, and J. Chanussot. 2021. “Unsupervised and Unregistered Hyperspectral Image Super-Resolution with Mutual Dirichlet-Net.” IEEE Transactions on Geoscience and Remote Sensing 60:1–18. https://doi.org/10.1109/TGRS.2021.3079518.
   Web of Science ®Google Scholar
• Rao, W., L. Gao, Y. Qu, X. Sun, B. Zhang, and J. Chanussot. 2022. “Siamese Transformer Network for Hyperspectral Image Target Detection.” IEEE Transactions on Geoscience and Remote Sensing 60:1–19. https://doi.org/10.1109/TGRS.2022.3163173.
   Web of Science ®Google Scholar
• Rasti, B., D. Hong, R. Hang, P. Ghamisi, X. Kang, J. Chanussot, and J. A. Benediktsson. 2020. “Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep: Overview and Toolbox.” IEEE Geoscience and Remote Sensing Magazine 8 (4): 60–88. https://doi.org/10.1109/MGRS.2020.2979764.
   Web of Science ®Google Scholar
• Selva, M., B. Aiazzi, F. Butera, F. Chiarantini, and S. Baronti. 2015. “Hyper-Sharpening: A First Approach on SIM-GA Data.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 8 (6): 3008–3024. https://doi.org/10.1109/JSTARS.2015.2440092.
   Web of Science ®Google Scholar
• Sethuraman, J. 1994. “A Constructive Definition of Dirichlet Priors.” Statistica sinica 4 (2): 639–650.
   Web of Science ®Google Scholar
• Simoes, M., J. Bioucas‐Dias, L. B. Almeida, and J. Chanussot. 2014. “A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization.” IEEE Transactions on Geoscience and Remote Sensing 53 (6): 3373–3388. https://doi.org/10.1109/TGRS.2014.2375320.
   Web of Science ®Google Scholar
• Wang, Y., X. A. Chen, Z. Han, and S. He. 2017. “Hyperspectral Image Super-Resolution via Nonlocal Low-Rank Tensor Approximation and Total Variation Regularization.” Remote Sensing 9 (12): 1286. https://doi.org/10.3390/rs9121286.
   Web of Science ®Google Scholar
• Wan, W., W. Guo, H. Huang, and J. Liu. 2020. “Nonnegative and Nonlocal Sparse Tensor Factorization-Based Hyperspectral Image Super-Resolution.” IEEE Transactions on Geoscience and Remote Sensing 58 (12): 8384–8394. https://doi.org/10.1109/TGRS.2020.2987530.
   Web of Science ®Google Scholar
• Wang, W., W. Zeng, Y. Huang, X. Ding, and J. Paisley. 2019. “Deep Blind Hyperspectral Image Fusion.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, October, 4150–4159.
   Google Scholar
• Wei, Q., N. Dobigeon, and J. Tourneret. 2015. “Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation.” IEEE Transactions on Image Processing 24 (11): 4109–4121. https://doi.org/10.1109/TIP.2015.2458572.
   PubMed Web of Science ®Google Scholar
• Xu, Y., Z. Wu, J. Chanussot, P. Comon, and Z. Wei. 2019. “Nonlocal Coupled Tensor CP Decomposition for Hyperspectral and Multispectral Image Fusion.” IEEE Transactions on Geoscience and Remote Sensing 58 (1): 348–362. https://doi.org/10.1109/TGRS.2019.2936486.
   Web of Science ®Google Scholar
• Xu, X., Y. Zhong, L. Zhang, and H. Zhang. 2012. “Sub-Pixel Mapping Based on a MAP Model with Multiple Shifted Hyperspectral Imagery.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 6 (2): 580–593. https://doi.org/10.1109/JSTARS.2012.2227246.
   Web of Science ®Google Scholar
• Yi, C., Y. Q. Zhao, and J. C. W. Chan. 2018. “Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion.” IEEE Transactions on Geoscience and Remote Sensing 56 (7): 4165–4177. https://doi.org/10.1109/TGRS.2018.2828042.
   Web of Science ®Google Scholar
• Yokoya, N., T. Yairi, and A. Iwasaki. 2011. “Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion.” IEEE Transactions on Geoscience and Remote Sensing 50 (2): 528–537. https://doi.org/10.1109/TGRS.2011.2161320.
   Web of Science ®Google Scholar
• Yuan, Y., X. Zheng, and X. Lu. 2017. “Hyperspectral Image Superresolution by Transfer Learning.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (5): 1963–1974. https://doi.org/10.1109/JSTARS.2017.2655112.
   Web of Science ®Google Scholar
• Zeng, K., Z. Xu, Y. Yang, Y. Liu, H. Zhao, Y. Zhang, B. Xie, W. Zhou, C. Li, and W. Cao. 2022. “In situ Hyperspectral Characteristics and the Discriminative Ability of Remote Sensing to Coral Species in the South China Sea.” GIScience & Remote Sensing 59 (1): 272–294. https://doi.org/10.1080/15481603.2022.2026641.
   Web of Science ®Google Scholar
• Zhang, L., J. Nie, W. Wei, Y. Zhang, S. Liao, and L. Shao. 2020. “Unsupervised Adaptation Learning for Hyperspectral Imagery Super-Resolution.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, June, 3073–3082. https://doi.drg/10.1109/CVPR42600.2020.00314.
   Google Scholar
• Zhang, L., W. Wei, C. Bai, Y. Gao, and Y. Zhang. 2018. “Exploiting Clustering Manifold Structure for Hyperspectral Imagery Super-Resolution.” IEEE Transactions on Image Processing 27 (12): 5969–5982. https://doi.org/10.1109/TIP.2018.2862629.
   PubMed Web of Science ®Google Scholar
• Zhang, L., X. Xu, J. Li, H. Shen, Y. Zhong, and X. Huang. 2012. “Research on Image Reconstruction Based and Pixel Unmixing Based Sub-Pixel Mapping Methods.” In 2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, July, 7263–7266.
   Google Scholar
• Zheng, K., L. Gao, W. Liao, D. Hong, B. Zhang, X. Cui, and J. Chanussot. 2020. “Coupled Convolutional Neural Network with Adaptive Response Function Learning for Unsupervised Hyperspectral Super Resolution.” IEEE Transactions on Geoscience and Remote Sensing 59 (3): 2487–2502. https://doi.org/10.1109/TGRS.2020.3006534.
   Web of Science ®Google Scholar
• Zhou, Y., A. Rangarajan, and P. D. Gader. 2019. “An Integrated Approach to Registration and Fusion of Hyperspectral and Multispectral Images.” IEEE Transactions on Geoscience and Remote Sensing 58 (5): 3020–3033. https://doi.org/10.1109/TGRS.2019.2946803.
   Web of Science ®Google Scholar
• Zhu, Q., W. Deng, Z. Zheng, Y. Zhong, Q. Guan, W. Lin, L. Zhang, and D. Li. 2021. “A Spectral-Spatial-Dependent Global Learning Framework for Insufficient and Imbalanced Hyperspectral Image Classification.” IEEE Transactions on Cybernetics 52 (11): 11709–11723. https://doi.org/10.1109/TCYB.2021.3070577.
   Web of Science ®Google Scholar
• Zhu, Q., Y. Zhang, L. Wang, Y. Zhong, Q. Guan, X. Lu, L. Zhang, and D. Li. 2021. “A Global Context-Aware and Batch-Independent Network for Road Extraction from VHR Satellite Imagery.” Isprs Journal of Photogrammetry & Remote Sensing 175:353–365. https://doi.org/10.1016/j.isprsjprs.2021.03.016.
   Web of Science ®Google Scholar
• Zhu, Q., Y. Zhong, L. Zhang, and D. Li. 2018. “Adaptive Deep Sparse Semantic Modeling Framework for High Spatial Resolution Image Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing 56 (10): 6180–6195. https://doi.org/10.1109/TGRS.2018.2833293.
   Web of Science ®Google Scholar