Vector-Quantized Variational AutoEncoder for pansharpening

References

• Aghapour Maleki, S., and H. Ghassemian. 2021. “A Pansharpened Image Quality Assessment Using Segmentation Procedure.” International Journal of Remote Sensing 42 (11): 4157–4176. https://doi.org/10.1080/01431161.2021.1890853.
   Web of Science ®Google Scholar
• Aiazzi, B., L. Alparone, S. Baronti, and A. Garzelli. 2002. “Context-Driven Fusion of High Spatial and Spectral Resolution Images Based on Oversampled Multiresolution Analysis.” IEEE Transactions on Geoscience and Remote Sensing 40 (10): 2300–2312. https://doi.org/10.1109/TGRS.2002.803623.
   Web of Science ®Google Scholar
• Aiazzi, B., L. Alparone, S. Baronti, A. Garzelli, and M. Selva. 2006. “MTF-Tailored Multiscale Fusion of High-Resolution MS and Pan Imagery.” Photogrammetric Engineering & Remote Sensing 72 (5): 591–596. https://doi.org/10.14358/PERS.72.5.591.
   Web of Science ®Google Scholar
• Aiazzi, B., S. Baronti, and M. Selva. 2007. “Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$pan Data.” IEEE Transactions on Geoscience and Remote Sensing 45 (10): 3230–3239. https://doi.org/10.1109/TGRS.2007.901007.
   Web of Science ®Google Scholar
• Alparone, L., B. Aiazzi, S. Baronti, A. Garzelli, F. Nencini, and M. Selva. 2008. “Multispectral and Panchromatic Data Fusion Assessment without Reference.” Photogrammetric Engineering and Remote Sensing 74 (2): 193–200. 2. https://doi.org/10.14358/PERS.74.2.193.
   Web of Science ®Google Scholar
• AL Smadi, A., S. Yang, Z. Kai, A. Mehmood, M. Wang, and A. Alsanabani. 2021. “Pansharpening Based on Convolutional Autoencoder and Multi-Scale Guided Filter.” EURASIP Journal on Image and Video Processing 2021 (1): 25. https://doi.org/10.1186/s13640-021-00565-3.
   Web of Science ®Google Scholar
• Amro, I., and J. Mateos. 2013. “General Shearlet Pansharpening Method Using Bayesian Inference.” 2013 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), Poznan, Poland, 231–235. ISSN: 2326-0319.
   Google Scholar
• Arienzo, A., G. Vivone, A. Garzelli, L. Alparone, and J. Chanussot. 2022. “Full-Resolution Quality Assessment of Pansharpening: Theoretical and Hands-On Approaches.” IEEE Geoscience and Remote Sensing Magazine 10 (3): 168–201. https://doi.org/10.1109/MGRS.2022.3170092.
   Web of Science ®Google Scholar
• Azarang, A., H. E. Manoochehri, and N. Kehtarnavaz. 2019. “Convolutional Autoencoder-Based Multispectral Image Fusion.” IEEE Access 7:35673–35683. https://doi.org/10.1109/ACCESS.2019.2905511.
   Web of Science ®Google Scholar
• Burt, P., and E. Adelson. 1983. “The Laplacian Pyramid as a Compact Image Code.” IEEE Transactions on Communications 31 (4): 532–540. https://doi.org/10.1109/TCOM.1983.1095851.
   Web of Science ®Google Scholar
• Chavez, P., Jr, S. Sides, and J. Anderson. 1991. “Comparison of Three Different Methods to Merge Multiresolution and Multispectral Data: Landsat TM and SPOT Panchromatic.” Photogrammetric Engineering and Remote Sensing 57 (3): 295–303.
   Web of Science ®Google Scholar
• Chikr El-Mezouar, M., K. Kpalma, N. Taleb, and J. Ronsin. 2014. “A Pan-Sharpening Based on the Non-Subsampled Contourlet Transform: Application to Worldview-2 Imagery.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 7 (5): 1806–1815. https://doi.org/10.1109/JSTARS.2014.2306332.
   Web of Science ®Google Scholar
• Choi, J., Y. Kiyun, and Y. Kim. 2011. “A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement.” IEEE Transactions on Geoscience and Remote Sensing 49 (1): 295–309. https://doi.org/10.1109/TGRS.2010.2051674.
   Web of Science ®Google Scholar
• Deng, L.-J., G. Vivone, M. Paoletti, G. Scarpa, H. Jiang, Y. Zhang, J. Chanussot, and A. Plaza. 2022. “Machine Learning in Pansharpening: A Benchmark, from Shallow to Deep Networks.” IEEE Geoscience and Remote Sensing Magazine 10 (3): 279–315. https://doi.org/10.1109/MGRS.2022.3187652.
   Web of Science ®Google Scholar
• Duran, J., A. Buades, B. Coll, C. Sbert, and G. Blanchet. 2017. “A Survey of Pansharpening Methods with a New Band-Decoupled Variational Model.” ISPRS Journal of Photogrammetry and Remote Sensing 125:78–105. https://doi.org/10.1016/j.isprsjprs.2016.12.013.
   Web of Science ®Google Scholar
• Fasbender, D., J. Radoux, and P. Bogaert. 2008. “Bayesian Data Fusion for Adaptable Image Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing 46 (6): 1847–1857. https://doi.org/10.1109/TGRS.2008.917131.
   Web of Science ®Google Scholar
• Garzelli, A., F. Nencini, and L. Capobianco. 2008. “Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images.” IEEE Transactions on Geoscience and Remote Sensing 46 (1): 228–236. https://doi.org/10.1109/TGRS.2007.907604.
   Web of Science ®Google Scholar
• Gastineau, A., J.-F. Aujol, Y. Berthoumieu, and C. Germain. 2022. “Generative Adversarial Network for Pansharpening with Spectral and Spatial Discriminators.” IEEE Transactions on Geoscience & Remote Sensing 60:1–11. https://doi.org/10.1109/TGRS.2021.3060958.
   Web of Science ®Google Scholar
• Jiang, T., and C. Chen. 2009. “An Ameliorative Remote Sensing Image Fusion Method Based on the Second-Generation Curvelet Transform.” Joint Urban Remote Sensing Event, Shanghai, China. 1–6. IEEE. https://doi.org/10.1109/URS.2009.5137513.
   Google Scholar
• Kingma, D. P., and M. Welling. 2013. “Auto-Encoding Variational Bayes.” https://openreview.net/forum?id=33X9fd2-9FyZd.
   Google Scholar
• Li, J., M. Ai, S. Wang, and Q. Hu. 2022. “GRF: Guided Residual Fusion for Pansharpening.” International Journal of Remote Sensing 43 (10): 3609–3627. https://doi.org/10.1080/01431161.2022.2100726.
   Web of Science ®Google Scholar
• Liu, Q., H. Zhou, X. Qizhi, X. Liu, and Y. Wang. 2021. “PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening.” IEEE Transactions on Geoscience and Remote Sensing 59 (12): 10227–10242. https://doi.org/10.1109/TGRS.2020.3042974.
   Web of Science ®Google Scholar
• Loncan, L., L. B. de Almeida, J. M. Bioucas-Dias, X. Briottet, J. Chanussot, N. Dobigeon, S. Fabre, et al. 2015. “Hyperspectral Pansharpening: A Review.” IEEE Geoscience and Remote Sensing Magazine 3 (3): 27–46. https://doi.org/10.1109/MGRS.2015.2440094.
   Web of Science ®Google Scholar
• Martinetz, T. M., S. G. Berkovich, and K. J. Schulten. 1993. “’neural-gas’ Network for Vector Quantization and Its Application to Time-Series Prediction.” IEEE Transactions on Neural Networks 4 (4): 558–569. https://doi.org/10.1109/72.238311.
   PubMed Web of Science ®Google Scholar
• Masi, G., D. Cozzolino, L. Verdoliva, and G. Scarpa. 2016. “Pansharpening by Convolutional Neural Networks.” Remote Sensing 8 (7): 594. Number: 7 Publisher: Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/rs8070594
   Web of Science ®Google Scholar
• Meng, X., H. Shen, L. Huifang, L. Zhang, and F. Randi. 2019. “Review of the Pansharpening Methods for Remote Sensing Images Based on the Idea of Meta-Analysis: Practical Discussion and Challenges.” Information Fusion 46:102–113. https://doi.org/10.1016/j.inffus.2018.05.006.
   Web of Science ®Google Scholar
• Meng, X., H. Shen, Q. Yuan, L. Huifang, L. Zhang, and W. Sun. 2019. “Pansharpening for Cloud-Contaminated Very High-Resolution Remote Sensing Images.” IEEE Transactions on Geoscience & Remote Sensing 57 (5): 2840–2854. https://doi.org/10.1109/TGRS.2018.2878007.
   Web of Science ®Google Scholar
• Meng, X., Y. Xiong, F. Shao, H. Shen, W. Sun, G. Yang, Q. Yuan, F. Randi, and H. Zhang. 2021. “A Large-Scale Benchmark Data Set for Evaluating Pansharpening Performance: Overview and Implementation.” IEEE Geoscience and Remote Sensing Magazine 9 (1): 18–52. https://doi.org/10.1109/MGRS.2020.2976696.
   Web of Science ®Google Scholar
• Nezhad, Z. H., A. Karami, R. Heylen, and P. Scheunders. 2016. “Fusion of Hyperspectral and Multispectral Images Using Spectral Unmixing and Sparse Coding.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 9 (6): 2377–2389. https://doi.org/10.1109/JSTARS.2016.2528339.
   Web of Science ®Google Scholar
• Otazu, X., M. Gonzalez-Audicana, O. Fors, and J. Nunez. 2005. “Introduction of Sensor Spectral Response into Image Fusion Methods. Application to Wavelet-Based Methods.” IEEE Transactions on Geoscience and Remote Sensing 43 (10): 2376–2385. https://doi.org/10.1109/TGRS.2005.856106.
   Web of Science ®Google Scholar
• Palsson, F., J. R. Sveinsson, and M. O. Ulfarsson. 2014. “A New Pansharpening Algorithm Based on Total Variation.” IEEE Geoscience & Remote Sensing Letters 11 (1): 318–322. https://doi.org/10.1109/LGRS.2013.2257669.
   Web of Science ®Google Scholar
• Pradhan, P. S., R. L. King, N. H. Younan, and D. W. Holcomb. 2006. “Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion.” IEEE Transactions on Geoscience and Remote Sensing 44 (12): 3674–3686. https://doi.org/10.1109/TGRS.2006.881758.
   Web of Science ®Google Scholar
• Scarpa, G., S. Vitale, and D. Cozzolino. 2018. “Target-Adaptive CNN-Based Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing 56 (9): 5443–5457. https://doi.org/10.1109/TGRS.2018.2817393.
   Web of Science ®Google Scholar
• Smadi, A. A., S. Yang, A. Abugabah, A. Ali Alzubi, and L. Sanzogni. 2022. “A Pansharpening Based on the Non-Subsampled Contourlet Transform and Convolutional Autoencoder: Application to QuickBird Imagery.” IEEE Access 10:44778–44788. https://doi.org/10.1109/ACCESS.2022.3169698.
   Web of Science ®Google Scholar
• Tu, T.-M., S. Shun-Chi, H.-C. Shyu, and P. S. Huang. 2001. “A New Look at IHS-Like Image Fusion Methods.” Information Fusion 2 (3): 177–186. https://doi.org/10.1016/S1566-2535(01)00036-7.
   Google Scholar
• van den Oord, A., O. Vinyals, and K. Kavukcuoglu. 2017. “Neural Discrete Representation Learning.” Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS, Long Beach California USA, 17, 6309–6318. Curran Associates Inc.
   Google Scholar
• Vivone, G., L. Alparone, J. Chanussot, M. Dalla Mura, A. Garzelli, G. A. Licciardi, R. Restaino, and L. Wald. 2015. “A Critical Comparison Among Pansharpening Algorithms.” IEEE Transactions on Geoscience and Remote Sensing 53 (5): 2565–2586. https://doi.org/10.1109/TGRS.2014.2361734.
   Web of Science ®Google Scholar
• Vivone, G., M. Dalla Mura, A. Garzelli, R. Restaino, G. Scarpa, M. O. Ulfarsson, L. Alparone, and J. Chanussot. 2021. “A New Benchmark Based on Recent Advances in Multispectral Pansharpening: Revisiting Pansharpening with Classical and Emerging Pansharpening Methods.” IEEE Geoscience and Remote Sensing Magazine 9 (1): 53–81. https://doi.org/10.1109/MGRS.2020.3019315.
   Web of Science ®Google Scholar
• Wald, L. 2000. “Quality of High Resolution Synthesised Images: Is There a Simple Criterion ?” In Third conference “Fusion of Earth data: merging point measurements, raster maps and remotely sensed images”, edited by Thierry Ranchin and Lucien, January, 99–103. Wald, Sophia Antipolis, France: SEE/URISCA. https://hal.science/hal-00395027.
   Google Scholar
• Wald, L. 2002. “Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions.” In Presses de l’Ecole, Ecole des Mines de. Paris, Paris: France. https://hal-mines-paristech.archives-ouvertes.fr/hal-00464703.
   Google Scholar
• Wang, Z., and A. C. Bovik. 2002. “A Universal Image Quality Index.” IEEE Signal Processing Letters 9 (3): 81–84. https://doi.org/10.1109/97.995823.
   Web of Science ®Google Scholar
• Wang, Z., M. Yikun, and Y. Zhang. 2023. “Review of Pixel-Level Remote Sensing Image Fusion Based on Deep Learning.” Information Fusion 90:36–58. https://doi.org/10.1016/j.inffus.2022.09.008.
   Web of Science ®Google Scholar
• Yuan, Q., Y. Wei, X. Meng, H. Shen, and L. Zhang. 2018. “A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 11 (3): 978–989. https://doi.org/10.1109/JSTARS.2018.2794888.
   Web of Science ®Google Scholar