A pansharpening scheme using spectral graph wavelet transforms and convolutional neural networks

References

• Aiazzi, B., L. Alparone, S. Baronti, A. Garzelli, and M. Selva. 2003. “An MTF-based Spectral Distortion Minimizing Model for Pan-sharpening of Very High Resolution Multispectral Images of Urban Areas.” 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas, Berlin, Germany, 2003, 90–94. IEEE.
   Google Scholar
• Aiazzi, B., L. Alparone, S. Baronti, A. Garzelli, and M. Selva. 2006. “MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery.” Photogrammetric Engineering and Remote Sensing 72 (5): 591–596. doi:10.14358/PERS.72.5.591.
   Web of Science ®Google Scholar
• Aiazzi, B., S. Baronti, F. Lotti, and M. Selva. 2009. “A Comparison Be- Tween Global and Context-adaptive Pansharpening of Multispectral Images.” IEEE Geo- Science and Remote Sensing Letters 6 (2): 302–306. doi:10.1109/LGRS.2008.2012003.
   Web of Science ®Google Scholar
• Aiazzi, B., S. Baronti, M. Selva, and L. Alparone. 2013. “Bi-cubic Interpolation for Shift-free Pan-sharpening.” ISPRS Journal of Photogrammetry and Remote Sensing 86: 65–76. doi:10.1016/j.isprsjprs.2013.09.007.
   Web of Science ®Google Scholar
• Alparone, L., B. Aiazzi, S. Baronti, A. Garzelli, F. Nencini, and M. Selva. 2008. “Multispectral and Panchromatic Data Fusion Assessment without Reference.” Photogrammetric Engineering and Remote Sensing 74 (2): 193–200. doi:10.14358/PERS.74.2.193.
   Web of Science ®Google Scholar
• Alparone, L., S. Baronti, B. Aiazzi, and A. Garzelli. 2016. “Spatial Methods for Multispectral Pansharpening: Multiresolution Analysis Demystified.” IEEE Transactions on Geoscience and Remote Sensing 54 (5): 2563–2576. doi:10.1109/TGRS.2015.2503045.
   Web of Science ®Google Scholar
• Azarang, A., H. E. Manoochehri, and N. Kehtarnavaz. 2019. “Convolutional Autoencoder-based Multispectral Image Fusion.” IEEE Access 7: 35673–35683. doi:10.1109/ACCESS.2019.2905511.
   Web of Science ®Google Scholar
• Chavez, P., S. C. Sides, J. A. Anderson. 1991. “Comparison of Three Different Methods to Merge Multiresolution and Multispectral Data- Landsat TM and SPOT Panchromatic.” Photogrammetric Engineering and Remote Sensing 57 (3): 295–303.
   Web of Science ®Google Scholar
• Czaja, W., T. Doster, and J. M. Murphy. 2014. “Wavelet Packet Mixing for Image Fusion and Pan-sharpening.” In Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XX. Vol. 9088, 908803. International Society for Optics and Photonics. Baltimore, Maryland, United States.
   Google Scholar
• Gillespie, A. R., A. B. Kahle, and R. E. Walker. 1987. “Color Enhancement of Highly Correlated Images. II. Channel Ratio and “Chromaticity” Transformation Techniques.” Remote Sensing of Environment 22 (3): 343–365. doi:10.1016/0034-4257(87)90088-5.
   Web of Science ®Google Scholar
• González-Audícana, M., J. L. Saleta, R. G. Catalán, and G. Rafael. 2004. “Fusion of Multispectral and Panchromatic Images Using Improved IHS and PCA Mergers Based on Wavelet Decomposition.” IEEE Transactions on Geoscience and Remote Sensing 42 (6): 1291–1299. doi:10.1109/TGRS.2004.825593.
   Web of Science ®Google Scholar
• Hammond, D. K., P. Vandergheynst, and R. Gribonval. 2011. “Wavelets on Graphs via Spectral Graph Theory.” Applied and Computational Harmonic Analysis 30 (2): 129–150. doi:10.1016/j.acha.2010.04.005.
   Web of Science ®Google Scholar
• He, L., Y. Rao, J. Li, J. Chanussot, A. Plaza, J. Zhu, and B. Li. 2019. “Pansharpening via Detail Injection Based Convolutional Neural Networks.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12 (4): 1188 - 1204.
   Web of Science ®Google Scholar
• Huang, W., L. Xiao, Z. Wei, H. Liu, and S. Tang. 2015. “A New Pansharpening Method with Deep Neural Networks.” IEEE Geoscience and Remote Sensing Letters 12 (5): 1037–1041. doi:10.1109/LGRS.2014.2376034.
   Web of Science ®Google Scholar
• Kim, J., J. K. Lee, and K. M. Lee. 2016. “Accurate Image Super-resolution Using Very Deep Convolutional Networks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 1646–1654.
   Google Scholar
• Lee, J., and C. Lee. 2010. “Fast and Efficient Panchromatic Sharpening.” IEEE Transactions on Geoscience and Remote Sensing 48 (1): 155–163. doi:10.1109/TGRS.2009.2028613.
   Web of Science ®Google Scholar
• Li, S., and B. Yang. 2010. “A New Pan-sharpening Method Using A Compressed Sensing Technique.” IEEE Transactions on Geoscience and Remote Sensing 49 (2): 738–746. doi:10.1109/TGRS.2010.2067219.
   Web of Science ®Google Scholar
• Li, S., H. Yin, and L. Fang. 2013. “Remote Sensing Image Fusion via Sparse Representations over Learned Dictionaries.” IEEE Transactions on Geoscience and Remote Sensing 51 (9): 4779–4789. doi:10.1109/TGRS.2012.2230332.
   Web of Science ®Google Scholar
• Masi, G., D. Cozzolino, L. Verdoliva, and G. Scarpa. 2016. “Pansharpening by Convolutional Neural Networks.” Remote Sensing 8 (7): 594. doi:10.3390/rs8070594.
   Web of Science ®Google Scholar
• Matsuoka, M., T. Tadono, and H. Yoshioka. 2016. “Effects of the Spectral Properties of a Panchromatic Image on Pan-sharpening Simulated Using Hyperspectral Data.” International Journal of Image and Data Fusion 7 (4): 339–359. doi:10.1080/19479832.2016.1218945.
   Web of Science ®Google Scholar
• Meena, H., K. Sharma, and S. D. Joshi. 2017. “Improved Facial Expression Recognition Using Graph Signal Processing.” Electronics Letters 53 (11): 718–720. doi:10.1049/el.2017.0420.
   Web of Science ®Google Scholar
• Meng, X., H. Shen, H. Li, L. Zhang, and R. Fu. 2019. “Review of the Pansharpening Methods for Remote Sensing Images Based on the Idea of Meta-analysis: Practical Discussion and Challenges.” Information Fusion 46: 102–113. doi:10.1016/j.inffus.2018.05.006.
   Web of Science ®Google Scholar
• Meng, X., H. Shen, Q. Yuan, H. Li, L. Zhang, and W.-W. Sun. 2018. “Pansharpening for Cloud-contaminated Very High-resolution Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 57 (5): 2840–2854. doi:10.1109/TGRS.2018.2878007.
   Web of Science ®Google Scholar
• Meng, X., Y. Xiong, F. Shao, H. Shen, W. Sun, G. Yang, Q. Yuan. et al. 2020. “A Large-Scale Benchmark Data Set for Evaluating Pansharpening Performance: Overview and Implementation.”IEEE Geoscience and Remote Sensing Magazine. doi:10.1109/MGRS.2020.2976696.
   Web of Science ®Google Scholar
• Moonon, A.-U., J. Hu, and S. Li. 2015. “Remote Sensing Image Fusion Method Based on Nonsubsampled Shearlet Transform and Sparse Representation.” Sensing and Imag- Ing 16 (1): 23. doi:10.1007/s11220-015-0125-0.
   Web of Science ®Google Scholar
• Narang, S. K., and A. Ortega. 2012. “Perfect Reconstruction Two-channel Wavelet Filter Banks for Graph Structured Data.” IEEE Transactions on Signal Processing 60 (6): 2786–2799. doi:10.1109/TSP.2012.2188718.
   Web of Science ®Google Scholar
• Otazu, X., M. González-Audícana, O. Fors, and N. Jorge. 2005. “Introduction of Sensor Spectral Response into Image Fusion Methods. Application to Wavelet-based Methods.” IEEE Transactions on Geoscience and Remote Sensing 43 (10): 2376–2385. doi:10.1109/TGRS.2005.856106.
   Web of Science ®Google Scholar
• Palsson, F., J. R. Sveinsson, M. O. Ulfarsson, and J. A. Benediktsson. 2016. “MTF-Based Deblurring Using a Wiener Filter for CS and MRA Pansharpening Methods.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 9 (6): 2255–2269. doi:10.1109/JSTARS.2016.2546061.
   Web of Science ®Google Scholar
• Rahmani, S., M. Strait, D. Merkurjev, M. Moeller, and T. Wittman. 2010. “An Adaptive IHS Pan-sharpening Method.” IEEE Geoscience and Remote Sensing Letters 7 (4): 746–750. doi:10.1109/LGRS.2010.2046715.
   Web of Science ®Google Scholar
• Restaino, R., G. Vivone, M. D. Mura, and J. Chanussot. 2016. “Fusion of Multispectral and Panchromatic Images Based on Morphological Operators.” IEEE Transactions on Image Processing 25 (6): 2882–2895. doi:10.1109/TIP.2016.2556944.
   PubMed Web of Science ®Google Scholar
• Sakiyama, A., and Y. Tanaka. 2014. “Oversampled Graph Laplacian Matrix for Graph Filter Banks.” IEEE Transactions on Signal Processing 62 (24): 6425–6437. doi:10.1109/TSP.2014.2365761.
   Web of Science ®Google Scholar
• Saxena, N., and K. K. Sharma. 2017a. “Pansharpening Approach Using Hilbert Vibration Decomposition.” IET Image Processing 11 (12): 1152–1162. doi:10.1049/iet-ipr.2017.0133.
   Web of Science ®Google Scholar
• Saxena, N., and K. K. Sharma. 2018. “Pansharpening Scheme Using Filtering in Two- Dimensional Discrete Fractional Fourier Transform.” IET Image Processing 12 (6): 1013–1019. doi:10.1049/iet-ipr.2017.0961.
   Web of Science ®Google Scholar
• Saxena, N., and K. K. Sharma. 2017b. “A Hybrid Approach for Pansharpening Using Hilbert Vibration Decomposition.” 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI), Chennai, India, 2801–2805. IEEE.
   Google Scholar
• Scarpa, G., S. Vitale, and D. Cozzolino. 2018. “Target-adaptive CNN-based Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing 56 (9): 5443–5457. doi:10.1109/TGRS.2018.2817393.
   Web of Science ®Google Scholar
• Thomas, C., T. Ranchin, L. Wald, and J. Chanussot. 2008. “Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics.” IEEE Transactions on Geoscience and Remote Sensing 46 (5): 1301–1312. doi:10.1109/TGRS.2007.912448.
   Web of Science ®Google Scholar
• Vivone, G., L. Alparone, J. Chanussot, M. D. Mura, A. Garzelli, G. A. Licciardi, R. Restaino, and L. Wald. 2015. “A Critical Comparison among Pansharpening Algorithms.” IEEE Transactions on Geoscience and Remote Sensing 53 (5): 2565–2586. doi:10.1109/TGRS.2014.2361734.
   Web of Science ®Google Scholar
• Vivone, G., R. Restaino, and J. Chanussot. 2018. “Full Scale Regression-based Injection Coefficients for Panchromatic Sharpening.” IEEE Transactions on Image Processing 27 (7): 3418–3431. doi:10.1109/TIP.2018.2819501.
   PubMed Web of Science ®Google Scholar
• Wald, L. 2002. Data Fusion: Definitions and Architectures: Fusion of Images of Different Spatial Resolutions. Presses des MINES, Paris, France.
   Google Scholar
• Wang, Z., and A. C. Bovik. 2002. “A Universal Image Quality Index.” IEEE Signal Processing Letters 9 (3): 81–84. doi:10.1109/97.995823.
   Web of Science ®Google Scholar
• Wei, Y., Q. Yuan, H. Shen, and L. Zhang. 2017. “Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network.” IEEE Geoscience and Remote Sensing Letters 14 (10): 1795–1799. doi:10.1109/LGRS.2017.2736020.
   Web of Science ®Google Scholar
• Yuhas, R. H., A. F. H. Goetz, and J. W. Boardman. 1992. “Discrimination among Semi-arid Landscape Endmembers Using the Spectral Angle Mapper (SAM) Algorithm.”
   Google Scholar
• Zhang, Y. 2004. “Understanding Image Fusion.” Photogrammetric Engineering and Remote Sensing 70 (6): 657–661.
   Web of Science ®Google Scholar
• Zhu, X. X., and R. Bamler. 2012. “A Sparse Image Fusion Algorithm with Application to Pan-sharpening.” IEEE Transactions on Geoscience and Remote Sensing 51 (5): 2827–2836. doi:10.1109/TGRS.2012.2213604.
   Web of Science ®Google Scholar