242
Views
6
CrossRef citations to date
0
Altmetric
Research Article

GRF: guided residual fusion for pansharpening

ORCID Icon, , & ORCID Icon
Pages 3609-3627 | Received 20 Aug 2021, Accepted 06 Jul 2022, Published online: 26 Jul 2022

References

  • Aiazzi, B., L. Alparone, S. Baronti, A. Garzelli, and M. Selva. 2006. “MTF-Tailored Multiscale Fusion of High-Resolution MS and Pan Imagery.” Photogrammetric Engineering & Remote Sensing 72 (5): 591–596. doi:10.14358/PERS.72.5.591.
  • Aiazzi, B., S. Baronti, and M. Selva. 2007. “Improving Component Substitution Pansharpening Through Multivariate Regression of MS + Pan Data.” IEEE Transactions on Geoscience and Remote Sensing 45 (10): 3230–3239. doi:10.1109/TGRS.2007.901007.
  • Ballester, C., V. Caselles, L. Igual, J. Verdera, and B. Rougé. 2006. “A Variational Model for P+ XS Image Fusion.” International Journal of Computer Vision 69 (1): 43–58. doi:10.1007/s11263-006-6852-x.
  • Chavez, P., S. C. Sides, J. A. Anderson, et al. 1991. ”Comparison of Three Different Methods to Merge Multiresolution and Multispectral Data- Landsat TM and SPOT Panchromatic.” Photogrammetric Engineering and Remote Sensing 57 (3): 295–303.
  • Choi, M., R. Y. Kim, M. R. Nam, and H. O. Kim. 2005. “Fusion of Multispectral and Panchromatic Satellite Images Using the Curvelet Transform.” IEEE Geoscience and Remote Sensing Letters 2 (2): 136–140. doi:10.1109/LGRS.2005.845313.
  • Choi, J., K. Yu, and Y. Kim. 2010. “A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement.” IEEE Transactions on Geoscience and Remote Sensing 49 (1): 295–309. doi:10.1109/TGRS.2010.2051674.
  • Duran, J., A. Buades, B. Coll, and C. Sbert. 2014. “A Nonlocal Variational Model for Pansharpening Image Fusion.” SIAM Journal on Imaging Sciences 7 (2): 761–796. doi:10.1137/130928625.
  • Duran, J., A. Buades, B. Coll, C. Sbert, and G. Blanchet. 2017. “A Survey of Pansharpening Methods with a New Band-Decoupled Variational Model.” ISPRS Journal of Photogrammetry and Remote Sensing 125: 78–105. doi:10.1016/j.isprsjprs.2016.12.013.
  • Fang, F., F. Li, C. Shen, and G. Zhang. 2013. “A Variational Approach for Pan-Sharpening.” IEEE Transactions on Image Processing 22 (7): 2822–2834. doi:10.1109/TIP.2013.2258355.
  • Fasbender, D., J. Radoux, and P. Bogaert. 2008. “Bayesian Data Fusion for Adaptable Image Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing 46 (6): 1847–1857. doi:10.1109/TGRS.2008.917131.
  • Garguet-Duport, B., J. Girel, J. M. Chassery, and G. Patou. 1996. “The Use of Multiresolution Analysis and Wavelets Transform for Merging SPOT Panchromatic and Multispectral Image Data.” Photogrammetric Engineering and Remote Sensing 62 (9): 1057–1066.
  • Garzelli, A. and F. Nencini. 2005. “Interband Structure Modeling for Pan-Sharpening of Very High-Resolution Multispectral Images.” Information Fusion 6 (3): 213–224. doi:10.1016/j.inffus.2004.06.008.
  • Garzelli, A., F. Nencini, and L. Capobianco. 2007. “Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images.” IEEE Transactions on Geoscience and Remote Sensing 46 (1): 228–236. doi:10.1109/TGRS.2007.907604.
  • Gillespie, A. R., A. B. Kahle, and R. E. Walker. 1987. “Color Enhancement of Highly Correlated Images. II. Channel Ratio and Chromaticity Transformation Techniques.” Remote Sensing of Environment 22 (3): 343–365. doi:10.1016/0034-4257(87)90088-5.
  • He, K., J. Sun, and X. Tang. 2012. “Guided Image Filtering.” IEEE Transactions on Pattern Analysis and Machine Intelligence 35 (6): 1397–1409. doi:10.1109/TPAMI.2012.213.
  • Huang, W., L. Xiao, Z. Wei, H. Liu, and S. Tang. 2015. “A New Pan-Sharpening Method with Deep Neural Networks.” IEEE Geoscience and Remote Sensing Letters 12 (5): 1037–1041. doi:10.1109/LGRS.2014.2376034.
  • Kwarteng, P. and A. Chavez. 1989. “Extracting Spectral Contrast in Landsat Thematic Mapper Image Data Using Selective Principal Component Analysis.” Photogrammetric Engineering and Remote Sensing 55 (1): 339–348.
  • Laben, C. A. and B. V. Brower. 2000. “Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening.” US Patent 6011875.
  • Li, H., B. S. Manjunath, and S. K. Mitra. 1995. “Multisensor Image Fusion Using the Wavelet Transform.” Graphical Models and Image Processing 57 (3): 235–245. doi:10.1006/gmip.1995.1022.
  • Li, J., Q. Hu, M. Ai, and R. Zhong. 2017. “Robust Feature Matching via Support-Line Voting and Affine-Invariant Ratios.” ISPRS Journal of Photogrammetry and Remote Sensing 132: 61–76. doi:10.1016/j.isprsjprs.2017.08.009.
  • Li, J., Q. Hu, and M. Ai. 2018. “Multispectral and Panchromatic Image Fusion Based on Spatial Consistency.” International Journal of Remote Sensing 39 (4): 1017–1041. doi:10.1080/01431161.2017.1395967.
  • Li, J., Q. Hu, and M. Ai. 2019. “LAM: Locality Affine-Invariant Feature Matching.” ISPRS Journal of Photogrammetry and Remote Sensing 154: 28–40. doi:10.1016/j.isprsjprs.2019.05.006.
  • Li, J., Q. Hu, and M. Ai. 2020a. “RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform.” IEEE Transactions on Image Processing 29: 3296–3310. doi:10.1109/TIP.2019.2959244.
  • Li, J., Q. Hu, and M. Ai. 2020b. “Robust Geometric Model Estimation Based on Scaled Welsch Q-Norm.” IEEE Transactions on Geoscience and Remote Sensing 58 (8): 5908–5921. doi:10.1109/TGRS.2020.2972982.
  • Li, J., W. Xu, P. Shi, Y. Zhang, and Q. Hu . 2022. “LNIFT: Locally Normalized Image for Rotation Invariant Multimodal Feature Matching.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–14. doi:10.1109/TGRS.2022.3165940.
  • Liu, J. G. 2000. “Smoothing Filter-Based Intensity Modulation: A Spectral Preserve Image Fusion Technique for Improving Spatial Details.” International Journal of Remote Sensing 21 (18): 3461–3472. doi:10.1080/014311600750037499.
  • Liu, P., L. Xiao, J. Zhang, and B. Naz. 2015. “Spatial-Hessian-Feature-Guided Variational Model for Pan-Sharpening.” IEEE Transactions on Geoscience and Remote Sensing 54 (4): 2235–2253. doi:10.1109/TGRS.2015.2497966.
  • Liu, P., L. Xiao, and T. Li. 2017. “A Variational Pan-Sharpening Method Based on Spatial Fractional-Order Geometry and Spectral–spatial Low-Rank Priors.” IEEE Transactions on Geoscience and Remote Sensing 56 (3): 1788–1802. doi:10.1109/TGRS.2017.2768386.
  • Lowe, D. G. 2004. “Distinctive Image Features from Scale-Invariant Keypoints.” International Journal of Computer Vision 60 (2): 91–110. doi:10.1023/B:VISI.0000029664.99615.94.
  • Masi, G., D. Cozzolino, L. Verdoliva, and G. Scarpa. 2016. “Pansharpening by Convolutional Neural Networks.” Remote Sensing 8 (7): 594. doi:10.3390/rs8070594.
  • Meng, X., H. Shen, H. Li, L. Zhang, and R. Fu. 2019. “Review of the Pansharpening Methods for Remote Sensing Images Based on the Idea of Meta-Analysis: Practical Discussion and Challenges.” Information Fusion 46: 102–113. doi:10.1016/j.inffus.2018.05.006.
  • Molina, R., M. Vega, J. Mateos, and A. K. Katsaggelos. 2008. “Variational Posterior Distribution Approximation in Bayesian Super Resolution Reconstruction of Multispectral Images.” Applied and Computational Harmonic Analysis 24 (2): 251–267. doi:10.1016/j.acha.2007.03.006.
  • Otazu, X., M. González-Audcana, O. Fors, and J. Núñez. 2005. “Introduction of Sensor Spectral Response into Image Fusion Methods. Application to Wavelet-Based Methods.” IEEE Transactions on Geoscience and Remote Sensing 43 (10): 2376–2385. doi:10.1109/TGRS.2005.856106.
  • Palsson, F., J. R. Sveinsson, and M. O. Ulfarsson. 2013. “A New Pansharpening Algorithm Based on Total Variation.” IEEE Geoscience and Remote Sensing Letters 11 (1): 318–322. doi:10.1109/LGRS.2013.2257669.
  • Scarpa, G., S. Vitale, and D. Cozzolino. 2018. “Target-Adaptive CNN-Based Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing 56 (9): 5443–5457. doi:10.1109/TGRS.2018.2817393.
  • Shah, V. P., N. H. Younan, and R. L. King. 2008. “An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets.” IEEE Transactions on Geoscience and Remote Sensing 46 (5): 1323–1335. doi:10.1109/TGRS.2008.916211.
  • Shettigara, V. K. 1992. “A Generalized Component Substitution Technique for Spatial Enhancement of Multispectral Images Using a Higher Resolution Data Set.” Photogrammetric Engineering and Remote Sensing 58 (5): 561–567.
  • Tu, T. M., S. C. Su, H. C. Shyu, and P. S. Huang. 2001. “A New Look at IHS-Like Image Fusion Methods.” Information Fusion 2 (3): 177–186. doi:10.1016/S1566-2535(01)00036-7.
  • Vivone, G., L. Alparone, J. Chanussot, M. Dalla Mura, A. Garzelli, G. A. Licciardi, R. Restaino, and L. Wald. 2014. “A Critical Comparison Among Pansharpening Algorithms.” IEEE Transactions on Geoscience and Remote Sensing 53 (5): 2565–2586. doi:10.1109/TGRS.2014.2361734.
  • Vivone, G., R. Restaino, and J. Chanussot. 2018. “Full Scale Regression-Based Injection Coefficients for Panchromatic Sharpening.” IEEE Transactions on Image Processing 27 (7): 3418–3431. doi:10.1109/TIP.2018.2819501.
  • Vivone, G., P. Addesso, R. Restaino, M. Dalla Mura, and J. Chanussot. 2018. “Pansharpening Based on Deconvolution for Multiband Filter Estimation.” IEEE Transactions on Geoscience and Remote Sensing 57 (1): 540–553. doi:10.1109/TGRS.2018.2858288.
  • Vivone G., L. Alparone, J. Chanussot, M. M. Dalla, A. Garzelli, and R. G. Restaino. 2019. “Pansharpening Toolbox.” IEEE GRSS Remote Sensing Code Library.
  • Wei, Y., Q. Yuan, H. Shen, and L. Zhang. 2017. “Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network.” IEEE Geoscience and Remote Sensing Letters 14 (10): 1795–1799. doi:10.1109/LGRS.2017.2736020.
  • Xiao, J., T. Huang, L. Deng, Z. Wu, and G. Vivone. 2022. “A New Context-Aware Details Injection Fidelity with Adaptive Coefficients Estimation for Variational Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing 60: 3154480. doi:10.1109/TGRS.2022.3154480.
  • Yuan, Q., Y. Wei, X. Meng, H. Shen, and L. Zhang. 2018. “A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (3): 978–989. doi:10.1109/JSTARS.2018.2794888.
  • Zhang, H. K. and B. Huang. 2015. “A New Look at Image Fusion Methods from a Bayesian Perspective.” Remote Sensing 7 (6): 6828–6861. doi:10.3390/rs70606828.
  • Zhang, Y., C. Liu, M. Sun, and Y. Ou. 2019. “Pan-Sharpening Using an Efficient Bidirectional Pyramid Network.” IEEE Transactions on Geoscience and Remote Sensing 57 (8): 5549–5563. doi:10.1109/TGRS.2019.2900419.
  • Zhou, J., D. L. Civco, and J. A. Silander. 1998. “A Wavelet Transform Method to Merge Landsat TM and SPOT Panchromatic Data.” International Journal of Remote Sensing 19 (4): 743–757. doi:10.1080/014311698215973.
  • Zhu, X. and R. Bamler. 2012. “A Sparse Image Fusion Algorithm with Application to Pan-Sharpening.” IEEE Transactions on Geoscience and Remote Sensing 51 (5): 2827–2836. doi:10.1109/TGRS.2012.2213604.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.