A primal-dual method for total-variation-based pansharpening

References

• Aiazzi, B., L. Alparone, S. Baronti, A. Garzelli, and M. Selva. 2006. “MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery.” Photogrammetric Engineering and Remote Sensing 72 (5): 591–596. doi:10.14358/PERS.72.5.591.
   Web of Science ®Google Scholar
• Alparone, L., B. Aiazzi, S. Baronti, A. Garzelli, F. Nencini, and M. Selva. 2008. “Multispectral and Panchromatic Data Fusion Assessment without Reference.” Photogrammetric Engineering and Remote Sensing 74 (2): 193–200. doi:10.14358/PERS.74.2.193.
   Web of Science ®Google Scholar
• Alparone, L., S. Baronti, A. Garzelli, and F. Nencini. 2004. “A Global Quality Measurement of Pan-sharpened Multispectral Imagery.” IEEE Geoscience and Remote Sensing Letters 1 (4): 313–317. doi:10.1109/LGRS.2004.836784.
   Web of Science ®Google Scholar
• Azarang, A., and H. Ghassemian. 2018. “Application of Fractional-order Differentiation in Multispectral Image Fusion.” Remote Sensing Letters 9 (1): 91–100. doi:10.1080/2150704X.2017.1395963.
   Web of Science ®Google Scholar
• Boreman, G. D. 2001. Modulation Transfer Function in Optical and Electro-optical Systems. Vol. 10. WA: SPIE press Bellingham.
   Google Scholar
• Bovolo, F., L. Bruzzone, L. Capobianco, A. Garzelli, S. Marchesi, and F. Nencini. 2009. “Analysis of the Effects of Pansharpening in Change Detection on VHR Images.” IEEE Geoscience and Remote Sensing Letters 7 (1): 53–57. doi:10.1109/LGRS.2009.2029248.
   Web of Science ®Google Scholar
• Chambolle, A., and T. Pock. 2016. “An Introduction to Continuous Optimization for Imaging.” Acta Numerica 25: 161–319. doi:10.1017/S096249291600009X.
   Web of Science ®Google Scholar
• Chen, B., B. Huang, and X. Bing. 2017. “Multi-source Remotely Sensed Data Fusion for Improving Land Cover Classification.” ISPRS Journal of Photogrammetry and Remote Sensing 124: 27–39. doi:10.1016/j.isprsjprs.2016.12.008.
   Web of Science ®Google Scholar
• Chen, Y., T.-Z. Huang, X.-L. Zhao, L.-J. Deng, and J. Huang. 2017. “Stripe Noise Removal of Remote Sensing Images by Total Variation Regularization and Group Sparsity Constraint.” Remote Sensing 9 (6): 559. doi:10.3390/rs9060559.
   Web of Science ®Google Scholar
• Chen, Y., H. Wei, N. Yokoya, and T.-Z. Huang. 2019. “Blind Cloud and Cloud Shadow Removal of Multitemporal Images Based on Total Variation Regularized Low-rank Sparsity Decomposition.” ISPRS Journal of Photogrammetry and Remote Sensing 157: 93–107. doi:10.1016/j.isprsjprs.2019.09.003.
   Web of Science ®Google Scholar
• Choi, J., Y. Kiyun, and Y. Kim. 2010. “A New Adaptive Component-substitution-based Satellite Image Fusion by Using Partial Replacement.” IEEE Transactions on Geoscience and Remote Sensing 49 (1): 295–309. doi:10.1109/TGRS.2010.2051674.
   Web of Science ®Google Scholar
• Choi, J., H. Park, and D. Seo. 2019. “Pansharpening Using Guided Filtering to Improve the Spatial Clarity of VHR Satellite Imagery.” Remote Sensing 11 (6): 633. doi:10.3390/rs11060633.
   Web of Science ®Google Scholar
• Daneshvar, S., and H. Ghassemian. 2007. “MRI and PET Images Fusion Based on Human Retina Model.” Journal of Zhejiang University-SCIENCE A 8 (10): 1624–1632. doi:10.1631/jzus.2007.A1624.
   Web of Science ®Google Scholar
• Eghbalian, S., and H. Ghassemian. 2018. “Multi Spectral Image Fusion by Deep Convolutional Neural Network and New Spectral Loss Function.” International Journal of Remote Sensing 39 (12): 3983–4002. doi:10.1080/01431161.2018.1452074.
   Web of Science ®Google Scholar
• Fei, R., J.-S. Zhang, L. Junmin, C. Fang Du Peiju, and H. Junying. 2019. “Manifold Regularized Sparse Representation of Injected Details for Pansharpening.” International Journal of Remote Sensing 40 (22): 8395–8417. doi:10.1080/01431161.2019.1610984.
   Web of Science ®Google Scholar
• Garzelli, A., L. Capobianco, and F. Nencini. 2009. “On the Effects of Pan-sharpening to Target Detection.” Paper presented at the 2009 IEEE International Geoscience and Remote Sensing Symposium.
   Google Scholar
• Garzelli, A., F. Nencini, and L. Capobianco. 2007. “Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images.” IEEE Transactions on Geoscience and Remote Sensing 46 (1): 228–236. doi:10.1109/TGRS.2007.907604.
   Web of Science ®Google Scholar
• Ghahremani, M., and H. Ghassemian. 2015. “Remote-sensing Image Fusion Based on Curvelets and ICA.” International Journal of Remote Sensing 36 (16): 4131–4143. doi:10.1080/01431161.2015.1071897.
   Web of Science ®Google Scholar
• Ghamchili, M., and H. Ghassemian. 2020. “Pansharpening through an Improved Sparsity-based Fusion Method.” International Journal of Remote Sensing 41 (6): 2159–2188. doi:10.1080/01431161.2019.1685717.
   Web of Science ®Google Scholar
• Ghamisi, P., B. Rasti, N. Yokoya, Q. Wang, B. Hofle, L. Bruzzone, F. Bovolo, M. Chi, K. Anders, and R. Gloaguen. 2019. “Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art.” IEEE Geoscience and Remote Sensing Magazine 7 (1): 6–39. doi:10.1109/MGRS.2018.2890023.
   Web of Science ®Google Scholar
• Ghassemian, H. 2001. Multi-sensor image fusion using multirate filter banks. Paper presented at the Proceedings 2001 International Conference on Image Processing, Thessaloniki, Greece(Cat. No. 01CH37205). https://doi.org/10.1109/ICIP.2001.959178
   Google Scholar
• Ghassemian, H. 2016. “A Review of Remote Sensing Image Fusion Methods.” Information Fusion 32: 75–89. doi:10.1016/j.inffus.2016.03.003.
   Web of Science ®Google Scholar
• He, W., H. Zhang, L. Zhang, and H. Shen. 2015. “Total-variation-regularized Low-rank Matrix Factorization for Hyperspectral Image Restoration.” IEEE Transactions on Geoscience and Remote Sensing 54 (1): 178–188. doi:10.1109/TGRS.2015.2452812.
   Web of Science ®Google Scholar
• He, X., L. Condat, J. Chanussot, and J. Xia. 2012. Pansharpening Using Total Variation Regularization. Paper presented at the 2012 IEEE International Geoscience and Remote Sensing Symposium.
   Google Scholar
• Hu, J., H. Zhi, and W. Jiemin. 2019. “Deep Self-Learning Network for Adaptive Pansharpening.” Remote Sensing 11 (20): 2395. doi:10.3390/rs11202395.
   Web of Science ®Google Scholar
• Huang, W., L. Xiao, Z. Wei, H. Liu, and S. Tang. 2015. “A New Pan-sharpening Method with Deep Neural Networks.” IEEE Geoscience and Remote Sensing Letters 12 (5): 1037–1041. doi:10.1109/LGRS.2014.2376034.
   Web of Science ®Google Scholar
• Imani, M. 2018. “Band Dependent Spatial Details Injection Based on Collaborative Representation for Pansharpening.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (12): 4994–5004. doi:10.1109/JSTARS.2018.2851791.
   Web of Science ®Google Scholar
• Imani, M. 2020. “A Collaborative Representation-based Approximation Method for Remote Sensing Image Fusion.” International Journal of Remote Sensing 41 (3): 974–995. doi:10.1080/01431161.2019.1654143.
   Web of Science ®Google Scholar
• Jan, J. 2005. Medical Image Processing, Reconstruction and Restoration:. concepts and methods, p. 760. Boca Raton: Crc Press. https://doi.org/10.1201/9781420030679
   Google Scholar
• Jiang, C., H. Zhang, H. Shen, and L. Zhang. 2011. “A Practical Compressed Sensing-based Pan-sharpening Method.” IEEE Geoscience and Remote Sensing Letters 9 (4): 629–633. doi:10.1109/LGRS.2011.2177063.
   Web of Science ®Google Scholar
• Kallel, A. 2014. “MTF-adjusted Pansharpening Approach Based on Coupled Multiresolution Decompositions.” IEEE Transactions on Geoscience and Remote Sensing 53 (6): 3124–3145. doi:10.1109/TGRS.2014.2369056.
   Web of Science ®Google Scholar
• Khademi, G., and H. Ghassemian. 2017a. “Bayesian Fusion of Multispectral and Panchromatic Images.” Paper presented at the 2017 10th Iranian conference on machine vision and image processing (MVIP).
   Google Scholar
• Khademi, G., and H. Ghassemian. 2017b. “A Multi-objective Component-substitution-based Pansharpening.” Paper presented at the 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA).
   Google Scholar
• Khademi, G., and H. Ghassemian. 2018. “Incorporating an Adaptive Image Prior Model into Bayesian Fusion of Multispectral and Panchromatic Images.” IEEE Geoscience and Remote Sensing Letters 15 (6): 917–921. doi:10.1109/LGRS.2018.2817561.
   Web of Science ®Google Scholar
• Khademi, G., and H. Ghassemian. 2019. “A Variational Pansharpening Algorithm Based on Total Variation and Primal-Dual Optimization.” Paper presented at the 2019 4th International Conference on Pattern Recognition and Image Analysis (IPRIA).
   Google Scholar
• Komodakis, N., and J.-C. Pesquet. 2015. “Playing with Duality: An Overview of Recent Primal? Dual Approaches for Solving Large-scale Optimization Problems.” IEEE Signal Processing Magazine 32 (6): 31–54. doi:10.1109/MSP.2014.2377273.
   Web of Science ®Google Scholar
• Li, J., H. Qingwu, and A. Mingyao. 2018. “Multispectral and Panchromatic Image Fusion Based on Spatial Consistency.” International Journal of Remote Sensing 39 (4): 1017–1041.
   Web of Science ®Google Scholar
• Li, S., and B. Yang. 2010. “A New Pan-sharpening Method Using A Compressed Sensing Technique.” IEEE Transactions on Geoscience and Remote Sensing 49 (2): 738–746. doi:10.1109/TGRS.2010.2067219.
   Web of Science ®Google Scholar
• Li, S., H. Yin, and L. Fang. 2013. “Remote Sensing Image Fusion via Sparse Representations over Learned Dictionaries.” IEEE Transactions on Geoscience and Remote Sensing 51 (9): 4779–4789. doi:10.1109/TGRS.2012.2230332.
   Web of Science ®Google Scholar
• Liu, P. 2019. “A New Total Generalized Variation Induced Spatial Difference Prior Model for Variational Pansharpening.” Remote Sensing Letters 10 (7): 659–668. doi:10.1080/2150704X.2019.1597299.
   Web of Science ®Google Scholar
• Maneshi, M., H. Ghassemian, G. Khademi, and M. Imani. 2020. “A Retina-Inspired Multiresolution Analysis Framework for Pansharpening.” Paper presented at the 2020 International Conference on Machine Vision and Image Processing (MVIP).
   Google Scholar
• Masi, G., D. Cozzolino, L. Verdoliva, and G. Scarpa. 2016. “Pansharpening by Convolutional Neural Networks.” Remote Sensing 8 (7): 594. doi:10.3390/rs8070594.
   Web of Science ®Google Scholar
• Meng, X., H. Shen, L. Huifang, L. Zhang, and F. Randi. 2019. “Review of the Pansharpening Methods for Remote Sensing Images Based on the Idea of Meta-analysis: Practical Discussion and Challenges.” Information Fusion 46: 102–113. doi:10.1016/j.inffus.2018.05.006.
   Web of Science ®Google Scholar
• Meng, X., H. Shen, Q. Yuan, L. Huifang, L. Zhang, and W. Sun. 2018. “Pansharpening for Cloud-contaminated Very High-resolution Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 57 (5): 2840–2854. doi:10.1109/TGRS.2018.2878007.
   Web of Science ®Google Scholar
• Meng, X., Y. Xiong, F. Shao, H. Shen, W. Sun, G. Yang, Q. Yuan, and H. Zhang. 2020. “A Large-Scale Benchmark Data Set for Evaluating Pansharpening Performance: Overview and Implementation.” IEEE Geoscience and Remote Sensing Magazine.
   Web of Science ®Google Scholar
• Naeimi Marandi, R., and H. Ghassemian. 2019. “A New Pixelwise Fusion Based on Feedback Error Correction.” Remote Sensing Letters 10 (8): 806–815. doi:10.1080/2150704X.2019.1612115.
   Web of Science ®Google Scholar
• Otazu, X., M. González-Audícana, O. Fors, and N. Jorge. 2005. “Introduction of Sensor Spectral Response into Image Fusion Methods. Application to Wavelet-based Methods.” IEEE Transactions on Geoscience and Remote Sensing 43 (10): 2376–2385. doi:10.1109/TGRS.2005.856106.
   Web of Science ®Google Scholar
• Palsson, F., J. R. Sveinsson, and M. O. Ulfarsson. 2013. “A New Pansharpening Algorithm Based on Total Variation.” IEEE Geoscience and Remote Sensing Letters 11 (1): 318–322. doi:10.1109/LGRS.2013.2257669.
   Web of Science ®Google Scholar
• Pock, T., and A. Chambolle. 2011. “Diagonal Preconditioning for First Order Primal-dual Algorithms in Convex Optimization.” Paper presented at the 2011 International Conference on Computer Vision.
   Google Scholar
• Pock, T., D. Cremers, H. Bischof, and A. Chambolle. 2009. “An Algorithm for Minimizing the Mumford-Shah Functional.” Paper presented at the 2009 IEEE 12th International Conference on Computer Vision.
   Google Scholar
• Rasti, B., P. Ghamisi, and R. Gloaguen. 2017. “Hyperspectral and LiDAR Fusion Using Extinction Profiles and Total Variation Component Analysis.” IEEE Transactions on Geoscience and Remote Sensing 55 (7): 3997–4007. doi:10.1109/TGRS.2017.2686450.
   Web of Science ®Google Scholar
• Shahdoosti, H. R., and H. Ghassemian. 2012. “Spatial PCA as a New Method for Image Fusion.” Paper presented at the The 16th CSI International Symposium on Artificial Intelligence and Signal Processing (AISP 2012).
   Google Scholar
• Shen, H., X. Meng, and L. Zhang. 2016. “An Integrated Framework for the Spatio–temporal–spectral Fusion of Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 54 (12): 7135–7148. doi:10.1109/TGRS.2016.2596290.
   Web of Science ®Google Scholar
• Shensa, M. J. 1992. “The Discrete Wavelet Transform: Wedding the a Trous and Mallat Algorithms.” IEEE Transactions on Signal Processing 40 (10): 2464–2482. doi:10.1109/78.157290.
   Web of Science ®Google Scholar
• Valizadeh, S. A., and H. Ghassemian. 2012. “Remote Sensing Image Fusion Using Combining IHS and Curvelet Transform.” Paper presented at the 6th International Symposium on Telecommunications (IST).
   Google Scholar
• Vivone, G., L. Alparone, J. Chanussot, M. D. Mura, A. Garzelli, G. A. Licciardi, R. Restaino, and L. Wald. 2014a. “A Critical Comparison among Pansharpening Algorithms.” IEEE Transactions on Geoscience and Remote Sensing 53 (5): 2565–2586. doi:10.1109/TGRS.2014.2361734.
   Web of Science ®Google Scholar
• Vivone, G., R. Restaino, and J. Chanussot. 2018. “Full Scale Regression-based Injection Coefficients for Panchromatic Sharpening.” IEEE Transactions on Image Processing 27 (7): 3418–3431. doi:10.1109/TIP.2018.2819501.
   PubMed Web of Science ®Google Scholar
• Vivone, G., M. Simões, M. D. Mura, R. Restaino, J. M. Bioucas-Dias, G. A. Licciardi, and J. Chanussot. 2014b. “Pansharpening Based on Semiblind Deconvolution.” IEEE Transactions on Geoscience and Remote Sensing 53 (4): 1997–2010. doi:10.1109/TGRS.2014.2351754.
   Web of Science ®Google Scholar
• Wald, L., T. Ranchin, and M. Mangolini. 1997. “Fusion of Satellite Images of Different Spatial Resolutions: Assessing the Quality of Resulting Images.” Photogramm. Eng. Remote Sens. 63 (6): 691–699.
   Web of Science ®Google Scholar
• Wald, L. 2000. “Quality of High Resolution Synthesised Images: Is There a Simple Criterion?” Paper presented at the the Third International Conference Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images, Sophia Antipolis, 26–28, January 2000. France.
   Google Scholar
• Wang, Z., and A. C. Bovik. 2002. “A Universal Image Quality Index.” IEEE Signal Processing Letters 9 (3): 81–84. doi:10.1109/97.995823.
   Web of Science ®Google Scholar
• Wei, Y., Q. Yuan, H. Shen, and L. Zhang. 2017. “Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network.” IEEE Geoscience and Remote Sensing Letters 14 (10): 1795–1799. doi:10.1109/LGRS.2017.2736020.
   Web of Science ®Google Scholar
• Xu, Y., S. E. Smith, S. Grunwald, A. Abd-Elrahman, and S. P. Wani. 2017. “Incorporation of Satellite Remote Sensing Pan-sharpened Imagery into Digital Soil Prediction and Mapping Models to Characterize Soil Property Variability in Small Agricultural Fields.” ISPRS Journal of Photogrammetry and Remote Sensing 123: 1–19. doi:10.1016/j.isprsjprs.2016.11.001.
   Web of Science ®Google Scholar
• Yilmaz, S., V. Y. Cigdem, and G. Oguz. 2020. “On the Use of the SOS Metaheuristic Algorithm in Hybrid Image Fusion Methods to Achieve Optimum Spectral Fidelity.” International Journal of Remote Sensing 41 (10): 3993–4021. doi:10.1080/01431161.2019.1711244.
   Web of Science ®Google Scholar
• Yilmaz, V., C. S. Yilmaz, O. Güngör, and J. Shan. 2020. “A Genetic Algorithm Solution to the Gram-schmidt Image Fusion.” International Journal of Remote Sensing 41 (4): 1458–1485. doi:10.1080/01431161.2019.1667553.
   Web of Science ®Google Scholar
• Yuhas, R. H., A. F. H. Goetz, and J. W. Boardman. 1992. “Discrimination among Semi-arid Landscape Endmembers Using the Spectral Angle Mapper (SAM) Algorithm.” In Summaries 3rd Annu. JPL Airborne Geosci. Workshop, 147–149. CA, USA: Pasadena. https://ntrs.nasa.gov/citations/19940012238
   Google Scholar
• Zhang, L., H. Shen, W. Gong, and H. Zhang. 2012. “Adjustable Model-based Fusion Method for Multispectral and Panchromatic Images.” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 42 (6): 1693–1704. doi:10.1109/TSMCB.2012.2198810.
   PubMed Web of Science ®Google Scholar
• Zhong, S., Y. Zhang, Y. Chen, and W. Di. 2017. “Combining Component Substitution and Multiresolution Analysis: A Novel Generalized BDSD Pansharpening Algorithm.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (6): 2867–2875. doi:10.1109/JSTARS.2017.2697445.
   Web of Science ®Google Scholar
• Zhu, X. X., and R. Bamler. 2012. “A Sparse Image Fusion Algorithm with Application to Pan-sharpening.” IEEE Transactions on Geoscience and Remote Sensing 51 (5): 2827–2836. doi:10.1109/TGRS.2012.2213604.
   Web of Science ®Google Scholar
• Zhu, X. X., C. Grohnfeldt, and R. Bamler. 2015. “Exploiting Joint Sparsity for Pansharpening: The J-SparseFI Algorithm.” IEEE Transactions on Geoscience and Remote Sensing 54 (5): 2664–2681. doi:10.1109/TGRS.2015.2504261.
   Web of Science ®Google Scholar