780
Views
32
CrossRef citations to date
0
Altmetric
Articles

A genetic algorithm solution to the gram-schmidt image fusion

ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Pages 1458-1485 | Received 19 Jul 2019, Accepted 04 Sep 2019, Published online: 22 Sep 2019

References

  • Adamiec, G., M. Garcia-Talavera, R. M. Bailey, and P. I. de La Torre. 2004. “Application of a Genetic Algorithm to Finding Parameter Values for Numerical Simulation of Quartz Luminescence.” Geochronometria: Journal on Methods & Applications of Absolute Chronology 23 (9): 9–14.
  • Aiazzi, B., L. Alparone, S. Baronti, and A. Garzelli. 2002a. “Context-driven Fusion of High Spatial and Spectral Resolution Images Based on Oversampled Multiresolution Analysis.” IEEE Transactions on Geoscience and Remote Sensing 40 (10): 2300–2312. doi:10.1109/TGRS.2002.803623.
  • Aiazzi, B., L. Alparone, S. Baronti, and M. Selva. 2002b. “Generalized Laplacian Pyramid-based Fusion of MS + P Image Data with Spectral Distortion Minimization.” ISPRS International Archives of Photogrammetry and Remote Sensing 34 (3B–W3): 3–6.
  • Aiazzi, B., S. Baronti, and M. Selva. 2007. “Improving Component Substitution Pansharpening through Multivariate Regression of MS+Pan Data.” IEEE Transactions on Geoscience and Remote Sensing 45 (10): 3230–3239. doi:10.1109/TGRS.2007.901007.
  • Alparone, L., B. Aiazzi, S. Baronti, and A. Garzelli. 2003. “Sharpening of Very High Resolution Images with Spectral Distortion Minimization.” Proceedings of the IEEE Geoscience and Remote Sensing Symposium (IGARSS’03), Toulouse, France, 1, 458–460. doi: 10.1109/IGARSS.2003.1293808.
  • Alparone, L., S. Baronti, A. Garzelli, and F. Nencini. 2004. “A Global Quality Measurement of Pan-sharpened Multispectral Imagery.” IEEE Geoscience and Remote Sensing Letters 1 (4): 313–317. doi:10.1109/LGRS.2004.836784.
  • Cai, W., Y. Xu, Z. Wu, H. Liu, L. Qian, and Z. Wei. 2018. “Pan-Sharpening Based on Multilevel Coupled Deep Network.” IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Valencia, Spain, pp. 7046–7049. doi: 10.1109/IGARSS.2018.8518121.
  • Chai, P., X. Luo, and Z. Zhang. 2017. “Image Fusion Using Quaternion Wavelet Transform and Multiple Features.” IEEE Access 5: 6724–6734. doi:10.1109/ACCESS.2017.2685178.
  • Chavez, P. S., and A. Y. Kwarteng. 1989. “Extracting Spectral Contrast in Landsat Thematic Mapper Image Data Using Selective Principal Component Analysis.” Photogrammetric Engineering & Remote Sensing 55 (3): 339–348.
  • Chen, L., X. Zhang, and H. Ma. 2018. “Sparse Representation over Shared Coefficients in Multispectral Pansharpening.” Tsinghua Science and Technology 23 (3): 315–322. doi:10.26599/TST.2018.9010088.
  • Cheng, J., H. Liu, T. Liu, F. Wang, and H. Li. 2015. “Remote Sensing Image Fusion via Wavelet Transform and Sparse Representation.” ISPRS Journal of Photogrammetry and Remote Sensing 104: 158–173. doi:10.1016/j.isprsjprs.2015.02.015.
  • Crippen, R. E. 1989. “A Simple Spatial Filtering Routine for the Cosmetic Removal of Scan-line Noise from Landsat TM P-tape Imagery.” Photogrammetric Engineering and Remote Sensing 55: 327–331.
  • Dian, R., S. Li, L. Fang, and Q. Wei. 2019. “Multispectral and Hyperspectral Image Fusion with Spatial-spectral Sparse Representation.” Information Fusion 49: 262–270. doi:10.1016/j.inffus.2018.11.012.
  • Dian, R., S. Li, A. Guo, and L. Fang. 2018. “Deep Hyperspectral Image Sharpening.” IEEE Transactions on Neural Networks and Learning Systems 29: 5345–5355. doi:10.1109/TNNLS.2018.2798162.
  • Dong, L., Q. Yang, H. Wu, H. Xiao, and M. Xu. 2015. “High Quality Multi-spectral and Panchromatic Image Fusion Technologies Based on Curvelet Transform.” Neurocomputing 159: 268–274. doi:10.1016/j.neucom.2015.01.050.
  • Ehlers, M., S. Klonus, P. Johan Åstrand, and P. Rosso. 2010. “Multi-sensor Image Fusion for Pansharpening in Remote Sensing.” Int. J. Image Data Fusion 1 (1): 25–45. doi:10.1080/19479830903561985.
  • ERDAS IMAGINE v.13 Field Guide, Leica Geosystems. 2013.
  • Fei, R., J. Zhang, J. Liu, F. Du, P. Chang, and J. Hu. 2019. “Convolutional Sparse Representation of Injected Details for Pansharpening.” IEEE Geoscience and Remote Sensing Letters 1–5. doi:10.1109/LGRS.2019.2904526.
  • Fernandez-Beltran, R., J. M. Haut, M. E. Paoletti, J. Plaza, A. Plaza, and F. Pla. 2018. “Remote Sensing Image Fusion Using Hierarchical Multimodal Probabilistic Latent Semantic Analysis.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (12): 4982–4993. doi:10.1109/JSTARS.2018.2881342.
  • Garzelli, A., and F. Nencini. 2006a. “Fusion of Panchromatic and Multispectral Images by Genetic Algorithms.” IEEE International Conference on Geoscience and Remote Sensing Symposium (IGARSS 2006), Denver, CO, USA, 3810–3813. doi: 10.1109/IGARSS.2006.976.
  • Garzelli, A., and F. Nencini. 2006b. “PAN‐sharpening of Very High Resolution Multispectral Images Using Genetic Algorithms.” International Journal of Remote Sensing 27 (15): 3273–3292. doi:10.1080/01431160600554991.
  • Garzelli, A., F. Nencini, and L. Capobianco. 2008. “Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images.” IEEE Transactions on Geoscience and Remote Sensing 46 (1): 228–236. doi:10.1109/TGRS.2007.907604.
  • Ghahremani, M., and H. Ghassemian. 2015. “Remote-sensing Image Fusion Based on Curvelets and ICA.” International Journal of Remote Sensing 36 (16): 4131–4143. doi:10.1080/01431161.2015.1071897.
  • Ghahremani, M., Y. Liu, P. Yuen, and A. Behera. 2019. “Remote Sensing Image Fusion via Compressive Sensing.” ISPRS Journal of Photogrammetry and Remote Sensing 152: 34–48. doi:10.1016/j.isprsjprs.2019.04.001.
  • Ghassemian, H. 2016. “A Review of Remote Sensing Image Fusion Methods.” Information Fusion 32: 75–89. doi:10.1016/j.inffus.2016.03.003.
  • Gogineni, R., and A. Chaturvedi. 2018. “Sparsity Inspired Pan-sharpening Technique Using Multiscale Learned Dictionary.” ISPRS Journal of Photogrammetry and Remote Sensing 146: 360–372. doi:10.1016/j.isprsjprs.2018.10.009.
  • Haghighat, M. B. A., A. Aghagolzadeh, and H. Seyedarabi. 2011. “A Non-Reference Image Fusion Metric Based on Mutual Information of Image Features.” Computers & Electrical Engineering 37 (5): 744–756. doi:10.1016/j.compeleceng.2011.07.012.
  • Hallada, W. A., and S. Cox. 1983. “Image Sharpening for Mixed Spatial and Spectral Resolution Satellite Systems.” Proceedings of the 17th International Symposium on Remote Sensing of Environment, Ann Arbor, MI, 1023–1032.
  • Han, Y., Y. Cai, Y. Cao, and X. Xu. 2013. “A New Image Fusion Performance Metric Based on Visual Information Fidelity.” Information Fusion 14 (2): 127–135. doi:10.1016/j.inffus.2011.08.002.
  • Hill, P., N. Canagarajah, and D. Bull. 2002. “Image Fusion Using Complex Wavelets.” Proceedings of the 13th British Machine Vision Conference, Cardiff, UK, 487–496. doi: 10.5244/C.16.47.
  • Hole, K. R., V. S. Gulhane, and N. D. Shellokar. 2013. “Application of Genetic Algorithm for Image Enhancement and Segmentation.” International Journal of Advanced Research in Computer Engineering & Technology 2 (4): 1342–1346.
  • Holland, H. 1975. Adaptation in Natural and Artificial Systems. Ann Arbor: University of Michigan Press.
  • Janssen, S., D. G. Ireland, and J. Ryckebusch. 2003. “Extraction of N* Information from the Limited P (γ, K+) Λ Data Set.” Physics Letters B 562 (1–2): 51–56. doi:10.1016/S0370-2693(03)00557-4.
  • Khademi, G., and H. Ghassemian. 2017. “A Multi-objective Component-substitution-based Pansharpening.” 3rd IEEE International Conference on Pattern Recognition and Image Analysis (IPRIA), Shahrekord, Iran, 248–252. doi: 10.1109/PRIA.2017.7983056.
  • Laben, C. A., and B. V. Brower. 2000. “Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pansharpening.” US Patent No. 6,011,875, filed 29 April 1998 and issued 4 January 2000 to the Eastman Kodak Company.
  • Lam, Y. C., L. Y. Zhai, K. Tai, and S. C. Fok. 2004. “An Evolutionary Approach for Cooling System Optimization in Plastic Injection Moulding.” International Journal of Production Research 42 (10): 2047–2061. doi:10.1080/00207540310001622412.
  • Lari, S. N., and M. Yazdi. 2016. “Improved IHS Pan-Sharpening Method Based on Adaptive Injection of À Trous Wavelet Decomposition.” International Journal of Signal Processing, Image Processing and Pattern Recognition 9 (3): 291–308. doi:10.14257/ijsip.2016.9.3.26.
  • Li, S., X. Kang, and J. Hu. 2013. “Image Fusion with Guided Filtering.” IEEE Transactions on Image Processing 22 (7): 2864–2875. doi:10.1109/TIP.2013.2244222.
  • Liu, A., W. Lin, and M. Narwaria. 2012. “Image Quality Assessment Based on Gradient Similarity.” IEEE Transactions on Image Processing 21 (4): 1500–1512. doi:10.1109/TIP.2011.2175935.
  • Liu, J. G. 2000. “Smoothing Filter-based Intensity Modulation: A Spectral Preserve Image Fusion Technique for Improving Spatial Details.” International Journal of Remote Sensing 21 (18): 3461–3472. doi:10.1080/014311600750037499.
  • Masi, G., D. Cozzolino, L. Verdoliva, and G. Scarpa. 2016. “Pansharpening by Convolutional Neural Networks.” Remote Sensing 8 (7): 594. doi:10.3390/rs8070594.
  • Masoudi, R., and P. Kabiri. 2014. “New Intensity-hue-saturation Pan-sharpening Method Based on Texture Analysis and Genetic Algorithm-adaption.” Journal of Applied Remote Sensing 8 (1): 083640. doi:10.1117/1.JRS.8.083640.
  • Maulik, U., and S. Bandyopadhyay. 2000. “Genetic Algorithm-based Clustering Technique.” Pattern Recognition 33 (9): 1455–1465. doi:10.1016/S0031-3203(99)00137-5.
  • Maurer, T. 2013. “How to Pan-sharpen Images Using the Gram-Schmidt Pan-sharpen method—A Recipe.” International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-1/W1: 239–244. doi:10.5194/isprsarchives-XL-1-W1-239-2013.
  • Miao, Q. G., C. Shi, P. F. Xu, M. Yang, and Y. B. Shi. 2011. “A Novel Algorithm of Image Fusion Using Shearlets.” Optics Communications 284 (6): 1540–1547. doi:10.1016/j.optcom.2010.11.048.
  • Niazi, S. M. N., M. M. Zade, and F. S. Zadeh. 2016. “A Novel IHS-GA Fusion Method Based on Enhancement Vegetated Area.” Journal of Geomatics Science and Technology 6 (1): 235–248.
  • Otazu, X., M. González-Audícana, O. Fors, and J. Núñez. 2005. “Introduction of Sensor Spectral Response into Image Fusion Methods, Application to Wavelet-based Methods.” IEEE Transactions on Geoscience and Remote Sensing 43 (10): 2376–2385. doi:10.1109/TGRS.2005.856106.
  • Padwick, C., M. Deskevich, F. Pacifici, and S. Smallwood. 2010. “WorldView-2 Pansharpening.” Proceedings of the ASPRS Annual Conference, San Diego, CA, USA, 2630.
  • Palsson, F., J. R. Sveinsson, and M. O. Ulfarsson. 2017. “Multispectral and Hyperspectral Image Fusion Using a 3-d-convolutional Neural Network.” IEEE Geoscience and Remote Sensing Letters 14 (5): 639–643. doi:10.1109/LGRS.2017.2668299.
  • Park, J. H., and M. G. Kang. 2004. “Spatially Adaptive Multiresolution Multispectral Image Fusion.” International Journal of Remote Sensing 25 (23): 5491–5508. doi:10.1080/01431160412331270830.
  • Pohl, C., and J. van Genderen. 2016. Remote Sensing Image Fusion: A Practical Guide. Boca Raton, FL: CRC Press.
  • Qiu, M., Z. Ming, J. Li, K. Gai, and Z. Zong. 2015. “Phase-change Memory Optimization for Green Cloud with Genetic Algorithm.” IEEE Transactions on Computers 64 (12): 3528–3540. doi:10.1109/TC.2015.2409857.
  • Ranchin, T., B. Aiazzi, L. Alparone, S. Baronti, and L. Wald. 2003. “Image fusion—The ARSIS Concept and Some Successful Implementation Schemes.” ISPRS Journal of Photogrammetry and Remote Sensing 58 (1–2): 4–18. doi:10.1016/S0924-2716(03)00013-3.
  • Scarpa, G., S. Vitale, and D. Cozzolino. 2018. “Target-adaptive CNN-based Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing 56 (9): 5443–5457. doi:10.1109/TGRS.2018.2817393.
  • Schowengerdt, R. A. 1980. “Reconstruction of Multispatial, Multispectral Image Data Using Spatial Frequency Content.” Photogrammetric Engineering & Remote Sensing 46 (10): 1325–1334.
  • Shao, Z., and J. Cai. 2018. “Remote Sensing Image Fusion with Deep Convolutional Neural Network.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (5): 1656–1669. doi:10.1109/JSTARS.2018.2805923.
  • Shukla, A., H. M. Pandey, and D. Mehrotra. 2015. “Comparative Review of Selection Techniques in Genetic Algorithm.” IEEE International Conference on Futuristic Trends on Computational Analysis and Knowledge Management, Noida, India, pp. 515–519. doi:10.6026/97320630011515
  • Siddiqui, Y. 2003. “The Modified IHS Method for Fusing Satellite Imagery.” Proceedings of the ASPRS Annual Conference, Anchorage, Alaska, 5–9.
  • Singh, D., D. Garg, and H. Singh Pannu. 2017. “Efficient Landsat Image Fusion Using Fuzzy and Stationary Discrete Wavelet Transform.” The Imaging Science Journal 65 (2): 108–114. doi:10.1080/13682199.2017.1289629.
  • Singh, D., M. Kaur, and H. Singh. 2018. “Remote Sensing Image Fusion Using Fuzzy Logic and Gyrator Transform.” Remote Sensing Letters 9 (10): 942–951. doi:10.1080/2150704X.2018.1500044.
  • Snehmani, A. G., A. Ganju, S. Kumar, P. K. Srivastava, and H. Ram R P. 2017. “A Comparative Analysis of Pansharpening Techniques on QuickBird and WorldView-3 Images.” Geocarto International 32 (11): 1268–1284. doi:10.1080/10106049.2016.1206627.
  • Song, H., Q. Liu, G. Wang, R. Hang, and B. Huang. 2018. “Spatiotemporal Satellite Image Fusion Using Deep Convolutional Neural Networks.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (3): 821–829. doi:10.1109/JSTARS.2018.2797894.
  • Tang, K. S., K. F. Man, S. Kwong, and Q. He. 1996. “Genetic Algorithms and Their Applications.” IEEE Signal Processing Magazine 13 (6): 22–37. doi:10.1109/79.543973.
  • Vargas, E., O. Espitia, H. Arguello, and J. Y. Tourneret. 2018. “Spectral Image Fusion from Compressive Measurements.” IEEE Transactions on Image Processing 28 (5): 2271–2282. doi:10.1109/TIP.2018.2884081.
  • Vicinanza, M. R., R. Restaino, G. Vivone, M. Dalla Mura, and J. Chanussot. 2014. “A Pansharpening Method Based on the Sparse Representation of Injected Details.” IEEE Geoscience and Remote Sensing Letters 12 (1): 180–184. doi:10.1109/LGRS.2014.2331291.
  • Wald, L. 2002. “Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions.” In Presses De l’Ecole, 143-163. Ecole des Mines de Paris France.
  • Wald, L., and T. Ranchin. 2002. “Liu ‘smoothing Filter-based Intensity Modulation: A Spectral Preserve Image Fusion Technique for Improving Spatial Details’.” International Journal of Remote Sensing 23 (3): 593–597. doi:10.1080/01431160110088772.
  • Wald, L., T. Ranchin, and M. Mangolini. 1997. “Fusion of Satellite Images of Different Spatial Resolutions: Assessing the Quality of Resulting Images.” Photogrammetric Engineering and Remote Sensing 63: 691–699.
  • Wang, W., L. Jiao, and S. Yang. 2014. “Fusion of Multispectral and Panchromatic Images via Sparse Representation and Local Autoregressive Model.” Information Fusion 20: 73–87. doi:10.1016/j.inffus.2013.11.004.
  • Wang, X., S. Bai, Z. Li, R. Song, and J. Tao. 2019. “The PAN and MS Image Pansharpening Algorithm Based on Adaptive Neural Network and Sparse Representation in the NSST Domain.” IEEE Access 7: 52508–52521. doi:10.1109/ACCESS.2019.2910656.
  • Wang, Z., and A. C. Bovik. 2002. “A Universal Image Quality Index.” IEEE Signal Processing Letters 9 (3): 81–84. doi:10.1109/97.995823.
  • Wang, Z., and Q. Li. 2011. “Information Content Weighting for Perceptual Image Quality Assessment.” IEEE Transactions on Image Processing 20 (5): 1185–1198. doi:10.1109/TIP.2010.2092435.
  • Wei, Q., J. Bioucas-Dias, N. Dobigeon, and J. Y. Tourneret. 2015. “Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation.” IEEE Transactions on Geoscience and Remote Sensing 53 (7): 3658–3668. doi:10.1109/TGRS.2014.2381272.
  • Wei, Q., J. Bioucas-Dias, N. Dobigeon, J. Y. Tourneret, M. Chen, and S. Godsill. 2016. “Multiband Image Fusion Based on Spectral Unmixing.” IEEE Transactions on Geoscience and Remote Sensing 54 (12): 7236–7249. doi:10.1109/TGRS.2016.2598784.
  • Wei, Y., Q. Yuan, H. Shen, and L. Zhang. 2017. “Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network.” IEEE Geoscience and Remote Sensing Letters 14 (10): 1795–1799. doi:10.1109/LGRS.2017.2736020.
  • Xing, Y., M. Wang, S. Yang, and L. Jiao. 2018. “Pan-sharpening via Deep Metric Learning.” ISPRS Journal of Photogrammetry and Remote Sensing 145: 165–183. doi:10.1016/j.isprsjprs.2018.01.016.
  • Yang, B., and S. Li. 2012. “Pixel-level Image Fusion with Simultaneous Orthogonal Matching Pursuit.” Information Fusion 13 (1): 10–19. doi:10.1016/j.inffus.2010.04.001.
  • Yang, J., Y. Q. Zhao, and J. C. W. Chan. 2018. “Hyperspectral and Multispectral Image Fusion via Deep Two-branches Convolutional Neural Network.” Remote Sensing 10: 800. doi:10.3390/rs10050800.
  • Yang, Y., W. Wan, S. Huang, F. Yuan, S. Yang, and Y. Que. 2016. “Remote Sensing Image Fusion Based on Adaptive IHS and Multiscale Guided Filter.” IEEE Access 4: 4573–4582. doi:10.1109/ACCESS.2016.2599403.
  • Yilmaz, V., and O. Gungor. 2016a. “Determining the Optimum Image Fusion Method for Better Interpretation of the Surface of the Earth.” Norsk Geografisk Tidsskrift-Norwegian Journal of Geography 70 (2): 69–81. doi:10.1080/00291951.2015.1126761.
  • Yilmaz, V., and O. Gungor. 2016b. “Fusion of Very High-resolution UAV Images with Criteria-based Image Fusion Algorithm.” Arabian Journal of Geosciences 9 (1): 59. doi:10.1007/s12517-015-2109-8.
  • Yilmaz, V., C. Serifoglu Yilmaz, and O. Gungor. 2019. “Genetic Algorithm-Based Synthetic Variable Ratio Image Fusion.” Geocarto International (just-accepted), 1–17. doi:10.1080/10106049.2019.1629649.
  • Yin, H. 2015. “Sparse Representation Based Pansharpening with Details Injection Model.” Signal Processing 113: 218–227. doi:10.1016/j.sigpro.2014.12.017.
  • Yin, H. 2019. “PAN-Guided Cross-Resolution Projection for Local Adaptive Sparse Representation-Based Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing 57 (7): 4938–4950. doi:10.1109/TGRS.2019.2894702.
  • Yu, M. 1998. “Image Segmentation Using Genetic Algorithm and Morphological Operations.” Master Thesis, Iowa State University.
  • Yuan, Q., Y. Wei, X. Meng, H. Shen, and L. Zhang. 2018. “A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-sharpening.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (3): 978–989. doi:10.1109/JSTARS.2018.2794888.
  • Zhang, K., M. Wang, and S. Yang. 2016. “Multispectral and Hyperspectral Image Fusion Based on Group Spectral Embedding and Low-rank Factorization.” IEEE Transactions on Geoscience and Remote Sensing 55 (3): 1363–1371. doi:10.1109/TGRS.2016.2623626.
  • Zhang, L., L. Zhang, X. Mou, and D. Zhang. 2011. “FSIM: A Feature Similarity Index for Image Quality Assessment.” IEEE Transactions on Image Processing 20 (8): 2378–2386. doi:10.1109/TIP.2011.2109730.
  • Zhang, Y. 1999. “A New Merging Method and Its Spectral and Spatial Effects.” International Journal of Remote Sensing 20 (10): 2003–2014. doi:10.1080/014311699212317.
  • Zhao, W., H. Lu, and D. Wang. 2017. “Multisensor Image Fusion and Enhancement in Spectral Total Variation Domain.” IEEE Transactions on Multimedia 20 (4): 866–879. doi:10.1109/TMM.2017.2760100.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.