A novel approach using the local energy function and its variations for medical image fusion

References

• Wang Z, Li X, Duan H, et al. Multifocus image fusion using convolutional neural networks in the discrete wavelet transform domain. Multimed Tools Appl. 2019;78(24):34483–34512. doi:10.1007/s11042-019-08070-6.
   Web of Science ®Google Scholar
• Dinh PH. Combining gabor energy with equilibrium optimizer algorithm for multi-modality medical image fusion. Biomed Signal Process Control. 2021;68:102696. doi:10.1016/j.bspc.2021.102696.
   Google Scholar
• Fu J, Li W, Du J, et al. Multimodal medical image fusion via laplacian pyramid and convolutional neural network reconstruction with local gradient energy strategy. Comput Biol Med. 2020;126:104048. doi:10.1016/j.compbiomed.2020.104048.
   Google Scholar
• Wang Z, Li X, Duan H, et al. Medical image fusion based on convolutional neural networks and non-subsampled contourlet transform. Expert Syst Appl. 2021;171:114574. doi:10.1016/j.eswa.2021.114574.
   Google Scholar
• Gao Y, Ma S, Liu J, et al. Fusion of medical images based on salient features extraction by PSO optimized fuzzy logic in NSST domain. Biomed Signal Process Control. 2021;69:102852. doi:10.1016/j.bspc.2021.102852.
   Google Scholar
• Nair RR, Singh T. MAMIF: multimodal adaptive medical image fusion based on b-spline registration and non-subsampled shearlet transform. Multimed Tools Appl. 2021;80(12):19079–19105. doi:10.1007/s11042-020-10439-x.
   Web of Science ®Google Scholar
• Wang S, Shen Y. Multi-modal image fusion based on saliency guided in NSCT domain. IET Image Process. 2020;14:3188–3201. doi:10.1049/iet-ipr.2019.1319.
   Web of Science ®Google Scholar
• Nair RR, Singh T. An optimal registration on shearlet domain with novel weighted energy fusion for multi-modal medical images. Optik. 2021;225:165742. doi:10.1016/j.ijleo.2020.165742.
   Google Scholar
• Dinh PH. A novel approach based on grasshopper optimization algorithm for medical image fusion. Expert Syst Appl. 2021;171:114576. doi:10.1016/j.eswa.2021.114576.
   Google Scholar
• Li X, Zhou F, Tan H. Joint image fusion and denoising via three-layer decomposition and sparse representation. Knowl Based Syst. 2021;224:107087. doi:10.1016/j.knosys.2021.107087.
   Google Scholar
• Wang Y, Li X, Zhu R, et al. A multi-focus image fusion framework based on multi-scale sparse representation in gradient domain. Signal Processing. 2021;189:108254. doi:10.1016/j.sigpro.2021.108254.
   Google Scholar
• Jie Y, Zhou F, Tan H, et al. Tri-modal medical image fusion based on adaptive energy choosing scheme and sparse representation. Measurement. 2022;204:112038. doi:10.1016/j.measurement.2022.112038.
   Google Scholar
• Liu Y, Zhou D, Nie R, et al. Robust spiking cortical model and total-variational decomposition for multimodal medical image fusion. Biomed Signal Process Control. 2020;61:101996. doi:10.1016/j.bspc.2020.101996.
   Google Scholar
• Liu Y, Hou R, Zhou D, et al. Multimodal medical image fusion based on the spectral total variation and local structural patch measurement. Int J Imaging Syst Technol. 2020;31(1):391–411. doi:10.1002/ima.22460.
   Web of Science ®Google Scholar
• Wang J, Li X, Wang Z, et al. Exposure correction using deep learning. J Electron Imaging. 2019;28(3):1. doi:10.1117/1.jei.28.3.033003.
   Web of Science ®Google Scholar
• Gai S, Bao Z. New image denoising algorithm via improved deep convolutional neural network with perceptive loss. Expert Syst Appl. 2019;138:112815. doi:10.1016/j.eswa.2019.07.032.
   Google Scholar
• Hou R, Zhou D, Nie R, et al. Brain CT and MRI medical image fusion using convolutional neural networks and a dual-channel spiking cortical model. Med Biol Eng Comput. 2018;57(4):887–900. doi:10.1007/s11517-018-1935-8.
   PubMed Web of Science ®Google Scholar
• Ding Z, Zhou D, Nie R, et al. Brain medical image fusion based on dual-branch CNNs in NSST domain. Biomed Res Int. 2020;2020:1–15. doi:10.1155/2020/6265708.
   Web of Science ®Google Scholar
• Ding Z, Zhou D, Li H, et al. Siamese networks and multi-scale local extrema scheme for multimodal brain medical image fusion. Biomed Signal Process Control. 2021;68:102697. doi:10.1016/j.bspc.2021.102697.
   Google Scholar
• Kaur M, Singh D. Fusion of medical images using deep belief networks. Cluster Comput. 2019;23(2):1439–1453. doi:10.1007/s10586-019-02999-x.
   Web of Science ®Google Scholar
• Yousif AS, Omar Z, Sheikh UU. An improved approach for medical image fusion using sparse representation and siamese convolutional neural network. Biomed Signal Process Control. 2022;72:103357. doi:10.1016/j.bspc.2021.103357.
   Google Scholar
• Guo K, Hu X, Li X. MMFGAN: A novel multimodal brain medical image fusion based on the improvement of generative adversarial network. Multimed Tools Appl. 2021;81:5889–5927. doi:10.1007/s11042-021-11822-y.
   Web of Science ®Google Scholar
• Li W, Peng X, Fu J, et al. A multiscale double-branch residual attention network for anatomical–functional medical image fusion. Comput Biol Med. 2021;141:105005. doi:10.1016/j.compbiomed.2021.105005.
   Google Scholar
• Wang Z, Li X, Yu S, et al. VSP-fuse: multifocus image fusion model using the knowledge transferred from visual salience priors. IEEE Trans Circuits Syst Video Technol. 2022:1–1. doi:10.1109/tcsvt.2022.3229691.
   Google Scholar
• Wang Z, Li X, Duan H, et al. A self-supervised residual feature learning model for multifocus image fusion. IEEE Trans Image Process. 2022;31:4527–4542. doi:10.1109/tip.2022.3184250.
   PubMed Web of Science ®Google Scholar
• Dinh PH. Multi-modal medical image fusion based on equilibrium optimizer algorithm and local energy functions. Appl Intell. 2021;51:8416–8431. doi:10.1007/s10489-021-02282-w.
   Web of Science ®Google Scholar
• Shilpa S, Rajan MR, Asha C, et al. Enhanced JAYA optimization based medical image fusion in adaptive non subsampled shearlet transform domain. Eng Sci Technol Int J. 2022;35:101245. doi:10.1016/j.jestch.2022.101245.
   Google Scholar
• Shehanaz S, Daniel E, Guntur SR, et al. Optimum weighted multimodal medical image fusion using particle swarm optimization. Optik. 2021;231:166413. doi:10.1016/j.ijleo.2021.166413.
   Google Scholar
• Xu L, Si Y, Jiang S, et al. Medical image fusion using a modified shark smell optimization algorithm and hybrid wavelet-homomorphic filter. Biomed Signal Process Control. 2020;59:101885. doi:10.1016/j.bspc.2020.101885.
   Google Scholar
• Dinh PH. Medical image fusion based on enhanced three-layer image decomposition and chameleon swarm algorithm. Biomed Signal Process Control. 2023;84:104740. doi:10.1016/j.bspc.2023.104740.
   Google Scholar
• Jose J, Gautam N, Tiwari M, et al. An image quality enhancement scheme employing adolescent identity search algorithm in the NSST domain for multimodal medical image fusion. Biomed Signal Process Control. 2021;66:102480. doi:10.1016/j.bspc.2021.102480.
   Web of Science ®Google Scholar
• Dinh PH. An improved medical image synthesis approach based on marine predators algorithm and maximum gabor energy. Neural Comput Appl. 2021;34:4367–4385. doi:10.1007/s00521-021-06577-4.
   Web of Science ®Google Scholar
• Nguyen TT, Wang HJ, Dao TK, et al. A scheme of color image multithreshold segmentation based on improved moth-flame algorithm. IEEE Access. 2020;8:174142–174159. doi:10.1109/access.2020.3025833.
   Google Scholar
• Nguyen TT, Ngo TG, Dao TK, et al. Microgrid operations planning based on improving the flying sparrow search algorithm. Symmetry. 2022;14(1):168. doi:10.3390/sym14010168.
   Google Scholar
• Liu Y, Chen X, Ward RK, et al. Image fusion with convolutional sparse representation. IEEE Signal Process Lett. 2016;23(12):1882–1886. doi:10.1109/lsp.2016.2618776.
   Web of Science ®Google Scholar
• Liu Y, Chen X, Ward RK, et al. Medical image fusion via convolutional sparsity based morphological component analysis. IEEE Signal Process Lett. 2019;26:485–489. doi:10.1109/lsp.2019.2895749.
   Web of Science ®Google Scholar
• Maqsood S, Javed U. Multi-modal medical image fusion based on two-scale image decomposition and sparse representation. Biomed Signal Process Control. 2020;57:101810. doi:10.1016/j.bspc.2019.101810.
   Web of Science ®Google Scholar
• Dong X, Wang G, Pang Y, et al. Fast efficient algorithm for enhancement of low lighting video. In: 2011 IEEE International Conference on Multimedia and Expo. IEEE; 2011. doi:10.1109/icme.2011.6012107.
   Google Scholar
• Amini N, Fatemizadeh E, Behnam H. MRI-PET image fusion based on NSCT transform using local energy and local variance fusion rules. J Med Eng Technol. 2014;38(4):211–219. doi:10.3109/03091902.2014.904014.
   PubMedGoogle Scholar
• Yin H. Tensor sparse representation for 3-d medical image fusion using weighted average rule. IEEE Trans Biomed Eng. 2018;65(11):2622–2633. doi:10.1109/tbme.2018.2811243.
   PubMed Web of Science ®Google Scholar
• Zhou J, Xing X, Yan M, et al. A fusion algorithm based on composite decomposition for PET and MRI medical images. Biomed Signal Process Control. 2022;76:103717. doi:10.1016/j.bspc.2022.103717.
   Web of Science ®Google Scholar
• Du J, Li W, Tan H. Three-layer medical image fusion with tensor-based features. Inf Sci (Ny). 2020;525:93–108. doi:10.1016/j.ins.2020.03.051.
   Web of Science ®Google Scholar
• Li X, Zhou F, Tan H, et al. Multimodal medical image fusion based on joint bilateral filter and local gradient energy. Inf Sci (Ny). 2021;569:302–325. doi:10.1016/j.ins.2021.04.052.
   Web of Science ®Google Scholar
• Zhang Q, Shen X, Xu L, et al. Rolling guidance filter. In: Computer Vision–ECCV 2014. Springer International Publishing; 2014. p. 815–830. doi:10.1007/978-3-319-10578-9_53.
   Google Scholar
• Gong Y, Goksel O. Weighted mean curvature. Signal Processing. 2019;164:329–339. doi:10.1016/j.sigpro.2019.06.020.
   Web of Science ®Google Scholar
• Pan Y, Liu D, Wang L, et al. A multispectral and panchromatic images fusion method based on weighted mean curvature filter decomposition. Appl Sci. 2022;12(17):8767. doi:10.3390/app12178767.
   Google Scholar
• Tan W, Thitøn W, Xiang P, et al. Multi-modal brain image fusion based on multi-level edge-preserving filtering. Biomed Signal Process Control. 2021;64:102280. doi:10.1016/j.bspc.2020.102280.
   Google Scholar
• Dong W, Xiao S, Liang J, et al. Fusion of hyperspectral and panchromatic images using structure tensor and matting model. Neurocomputing. 2020;399:237–246. doi:10.1016/j.neucom.2020.02.050.
   Web of Science ®Google Scholar
• Liu K, Xu W, Wu H, et al. Weighted hybrid order total variation model using structure tensor for image denoising. Multimed Tools Appl. 2022;82:927–943. doi:10.1007/s11042-022-12393-2.
   Web of Science ®Google Scholar
• Zhou Z, Li S, Wang B. Multi-scale weighted gradient-based fusion for multi-focus images. Inf Fusion. 2014;20:60–72. doi:10.1016/j.inffus.2013.11.005.
   Web of Science ®Google Scholar
• Polinati S, Dhuli R. Multimodal medical image fusion using empirical wavelet decomposition and local energy maxima. Optik. 2020;205:163947. doi:10.1016/j.ijleo.2019.163947.
   Google Scholar
• Dinh PH. A novel approach using structure tensor for medical image fusion. Multidimens Syst Signal Process. 2022;33(3):1001–1021. doi:10.1007/s11045-022-00829-9.
   Web of Science ®Google Scholar
• Faramarzi A, Heidarinejad M, Mirjalili S, et al. Marine predators algorithm: A nature-inspired metaheuristic. Expert Syst Appl. 2020;152:113377. doi:10.1016/j.eswa.2020.113377.
   Web of Science ®Google Scholar
• Rashedi E, Nezamabadi-pour H, Saryazdi S. GSA: A gravitational search algorithm. Inf Sci (Ny). 2009;179(13):2232–2248. doi:10.1016/j.ins.2009.03.004.
   Web of Science ®Google Scholar
• Mirjalili S, Gandomi AH, Mirjalili SZ, et al. Salp swarm algorithm: A bio-inspired optimizer for engineering design problems. Adv Eng Softw. 2017;114:163–191. doi:10.1016/j.advengsoft.2017.07.002.
   Web of Science ®Google Scholar
• Ho LV, Nguyen DH, Mousavi M, et al. A hybrid computational intelligence approach for structural damage detection using marine predator algorithm and feedforward neural networks. Comput Struct. 2021;252:106568. doi:10.1016/j.compstruc.2021.106568.
   Web of Science ®Google Scholar
• Houssein EH, Hussain K, Abualigah L, et al. An improved opposition-based marine predators algorithm for global optimization and multilevel thresholding image segmentation. Knowl Based Syst. 2021;229:107348. doi:10.1016/j.knosys.2021.107348.
   Web of Science ®Google Scholar
• Dinh PH. A novel approach based on three-scale image decomposition and marine predators algorithm for multi-modal medical image fusion. Biomed Signal Process Control. 2021;67:102536. doi:10.1016/j.bspc.2021.102536.
   Google Scholar
• Li S, Kang X, Hu J. Image fusion with guided filtering. IEEE Trans Image Process. 2013;22(7):2864–2875. doi:10.1109/tip.2013.2244222.
   PubMed Web of Science ®Google Scholar
• Mirjalili S, Mirjalili SM, Hatamlou A. Multi-verse optimizer: a nature-inspired algorithm for global optimization. Neural Comput Appl. 2015;27(2):495–513. doi:10.1007/s00521-015-1870-7.
   Web of Science ®Google Scholar
• Mirjalili S, Lewis A. The whale optimization algorithm. Adv Eng Softw. 2016;95:51–67. doi:10.1016/j.advengsoft.2016.01.008.
   Web of Science ®Google Scholar
• Mirjalili S. SCA: a sine cosine algorithm for solving optimization problems. Knowl Based Syst. 2016;96:120–133. doi:10.1016/j.knosys.2015.12.022.
   Web of Science ®Google Scholar
• Lu H, Zhang L, Serikawa S. Maximum local energy: an effective approach for multisensor image fusion in beyond wavelet transform domain. Comput Math Appl. 2012;64(5):996–1003. doi:10.1016/j.camwa.2012.03.017.
   Web of Science ®Google Scholar
• Yin M, Liu X, Liu Y, et al. Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain. IEEE Trans Instrum Meas. 2019;68:49–64. doi:10.1109/tim.2018.2838778.
   Web of Science ®Google Scholar
• Li X, Zhang X, Ding M. A sum-modified-laplacian and sparse representation based multimodal medical image fusion in laplacian pyramid domain. Med Biol Eng Comput. 2019;57(10):2265–2275. doi:10.1007/s11517-019-02023-9.
   PubMed Web of Science ®Google Scholar
• Zhu Z, Zheng M, Qi G, et al. A phase congruency and local laplacian energy based multi-modality medical image fusion method in NSCT domain. IEEE Access. 2019;7:20811–20824. doi:10.1109/access.2019.2898111.
   Web of Science ®Google Scholar
• Sufyan A, Imran M, Shah SA, et al. A novel multimodality anatomical image fusion method based on contrast and structure extraction. Int J Imaging Syst Technol. 2021;32(1):324–342. doi:10.1002/ima.22649.
   Web of Science ®Google Scholar
• Li B, Peng H, Luo X, et al. Medical image fusion method based on coupled neural p systems in nonsubsampled shearlet transform domain. Int J Neural Syst. 2020;31(01):2050050. doi:10.1142/s0129065720500501.
   Google Scholar
• Li B, Peng H, Wang J. A novel fusion method based on dynamic threshold neural p systems and nonsubsampled contourlet transform for multi-modality medical images. Signal Processing. 2021;178:107793. doi:10.1016/j.sigpro.2020.107793.
   Google Scholar
• Zhu R, Li X, Huang S, et al. Multimodal medical image fusion using adaptive co-occurrence filter-based decomposition optimization model. Bioinformatics. 2021;38(3):818–826. doi:10.1093/bioinformatics/btab721.
   Web of Science ®Google Scholar
• Xydeas C, Petrovic V. Objective image fusion performance measure. Electron Lett. 2000;36:308. doi:10.1049/el:20000267.
   Web of Science ®Google Scholar
• Haghighat MBA, Aghagolzadeh A, Seyedarabi H. A non-reference image fusion metric based on mutual information of image features. Comput Electr Eng. 2011;37:744–756. doi:10.1016/j.compeleceng.2011.07.012.
   Web of Science ®Google Scholar
• Wilcoxon F. Individual comparisons by ranking methods. Biometrics Bulletin. 1945;1(6):80. doi:10.2307/3001968.
   Google Scholar
• Su Y, Li Z, Yu H, et al. Multi-band weighted lp norm minimization for image denoising. Inf Sci (Ny). 2020;537:162–183. doi:10.1016/j.ins.2020.05.049.
   Web of Science ®Google Scholar
• Dinh PH, Giang NL. A new medical image enhancement algorithm using adaptive parameters. Int J Imaging Syst Technol. 2022;32:2198–2218. doi:10.1002/ima.22778.
   Web of Science ®Google Scholar
• Dinh PH. A novel approach based on marine predators algorithm for medical image enhancement. Sens Imaging. 2023;24(1):6. doi:10.1007/s11220-023-00411-y.
   Web of Science ®Google Scholar
• Braik MS. Chameleon swarm algorithm: a bio-inspired optimizer for solving engineering design problems. Expert Syst Appl. 2021;174:114685. doi:10.1016/j.eswa.2021.114685.
   Web of Science ®Google Scholar
• Dinh PH. Combining spectral total variation with dynamic threshold neural p systems for medical image fusion. Biomed Signal Process Control. 2023;80:104343. doi:10.1016/j.bspc.2022.104343.
   Google Scholar
• Braik M, Hammouri A, Atwan J, et al. White shark optimizer: A novel bio-inspired meta-heuristic algorithm for global optimization problems. Knowl Based Syst. 2022;243:108457. doi:10.1016/j.knosys.2022.108457.
   Web of Science ®Google Scholar