HEVC Video Quality Enhancement Using Deep Learning with Super Interpolation and Laplacian Filter

References

• Y. Zhang, S. Kwong, and S. Wang, “Machine learning-based video coding optimizations: A survey,” Inf. Sci., Vol. 506, pp. 395–423, 2020. doi:10.1016/j.ins.2019.07.096.
   Web of Science ®Google Scholar
• K. Kumar, D. D. Shrimankar, and N. Singh, “Eratosthenes sieve based key-frame extraction technique for event summarization in videos,” J. Multim. Tool. App., Vol. 77, no. 2, pp. 1–22, 2017. doi:10.1007/s11042-017-4642-9.
   Google Scholar
• K. I. Kim, and Y. Kwon, “Single-image super-resolution using sparse regression and natural image prior,” IEEE Trans. Pattern Anal. Mach. Intell., Vol. 32, no. 6, pp. 1127–33, Jun. 2010. doi:10.1109/TPAMI.2010.25.
   PubMed Web of Science ®Google Scholar
• J.-S. Choi, and M. Kim, “Super-interpolation with edge-orientation based on mapping kernels for low complex 2× upscaling,” IEEE Trans. Image Process., Vol. 25, no. 1, pp. 469–83, Jan. 2016.
   PubMed Web of Science ®Google Scholar
• B. Langari, and S. Vaseghi, “Edge-guided image gap interpolation using multi-scale transformation,” IEEE Trans. Image Process., Vol. 25, no. 9, Sep. 2016. doi:10.1109/TIP.2016.2590825.
   PubMed Web of Science ®Google Scholar
• M. Bevilacqua, A. Roumy, C. Guillemot, and M.-L. A. Morel, “Single-image super-resolution via linear mapping of interpolated selfexamples,” IEEE Trans. Image Process., Vol. 23, no. 12, pp. 5334–47, Dec. 2014. doi:10.1109/TIP.2014.2364116.
   PubMed Web of Science ®Google Scholar
• K. Kumar, and D. D. Shrimankar, “F-DES: Fast and deep event summarization,” IEEE Trans. Multimed., Vol. 20, no. 2, pp. 323–34, 2018. doi:10.1109/TMM.2017.2741423.
   Web of Science ®Google Scholar
• S. das, and c. S. Pawar, “Machine learning based algorithm for high efficiency video coding,” International Journal of Advances in Electronics and Computer Science, Vol. 3, no. 7, pp. 2393–835, Jul. 2016.
   Google Scholar
• D. Dai, R. Timofte, and L. Van Gool, “Jointly optimized regressors for image super resolution,” Eurographics, Vol. 34, no. 2, pp. 95–104, May 2015.
   Google Scholar
• L. Zhang, H. Zhang, H. Shen, and P. Li, “Super-resolution reconstruction algorithm for surveillance images,” IEEE Trans. Signal Process., Vol. 90, no. 3, pp. 848–59, 2010.
   Google Scholar
• Z. Wang, and F. Li, “Convolutional neural network based low complexity HEVC intra encoder,” Multimed. Tools. Appl., Vol. 80, pp. 2441–60, 2021. https://doi.org/10.1007/s11042-020-09231-8.
   Web of Science ®Google Scholar
• X. He, Q. Hu, X. Zhang, C. Zhang, W. Lin and X. Han. “Enhancing HEVC Compressed Videos with a Partition-Masked Convolutional Neural Network,” 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 2018, pp. 216–220, doi:10.1109/ICIP.2018.8451086.
   Google Scholar
• R. Yang, M. Xu, Z. Wang, and Z. Guan. “Enhancing quality for HEVC compressed videos” IEEE Transactions on Circuits and Systems for Video Technology, 2017. doi:10.1109/TCSVT.2018.2867568.
   Google Scholar
• D. Ding, J. Tong, and L. Kong, “A deep learning approach for quality enhancement of surveillance video,” J. Intell. Transp. Syst., Vol. 24, pp. 1–11, 2019. doi:10.1080/15472450.2019.1670659.
   Web of Science ®Google Scholar
• Z. Pan, X. Yi, Y. Zhang, B. Jeon, and S. Kwong, “Efficient in-loop filtering based on enhanced deep convolutional neural networks for HEVC,” IEEE Trans. Image Process., Vol. 29, pp. 5352–66, 2020. doi: 10.1109/TIP.2020.2982534.
   Web of Science ®Google Scholar
• H. Lin, X. He, L. Qing, Q. Teng, and S. Yang, “Improved low-bitrate HEVC video coding using deep learning based super-resolution and adaptive block patching,” IEEE Trans. Multimed., Vol. 21, no. 12, pp. 3010–23, Dec. 2019. doi: 10.1109/TMM.2019.2919433.
   Web of Science ®Google Scholar
• Z. Guan, Q. Xing, M. Xu, R. Yang, T. Liu, and Z. Wang. MFQE 2.0: A new approach for multi-frame quality enhancement on compressed video, 2019.
   Google Scholar
• W. Lin, et al., “Partition-aware adaptive switching neural networks for post-processing in HEVC,” IEEE Trans. Multimed., Vol. 22, no. 11, pp. 2749–63, Nov. 2020. doi: 10.1109/TMM.2019.2962310.
   Web of Science ®Google Scholar
• W. Sun, X. He, H. Chen, R. E. Sheriff, and S. Xiong, “A quality enhancement framework with noise distribution characteristics for high efficiency video coding,” Neurocomputing, Vol. 411, pp. 428–41, 2020. doi:10.1016/j.neucom.2020.06.048.
   Web of Science ®Google Scholar
• H. Badri, H. Yahi, and D. Aboutajdine, “Fast edge-aware processing via first order proximal approximation,” IEEE Trans. Vis. Comput. Graph, Vol. 21, no. 6, June 1 2015. doi:10.1109/TVCG.2015.2396064.
   PubMed Web of Science ®Google Scholar
• J. Xie, R. S. Feris, S.-S. Yu, and M.-T. Sun, “Joint super resolution and de-noising from a single depth image,” IEEE Trans. Multimed., Vol. 17, no. 9, pp. 1525–37, Sept. 2015.
   Web of Science ®Google Scholar
• S. Jammal, T. Tillo, and J. Xiao, “Multiview video quality enhancement without depth information,” Signal Process., Image Commun., Vol. 75, pp. 22–31, 2019. doi:10.1016/j.image.2019.03.014.
   Web of Science ®Google Scholar
• N. M. Lokhande, “A matlab based GUI for multiframe super resolution reconstruction of different gray scale images with and without adaptive filter,” International Conference on Computing Communication Control and Automation IEEE, 669–672, Feb. 2015.
   Google Scholar
• R. Yang, M. Xu, Z. Wang, and T. Li. “Multi-frame quality enhancement for compressed video,” 6664–73, 2018. doi:10.1109/CVPR.2018.00697.
   Google Scholar
• L. Yu, L. Shen, H. Yang, L. Wang, and P. An, “Quality Enhancement Network via Multi-Reconstruction Recursive Residual Learning for Video Coding,” IEEE Signal Process Lett., Vol. 26, no. 4, pp. 557–61, April 2019. doi:10.1109/LSP.2019.2899253.
   Web of Science ®Google Scholar
• S. Shaji, A. George, and S. Elizabeth, “Super Resolution and De-noising of Images via Dictionary Learning,” IJSRD – Int. J. Sci. Res. Dev., Vol. 3, no. 9, pp. 750–3, 2015.
   Google Scholar
• X. Wei, and P. L. Dragotti, “FRESH - FRI based single image super resolution algorithm,” IEEE Trans. Image Process., Vol. 25, no. 8, pp. 3723–35, Aug. 2016.
   PubMed Web of Science ®Google Scholar
• Chih-Yuan Yang, and Chao Ma Ming-Hsuan Yang, “Single-image super resolution benchmark,” in Computer V is ECCV. Cham: Springer, 2014, pp. 372–86.
   Google Scholar
• S. Kuanar, C. Conly, and K. R. Rao, “Deep learning based HEVC in-loop filtering for decoder quality enhancement,” 2018 Picture Coding Symposium (PCS), Vol. 2018, pp. 164–8. doi: 10.1109/PCS.2018.8456278.
   Google Scholar
• A. Dhanalakshmi, and G. Nagarajan, “Convolutional neural network-based deblocking filter for SHVC in H.265,” Signal. Image. Video. Process., Vol. 14, pp. 1–11, 2020. doi:10.1007/s11760-020-01713-4.
   Web of Science ®Google Scholar