33
Views
6
CrossRef citations to date
0
Altmetric
Original Research Paper

Video enhancement through image registration based on structural similarity

, &
Pages 238-250 | Received 16 Oct 2010, Published online: 12 Nov 2013
 

Abstract

It is commonly known that the mean square error (MSE) does not accurately reflect the subjective image quality for most video enhancement tasks. Among the various image quality metrics, structural similarity (SSIM) metric provides remarkably good prediction of the subjective scores. In this paper, a new registration method based on contribution of structural similarity measurement to the well known Lucas–Kanade (LK) algorithm has been proposed. The core of the proposed method is contributing the SSIM in the sum of squared difference of images along with the Levenberg–Marquardt optimisation approach in LK algorithm. Mathematical derivation of the proposed method, based on the unified framework of Baker et al., is given. The proposed registration algorithm is applied to a video enhancement successfully. Various objective and subjective comparisons show the superior performance of the proposed method.

The authors are indebted to anonymous referees for valuable comments. We would also like to thank Dr Vandewalle VandewalleCitation25 for his SR package and Dr D. Lowe for his SIFT key point program (http://www.cs.ubc.ca/lowe/keypoints/). We also thank to Dr Peter Kovesi (http://www.csse.uwa.edu.au/pk/research/matlabfns/), Dr Simon Baker and his co-workersCitation6 for providing many useful MATLAB functions and Dr Gh. Mohajeri for ‘Tokyo’ sequence.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.