106
Views
0
CrossRef citations to date
0
Altmetric
Articles

Video retrieval for shot cluster and classification based on key feature set

&
Pages 38-58 | Received 08 Apr 2017, Accepted 30 Jul 2017, Published online: 04 Oct 2017
 

ABSTRACT

The proposed content-based video retrieval method in this study uses feature extraction, shot boundary detection, shot noise filter, shot cluster, the key feature set of shot extraction and shot classification. Shot boundary detection is conducted using a weight selection genetic algorithm. In order to verify the video retrieval method in this paper, three video databases were used in the experiment. These video databases are used to verify the shot boundary detection, the shot classification and video retrieval of this study. A series of comparisons and analyses were then conducted using the above video databases. The experiment results showed that the shot boundary detection method exhibits better performance than the other compared methods. Moreover, the video retrieval experiment results showed that the proposed method is able to precisely catch a shot in the search video, and do so with reduced video retrieval time.

Disclosure statement

No potential conflict of interest was reported by the authors.

Notes on contributors

Chuen-Horng Lin is a professor in the Department of Computer Science and Information Engineering at National Taichung University of Science and Technology, Taiwan. He received his M.S. and Ph.D. from the Department of Applied Mathematics from National Chung-Hsing University, Taiwan. Chuen-Horng Lin’s research interests include image/video retrieval, image/video object segmentation, video object tracking, precision manufacturing and measurement, mobile communication technology, reliability and sensitivity analysis for queueing system.

Li-Jung Fu is an engineer in Altek Corporation headquartered in Hsinchu, Taiwan. She received her Master’s degree from the Department of Information Management at National Taichung University of Science and Technology, Taiwan. Her research interests include image/video retrieval and image quality.

Image Acknowledgment

The film stills used in Figures 1, 12 and 13 have been obtained from the film Groundhog Day, directed by Harold Ramis. © Columbia Pictures Corporation, USA, 1993.

Images used in Figures 8, 9 and Table 1 have been obtained from the Carleton University MacOdrum Dataset Library, which can be accessed through the following link: https://library.carleton.ca/find/databases

Image stills used in Table 2 and 3, and in Figures 15 to 25, have been obtained from YouTube and can accessed through the following links:

YouTube, No. 1 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=mbkfDBAazVY.

YouTube, No. 2 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=FH96haA1yiU.

YouTube, No. 3 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=6lFV7dqO0Po.

YouTube, No. 4 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=dddV-MAR4Ow.

YouTube, No. 5 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=82vd3GIcatM.

YouTube, No. 6 of the second video database, retrieved on March, 2012, from http://www.youtube.com/.

YouTube, No. 7 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=f6VnMd2_EaU.

YouTube, No. 8 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=7EtQiGMOWXk.

YouTube, No. 9 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=IdEVcDc7QxU.

YouTube, No. 10 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=p3rt9yioGDk.

YouTube, No. 11 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=srQBCyp4m_0.

YouTube, No. 12 of the second video database, retrieved on March, 2012, from http://www.youtube.com/.

YouTube, No. 13 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=eW1fZKNFUnk.

YouTube, No. 14 of the second video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=cEMgc8Wid5E.

YouTube, No. 1 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=C76qXAXO2Mw.

YouTube, No. 2 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=fideBaCbxJg.

YouTube, No. 3 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=8Xe_mW-kj0A.

YouTube, No. 4 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=qtUBZwDZ7jI.

YouTube, No. 5 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=-qFAymkdW4A.

YouTube, No. 6 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=WGa8tDIEbgM.

YouTube, No. 7 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=6UrOyQxRz9I.

YouTube, No. 8 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=Z0sIKQgorSw.

YouTube, No. 9 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=qCETTtw-nNk.

YouTube, No. 10 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=ijXEPmkLPVg.

YouTube, No. 11 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=F8IoLnJCPrY.

YouTube, No. 12 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=66vNerE5Cnw.

YouTube, No. 13 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=TuFlZC25zdk.

YouTube, No. 14 of the third video database, retrieved on March, 2012, from https://www.youtube.com/watch?v=XmWe4z6BdsY.

Additional information

Funding

This work was supported in part by National Science Council, Taiwan, under grant number NSC 101-2221-E-025-009.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.