Tucker visual search-based hybrid tracking model and Fractional Kohonen Self-Organizing Map for anomaly localization and detection in surveillance videos

ABSTRACT

Anomaly detection (AD) in video is a challenging task employed in the intelligent video surveillance applications. This paper presents a technique for localizing and detecting anomalies in surveillance videos by proposing hybrid tracking model and Fractional Kohonen Self-Organizing Map (FKSOM). At first, the objects in the initial frames are detected by extracting the background and comparing with the succeeding frames. Then, a tracking model is developed to track the objects in the frame. Further, the features, such as object shape, speed, energy, correlation, and homogeneity, are extracted in the feature extraction process. Finally, the proposed FKSOM algorithm performs AD by identifying anomalous and normal events in the frame. The performance of the proposed technique is evaluated using the metrics, such as Multiple Object Tracking Precision (MOTP), accuracy, sensitivity, and specificity, where it obtains MOTP of 0.9895 with an average accuracy of 0.9339, the sensitivity of 0.9288 and specificity of 1.

KEYWORDS:

• Anomaly detection
• Tucker visual search model
• Self-Organizing Map (SOM)
• object detection
• object tracking

Disclosure statement

No potential conflict of interest was reported by the authors.

Notes on contributors

Avinash Ratre received the master’s degree from Indian Institute of Science, Bangalore, Karnataka, India in 2000. He is currently pursuing the Ph.D. degree with the Department of Electronics and Communication Engineering, Indian Institute of Technology, Roorkee, Uttarakhand, India. He is also an Assistant Professor in Electronics and Communication Engineering at Delhi Technological University, Delhi, India. His research interests include computer vision, pattern recognition and machine learning.

Dr. Vinod Pankajakshan received the Ph.D. degree in Electronics and Communication Engineering with specialization in video watermarking from Indian Institute of Technology, Guwahati, Assam, India in 2008. He is currently an Assistant Professor with the Department of Electronics and Communication Engineering, Indian Institute of Technology, Roorkee, Uttarakhand, India. Prior to this, he was a post-doctoral researcher with the Image and Video Communication Research Group, IRCCyN Lab, Nantes, France during 2009-11. He was also Research fellow and Associate Lecturer with the Department of Computing, University of Surrey, UK during 2007-08. His research interests include signal processing, image and video processing and multimedia forensics.