A Novel Approach for Human Action Recognition from Silhouette Images

ABSTRACT

In this work, we propose a novel human action recognition (HAR) technique for human silhouette sequence based on spatio-temporal body parts movement (STBPM) and action-code classification (ACC). STBPM feature is designed to accumulate the signature of the activity of several body parts to accomplish any action. ACC is a code-based classifier for HAR, which needs no training and the codes of any action is created by analyzing the STBPM features. The proposed approach is view independent except the top view and scale invariant. The experimental results on publicly available Weizmann, MuHVAi, and IXMAS datasets clearly show that our proposed technique outperforms the related research works in terms of accuracy in the human action detection.

KEYWORDS:

• Action-code classifier (AAC)
• Action units (AU)
• Human action recognition (HAR)
• Spatio-temporal body parts movement (STBPM)
• Trajectory analysis (TA)
• Video analysis

DISCLOSURE STATEMENT

No potential conflict of interest was reported by the authors.

ACKNOWLEDGEMENT

The work is funded by DST, Ministry of Science and Technology, Government of India through INSPIRE project [IF10163]; and Science and Engineering Research Board.

Additional information

Notes on contributors

Satyabrata Maity

Satyabrata Maity is presently working as a research scholar in Computer Vision Lab, A.K.C.S.I.T, CU. Prior to this, he received M.Tech degree in I.T. from A.K.C.S.I.T, CU, and M.Sc. in Computer Science from Vidyasagar University in 2009 and 2006, respectively. Besides this, he was a faculty in Meghnad Saha Institute of Technology during 2010. His research interests include Image and Video Processing.

E-mail: [email protected]

Debotosh Bhattacharjee

Debotosh Bhattacharjee received the Master of Computer Science and Engineering and the PhD (Engineering) degrees from Jadavpur University, India, in 1997 and 2004, respectively. He was associated with different institutes in various capacities until March 2007. After that, he joined his Alma Mater, Jadavpur University. Currently, he is working as a full professor in the Department of Computer Science and Engineering there. His research interests pertain to the applications of computational intelligence techniques like Fuzzy Logic, Artificial Neural Network, Genetic Algorithm, Rough Set Theory in Face Recognition, Gait Analysis, Hand Geometry Recognition, Histopathological Image Analysis and Biomedical imaging. He has authored or coauthored more than 200 journals, conference publications, including several book chapters in the areas of Biometrics and Medical Image Processing. For postdoctoral research, Dr Bhattacharjee has visited different universities abroad like the University of Twente, The Netherlands; Instituto Superior Técnico, Lisbon, Portugal; University of Bologna, Italy; ITMO National Research University, St. Petersburg, Russia; University of Ljubljana, Slovenia and Heidelberg University, Germany. He is a life member of Indian Society for Technical Education (ISTE, New Delhi), Indian Unit for Pattern Recognition and Artificial Intelligence (IUPRAI), and a senior member of IEEE (USA).

E-mail: [email protected]

Amlan Chakrabarti

Amlan Chakrabarti is, at present, a Professor and Coordinator of the A.K. Choudhury School of Information Technology, University of Calcutta, India. He is an MTech from the University of Calcutta and has done his Doctoral research on Quantum Computing and related logic design at Indian Statistical Institute, Kolkata, 2004–2008. He was a Post-Doctoral fellow at the School of Engineering, Princeton University, USA during 2011–2012. He is the recipient of BOYSCAST fellowship award in the area of Engineering Science from the Department of Science and Technology, Govt. of India, in 2011. He is a senior Member of IEEE, Member of ACM. His present research interests are Quantum Computing, VLSI design, Embedded System Design and Video & Image Processing Algorithm.

E-mail: [email protected]