Facial expression recognition based on spatio-temporal interest points for depth sequences

References

• Sumathi, C. P., Santhanam, T. and Mahadevi, M. Automatic facial expression analysis a survey. Int. J. Comput. Sci. Eng. Surv., 2012, 3, (6), 47–59. doi: 10.5121/ijcses.2012.3604
   Google Scholar
• Valstar, M. F., Mehu, M., Jiang, B., Pantic, M. and Scherer, K. Meta-analysis of the first facial expression recognition challenge. IEEE Trans. Syst. Man Cybern. Part B Cybern., 2012, 42, (4), 966–979. doi: 10.1109/TSMCB.2012.2200675
   PubMed Web of Science ®Google Scholar
• Metaxas, D. and Zhang, S. A review of motion analysis methods for human nonverbal communication and computing. Image Vis. Comput., 2013, 31, (6–7), 421–433. doi: 10.1016/j.imavis.2013.03.005
   Web of Science ®Google Scholar
• Sandbach, G., Zafeiriou, S., Pantic, M. and Yin, L. Static and dynamic 3D facial expression recognition: a comprehensive survey. Image Vis. Comput., 2012, 30, (10), 683–697. doi: 10.1016/j.imavis.2012.06.005
   Web of Science ®Google Scholar
• Fang, T., Zhao, X., Ocegueda, O., Shah, S. K. and Kakadiaris, I. A. 3D facial expression recognition: a perspective on promises and challenges. Proc. Int. Conf. Automatic Face and Gesture Recognition, 2011, pp. 603–610.
   Google Scholar
• Yin, L., Wei, X., Sun, Y., Wang, J. and Rosato, M. A 3D facial expression database for facial behavior research. Proc. Int. Conf. Automatic Face and Gesture Recognition, 2006, pp. 211–216.
   Google Scholar
• Yin, L., Chen, X., Sun, Y., Worm, T. and Reale, M. A high-resolution 3D dynamic facial expression database. Proc. IEEE Int. Conf. Automatic Face & Gesture Recognition, 2008.
   Google Scholar
• Wang, J., Yin, L., Wu, X. and Sun, Y. 3D facial expression recognition based on primitive surface feature distribution. Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2006, pp. 1399–1406.
   Google Scholar
• Maalej, A., Amor, B. B., Daoudi, M., Srivastava, A. and Berretti, S. Shape analysis of local facial patches for 3D facial expression recognition. Pattern Recogn., 2011, 44, (8), 1581–1589. doi: 10.1016/j.patcog.2011.02.012
   Web of Science ®Google Scholar
• Berretti, S., Amor, B. B., Daoudi, M. and del Bimbo, A. 3D facial expression recognition using SIFT descriptors of automatically detected keypoints. Visual Comput., 2011, 27, 1021–1036. doi: 10.1007/s00371-011-0611-x
   Web of Science ®Google Scholar
• Berretti, S., del Bimbo, A. and Pala, P. Automatic facial expression recognition in real-time from dynamic sequences of 3D face scans. Visual Comput., 2013, 29, 1333–1350. doi: 10.1007/s00371-013-0869-2
   Web of Science ®Google Scholar
• Gong, B., Wang, Y., Liu, J. and Tang, X. Automatic facial expression recognition on a single 3D face by exploring shape deformation. Proc. ACM Int. Conf. Multimedia, 2009, 569–572.
   Google Scholar
• Soyel, H. and Demirel, H. Optimal feature selection for 3D facial expression recognition using coarse-to-fine classification. Turkish J. Electr. Eng. Comput. Sci., 2010, 18, (6), 1031–1040.
   Web of Science ®Google Scholar
• Tang, H. and Huang, T. S. 3D facial expression recognition based on automatically selected features. Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2008.
   Google Scholar
• Le, V., Tang, H. and Huang, T. S. Expression recognition from 3D dynamic faces using robust spatio-temproal shape features. Proc. Int. Conf. Automatic Face and Gesture Recognition, 2011, pp. 414–421.
   Google Scholar
• Danelakis, A., Theoharis, T. and Pratikakis, I. A robust spatio-temporal scheme for dynamic 3D facial expression retrieval. Visual Comput., 2015, 32, 257–269. doi: 10.1007/s00371-015-1142-7
   Web of Science ®Google Scholar
• Yin, L., Wei, X., Longo, P. and Bhuvanesh, A. Analyzing facial expressions using intensity-variant 3D data for human computer interaction. Proc. Int. Conf. Pattern Recognition, 2006, pp. 1248–1251.
   Google Scholar
• Rosato, M., Chen, X. and Yin, L. Automatic registration for vertex correspondences for 3D facial expression analysis. Proc. IEEE Int. Conf. Biometrics: Theory, Applications and Systems, 2008.
   Google Scholar
• Sun, Y. and Yin, L. Facial expression recognition based on 3D dynamic range model sequences. Proc. European Conf. Computer Vision, 2008.
   Google Scholar
• Huang, Y., Zhang, X., Fan, Y., Yin, L., Seversky, L., Allen, J., Lei, T. and Dong, W. Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis. Image Vis. Comput., 2012, 30, (10), 750–761. doi: 10.1016/j.imavis.2011.12.008
   Web of Science ®Google Scholar
• Reale, M., Zhang, X. and Yin, L. Nebula feature: a space-time feature for posed and spontaneous 4D facial behavior analysis. Proc. IEEE Int. Conf. Automatic Face & Gesture Recognition, 2013.
   Google Scholar
• Fang, T., Zhao, X., Ocegueda, O., Shah, S. K. and Kakadiaris, I. A. 3D/4D facial expression analysis: an advanced annotated face model approach. Image. Vis. Comput., 2012, 30, (10), 738–749. doi: 10.1016/j.imavis.2012.02.004
   Web of Science ®Google Scholar
• Sandbach, G., Zafeririou, S., Pantic, M. and Rueckert, D. Recognition of 3D facial expression dynamics. Image Vis. Comput., 2012, 30, (10), 762–773. doi: 10.1016/j.imavis.2012.01.006
   Web of Science ®Google Scholar
• Laptev, I. On space-time interest points. Int. J. Comput. Vis., 2005, 64, (2–3), 107–123. doi: 10.1007/s11263-005-1838-7
   Web of Science ®Google Scholar
• Laptev, I., Marszałek, M., Schmid, C. and Rozenfeld, B. Learning realistic human actions from movies. Proc. Int. Conf. Computer Vision and Pattern Recognition, 2008.
   Google Scholar
• Yuan, J., Liu, S. and Wu, Y. Discriminative video pattern search for efficient action detection. IEEE Trans. Pattern Anal. Mach., 2011, 33, (9), 1728–1743. doi: 10.1109/TPAMI.2011.38
   PubMed Web of Science ®Google Scholar
• Dollar, P., Rabaud, V., Cottrell, G. and Belongie, S. Behavior recognition via sparse spatio-temporal features. Proc. Int. Conf. Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005.
   Google Scholar
• Willems, G., Tuytelaars, T. and Van Gool, L. An efficient dense and scale-invariant spatio-temporal interest point detector. Proc. European Conf. Computer Vision, 2008.
   Google Scholar
• Scovanner, P., Ali, S. and Shah, M. A 3-dimensional SIFT descriptor and its application to action recognition. Proc. Int. Conf. Multimedia, 2007.
   Google Scholar
• Harris, C. and Stephens, M. A combined corner and edge detector. Proc. Alvey Vision Conference, 1988.
   Google Scholar
• Laptev, I. and Pérez, P. Retrieving actions in movies. Proc. Int. Conf. Computer Vision, 2007.
   Google Scholar
• Laptev, I. and Lindeberg, T. Local descriptors for spatio-temporal recognition. Proc. Int. Workshop Spatial Coherence for Visual Motion Analysis, 2004.
   Google Scholar
• Hoffmann, H., Traue, H. C., Limbrecht-Ecklundt, K., Walter, S. and Kessler, H. Static and dynamic presentation of emotions in different facial areas: fear and surprise show influences of temporal and spatial properties. Psychology, 2013, 04, (8), 663–668. doi: 10.4236/psych.2013.48094
   Google Scholar
• Calder, A. J., Young, A. W., Keane, J. and Dean, M. Configural information in facial expression perception. J. Exp. Psychol. Hum. Percept. Perform., 2000, 26, (2), 527–551. doi: 10.1037/0096-1523.26.2.527
   PubMed Web of Science ®Google Scholar
• Bassili, J. N. Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. J. Pers. Soc. Psychol., 1979, 37, (11), 2049–2058. doi: 10.1037/0022-3514.37.11.2049
   PubMed Web of Science ®Google Scholar
• Cortes, C. and Vapnik, V. Support-vector networks. Mach. Learn., 1995, 20, (3), 273–297.
   Web of Science ®Google Scholar
• Chang, C. C. and Lin, C. J. LIBSVM: a library for support vector machines. 2001, Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
   Google Scholar
• Zeng, Z., Pantic, M., Roisman, G. I. and Hunag, T. S. A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal.Mach. Intell., 2009, 31, (1), 39–58. doi: 10.1109/TPAMI.2008.52
   PubMed Web of Science ®Google Scholar
• Gunes, H. and Pantic, M. Automatic, dimensional and continuous emotion recognition. Int. J. Synth. Emot., 2010, 1, (1), 68–99. doi: 10.4018/jse.2010101605
   Google Scholar
• Nicolaou, M. A., Gunes, H. and Pantic, M. Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space. IEEE Trans. Affect. Comput., 2011, 2, (2), 92–105. doi: 10.1109/T-AFFC.2011.9
   Web of Science ®Google Scholar
• Sneddon, I., McRorie, M., McKeown, G. and Hanratty, J. The belfast induced natural emotion database. IEEE Trans. Affect. Comput., 2012, 3, (1), 32–41. doi: 10.1109/T-AFFC.2011.26
   Web of Science ®Google Scholar
• Mavadati, S. M., Mahoor, M. H., Trinh, K. B. P. and Cohn, J. F. DISFA: a spontaneous facial action intensity databases. IEEE Trans. Affect. Comput., 2013, 4, (2), 151–160. doi: 10.1109/T-AFFC.2013.4
   Web of Science ®Google Scholar
• Zhang, X., Yin, L., Cohn, J. F., Canavan, S., Reale, M., Horowitz, A., Liu, P. and Girard, J. M. BP4D-spontaneous: a high-resolution spontaneous 3D dynamic facial expression database. Image Vis. Comput., 2014, 32, (10), 692–706. doi: 10.1016/j.imavis.2014.06.002
   Web of Science ®Google Scholar
• Wan, S. and Aggarwal, J. K. Spontaneous facial expression recognition: a robust metric approach. Pattern Recogn., 2014, 47, (5), 1859–1868. doi: 10.1016/j.patcog.2013.11.025
   Web of Science ®Google Scholar
• Microsoft Project Oxford seconds that emotion. Biomet. Technol. Today, 2016, 2016, (1), 2.
   Google Scholar