Real time facial expression and gender recognition with feature integrated CNN

References

• Mehrabian A, Ferris SR. Inference of attitudes from nonverbal communication in two channels. J Consult Psychol. 1967;31(3):248.
   PubMedGoogle Scholar
• Yan J, Zheng W, Cui Z, et al. Multi-cue fusion for emotion recognition in the wild. Neurocomputing. 2018;309:27–35.
   Web of Science ®Google Scholar
• González-Briones A, Villarrubia G, De Paz JF, et al. A multi-agent system for the classification of gender and age from images. Comput Vis Image Underst. 2018;172:98–106.
   Web of Science ®Google Scholar
• Azzopardi G, Greco A, Saggese A, et al. Fusion of domain-specific and trainable features for gender recognition from face images. IEEE Access. 2018;6:24171–24183.
   Web of Science ®Google Scholar
• Ng C-B, Tay Y-H, Goi B-M. Pedestrian gender classification using combined global and local parts-based convolutional neural networks. Pattern Anal Appl. 2019;22(4):1469–1480.
   Web of Science ®Google Scholar
• Gorokhovatskyi O, Peredrii O. Video stream gender classification using shallow CNN. Int J Pattern Recognit Artif Intell. 2021;35(01):2155001.
   Google Scholar
• Qawaqneh Z, Mallouh AA, Barkana BD. Age and gender classification from speech and face images by jointly fine-tuned deep neural networks. Expert Syst Appl. 2017;85:76–86.
   Web of Science ®Google Scholar
• Shao J, Qian Y. Three convolutional neural network models for facial expression recognition in the wild. Neurocomputing. 2019;355:82–92.
   Web of Science ®Google Scholar
• Podder T, Bhattacharya D, Majumdar A. Dew computing-inspired mental health monitoring system framework powered by a lightweight CNN. In: Disruptive technologies for big data and cloud applications. Singapore: Springer; 2022. p. 309–319.
   Google Scholar
• Sajjad M, Zahir S, Ullah A, et al. Human behavior understanding in Big multimedia data using CNN based facial expression recognition. Mobile Netw Appl. 2020;25:1611–1621.
   Web of Science ®Google Scholar
• Agbo-Ajala O, Viriri S. Deeply learned classifiers for age and gender predictions of unfiltered faces. Scientific World J. 2020;2020.
   Google Scholar
• Lekdioui K, Messoussi R, Ruichek Y, et al. Facial decomposition for expression recognition using texture/shape descriptors and SVM classifier. Signal Process Image Commun. 2017;58:300–312.
   Web of Science ®Google Scholar
• Ghimire D, Lee J, Li Z-N, et al. Recognition of facial expressions based on salient geometric features and support vector machines. Multimed Tools Appl. 2017;76(6):7921–7946.
   Web of Science ®Google Scholar
• Khan G, Siddiqi A, Ghani Khan MU, et al. Geometric positions and optical flow based emotion detection using MLP and reduced dimensions. IET Image Process. 2019;13(4):634–643.
   Web of Science ®Google Scholar
• Yan Y, Zhang Z, Chen S, et al. Low-resolution facial expression recognition: A filter learning perspective. Signal Process. 2020;169:107370.
   Web of Science ®Google Scholar
• Sadeghi H, Raie A-A. Histogram distance metric learning for facial expression recognition. J Vis Commun Image Represent. 2019;62:152–165.
   Web of Science ®Google Scholar
• Vedantham R, Reddy ES. A robust feature extraction with optimized DBN-SMO for facial expression recognition. Multimed Tools Appl. 2020;79(29):21487–21512.
   Web of Science ®Google Scholar
• Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
   Google Scholar
• Szegedy C, Vanhoucke V, Ioffe S, et al. Rethinking the inception architecture for computer vision. Proceedings of the IEEE conference on computer vision and pattern recognition, 2818–2826, 2016.
   Google Scholar
• Huang G, Liu Z, Van Der Maaten L, et al. Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition, 4700–4708. 2017.
   Google Scholar
• Fei Z, Yang E, Li DD-U, et al. Deep convolution network based emotion analysis towards mental health care. Neurocomputing. 2020.
   Google Scholar
• Ahmed MU, Woo KJ, Hyeon KY, et al. Wild facial expression recognition based on incremental active learning. Cogn Syst Res. 2018;52:212–222.
   Web of Science ®Google Scholar
• Miao Y, Dong H, Al Jaam JM, et al. A deep learning system for recognizing facial expression in real-time. ACM Trans Multimed Comput Commun Appl. 2019;15(2):1–20.
   Web of Science ®Google Scholar
• Happy SL, Dantcheva A, Bremond F. A weakly supervised learning technique for classifying facial expressions. Pattern Recognit Lett. 2019;128:162–168.
   Web of Science ®Google Scholar
• Podder T, Bhattacharya D, Majumdar A. Time efficient real time facial expression recognition with CNN and transfer learning. Sādhanā. 2022;47(3):1–20.
   Web of Science ®Google Scholar
• Jain DK, Shamsolmoali P, Sehdev P. Extended deep neural network for facial emotion recognition. Pattern Recognit Lett. 2019;120:69–74.
   Web of Science ®Google Scholar
• Lopes AT, de Aguiar E, De Souza AF, et al. Facial expression recognition with convolutional neural networks: coping with few data and the training sample order. Pattern Recognit. 2017;61:610–628.
   Web of Science ®Google Scholar
• Hung JC, Lin K-C, Lai N-X. Recognizing learning emotion based on convolutional neural networks and transfer learning. Appl Soft Comput. 2019;84:105724.
   Web of Science ®Google Scholar
• P. Jiang, B. Wan, Q. Wang and J. Wu, “Fast and efficient facial expression recognition using a gabor convolutional network,” IEEE Signal Process Lett, vol. 27, pp. 1954-1958, 2020, doi:10.1109/LSP.2020.3031504.
   Web of Science ®Google Scholar
• Gera D, Balasubramanian S. Landmark guidance independent spatio-channel attention and complementary context information based facial expression recognition. Pattern Recognit Lett. 2021;145:58–66. doi:10.1016/j.patrec.2021.01.029.
   Web of Science ®Google Scholar
• Gera D, Balasubramanian S, Jami A. CERN: compact facial expression recognition net. Pattern Recognit Lett. 2022;155:9–18. doi:10.1016/j.patrec.2022.01.013.
   Web of Science ®Google Scholar
• Jia S, Cristianini N. Learning to classify gender from four million images. Pattern Recognit Lett. 2015;58:35–41.
   Web of Science ®Google Scholar
• González-Briones A, Villarrubia G, De Paz JF, et al. A multi-agent system for the classification of gender and age from images. Comput Vis Image Underst. 2018;172:98–106.
   Web of Science ®Google Scholar
• Castrillón-Santana M, Lorenzo-Navarro J, Ramón-Balmaseda E. Multi-scale score level fusion of local descriptors for gender classification in the wild. Multimed Tools Appl. 2017;76(4):4695–4711.
   Web of Science ®Google Scholar
• Qawaqneh Z, Mallouh AA, Barkana BD. Age and gender classification from speech and face images by jointly fine-tuned deep neural networks. Expert Syst Appl. 2017;85:76–86.
   Web of Science ®Google Scholar
• Dehghan A, Ortiz EG, Shu G, et al. Dager: Deep age, gender and emotion recognition using convolutional neural network. arXiv preprint arXiv:1702.04280 (2017).
   Google Scholar
• Althnian A, Aloboud N, Alkharashi N, et al. Face gender recognition in the wild: an extensive performance comparison of deep-learned, hand-crafted, and fused features with deep and traditional models. Appl Sci. 2021;11(1):89.
   Google Scholar
• Zhang K, Gao C, Guo L, et al. Age group and gender estimation in the wild with deep RoR architecture. IEEE Access. 2017;5:22492–22503.
   Web of Science ®Google Scholar
• Parkhi OM, Vedaldi A, Zisserman A. Deep face recognition.” (2015).
   Google Scholar
• Ozbulak G, Aytar Y, Ekenel HK. How transferable are CNN-based features for age and gender classification?. 2016 international conference of the biometrics special interest group (BIOSIG), 1–6. IEEE, 2016.
   Google Scholar
• Rodríguez P, Cucurull G, Gonfaus JM, et al. Age and gender recognition in the wild with deep attention. Pattern Recognit. 2017;72:563–571.
   Web of Science ®Google Scholar
• Fang J, Yuan Y, Lu X, et al. Muti-stage learning for gender and age prediction. Neurocomputing. 2019;334:114–124.
   Web of Science ®Google Scholar
• Duan M, Li K, Yang C, et al. A hybrid deep learning CNN–ELM for age and gender classification. Neurocomputing. 2018;275:448–461.
   Web of Science ®Google Scholar
• Ng C-B, Tay Y-H, Goi B-M. Pedestrian gender classification using combined global and local parts-based convolutional neural networks. Pattern Anal Appl. 2019;22(4):1469–1480.
   Web of Science ®Google Scholar
• Lucey P, Cohn JF, Kanade T, et al. The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. 2010 ieee computer society conference on computer vision and pattern recognition-workshops, 94–101. IEEE, June, 2010.
   Google Scholar
• Lyons MJ, Akamatsu S, Kamachi M, et al. Coding facial expressions with gabor wavelets). 3rd IEEE international conference on automatic face and gesture recognition, 200–205, 1998.
   Google Scholar
• Lundqvist D, Flykt A, Öhman A. The Karolinska directed emotional faces (KDEF). CD ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet. 1998;91(630):2–2.
   Google Scholar
• Viola P, Jones MJ. Robust real-time face detection. Int J Comput Vis. 2004;57(2):137–154.
   Web of Science ®Google Scholar
• Eidinger E, Enbar R, Hassner T. Age and gender estimation of unfiltered faces. IEEE Trans Inf Forensics Secur. 2014;9(12):2170–2179.
   Web of Science ®Google Scholar
• Ozbulak G, Aytar Y, Ekenel HK. How transferable are CNN-based features for age and gender classification?. 2016 international conference of the biometrics special interest group (BIOSIG), 1–6. IEEE, 2016.
   Google Scholar
• Wen Y, Zhang K, Li Z, et al. A discriminative feature learning approach for deep face recognition). European conference on computer vision, 499–515. Springer, Cham, 2016.
   Google Scholar
• Goodfellow IJ, Erhan D, Carrier PL, et al. Challenges in representation learning: A report on three machine learning contests. International conference on neural information processing, 117–124. Springer, Berlin, Heidelberg, 2013.
   Google Scholar
• Barsoum E, Zhang C, Ferrer CC, et al. Training deep networks for facial expression recognition with crowd-sourced label distribution. Proceedings of the 18th ACM international conference on multimodal interaction, 279–283, 2016.
   Google Scholar
• Yu J, Li H, Yin SL, et al. Dynamic gesture recognition based on deep learning in human-to-computer interfaces. J Appl Sci Eng. 2020;23(1):31–38.
   Google Scholar
• Gao S. A two-channel attention mechanism-based MobileNetV2 and bidirectional long short memory network for multi-modal dimension dance emotion recognition. J Appl Sci Eng. 2022;26(4):455–464.
   Google Scholar
• Gao TT, Li H, Yin SL. Adaptive convolutional neural network-based information fusion for facial expression recognition. Int J Electron Inf Eng. 2021;13(1):17–23.
   Google Scholar
• Jisi A, Yin S. A new feature fusion network for student behavior recognition in education. J Appl Sci Eng. 2021;24(2):133–140.
   Google Scholar