Enhanced Facial Emotion Recognition by Optimal Descriptor Selection with Neural Network

References

• J. C. Zwick, and L. Wolkenstein, “Facial emotion recognition, theory of mind and the role of facial mimicry in depression,” J. Affect. Disord., Vol. 210, pp. 90–9, Mar. 2017.
   PubMed Web of Science ®Google Scholar
• L. Lenc, and P. Král, “Automatic face recognition system based on the SIFT features,” Comput. Electr. Eng., Vol. 46, pp. 256–72, Aug. 2015.
   Web of Science ®Google Scholar
• A. Theurel, A. Witt, J. Malsert, F. Lejeune, C. Fiorentini, K. Barisnikov, and E. Gentaz, “The integration of visual context information in facial emotion recognition in 5- to 15-year-olds,” J. Exp. Child Psychol., Vol. 150, pp. 252–71, Oct. 2016.
   PubMed Web of Science ®Google Scholar
• S. Mohammad, and G. V. Kumar, “Development of sEMG based human machine interface control system for robotic watch,” IEEE Intl. Conf. Res. Adv. Integ. Nav. Syst., Vol. 1, pp. 1–5, May 2016.
   Google Scholar
• E. Batbaatar, M. Li, and K. H. Ryu, “Semantic-emotion neural network for emotion recognition from text,” IEEE. Access., Vol. 7, pp. 111866–78, Aug. 2019.
   Web of Science ®Google Scholar
• M. S. Özerdem, and H. Polat, “Emotion recognition based on EEG features in movie clips with channel selection,” Brain. Inform., Vol. 4, no. 4, pp. 241–52, Dec. 2017.
   PubMedGoogle Scholar
• L. S. Videla, M. R. N. Rao, D. Anand, H. D. Vankayalapati, and S. Razia, “Deformable facial fitting using active appearance model for emotion recognition,” Smart Intell. Comput. Appl. Smart Innov. Syst. Technol., Vol. 104, pp. 135–144, Oct. 2019.
   Google Scholar
• S. E. S. C. A. L. E. R. A. et al, “Guest editorial: The computational face,” IEEE Trans. Pattern Anal. Mach. Intell., Vol. 40, no. 11, pp. 2541–5, Nov. 2018.
   Web of Science ®Google Scholar
• V. N. Mandhala, D. Bhattacharyya, and T. Kim, “Face detection using image morphology – a review,” Int. J. Sec. Its Appl., Vol. 10, no. 4, pp. 89–94, Oct. 2016.
   Web of Science ®Google Scholar
• B. N. Jagadesh, N. S. Shaik, V. N. Mandhala, and D. Bhattacharyya, “Illumination invariant face recognition model using tetrolet transform and truncated Gaussian mixture model,” Int. J. Soft. Eng. Its Appl., Vol. 10, no. 10, pp. 43–52, May.2016.
   Google Scholar
• B. Balas, C. Huynh, A. Saville, and J. Schmidt, “Orientation biases for facial emotion recognition during childhood and adulthood,” J. Exp. Child Psychol., Vol. 140, pp. 171–83, Dec. 2015.
   PubMed Web of Science ®Google Scholar
• S. YoungLee, M. Bang, K. R. Kim, M. K. Lee, J. Y. Park, Y. Y. Song, J. I. Kang, E. Lee, and S. K. An, “Impaired facial emotion recognition in individuals at ultra-high risk for psychosis and with first-episode schizophrenia, and their associations with neurocognitive deficits and self-reported schizotypy,” Schizophr. Res., Vol. 165, no. 1, pp. 60–5, June 2015.
   PubMed Web of Science ®Google Scholar
• S. Kuchibhotla, and M. S. R. Niranjan, “Emotional classification of acoustic information with optimal feature subset selection methods,” Int. J. Eng. Technol. (UAE), Vol. 7, no. 2, pp. 39–43, Oct. 2018.
   Google Scholar
• G. K. Pandhari, and M. S. R. Chetty, “Performance analysis of bimodal emotion recognition system based on regression model,” J. Adv. Res. Dyn. Cont. Syst., Vol. 10, no. 5 (Special Issue), pp. 1349–56, July 2018.
   Google Scholar
• R. Radha, M. Atchatha, B. Kaushik, A. Agassi Felix, and G. Staflin Betzy, “Human emotion surveillance using computer vision,” Int. J. Eng. Technol. (UAE), Vol. 7, no. 4, pp. 9–12, Aug. 2018.
   Google Scholar
• L. Barnard-Brak, L. Abby, D. M. Richman, and S. Chesnut, “Facial emotion recognition among typically developing young children: A psychometric validation of a subset of NimStim stimuli,” Psychiatry Res., Vol. 249, pp. 109–14, Mar. 2017.
   PubMed Web of Science ®Google Scholar
• A. C. Cruz, B. Bhanu, and N. S. Thakoor, “Vision and attention theory based sampling for continuous facial emotion recognition,” IEEE Trans. Affect. Comput., Vol. 5, no. 4, pp. 418–31, Dec. 2014.
   Web of Science ®Google Scholar
• A. Hernandez-Matamoros, A. Bonarini, E. Escamilla-Hernandez, M. Nakano-Miyatake, and H. Perez-Meana, “Facial expression recognition with automatic segmentation of face regions using a fuzzy based classification approach,” Knowl. Based. Syst., Vol. 110, pp. 1–14, 15 Oct. 2016.
   Web of Science ®Google Scholar
• N. Durga Indira, and M. Venu Gopala Rao, “Automatic facial expression detection system using single face classifier,” Int. J. Eng. Technol. (UAE), Vol. 7, no. 3.12 (Special Issue 12), pp. 1144–8, July 2018.
   Google Scholar
• K. Mannepalli, P. N. Sastry, and M. Suman, “FDBN: Design and development of fractional deep belief networks for speaker emotion recognition,” Int. J. Speech Technol., Vol. 19, no. 4, pp. 779–90, Aug. 2016.
   Web of Science ®Google Scholar
• N. V. Kimmatkar, and V. B. Babu. “Human emotion classification from brain EEG signal using multimodal approach of classifier,” ICIIT 2018: Proceedings of the 2018 International Conference on Intelligent Information Technology, June 2018, pp. 9–13.
   Google Scholar
• A. Teixeir, L. E. Aguiar, A. F. De Souza, and T. Oliveira-Santos, “Facial expression recognition with convolutional neural networks: Coping with few data and the training sample order,” Pattern Recognit., Vol. 61, pp. 610–28, Jan. 2017.
   Web of Science ®Google Scholar
• A. Vinay, G. Kathiresan, D. A. Mundroy, H. Nihar Nandan, C. Sureka, K. N. Balasubramanya Murthy, and S. Natarajan, “Face recognition using filtered Eoh-sift,” Procedia. Comput. Sci., Vol. 79, pp. 543–52, 2016.
   Google Scholar
• T. Zhang, W. Zheng, Z. Cui, Y. Zong, J. Yan, and K. Yan, “A deep neural network-driven feature learning method for multi-view facial expression recognition,” IEEE Trans. Multimed., Vol. 18, no. 12, pp. 2528–36, Dec. 2016.
   Web of Science ®Google Scholar
• K. Xiaorong Pu, X. Chen, L. Ji, and Z. Zhou, “Facial expression recognition from image sequences using twofold random forest classifier,” Neurocomputing, Vol. 168, pp. 1173–80, 30 Nov, 2015.
   Web of Science ®Google Scholar
• B. Fasel, “Robust face analysis using convolutional neural networks,” Object Recognition Supported by User Interaction for Service Robots, Quebec City, Quebec, Canada, Vol. 2, pp. 40–3, Aug. 2002.
   Google Scholar
• A. Azeem, M. Sharif, J. H. Shah, and M. Raza, “Hexagonal scale invariant feature transform (H-SIFT) for facial feature extraction,” J Appl. Res. Technol., Vol. 13, no. 3, pp. 402–8, June 2015.
   Google Scholar
• B. Wu, and C. Lin, “Adaptive feature mapping for customizing deep learning based facial expression recognition model,” IEEE. Access., Vol. 6, pp. 12451–61, 2018.
   Web of Science ®Google Scholar
• N. P. Nirmala Sreedharan, B. Ganesan, R. Raveendran, P. Sarala, B. Dennis, and R. Boothalingam, “Grey Wolf optimisation-based feature selection and classification for facial emotion recognition,” IET Biometrics, Vol. 7, no. 5, pp. 490–9, 2018.
   Web of Science ®Google Scholar
• M. Hu, Y. Zheng, C. Yang, X. Wang, L. He, and F. Ren, “Facial expression recognition using fusion features based on center-symmetric local octonary pattern,” IEEE. Access., Vol. 7, pp. 29882–90, 2019.
   Web of Science ®Google Scholar
• J. Kim, B. Kim, P. P. Roy, and D. Jeong, “Efficient facial expression recognition algorithm based on hierarchical deep neural network structure,” IEEE. Access., Vol. 7, pp. 41273–85, 2019.
   Web of Science ®Google Scholar
• M. Verma, S. K. Vipparthi, and G. Singh, “Hinet: Hybrid inherited feature learning network for facial expression recognition,” IEEE Lett. Comput. Soc., Vol. 2, no. 4, pp. 36–9, Dec. 2019.
   Google Scholar
• H. Zhang, A. Jolfaei, and M. Alazab, “A face emotion recognition method using convolutional neural network and image edge computing,” IEEE. Access., Vol. 7, pp. 159081–89, Oct. 2019.
   Google Scholar
• A. K. Hassan, and S. N. Mohammed, “A novel facial emotion recognition scheme based on graph mining,” Defence Technology, Vol. 16, no. 5, pp. 1062–72, Oct. 2020.
   Web of Science ®Google Scholar
• N. Jain, S. Kumar, A. Kumar, P. S. Solmoali, and M. Zareapoor, “Hybrid deep neural networks for face emotion recognition,” Pattern Recognit. Lett., Vol. 115, pp. 101–6, 1 Nov. 2018.
   Web of Science ®Google Scholar
• N. T. Deshpande, and S. Ravishankar, “Face detection and recognition using Viola-Jones algorithm and fusion of PCA and ANN,” Adv. Comput. Sci. Technol., Vol. 10, no. 5, pp. 1173–89, Nov. 2017.
   Google Scholar
• S. HamadKhaleefah, S. A. Mostafa, A. Mustapha, and M. F. Nasrudin, “The ideal effect of Gabor filters and uniform local binary pattern combinations on deformed scanned paper images,” J King Saud Univ. – Comput. Infor. Sci., 30 July 2019, Available online.
   Web of Science ®Google Scholar
• J. Yum, C. Lee, J. Park, J. Kim, and H. Lee, “A hardware architecture for the affine-invariant extension of SIFT,” IEEE Trans. Circuits Syst. Video Technol., Vol. 28, no. 11, pp. 3251–61, Nov. 2018.
   Web of Science ®Google Scholar
• F. Fernández-Navarro, M. Carbonero-Ruz, D. Becerra Alonso, and M. Torres-Jiménez, “Global sensitivity estimates for neural network classifiers,” IEEE Trans. Neural Net. Learn. Syst., Vol. 28, no. 11, pp. 2592–604, Nov. 2017.
   PubMed Web of Science ®Google Scholar
• A. George, and B. R. Rajakumar, “On hybridizing fuzzy min max neural network and firefly algorithm for automated heart disease diagnosis”, IEEE Fourth Int. Conf. Comput. Comm. Network. Technol., Vol. 1, pp. 1–5, July 2013.
   Google Scholar
• M. Marsaline Beno, I. R. Valarmathi, S. M. Swamy, and B. R. Rajakumar, “Threshold prediction for segmenting tumour from brain MRI scans,” Int. J. Imaging Syst. Technol., Vol. 24, no. 2, pp. 129–37, May 2014.
   Web of Science ®Google Scholar
• S. Mirjalili, and A. Lewis, “The whale optimization algorithm,” Adv. Eng. Softw., Vol. 95, pp. 51–67, May 2016.
   Web of Science ®Google Scholar
• E. Mirjalili, S. M. Mirjalili, and A. Hatamlou, “Multi-verse optimizer: A nature-inspired algorithm for global optimization,” Neural Comput. Appl., Vol. 27, pp. 495–513, Mar. 2016.
   Web of Science ®Google Scholar
• K. Mistry, L. Zhang, S. C. Neoh, C. P. Lim, and B. Fielding, “A micro-GA embedded PSO feature selection approach to intelligent facial emotion recognition,” IEEE Trans. Cyber., Vol. 47, no. 6, pp. 1496–509, June 2017.
   PubMed Web of Science ®Google Scholar
• M. A. Abuzneid, and A. Mahmood, “Enhanced human face recognition using LBPH descriptor, multi-KNN, and back-propagation neural network,” IEEE. Access., Vol. 6, pp. 20641–51, Apr. 2018.
   Web of Science ®Google Scholar
• W. Rawat, and Z. Wang, “Deep convolutional neural networks for image classification: A comprehensive review,” Neural Comput., Vol. 29, pp. 2352–450, June 2017.
   PubMed Web of Science ®Google Scholar