A novel convolutional neural network with gated recurrent unit for automated speech emotion recognition and classification

Abstract

Automated Speech Emotion Recognition (SER) becomes more popular and has increased applicability. SER concentrates on the automatic identification of the emotional state of a human being using speech signals. It mainly depends upon the in-depth analysis of the speech signal, extracts features containing emotional details from the speech signal, and utilises pattern recognition techniques for emotional state identification. The major problem in automatic SER is to extract discriminate, powerful, and emotional salient features from the acoustical content of speech signals. The proposed model aims to detect and classify three emotional states of speech such as happy, neutral, and sad. The presented model makes use of Convolution neural network – Gated Recurrent unit (CNN-GRU) based feature extraction technique which derives a set of feature vectors. A comprehensive simulation takes place using the Berlin German Database and SJTU Chinese Database which comprises numerous audio files under a collection of different emotion labels.

KEYWORDS:

• Emotion recognition
• speech recognition
• deep learning
• classification model
• Berlin emotion dataset

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

P. Ravi Prakash

Ravi Prakash Paruchuri working as an Assistant Professor in Prasad v Potluri Siddhartha Institute of Technology Vijayawada, India. he obtained his Bachelor’s degree in Information Technology from Acharya Nagarjuna University of Master’s degree in Computer Science & Engineering from Acharya Nagarjuna University, he has a rich experience in the field of Computer Science over one decade. His current research interests are Network and cyber Security, big data analytics. he has published more research articles in many reputed journals and conferences.

D. Anuradha

D. Anuradha (Durairaj Anuradha) working as a Professor in Panimalar Engineering College, Chennai, India. She obtained her Bachelor’s degree in Computer Science& Engineering from University of Madras, Master’s degree in Computer Science & Engineering from Sathyabama Institute of Science and Technology. She completed Ph.D, in Computer Science and Engineering from Sathyabama Institute of Science and Technology. She has a rich experience in the field of Computer Science over two decades. Her specialisations include Wireless networks, Compiler Design, and Networking. Her current research interests are Wireless sensor networks routing protocols, Network Security, and Authentication.

Javid Iqbal

Javid Iqbal is currently working as a Lecturer at UCSI University, Malaysia. He holds a PhD in Information and Communication Technology from the National Energy University Malaysia. He holds a bachelor’s degree in Computer Science and Engineering from Dr. M.G.R. Educational and Research Institute and Master’s degree in Communication Systems from Dr. M.G.R. Educational and Research Institute. His research interest includes Multimedia, Augmented Reality and Virtual Reality.

Mohammad Gouse Galety

Mohammad Gouse Galety has been working on computer science and information technology subjects since 1999. He is now an Associate professor in the CS and IT department of Catholic University in Erbil, Iraq. He holds his Ph.D. in web mining in computer science and two master's degrees in computers. The first master's degree in computer applications and the second in computer science. His research interests span computer science and information science, mainly web mining, IoT, and Networks.

Ruby Singh

Ruby Singh is currently serving as an Assistant Professor at SRM Institute of Science and Technology, Delhi NCR Campus. Professionally, she is a result-driven person passionate towards academics and research. She has completed her B. Tech in IT from Uttar Pradesh Technical University, Lucknow in 2009 and M. Tech in CSE from SRM University, Chennai in 2011. She had pursued her Doctoral degree in CSE from Shobhit University, Meerut in 2020.

S. Neelakandan

S. Neelakandan (Senior Member, IEEE) is working as an Assistant Professor in the Department of CSE at R.M.K Engineering College Chennai. He has 14 years of Teaching experience. He has obtained his Bachelor of Engineering in Computer Science & Engineering M.E in Computer Science and Engineering from Anna University Chennai. He has received Ph.D in Information and Communication Engineering from Anna University. His research interests include Data Science, Machine Learning, Big Data and Cloud Computing. He has published more than 30 research papers in SCI, Web of Science and Scopus indexed journals. He is a Reviewer for several International Journals. He is also a Senior IEEE member, Life member of ISTE & IAENG.