Classification of mental workload with EEG analysis by using effective connectivity and a hybrid model of CNN and LSTM

Abstract

Estimation of mental workload from electroencephalogram (EEG) signals aims to accurately measure the cognitive demands placed on an individual during multitasking mental activities. By analyzing the brain activity of the subject, we can determine the level of mental effort required to perform a task and optimize the workload to prevent cognitive overload or underload. This information can be used to enhance performance and productivity in various fields such as healthcare, education, and aviation. In this paper, we propose a method that uses EEG and deep neural networks to estimate the mental workload of human subjects during multitasking mental activities. Notably, our proposed method employs subject-independent classification. We use the “STEW” dataset, which consists of two tasks, namely “No task” and “simultaneous capacity (SIMKAP)-based multitasking activity”. We estimate the different workload levels of two tasks using a composite framework consisting of brain connectivity and deep neural networks. After the initial preprocessing of EEG signals, an analysis of the relationships between the 14 EEG channels is conducted to evaluate effective brain connectivity. This assessment illustrates the information flow between various brain regions, utilizing the direct Directed Transfer Function (dDTF) method. Then, we propose a deep hybrid model based on pre-trained Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) for the classification of workload levels. The accuracy of the proposed deep model achieved 83.12% according to the subject-independent leave-subject-out (LSO) approach. The pre-trained CNN + LSTM approaches to EEG data have been found to be an accurate method for assessing the mental workload.

Keywords:

• Mental workload
• EEG
• brain connectivity
• convolutional neural networks (CNN)
• long short-term memory (LSTM)

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

This research is financially supported by “Shahid Beheshti University of Medical Sciences” (Grant No 43004523).