Deep learning with convolutional neural networks for EEG-based music emotion decoding and visualization

References

• Bradley MM, Lang PJ. Emotion and motivation. In: Handbook of Psychophysiology. New York: Cambridge University Press; 2007. p. 581–607.
   Google Scholar
• Gross JJ, Muñoz RF. Emotion regulation and mental health. Clin Psychol Sci Pract. 1995;2(2):151–164.
   Google Scholar
• C. G L. The mechanism of the emotions. Classical Psychol. 1885;:672–684.
   Google Scholar
• Ofri D. What doctors feel: how emotions affect the practice of medicine. Boston, MA: Beacon Press; 2013.
   Google Scholar
• Burkitt I. Social relationships and emotions. Sociology. 1997;31(1):37–55.
   Google Scholar
• Liu Y, Fu Q, Fu X. The interaction between cognition and emotion. Chin Sci Bull. 2009;54(22):4102–4116.
   Google Scholar
• Tian Y, Zhang H, Pang Y, et al. Classification for single-trial N170 during responding to facial picture with emotion. Front Comput Neurosci. 2018;12:68.
   Google Scholar
• Koelstra S, Muhl C, Soleymani M, et al. Deap: a database for emotion analysis; using physiological signals. IEEE Trans Affective Comput. 2011;3(1):18–31.
   Web of Science ®Google Scholar
• Zheng W-L, Liu W, Lu Y, et al. Emotionmeter: a multimodal framework for recognizing human emotions. IEEE Trans Cybern. 2019;49(3):1110–1122.
   PubMed Web of Science ®Google Scholar
• Krumhansl CL. An exploratory study of musical emotions and psychophysiology. Can J Exp Psychol. 1997;51(4):336–353.
   PubMed Web of Science ®Google Scholar
• Liu J, Wu G, Luo Y, et al. EEG-based emotion classification using a deep neural network and sparse autoencoder. Front Syst Neurosci. 2020;14:43.
   Google Scholar
• Salama ES, A. El-Khoribi R, E. Shoman M, et al. EEG-based emotion recognition using 3D convolutional neural networks. IJACSA. 2018;9(8):329–337.
   Google Scholar
• Yosinski J, Clune J, Nguyen A, et al. “Understanding neural networks through deep visualization,” arXiv preprintarXiv:1506.065792015.
   Google Scholar
• Zheng W-L, Zhu J-Y, Lu B-L. Identifying stable patterns over time for emotion recognition from EEG. IEEE Trans. Affective Comput. 2019;10(3):417–429.
   Web of Science ®Google Scholar
• Ioffe S, Szegedy C. “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” International conference on machine learning. PMLR, p. 448–456. 2015.
   Google Scholar
• Glorot X, Bordes A, Bengio Y. “Deep sparse rectifier neural networks,”Proceedings of the fourteenth international conference on artificial intelligence and statistics. JMLR Workshop and Conference Proceedings, p. 315–323. 2011.
   Google Scholar
• Srivastava N, Hinton G, Krizhevsky A, et al. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014;15(1):1929–1958.
   Google Scholar
• Duan R-N, Zhu J-Y, Lu B-L. Differential entropy feature for EEG-based emotion classification. In: 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE; 2013. p. 81–84.
   Google Scholar
• Schirrmeister RT, Springenberg JT, Fiederer LDJ, et al. Deep learning with convolutional neural networks for EEG decoding and visualization. Hum Brain Mapp. 2017;38(11):5391–5420.
   PubMed Web of Science ®Google Scholar
• Schmidt LA, Trainor LJ. Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cogn Emot. 2001;15(4):487–500.
   Web of Science ®Google Scholar
• Ahern GL, Schwartz GE. Differential lateralization for positive and negative emotion in the human brain: EEG spectral analysis. Neuropsychologia. 1985;23(6):745–755.
   PubMed Web of Science ®Google Scholar
• Wheeler RE, Davidson RJ, Tomarken AJ. Frontal brain asymmetry and emotional reactivity: a biological substrate of affective style. Psychophysiology. 1993;30(1):82–89.
   PubMed Web of Science ®Google Scholar
• Lin Y-P, Wang C-H, Jung T-P, et al. EEG-based emotion recognition in music listening. IEEE Trans Biomed Eng. 2010;57(7):1798–1806.
   PubMed Web of Science ®Google Scholar
• Zhuang N, Zeng Y, Yang K, et al. Investigating patterns for self-induced emotion recognition from EEG signals. Sensors. 2018;18(3):841.
   Google Scholar