2,034
Views
166
CrossRef citations to date
0
Altmetric
Articles

A survey of affective brain computer interfaces: principles, state-of-the-art, and challenges

, , &
Pages 66-84 | Received 22 Dec 2013, Accepted 03 Mar 2014, Published online: 14 May 2014

References

  • LeDoux JE. Emotion circuits in the brain. Annu Rev Neurosci. 2000;23:155–184.10.1146/annurev.neuro.23.1.155
  • Schwarz N. Emotion, cognition, and decision making. Cogn Emot. 2000 Jul;14:433–440.10.1080/026999300402745
  • Scherer KR. What are emotions? And how can they be measured? Soc Sci Inf. 2005 Dec 1;44:695–729.10.1177/0539018405058216
  • Picard RW. Affective computing. MA: The MIT Press; 1997.
  • Broek EL. Affective computing: a reverence for a century of research. In: Esposito Anna, Esposito Antonietta M, Vinciarelli Alessandro, Hoffman Rüdiger, Müller Vincent C, editors. Cognitive behavioural systems. Berlin: Springer; 2012. p. 434–448.10.1007/978-3-642-34584-5
  • Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM. Brain-computer interfaces for communication and control. Clin Neurophysiol. 2002 Jul;113:767–791.10.1016/S1388-2457(02)00057-3
  • Plass-Oude Bos D, Reuderink B, Laar B, Gürkök H, Mühl C, Poel M, et al. Brain-computer interfacing and games. In: Tan DS, Nijholt A, editors. Brain-computer interfaces: applying our minds to human-computer interaction. London: Springer; 2010. p. 149–178.10.1007/978-1-84996-272-8
  • Zander TO, Kothe C. Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. J Neural Eng. 2011 Apr;8:025005.10.1088/1741-2560/8/2/025005
  • Mühl C, Heylen D, Nijholt A Affective brain-computer interfaces: neuroscientific approaches to affect detection. In: Calvo RA, D’Mello SK, J. Gratch AK, editor. Handbook of affective computing. Oxford University Press; 2014.
  • Vidal JJ. Toward direct brain-computer communication. Annu Rev Biophys Bioeng. 1973 Jan;2:157–180.10.1146/annurev.bb.02.060173.001105
  • Farwell LA, Donchin E. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol. Elsevier. 1988 Dec;70:510–523.10.1016/0013-4694(88)90149-6
  • Pfurtscheller G, Neuper C. Motor imagery and direct brain-computer communication. Proc IEEE. 2001 Jul;89:1123–1134.10.1109/5.939829
  • Friedrich EVC, Scherer R, Neuper C. The effect of distinct mental strategies on classification performance for brain-computer interfaces. Int J Psychophysiol. 2012;84:86–94.10.1016/j.ijpsycho.2012.01.014
  • Reuderink B, Mühl C, Poel M. Valence, arousal and dominance in the EEG during game play. Int J Auton Adapt Commun Syst. 2013;6:45–62.10.1504/IJAACS.2013.050691
  • Chanel G, Rebetez C, Bétrancourt M, Pun T, Bétrancourt M Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty. IEEE Trans Syst Man, Cybern Part A Syst Humans. IEEE. 2011;41:1052–1063.10.1109/TSMCA.2011.2116000
  • Rani P, Sarkar N, Liu C Maintaining Optimal Challenge in Computer Games through Real-Time Physiological Feedback Mechanical Engineering. Proc 11th Int’l Conf on Human Computer Interaction. Las Vegas, NV, USA; 2005. p. 184–192.
  • Allison BZ, Polich J. Workload assessment of computer gaming using a single-stimulus event-related potential paradigm. Biol Psychol. 2008 Mar;77:277–283.10.1016/j.biopsycho.2007.10.014
  • Buttfield A, Ferrez PW, Millan J del R. Towards a robust BCI: error potentials and online learning. IEEE Trans Neural Syst Rehabil Eng. 2006 Jun;14:164–168.10.1109/TNSRE.2006.875555
  • Zander TO, Jatzev S. Detecting affective covert user states with passive Brain-Computer Interfaces. In: Cohn J, Nijholt A, Pantic M, editors. Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction (ACII2009), Part II. Amsterdam, The Netherlands: IEEE Computer Society Press; 2009.
  • Abootalebi V, Moradi MH, Khalilzadeh MA. A new approach for EEG feature extraction in P300-based lie detection. Comput Methods Programs Biomed. 2009 Apr;94:48–57.10.1016/j.cmpb.2008.10.001
  • Soleymani M, Lichtenauer J, Pun T, Pantic M. A Multimodal Database for Affect Recognition and Implicit Tagging. IEEE Trans Affect Comput. Published by the IEEE Computer Society. 2011 Jul 28;3:42–55.
  • Koelstra S, Muhl C, Soleymani M, Lee J-S, Yazdani T, Ebrahimi T, et al. DEAP: A Database for Emotion Analysis using Physiological Signals. IEEE Trans Affect Comput. 2012;3:18–31.10.1109/T-AFFC.2011.15
  • Liberati G, Veit R, Kim S, Birbaumer N, von Arnim C, Jenner A, et al. Development of a Binary fMRI-BCI for Alzheimer Patients: A Semantic Conditioning Paradigm Using Affective Unconditioned Stimuli. 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction. IEEE. 2013. p. 838–842.10.1109/ACII.2013.157
  • Hammond DC. Neurofeedback Treatment of Depression and Anxiety. J Adult Dev. Springer; 2005 Aug 1;12:131–137.10.1007/s10804-005-7029-5
  • George L, Lotte F, Abad RV, Lecuyer A. Using scalp electrical biosignals to control an object by concentration and relaxation tasks: design and evaluation. Proceedings of the 33th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Boston (MA): IEEE; 2011. p. 6299–6302.
  • Hjelm SI. Research + design: the making of Brainball. Interactions. ACM; 2003;10:26–34.
  • Mühl C, Gürkök H, Plass-Oude Bos D, Thurlings ME, Scherffig L, Duvinage M, et al. Bacteria Hunt - Evaluating multi-paradigm BCI interaction. J Multimodal User Interfaces. Springer Berlin/Heidelberg; 2010 Aug 14;4:11–25.10.1007/s12193-010-0046-0
  • Fairclough SH. Fundamentals of physiological computing. Elsevier Science Inc.; 2009 Jan;21:133–145.10.1016/j.intcom.2008.10.011
  • Gilleade KM, Dix A, Allanson J. Affective videogames and modes of affective gaming: assist me, challenge me, emote me. Digital Games Research Association (Di-GRA) Conference. Vancouver, Canada: Citeseer; 2005. p. 16–20.
  • Damasio AR. The Feeling of what Happens. Vintage U.K: Random House; 2000.
  • Barrett LF, Mesquita B, Ochsner KN, Gross JJ. The experience of emotion. Annu Rev Psychol. 2007 Jan;58:373–403.10.1146/annurev.psych.58.110405.085709
  • Kleinginna PR, Kleinginna AM. A categorized list of emotion definitions, with suggestions for a consensual definition. Motiv Emot. Springer Netherlands; 1981 Dec 1;5:345–379.10.1007/BF00992553
  • Ekman P. Are there basic emotions? Psychol Rev. 1992 Jul;99:550–553.10.1037/0033-295X.99.3.550
  • Ortony A, Clore GL, Collins A. The cognitive structure of emotions. booksgooglecom. Cambridge, USA: Cambridge University Press; 1988.10.1017/CBO9780511571299
  • Russel JA. A circumplex model of affect. J Pers Soc Psychol. 1980;39:1161–1178.10.1037/h0077714
  • Russel JA, Barrett LF. Core affect, prototypical emotions, and other things called emotion: Disecting the elephant. J Pers Soc Psychol. 1999;76:805–819.10.1037/0022-3514.76.5.805
  • Barrett L, Satpute A. Large-scale brain networks in affective and social neuroscience: towards an integrative functional architecture of the brain. Curr Opin Neurobiol. Elsevier; 2013 Jan 22;23:361–372.10.1016/j.conb.2012.12.012
  • Hamann S. Mapping discrete and dimensional emotions onto the brain: controversies and consensus. Trends Cogn Sci. Elsevier Ltd; 2012 Sep;16:458–466.10.1016/j.tics.2012.07.006
  • Vytal K, Hamann S. Neuroimaging support for discrete neural correlates of basic emotions: a voxel-based meta-analysis. J Cogn Neurosci. MIT Pres; 2010 Dec;22:2864–2885.10.1162/jocn.2009.21366
  • Kober H, Barrett LFF, Joseph J, Bliss-Moreau E, Lindquist K, Wager TD. Functional grouping and cortical-subcortical interactions in emotion: a meta-analysis of neuroimaging studies. Neuroimage. 2008 Aug 15;42:998–1031.10.1016/j.neuroimage.2008.03.059
  • Lindquist KA, Wager TD, Kober H, Bliss-moreau E, Barrett LF. The brain basis of emotion: A meta-analytic review. Behav Brain Sci. 2011;173:1–86.
  • Davidson RRJ. Anterior cerebral asymmetry and the nature of emotion. Brain Cogn. 1992 Sep;20:125–151.10.1016/0278-2626(92)90065-T
  • Harmon-Jones E. Clarifying the emotive functions of asymmetrical frontal cortical activity. Psychophysiology. Blackwell Publishing; 2003;40:838–848.10.1111/psyp.2003.40.issue-6
  • Olofsson JK, Nordin S, Sequeira H, Polich J. Affective picture processing: an integrative review of ERP findings. Biol Psychol. 2008 Mar;77:247–265.10.1016/j.biopsycho.2007.11.006
  • Polich J. Updating P300: an integrative theory of P3a and P3b. Clin Neurophysiol; 2007 Oct;118:2128–2148.10.1016/j.clinph.2007.04.019
  • Briggs KE, Martin FH. Affective picture processing and motivational relevance: arousal and valence effects on ERPs in an oddball task. Int J Psychophysiol. 2009 Jun;72:299–306.10.1016/j.ijpsycho.2009.01.009
  • Schupp HT, Cuthbert BN, Bradley MM, Cacioppo JT, Ito T, Lang PJ. Affective picture processing: the late positive potential is modulated by motivational relevance. Psychophysiology. 2000;37:257–261.10.1111/psyp.2000.37.issue-2
  • Sabatinelli D, Lang PJJ, Keil A, Bradley MMM. Emotional Perception: Correlation of Functional MRI and Event-Related Potentials. Cereb Cortex. Oxford University Press; 2006 May 12;17:1085–1091.10.1093/cercor/bhl017
  • Tallon-Baudry C, Bertrand O, Baudry T. Oscillatory gamma activity in humans and its role in object representation. Trends Cogn Sci. 1999 Apr;3:151–162.10.1016/S1364-6613(99)01299-1
  • Steriade M, McCormick DA, Sejnowski TJ. Thalamocortical oscillations in the sleeping and aroused brain. Science (80-). American Association for the Advancement of Science. 1993;262:679–685.10.1126/science.8235588
  • Knyazev GG. EEG delta oscillations as a correlate of basic homeostatic and motivational processes. Neurosci Biobehav Rev. 2012 Neurosci Biobehav Rev;36:677–695.10.1016/j.neubiorev.2011.10.002
  • Aftanas LI, Varlamov AA, Pavlov SV. Time-dependent cortical asymmetries induced by emotional arousal: EEG analysis of event-related synchronization and desynchronization in individually defined frequency bands. Int J Psychophysiol. 2002 Apr;44:67–82.10.1016/S0167-8760(01)00194-5
  • Balconi M, Lucchiari C. EEG correlates (event-related desynchronization) of emotional face elaboration: a temporal analysis. Neurosci Lett. 2006 Jan;392:118–123.10.1016/j.neulet.2005.09.004
  • Klados MA, Frantzidis C, Vivas AB, Papadelis C, Lithari C, Pappas C, et al. A framework combining delta Event-Related Oscillations (EROs) and Synchronisation Effects (ERD/ERS) to study emotional processing. Comput Intell Neurosci. 2009 Jan;549419.
  • Başar E, Schürmann M, Sakowitz O. The selectively distributed theta system: functions. Int J Psychophysiol. 2001 Jan;39:197–212.10.1016/S0167-8760(00)00141-0
  • Sammler D, Grigutsch M, Fritz T, Koelsch S. Music and emotion: Electrophysiological correlates of the processing of pleasant and unpleasant music. Psychophysiology. Blackwell Publishing; 2007 Mar;44:293–304.10.1111/psyp.2007.44.issue-2
  • Lin Y-P, Duann J-R, Chen J-H, Jung T-P. Electroencephalographic dynamics of musical emotion perception revealed by independent spectral components. Neuroreport. 2010;21:410–415.10.1097/WNR.0b013e32833774de
  • Cavanagh J, Zambrano-Vazquez L, Allen JJB. Theta lingua franca: A common mid-frontal substrate for action monitoring processes. Psychophysiology. 2012;49:220–238.10.1111/j.1469-8986.2011.01293.x
  • Klimesch W, Freunberger R, Sauseng P, Gruber W. A short review of slow phase synchronization and memory: evidence for control processes in different memory systems? Brain Res. 2008 Oct 15;1235:31–44.10.1016/j.brainres.2008.06.049
  • Kawasaki M, Kitajo K, Yamaguchi Y. Dynamic links between theta executive functions and alpha storage buffers in auditory and visual working memory. Eur J Neurosci. 2010 May;31:1683–1689.
  • Niedermeyer E. The normal EEG of the waking adult. In: Niedermeyer E, Lopes Da Silva F, editors. Electroencephalography Basic Principles Clinical Applications and Related Fields. Baltimore MD: Williams & Wilkins; 2005. p. 167–192.
  • Balconi M, Pozzoli U. Arousal effect on emotional face comprehension: frequency band changes in different time intervals. Physiol Behav. 2009 Jun 22;97:455–462.10.1016/j.physbeh.2009.03.023
  • Andersen SB, Moore RA, Venables L, Corr PJ, Venebles L. Electrophysiological correlates of anxious rumination. Int J Psychophysiol. 2009 Feb;71:156–169.10.1016/j.ijpsycho.2008.09.004
  • Pfurtscheller G. Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin Neurophysiol. 1999 Nov;110:1842–1857.10.1016/S1388-2457(99)00141-8
  • Lehtelä L, Salmelin R, Hari R. Evidence for reactive magnetic 10-Hz rhythm in the human auditory cortex. Neurosci Lett. 1997 Jan;222:111–114.10.1016/S0304-3940(97)13361-4
  • Pfurtscheller G, Brunner C, Schlögl A. Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks. Neuroimage. 2006 May;31:153–159.10.1016/j.neuroimage.2005.12.003
  • Klimesch W, Sauseng P, Hanslmayr S. EEG alpha oscillations: the inhibition-timing hypothesis. Brain Res Rev Jan. 2007;53:63–88.10.1016/j.brainresrev.2006.06.003
  • Coan JA, Allen JJB. Frontal EEG asymmetry as a moderator and mediator of emotion. Biol Psychol. 2004 Oct;67:7–50.10.1016/j.biopsycho.2004.03.002
  • Silberman E. Hemispheric lateralization of functions related to emotion. Brain Cogn. 1986 Jul;5:322–353.10.1016/0278-2626(86)90035-7
  • Engels AS, Heller W, Mohanty A, Herrington JD, Banich MT, Webb AG, et al. Specificity of regional brain activity in anxiety types during emotion processing. Psychophysiology. 2007 May;44:352–363.10.1111/psyp.2007.44.issue-3
  • Huster RJ, Stevens S, Gerlach AL, Rist F. A spectralanalytic approach to emotional responses evoked through picture presentation. Int J Psychophysiol. 2009 May;72:212–216.10.1016/j.ijpsycho.2008.12.009
  • Balconi M, Mazza G. Lateralisation effect in comprehension of emotional facial expression: a comparison between EEG alpha band power and behavioural inhibition (BIS) and activation (BAS) systems. Laterality. Psychology Press; 2010 May;15:361–384.
  • Schmidt LA, Trainor LJ. Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cogn Emot. Psychology Press, part of the Taylor & Francis. Group. 2001 Jul;15:487–500.
  • Altenmüller E, Schürmann K, Lim VK, Parlitz D. Hits to the left, flops to the right: different emotions during listening to music are reflected in cortical lateralisation patterns. Neuropsychologia. 2002;40:2242–2256.10.1016/S0028-3932(02)00107-0
  • Tsang CD, Trainor LJ, Santesso DL, Tasker SL, Schmidt LA. Frontal EEG Responses as a Function of Affective Musical Features. Ann N Y Acad Sci. 2006 Jan 25;930:439–442.10.1111/(ISSN)1749-6632
  • Jones NA, Fox NA. Electroencephalogram asymmetry during emotionally evocative films and its relation to positive and negative affectivity. Brain Cogn. 1992 Nov;20:280–299.10.1016/0278-2626(92)90021-D
  • Barry RJ, Clarke AR, Johnstone SJ, Magee CA, Rushby JA. EEG differences between eyes-closed and eyes-open resting conditions. Clin Neurophysiol. 2007 Dec;118:2765–2773.10.1016/j.clinph.2007.07.028
  • Barry RJ, Clarke AR, Johnstone SJ, Brown CR. EEG differences in children between eyes-closed and eyes-open resting conditions. Clin Neurophysiol. 2009 Oct;120:1806–1811.10.1016/j.clinph.2009.08.006
  • Nowlis DP, Kamiya J. The control of electroencephalographic alpha rhythms through auditory feedback and the associated mental activity. Psychophysiology. 1970;6:476–484.10.1111/psyp.1970.6.issue-4
  • Teplan M, Krakovska A. EEG features of psycho-physiological relaxation. Proceedings of the 2nd International Symposium on Applied Sciences in Biomedical and Communication Technologies (ISABEL 2009). Bratislava, Slovakia: IEEE; 2009. p. 1–4.
  • Neuper C, Wörtz M, Pfurtscheller G. ERD/ERS patterns reflecting sensorimotor activation and deactivation. Prog Brain Res. 2006 Prog Brain Res;159:211–222.10.1016/S0079-6123(06)59014-4
  • Pfurtscheller G, Stancák A, Neuper C. Post-movement beta synchronization. A correlate of an idling motor area? Electroencephalogr Clin Neurophysiol. 1996 Apr;98:281–293.10.1016/0013-4694(95)00258-8
  • Engel AK, Fries P. Beta-band oscillations–signalling the status quo? Curr Opin Neurobiol. 2010 Apr;20:156–165.10.1016/j.conb.2010.02.015
  • Cole HW, Ray WJ. EEG correlates of emotional tasks related to attentional demands. Int J Psychophysiol. 1985 Jul;3:33–41.10.1016/0167-8760(85)90017-0
  • Onton J, Makeig S. High-frequency Broadband Modulations of Electroencephalographic Spectra. Front Hum Neurosci. 2009;3:1--18.
  • Dan Glauser ES. Neuronal Processes Involved in Subjective Feeling Emergence: Oscillatory Activity During an Emotional Monitoring Task. Brain Topogr. 2008 Jun;20:224–231.10.1007/s10548-008-0048-3
  • Goncharova I, McFarland D, Vaughan T, Wolpaw J. EMG contamination of EEG: spectral and topographical characteristics. Clin Neurophysiol. 2003 Sep;114:1580–1593.10.1016/S1388-2457(03)00093-2
  • Fries P. Neuronal gamma-band synchronization as a fundamental process in cortical computation. Annu Rev Neurosci. 2009 Jan;32:209–224.10.1146/annurev.neuro.051508.135603
  • Gruber T, Müller MM, Keil A, Elbert T. Selective visual-spatial attention alters induced gamma band responses in the human EEG. Clin Neurophysiol. Elsevier; 1999;110:2074–2085.10.1016/S1388-2457(99)00176-5
  • Senkowski D, Schneider TR, Tandler F, Engel AK. Gamma-band activity reflects multisensory matching in working memory. Exp Brain Res. 2009;198:363–372.10.1007/s00221-009-1835-0
  • Jensen O, Kaiser J, Lachaux J-PP. Human gamma-frequency oscillations associated with attention and memory. Trends Neurosci. 2007 Jul;30:317–324.10.1016/j.tins.2007.05.001
  • Ward LM. Synchronous neural oscillations and cognitive processes. Trends Cogn Sci. 2003 Dec;7:553–559.10.1016/j.tics.2003.10.012
  • Müller MM, Keil A, Gruber T, Elbert T. Processing of affective pictures modulates right-hemispheric gamma band EEG activity. Clin Neurophysiol. 1999 Nov;110:1913–1920.10.1016/S1388-2457(99)00151-0
  • Aftanas LI, Reva NV, Varlamov AA, Pavlov SV, Makhnev VP. Analysis of evoked EEG synchronization and desynchronization in conditions of emotional activation in humans: temporal and topographic characteristics. Neurosci Behav Physiol. 2004 Oct;34:859–867.10.1023/B:NEAB.0000038139.39812.eb
  • Keil A, Müller MM, Gruber T, Wienbruch C, Stolarova M, Elbert T. Effects of emotional arousal in the cerebral hemispheres: a study of oscillatory brain activity and event-related potentials. Clin Neurophysiol. 2001 Nov;112:2057–2068.10.1016/S1388-2457(01)00654-X
  • Gross J, Schnitzler A, Timmermann L, Ploner M. Gamma oscillations in human primary somatosensory cortex reflect pain perception. PLoS Biol. 2007 May;5:e133.10.1371/journal.pbio.0050133
  • Senkowski D, Kautz J, Hauck M, Zimmermann R, Engel AK. Emotional Facial Expressions Modulate Pain-Induced Beta and Gamma Oscillations in Sensorimotor Cortex. J Neurosci. 2011 Oct;31:14542–14550.10.1523/JNEUROSCI.6002-10.2011
  • Hinrichs H, Machleidt W. Basic emotions reflected in EEG-coherences. Int J Psychophysiol. 1992 Dec;13:225–232.10.1016/0167-8760(92)90072-J
  • Costa T, Rognoni E, Galati D. EEG phase synchronization during emotional response to positive and negative film stimuli. Neurosci Lett. 2006;406:159–164.10.1016/j.neulet.2006.06.039
  • Martini N, Menicucci D, Sebastiani L, Bedini R, Pingitore A, Vanello N, et al. The dynamics of EEG gamma responses to unpleasant visual stimuli: From local activity to functional connectivity. Neuroimage. 2012;60:922–932.10.1016/j.neuroimage.2012.01.060
  • Aftanas LI, Lotova NVKoshkarov VI, Makhnev VP, Mordvintsev YN, Popov SA. Non-linear dynamic complexity of the human EEG during evoked emotions. Int J Psychophysiol. 1998 Jan;28:63–76.10.1016/S0167-8760(97)00067-6
  • Choppin A. EEG-Based Human Interface for Disabled Individuals: Emotion Expression with Neural Networks. Information processing. Yokohama, Japan: Tokyo institute of technology; 2000.
  • Chanel G, Rebetez C, Bétrancourt M, Pun T. Emotion Assessment from Physiological Signals for Adaptation of Games Difficulty. IEEE Trans Syst Man Cybern Part A. 2011;41:1052–1063.10.1109/TSMCA.2011.2116000
  • Westermann R, Spies K, Stahl G, Hesse FW. Relative effectiveness and validity of mood induction procedures: a meta-analysis. Eur J Soc Psychol. 1996 Jul;26:557–580.10.1002/(ISSN)1099-0992
  • Soleymani M, Pantic M, Pun T. Multimodal Emotion Recognition in Response to Videos. IEEE Trans Affect Comput. 2012 Apr;3:211–223.10.1109/T-AFFC.2011.37
  • Koelstra S, Patras I. Fusion of facial expressions and EEG for implicit affective tagging. Image Vis Comput. Elsevier B.V; 2013 Feb;31:164–174.10.1016/j.imavis.2012.10.002
  • Stephens CL, Christie IC, Friedman BH. Autonomic specificity of basic emotions: evidence from pattern classification and cluster analysis. Biol Psychol. 2010 Jul;84:463–473.10.1016/j.biopsycho.2010.03.014
  • Zhou F, Qu X, JJiao, Helander MG. Emotion Prediction from Physiological Signals: A Comparison Study Between Visual and Auditory Elicitors. Interact Comput. 2013, in press, published online Aug 1.
  • Kothe C, Makeig S, Onton J. Emotion Recognition from EEG during Self-Paced Emotional Imagery. International Conference on Affective Computing and Intelligent Interaction. Geneva, Swizerland; 2013. p. 855–858.
  • Chanel G, Kierkels JJM, Soleymani M, Pun T. Short-term emotion assessment in a recall paradigm. Int J Hum Comput Stud. 2009;67:607–627.10.1016/j.ijhcs.2009.03.005
  • Grandjean D, Scherer K. Unpacking the cognitive architecture of emotion processes. Emotion. 2008 Jun;8:341–351.10.1037/1528-3542.8.3.341
  • Lang PJ, Bradley MM, Cuthbert BN. International affective picture system (IAPS): digitized photographs, instruction manual and affective ratings. Gainesville, FL: University of Florida; 2005.
  • Fontaine JR, Scherer KR, Roesch EB, Ellsworth PC. The world of emotions is not two-dimensional. Psychol Sci. 2007;18:1050–1057.10.1111/j.1467-9280.2007.02024.x
  • Moghimi S, Kushki A, Power S, Guerguerian AM, Chau T. Automatic detection of a prefrontal cortical response to emotionally rated music using multi-channel near-infrared spectroscopy. J Neural Eng. 2012 Apr;9.
  • Frantzidis CA, Bratsas C, Papadelis CL, Konstantinidis E, Pappas C, Bamidis PD. Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli. IEEE Trans Inf Technol Biomed. 2010 May;14:589–597.10.1109/TITB.2010.2041553
  • Gürkök H, Nijholt A. Brain–Computer Interfaces for Multimodal Interaction: A Survey and Principles. Int J Hum Comput Interact. 2012 May;28:292–307.10.1080/10447318.2011.582022
  • Hua J, Xiong Z, Lowey J, Suh E, Dougherty ER. Optimal number of features as a function of sample size for various classification rules. Bioinformatics. 2005;21:1509–1515.10.1093/bioinformatics/bti171
  • Takahashi K. Remarks on SVM-based emotion recognition from multi-modal bio-potential signals. IEEE International Workshop on Robot and Human Interactive Communication. Kurashiki, Okayama, Japan: IEEE; 2004. p. 95–100.
  • Petrantonakis PC, Hadjileontiadis LJ. Emotion Recognition from Brain Signals Using Hybrid Adaptive Filtering and Higher Order Crossings Analysis. IEEE Trans Affect Comput. Published by the IEEE Computer Society; 2010 Jul 17;1:81–97.10.1109/T-AFFC.2010.7
  • Ansari-Asl K, Chanel G, Pun T. A channel selection method for EEG classification in emotion assessment based on synchronization likelihood. 15th European Signal Processing Conference (Eusipco 2007). Poznan, Poland. 2007. p. 1241–1245.
  • Van Boxte A. Optimal signal bandwidth for the recording of surface EMG activity of facial, jaw, oral, and neck muscles. Psychophysiology. United States; 2001;38:22–34.10.1111/psyp.2001.38.issue-1
  • Hidalgo-Muñoz AR, López MM, Pereira AT, Santos IM, Tomé AM. Spectral turbulence measuring as feature extraction method from EEG on affective computing. Biomed Signal Process Control. 2013 Nov;8:945–950.10.1016/j.bspc.2013.09.006
  • Sander D, Grandjean D, Scherer KR. A systems approach to appraisal mechanisms in emotion. Neural Networks. Elsevier Science Ltd; 2005 May;18:317–352.10.1016/j.neunet.2005.03.001
  • ZKhalili, MHMoradi. Emotion Recognition System Using Brain and Peripheral Signals: Using Correlation Dimension to Improve the Results of EEG. International Joint Conference on Neural Networks. Atlanta, GA: IEEE; 2009. p. 1571–1575.
  • Ekman I, Chanel G, Jarvela S, Kivikangas JM, Salminen M, Ravaja N. Social Interaction in Games: Measuring Physiological Linkage and Social Presence. Simul Gaming. 2012;43:321–338.10.1177/1046878111422121
  • Stam CJ. Nonlinear dynamical analysis of EEG and MEG: Review of an emerging field. Clin Neurophysiol. Elsevier; 2005;116:2266–2301.10.1016/j.clinph.2005.06.011
  • Tangermann M, Müller KR, Aertsen A, Birbaumer N, Braun C, Brunner C, et al. Review of the BCI competition IV. Front Neurosci. Frontiers Media SA; 2012;6.
  • Fazli S, Grozea C, Danóczy M, Blankertz B, Popescu F, Müller K-R. Subject independent EEG-based BCI decoding. Advances in Neural Information Processing Systems (NIPS) 22. 2009. p. 513–521.
  • Alamgir M, Grosse-Wentrup M, Altun Y. Multitask Learning for Brain-Computer Interfaces. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2010). 2010. p. 17–24.
  • Winkler, I, Haufe, S, Tangermann, M. Automatic Classification of Artifactual ICA-Components for Artifact Removal in EEG Signals. Behav brain Funct BBF. BioMed Central; 2011;7:30.10.1186/1744-9081-7-30
  • Gao J, Zheng C, Wang P. Online removal of muscle artifact from electroencephalogram signals based on canonical correlation analysis. Clin EEG Neurosci. 2010 Jan;41:53–59.10.1177/155005941004100111
  • Mühl C, Brouwer A-M, van Wouwe N, van den Broek EL, Nijboer F, Heylen DKJ. Modality-specific Affective Responses and their Implications for Affective BCI. In: Müller-Putz GR, Scherer R, Billinger M, Kreilinger A, Kaiser V, Neuper C, editors. Proceedings of the Fifth International Brain-Computer Interface Conference 2011. Graz, Austria: Verlag der Technischen Universität; 2011. p. 120–123.
  • Chanel G, Kronegg J, Grandjean D, Pun T. Emotion Assessment: Arousal Evaluation Using EEG’s and Peripheral Physiological Signals. In: Gunsel B, Jain AK, Tekalp AM, Sankur B, editors. Multimedia Content Representation, Classification and Security. 2005. Istambul: Springer; 2006. p. 530–537.
  • Chanel G, Kierkels JJM, Soleymani M, Pun T. Short-term emotion assessment in a recall paradigm. Int J Hum Comput Stud. 2009;67:607–627.10.1016/j.ijhcs.2009.03.005
  • Lin YP, Wang CH, Jung TP, Wu TL, Jeng SK, Duann JR, et al. EEG-Based Emotion Recognition in Music Listening. IEEE Trans Biomed Eng. 2010;57:1798–1806.
  • Koelstra S, Muhl C, Soleymani M, Lee J, Yazdani T, Ebrahimi T, et al. DEAP: A Database for Emotion Analysis using Physiological Signals. IEEE Trans Affect Comput. 2012;3:18–31.10.1109/T-AFFC.2011.15
  • Zhang Q, Lee M. Emotion development system by interacting with human EEG and natural scene understanding. Cogn Syst Res. 2011 Jan 15;14:49–37.
  • Abadi MK, Kia SM, Subramanian R, Avesani P, Sebe N. User-centric Affective Video Tagging from MEG and Peripheral Physiological Responses. Affective Computing and Intelligent Interaction. Switzerland: Geneva; 2013.
  • Kothe Christian Andreas Onton JA, Makeig S. Emotion Recognition from EEG During Self-Paced Emotional Imagery. Affective Computing and Intelligent Interaction. Geneva, Swizerland; 2013. p. 855–858.
  • Heger D, Mutter R, Herff C, Putze F, Schultz T. Continuous Recognition of Affective States by Functional Near Infrared Spectroscopy Signals. Affective Computing and Intelligent Interaction. Switzerland: Geneva; 2013.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.