Continuous affective states recognition using functional near infrared spectroscopy

References

• Picard RW. Affective computing. MIT press; 2000.
   Google Scholar
• D’Mello SK, Craig SD, Witherspoon A, Mcdaniel B, Graesser A. Automatic detection of learners affect from conversational cues. User Modeling and User-Adapted Interaction. 2008;18:45–80.10.1007/s11257-007-9037-6
   Google Scholar
• Nasoz F, Lisetti CL, Vasilakos AV. Affectively intelligent and adaptive car interfaces. Inf Sci. 2010;180:3817–3836.10.1016/j.ins.2010.06.034
   Google Scholar
• Heger D, Putze F, Schultz T. An eeg adaptive information system for an empathic robot. Int J Soc Rob. 2011;3:415–425.10.1007/s12369-011-0107-x
   Google Scholar
• Moore D, Cheng Y, McGrath P, Powell NJ. Collaborative virtual environment technology for people with autism. Focus on Autism and Other Developmental Disabilities. 2005;20:231–243.10.1177/10883576050200040501
   Google Scholar
• Kaliouby Re, Picard R, Baron-Cohen S. Affective computing and autism. Ann NY Acad Sci. 2006;1093:228–248.10.1196/annals.1382.016
   Google Scholar
• Rolls ET. The orbitofrontal cortex and reward. Cerebral cortex. 2000;10:284–294.10.1093/cercor/10.3.284
   Google Scholar
• LeDoux JE. Emotion circuits in the brain. Annu Rev Neurosci. 2000;23:155–184.10.1146/annurev.neuro.23.1.155
   Google Scholar
• Bush G, Luu P, Posner MI. Cognitive and emotional influences in anterior cingulate cortex. Trends in Cognitive Sci. 2000;4:215–222.10.1016/S1364-6613(00)01483-2
   Google Scholar
• Damasio AR, Grabowski TJ, Bechara A, Damasio H, Ponto LL, Parvizi J, Hichwa RD. Subcortical and cortical brain activity during the feeling of self-generated emotions. Nat Neurosci. 2000;3:1049–1056.10.1038/79871
   Google Scholar
• Davidson RJ, Ekman P, Saron CD, Senulis JA, Friesen WV. Approach-withdrawal and cerebral asymmetry: Emotional expression and brain physiology: I. J Personality Soc Psychol. 1990;58:330–341.10.1037/0022-3514.58.2.330
   Google Scholar
• Doi H, Nishitani S, Shinohara K. Nirs as a tool for assaying emotional function in the prefrontal cortex. Front Human Neurosci. 2013;7.
   Google Scholar
• Bechara A, Damasio H, Damasio AR. Emotion, decision making and the orbitofrontal cortex. Cerebral cortex. 2000;10:295–307.10.1093/cercor/10.3.295
   Google Scholar
• Zander TO, Kothe C. Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general. J Neural Eng. 2011;8:025005.10.1088/1741-2560/8/2/025005
   Google Scholar
• Garcia-Molina G, Tsoneva T, Nijholt A. Emotional brain–computer interfaces. Int J of Auton Adapt Commun Syst. 2013;6:9–25.10.1504/IJAACS.2013.050687
   Google Scholar
• Sassaroli A, Fantini S. Comment on the modified beerlambert law for cattering media. Phys Med Biol. 2004;49:N255–N257.
   Google Scholar
• Heger D, Mutter R, Herff C, Putze F, Schultz T. “Continuous recognition of affective states by functional near infrared spectroscopy signals”, in Affective Computing and Intelligent Interaction (ACII). IEEE. 2013;832–837. ISSN 2156-8103.
   Google Scholar
• Jerritta S, Murugappan M, Nagarajan R, Wan K. “Physiological signals based human emotion recognition: a review,” in Signal Processing and its Applications (CSPA), 2011 IEEE 7th International Colloquium on. IEEE. 2011;410–415. ISBN 978-1-61284-414-5.
   Google Scholar
• El Ayadi M, Kamel MS, Karray F. Survey on speech emotion recognition: Features, classification schemes, and databases. Pattern Recognit. 2011;44:572–587.10.1016/j.patcog.2010.09.020
   Google Scholar
• Lang PJ, Bradley MM, Cuthbert BN. International affective picture system (iaps): Technical manual and affective ratings. Gainesville, FL: Technical report of University of Florida; 1999.
   Google Scholar
• Ekman P, et al. Facial expression and emotion. Am Psycho. 1993;48:384–392.10.1037/0003-066X.48.4.384
   Google Scholar
• Russell JA, Mehrabian A. Evidence for a three-factor theory of emotions. J Res Personality. 1977;11:273–294.10.1016/0092-6566(77)90037-X
   Google Scholar
• Lang P, Bradley MM. The international affective picture system (iaps) in the study of emotion and attention. Handbook of emotion elicitation and assessment. 2007;29–46.
   Google Scholar
• Bradley MM, Lang PJ. The international affective digitized sounds (; iads-2): Affective ratings of sounds and instruction manual. University of Florida, Gainesville, FL: Tech. Rep. B-3; 2007.
   Google Scholar
• Herrmann M, Ehlis A, Fallgatter A. Prefrontal activation through task requirements of emotional induction measured with nirs. Biol Psycho. 2003;64:255–263.10.1016/S0301-0511(03)00095-4
   Google Scholar
• Hoshi Y, Huang J, Kohri S, Iguchi Y, Naya M, Okamoto T, Ono S. Recognition of human emotions from cerebral blood flow changes in the frontal region: A study with event-related near-infrared spectroscopy. J Neuroimaging. 2011;21:e94–e101.10.1111/jon.2011.21.issue-2
   Google Scholar
• Morinaga K, Akiyoshi J, Matsushita H, Ichioka S, Tanaka Y, Tsuru J, Hanada H. Anticipatory anxiety-induced changes in human lateral prefrontal cortex activity. Biol Psycho. 2007;74:34–38.10.1016/j.biopsycho.2006.06.005
   Google Scholar
• Kreplin U, Fairclough SH. Activation of the rostromedial prefrontal cortex during the experience of positive emotion in the context of aesthetic experience. an fnirs study. Front Human Neurosci. 2013;7.
   Google Scholar
• Leon-Carrion J, Damas J, Izzetoglu K, Pourrezai K, Martin-Rodriguez JF, Martin JMBy, Dominguez-Morales MR. Differential time course and intensity of pfc activation for men and women in response to emotional stimuli: a functional near-infrared spectroscopy (fnirs) study. Neurosci Lett. 2006;403:90–95.10.1016/j.neulet.2006.04.050
   Google Scholar
• Yang H, Zhou Z, Liu Y, Ruan Z, Gong H, Luo Q, Lu Z. Gender difference in hemodynamic responses of prefrontal area to emotional stress by near-infrared spectroscopy. Behav Brain Res. 2007;178:172–176.10.1016/j.bbr.2006.11.039
   Google Scholar
• Glotzbach E, Mühlberger A, Gschwendtner K, Fallgatter AJ, Pauli P, Herrmann MJ. Prefrontal brain activation during emotional processing: A functional near infrared spectroscopy study (fnirs). The open neuroimaging journal. 2011;5:33–39.10.2174/1874440001105010033
   Google Scholar
• Sitaram R, Zhang H, Guan C, Thulasidas M, Hoshi Y, Ishikawa A, Shimizu K, Birbaumer N. Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface. NeuroImage. 2007;34:1416–1427.10.1016/j.neuroimage.2006.11.005
   Google Scholar
• Coyle SM, Ward TE, Markham CM. Brain–computer interface using a simplified functional near-infrared spectroscopy system. J Neural Eng. 2007;4:219.10.1088/1741-2560/4/3/007
   Google Scholar
• Girouard A. “Adaptive brain-computer interface,” in CHI ‘09 Extended Abstracts on Human Factors in Computing Systems, ser. CHI EA ’09. 2009; 3097–3100. doi: 10.1145/1520340.1520436
   Google Scholar
• Ang KK, Guan C, Lee K, Lee JQ, Nioka S, Chance B. A brain-computer interface for mental arithmetic task from singletrial near-infrared spectroscopy brain signals, in Pattern Recognition (ICPR), 20th International Conference on. IEEE. 2010; 3764–3767.
   Google Scholar
• Herff C, Putze F, Heger D, Guan C, Schultz T Speaking mode recognition from functional near infrared spectroscopy, in Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE. IEEE. 2012; 1715–1718.
   Google Scholar
• Herff, C, Heger, D, Putze, F, Hennrich, J, Fortmann, O, Schultz, T. Classification of mental tasks in the prefrontal cortex using fnirs, in Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE. IEEE. 2013;2160–2163.
   Google Scholar
• Tai K, Chau T. Single-trial classification of nirs signals during emotional induction tasks: towards a corporeal machine interface. J Neuroengineering and Rehabil. 2009;6:39.10.1186/1743-0003-6-39
   Google Scholar
• Hosseini S, Mano Y, Rostami M, Takahashi M, Sugiura M, Kawashima R. Decoding what one likes or dislikes from single-trial fnirs measurements. Neuroreport. 2011;269–273.10.1097/WNR.0b013e3283451f8f
   Google Scholar
• Moghimi S, Kushki A, Power S, Guerguerian AM, Chau T. Automatic detection of a prefrontal cortical response to emotionally rated music using multi-channel near-infrared spectroscopy. J Neural Eng. 2012;9:026022.10.1088/1741-2560/9/2/026022
   Google Scholar
• Asano H, Sagami T, Ide H. The evaluation of the emotion by near-infrared spectroscopy. Artif Life Rob. 2013;17:452–456.10.1007/s10015-012-0083-8
   Google Scholar
• Amma C, Fischer A, Stein T, Schwameder H, Schultz T. Emotionserkennung auf der Basis von Gangmustern, in Sportinformatik trifft Sporttechnologie, Tagung der dvs-Sektion Sportinformatik, 2010.
   Google Scholar
• Matthews F, Pearlmutter B, Ward T, Soraghan C, Markham C. Hemodynamics for brain-computer interfaces. Signal Processing Magazine, IEEE. 2008;25:87–94.10.1109/MSP.2008.4408445
   Google Scholar
• Cooper R, Selb J, Gagnon L, Phillip D, Schytz H, Iversen H, Ashina M, Boas D. A systematic comparison of motion artifact correction techniques for functional near-infrared spectroscopy. Front Neurosci. 2012;6:147.
   Google Scholar
• Molavi B, Dumont GA. Wavelet-based motion artifact removal for functional near-infrared spectroscopy. Physiol Meas. 2012;33:259.10.1088/0967-3334/33/2/259
   Google Scholar
• Khoa TQD, Nakagawa M. Functional near infrared spectroscope for cognition brain tasks by wavelets analysis and neural networks. Int J Biol Med Sci. 2008;1:28–33.
   Google Scholar
• Tsunashima H, Yanagisawa K. Measurement of brain function of car driver using functional near-infrared spectroscopy (fnirs). Comput Intell Neurosci. 2009;2009.
   Google Scholar
• Abibullaev B, An J. Classification of frontal cortex haemodynamic responses during cognitive tasks using wavelet transforms and machine learning algorithms. Med Eng Phys. 2012;34:1394–1410.
   Google Scholar
• Mallat SG. A theory for multiresolution signal decomposition: the wavelet representation. Pattern Analysis and Machine Intelligence, IEEE Transactions on. 1989;11:674–693.10.1109/34.192463
   Google Scholar
• Daubechies I. Ten lectures on wavelets. SIAM. 1992;61:1–357.
   Google Scholar
• Ang KK, Chin ZY, Zhang H, Guan C. Mutual information based selection of optimal spatial–temporal patterns for single-trial eeg based bcis. Pattern Recognit. 2012;45:2137–2144.10.1016/j.patcog.2011.04.018
   Google Scholar
• Marathe AR, Ries AJ, McDowell K. A novel method for single-trial classification in the face of temporal variability, in Foundations of Augmented Cognition. Springer. 2013; 345–352.
   Google Scholar
• Bradley MM, Sabatinelli D, Lang PJ, Fitzsimmons JR, King W, Desai P. Activation of the visual cortex in motivated attention. Behav Neurosci. 2003;117:369–380.10.1037/0735-7044.117.2.369
   Google Scholar
• Rauschecker JP, Scott SK. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat Neurosci. 2009;12:718–724.10.1038/nn.2331
   Google Scholar
• Grill-Spector K, Malach R. The human visual cortex. Annu Rev Neurosci. 2004;27:649–677.10.1146/annurev.neuro.27.070203.144220
   Google Scholar