A concept for emotion recognition systems for children with profound intellectual and multiple disabilities based on artificial intelligence using physiological and motion signals

References

• Chou YC, Chiao C, Fu LY. Health status, social support, and quality of life among family carers of adults with profound intellectual and multiple disabilities (PIMD) in Taiwan. J Intellect Dev Disabil. 2011;36(1):73–79.
   PubMed Web of Science ®Google Scholar
• Suzuki Y, Tatsuno M, Yamada M. [Seriously handicapped children with intensive medical cares.] J Child Health. 1995;54(3):406–410. Japanese.
   Google Scholar
• Mesquita B, Frijda NH. Cultural variations in emotions: a review. Psychol Bull. 1992;112(2):179–204.
   PubMed Web of Science ®Google Scholar
• Hutchison A, Gerstein L. Emotion recognition, emotion expression, and cultural display rules: implications for counseling. J Asia Pac. Couns. 2017;7(1):19–35.
   Google Scholar
• Mencap. [Internet]. Communicating with people with profound and multiple learning disabilities (PMLD); [cited 2022 Feb]. Available from: https://www.jpaget.nhs.uk/media/104336/Communicating_with_people_with_PMLD__a_guide__1_.pdf.
   Google Scholar
• Adams D, Oliver C. The expression and assessment of emotions and internal states in individuals with severe or profound intellectual disabilities. Clin Psychol Rev. 2011;31(3):293–306.
   PubMed Web of Science ®Google Scholar
• Ekman P, Freisen WV, Ancoli S. Facial signs of emotional experience. J Pers Soc Psychol. 1980;39(6):1125–1134.
   Web of Science ®Google Scholar
• Nozaki Y, Kawasumi R. [Challenges for teachers instructing children with severe motor and intellectual disabilities and medical care dependent groups]. Annu Bull Grad Sch Educ Tohoku Univ. 2012;60(2):225–241. Japanese.
   Google Scholar
• Matsuda T. [Support of school children]. Jpn J Dev Disabil. 2003;25:150–158. Japanese.
   Google Scholar
• Okazawa S, Kawasumi R. [Educational approaches to a boy with profound and multiple disabilities]. Jpn Assoc Spec Educ. 2005;43:203–214. Japanese.
   Google Scholar
• Abe S, Tsujino M, Nakata S, et al. [Nonverbal communication of children with profound intellectual and multiple disabilities having visual and auditory disorders]. J Jpn Soc Nurs Sci Natl Health Serv. 2007;3(1):38–42. Japanese.
   Google Scholar
• Araki H, Iwamoto Y, Arima M. [Development of communication support system for children (persons) with severe motor and intellectual disabilities]. Jpn J Ergon. 2016;52(Suppl):290–291. Japanese.
   Google Scholar
• Sesin A, Adjouadi M, Cabrerizo M, et al. Adaptive eye-gaze tracking using neural-network-based user, profiles to assist people with motor disability. J Rehabil Res Dev. 2008;45(6):801–817.
   PubMedGoogle Scholar
• Falk TH, Guirgis M, Power S, et al. Taking NIRS-BCIs outside the lab: towards achieving robustness against environment noise. IEEE Trans Neural Syst Rehabil Eng. 2011;19(2):136–146.
   PubMed Web of Science ®Google Scholar
• Harada A, Landay JA, Malkin J, et al. The vocal joystick evaluation of voice-based cursor control techniques for assistive technology. Disabil Rehabil Assist Technol. 2008;3(1):22–34.
   PubMedGoogle Scholar
• Struijk LNSA, Lontis ER, Gaihede M, et al. Development and functional demonstration of a wireless intraoral inductive tongue computer interface for severely disabled persons. Disabil Rehabil Assist Technol. 2017;12(6):631–640.
   PubMedGoogle Scholar
• Kitajima Y. [Studies on children with severe motor and intellectual disabilities using physiological psychology indices]. Jpn Assoc Spec Educ. 2005;43:225–231. Japanese.
   Google Scholar
• Sakamoto K, Sakashita S, Yamashita K, et al. [Effect of TV viewers’ emotional states on physiological and psychological measurements]. Panasonic Tech J. 2013;59(1):29–34. Japanese.
   Google Scholar
• Murase C, Kawamoto R, Sugimoto S. [Changing of emotions by the stimulation of visual and auditory senses –an analysis of heart rate variability (HRV)]. J Uoeh. 2004;26(4):461–471. Japanese.
   PubMedGoogle Scholar
• Valderas MT, Bolea J, Laguna P, et al. Human emotion recognition using heart rate variability analysis with spectral bands based on respiration. Proc 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC); 2015 Aug 25–29; Milan, Italy. p. 6134–6137.
   Google Scholar
• Ooe H, Yamada T, Kobayashi I. [Behavior in person with profound intellectual and multiple disabilities]. Proc Jpn Assoc Spec Educ 43rd Conf; 2005 Sep 23–25; Kanazawa, Japan. p. 222. Japanese.
   Google Scholar
• Hayano J, Tanabiki T, Iwata S, et al. Estimation of emotions by wearable biometric sensors under daily activities. Proc IEEE 7th Global Conference on Consumer Electronics (GCCE); 2018 Oct 9–12; Nara, Japan. p. 268–269.
   Google Scholar
• Garg A, Chaturvedi V, Kaur AB, et al. Machine learning model for mapping of music mood and human emotion based on physiological signals. Multimed Tools Appl. 2022;81(4):5137–5177.
   Web of Science ®Google Scholar
• Gąsior JS, Zamunér AR, Silva LEV, et al. Heart rate variability in children and adolescents with cerebral palsy–a systematic literature review. JCM. 2020;9(4):1141.
   Google Scholar
• McCarthy J. [Internet]. What is artificial intelligence?; [cited 2022 Sept]. Available from: http://www-formal.stanford.edu/jmc/whatisai/whatisai.html.
   Google Scholar
• Arrieta AB, Diaz-Rodriguez N, Ser JD, et al. Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inf Fusion. 2020;58:82–115.
   Web of Science ®Google Scholar
• Hidecker MJ, Paneth N, Rosenbaum PL, et al. Developing and validating the communication function classification system for individuals with cerebral palsy. Dev Med Child Neurol. 2011;53(8):704–710.
   PubMed Web of Science ®Google Scholar
• Palisano R, Rosenbaum P, Walter S, et al. Development and reliability of a system to classify gross motor function in children with cerebral palsy. Dev Med Child Neurol. 1997;39(4):214–223.
   PubMed Web of Science ®Google Scholar
• Palisano RJ, Rosenbaum P, Bartlett D, et al. Content validity of the expanded and revised gross motor function classification system. Dev Med Child Neurol. 2008;50(10):744–750.
   PubMed Web of Science ®Google Scholar
• Malik M, Bigger JT, Camm J, et al. Heart rate variability: standards of measurement, physiological interpretation and clinical use. Eur Heart J. 1996;17(3):354–381.
   PubMed Web of Science ®Google Scholar
• Li G, Yu Y. Visual saliency based on multiscale deep features. Proc 2015 IEEE Conference on computer vision and pattern recognition (CVPR); 2015 Jun 7–12; Boston. p.5455–5463.
   Google Scholar
• Nakamura H. Back to basics series: biomedical measurement 1 (electromyography). Trans Jpn Soc Med Biol Eng. 2019;57(4,5):149–157.
   Google Scholar
• Habe H. [Random forests: fundamentals and recent trends]. J ITE. 2016;70(9):788–791. Japanese.
   Google Scholar
• Pedregosa F, Varoquaux G, Gramfort A, et al. Scikit-learn: machine learning in python. J Mach Learn Res. 2011;12:2825–2830.
   Web of Science ®Google Scholar
• Atkin K, Lorch MP. An ecological method for the sampling of nonverbal signalling behaviours of young children with profound and multiple learning disabilities (PMLD). Dev Neurorehabil. 2016;19(4):211–225.
   PubMed Web of Science ®Google Scholar
• Choi KH, Kim J, Kwon OS, et al. Is heart rate variability (HRV) an adequate tool for evaluating human emotions? A focus on the use of the international affective picture system (IAPS). Psychiatry Res. 2017;251:192–196.
   PubMed Web of Science ®Google Scholar
• Japan Meteorological A. [Internet]. About TCC (Ensemble Prediction System); [cited 2022 Sept] Available from: https://ds.data.jma.go.jp/tcc/tcc/about/products/aboutModel.html.
   Google Scholar
• James G, Witten D, Hastie T, et al. An introduction to statistical learning. New York (NY): Springer; 2013.
   Google Scholar
• Riquelme I, Rosário RS, Vehmaskoski K, et al. Autonomous nervous system regulation of pain in children with cerebral palsy. Brain Inj. 2021;35(3):356–362.
   PubMed Web of Science ®Google Scholar
• Pagani M, Lombardi F, Guzzetti S, et al. Power spectral analysis of heart rate and arterial pressure variabilities as a marker of sympatho-vagal interaction in man and conscious dog. Circ Res. 1986;59(2):178–193.
   PubMed Web of Science ®Google Scholar
• Borgestig M, Rytterström P, Hemmingsson H. Gaze-based assistive technology used in daily life by children with severe physical impairments – parents’ experiences. Dev Neurorehabil. 2017;20(5):301–308.
   PubMed Web of Science ®Google Scholar