Effectiveness of virtual reality and computerized training programs for enhancing emotion recognition in people with autism spectrum disorder: a systematic review and meta-analysis

References

• Adjorlu, A. and Serafin, S. 2019. Head-mounted display-based virtual reality as a tool to reduce disruptive behavior in a student diagnosed with autism spectrum disorder. In: Interactivity, game creation, design, learning, and innovation. Berlin/Heidelberg,Germany: Springer, pp. 739–748.
   Google Scholar
• Andrade, C. 2020. Mean difference, standardized mean difference (SMD), and their use in meta-analysis: as simple as it gets. The Journal of Clinical Psychiatry, 81, 20f13681.
   Web of Science ®Google Scholar
• Babu, P. R. K., Oza, P. and Lahiri, U. 2018. Gaze-sensitive virtual reality based social communication platform for individuals with autism. IEEE Transactions on Affective Computing, 9, 450–462.
   Web of Science ®Google Scholar
• Beaumont, R. and Sofronoff, K. 2008. A multi-component social skills intervention for children with Asperger syndrome: The Junior Detective Training Program. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 49(7), 743–753. doi: 10.1111/j.1469-7610.2008.01920.x
   PubMed Web of Science ®Google Scholar
• Begg, C. B. and Mazumdar, M. 1994. Operating characteristics of a rank correlation test for publication bias. Biometrics, 50, 1088–1101. doi:10.2307/2533446
   PubMed Web of Science ®Google Scholar
• Bekele, E., Crittendon, J., Zheng, Z., Swanson, A., Weitlauf, A., Warren, Z. and Sarkar, N. 2014. Assessing the utility of a virtual environment for enhancing facial affect recognition in adolescents with autism. Journal of Autism and Developmental Disorders, 44, 1641–1650.
   PubMed Web of Science ®Google Scholar
• Bekele, E., Zheng, Z., Swanson, A., Crittendon, J., Warren, Z. and Sarkar, N. 2013. Understanding how adolescents with autism respond to facial expressions in virtual reality environments. IEEE Transactions on Visualization and Computer Graphics, 19, 711–720.
   PubMed Web of Science ®Google Scholar
• Billstedt, E., Gillberg, I. C., Gillberg, C. and Gillberg, C. 2005. Autism after adolescence: Population-based 13- to 22-year follow-up study of 120 individuals with autism diagnosed in childhood. Journal of Autism and Developmental Disorders, 35, 351–360.
   PubMed Web of Science ®Google Scholar
• Bölte, S., Ciaramidaro, A., Schlitt, S., Hainz, D., Kliemann, D., Beyer, A., Poustka, F., Freitag, C. and Walter, H. 2015. Training-induced plasticity of the social brain in autism spectrum disorder. The British Journal of Psychiatry, 207, 149–157.
   PubMed Web of Science ®Google Scholar
• Bölte, S., Hubl, D., Feineis-Matthews, S., Prvulovic, D., Dierks, T. and Poustka, F. 2006. Facial affect recognition training in autism: Can we animate the fusiform gyrus? Behavioral Neuroscience, 120, 211–216.
   PubMed Web of Science ®Google Scholar
• Chen, C.-H., Lee, I. J. and Lin, L.-Y. 2016. Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior, 55, 477–485.
   Web of Science ®Google Scholar
• Cheng, Y. F., Chiang, H. C., Ye, J. and Cheng, L. H. 2010. Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions. Computers & Education, 55, 1449–1458.
   Web of Science ®Google Scholar
• Cunha, P., Brandão, J., Vasconcelos, J., Soares, F. and Carvalho, V. 2016. Augmented reality for cognitive and social skills improvement in children with ASD. Proceedings of 2016 13th International Conference on Remote Engineering and Virtual Instrumentation, REV 2016, 334–335.
   Google Scholar
• Didehbani, N., Allen, T., Kandalaft, M., Krawczyk, D. and Chapman, S. 2016. Virtual reality social cognition training for children with high functioning autism. Computers in Human Behavior, 62, 703–711.
   Web of Science ®Google Scholar
• Dixon, D. R., Miyake, C. J., Nohelty, K., Novack, M. N. and Granpeesheh, D. 2020. Evaluation of an immersive virtual reality safety training used to teach pedestrian skills to children with Autism Spectrum Disorder. Behavior Analysis in Practice, 13, 631–640.
   PubMed Web of Science ®Google Scholar
• Dong, H.-Y., Wang, B., Li, H.-H., Yue, X.-J. and Jia, F.-Y. 2021. Correlation between screen time and autistic symptoms as well as development quotients in children with Autism Spectrum Disorder. Front Psychiatry, 12, 140.
   Web of Science ®Google Scholar
• Dores, A., Barbosa, F., Monteiro, L., Reis, M., Coelho, C., Ribeiro, E., Leitao, M., Carvalho, I., de Sousa, L. and Castro-Caldas, A. 2014. Amygdala activation in response to 2D and 3D emotion-inducing stimuli. PsychNology Journal, 12, 29–43.
   Google Scholar
• Egger, M., Smith, G. D., Schneider, M. and Minder, C. 1997. Bias in meta-analysis detected by a simple, graphical test. BMJ (Clinical Research ed.), 315, 629–634.
   PubMed Web of Science ®Google Scholar
• Farashi, S. and Khosrowabadi, R. 2020. EEG based emotion recognition using minimum spanning tree. Physical and Engineering Sciences in Medicine, 43, 985–996.
   PubMedGoogle Scholar
• Garcia-Garcia, J. M., Penichet, V. M. R., Lozano, M. D. and Fernando, A. 2021. Using emotion recognition technologies to teach children with autism spectrum disorder how to identify and express emotions. Universal Access in the Information Society. doi:10.1007/s10209-021-00818-y
   Web of Science ®Google Scholar
• Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V. and Baron-Cohen, S. 2010. Enhancing emotion recognition in children with autism spectrum conditions: An intervention using animated vehicles with real emotional faces. Journal of Autism and Developmental Disorders, 40, 269–279.
   PubMed Web of Science ®Google Scholar
• Golan, O. and Baron-Cohen, S. 2006. Systemizing empathy: Teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia. Development and Psychopathology, 18, 591–617.
   PubMed Web of Science ®Google Scholar
• Gross, T. F. 2008. Recognition of immaturity and emotional expressions in blended faces by children with autism and other developmental disabilities. Journal of Autism and Developmental Disorders, 38, 297–311.
   PubMed Web of Science ®Google Scholar
• Grossard, C., Grynspan, O., Serret, S., Jouen, A. L., Bailly, K. and Cohen, D. 2017. Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD). Computers & Education, 113, 195–211.
   Web of Science ®Google Scholar
• Grynszpan, O., Nadel, J., Martin, J.-C., Simonin, J., Bailleul, P., Wang, Y., Gepner, D., Le Barillier, F. and Constant, J. 2012. Self-monitoring of gaze in high functioning autism. Journal of Autism and Developmental Disorders, 42, 1642–1650.
   PubMed Web of Science ®Google Scholar
• Grynszpan, O., Weiss, P. L., Perez-Diaz, F. and Gal, E. 2014. Innovative technology-based interventions for autism spectrum disorders: a meta-analysis. Autism, 18, 346–361.
   PubMed Web of Science ®Google Scholar
• Harjunen, V. J., Ahmed, I., Jacucci, G., Ravaja, N. and Spapé, M. M. 2017. Manipulating bodily presence affects cross-modal spatial attention: a virtual-reality-based ERP study. Frontiers in Human Neuroscience, 11, 79.
   PubMed Web of Science ®Google Scholar
• Harms, M. B., Martin, A. and Wallace, G. L. 2010. Facial emotion recognition in autism spectrum disorders: A review of behavioral and neuroimaging studies. Neuropsychology Review, 20, 290–322.
   PubMed Web of Science ®Google Scholar
• Hernandez-Mosti, J. P., Cañete Alavez, M., Vaillard Martínez, J., Reza Becerril, D., Moya-Albor, E. and Brieva, J. 2018. Thoughts and emotion assimilation and detonation through VR for people with ASD. Proceedings of SPIE - The International Society for Optical Engineering.
   Google Scholar
• Higgins, J. P. T. and Thompson, S. G. 2002. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21, 1539–1558.
   PubMed Web of Science ®Google Scholar
• Hopkins, I. M., Gower, M. W., Perez, T. A., Smith, D. S., Amthor, F. R., Wimsatt, F. C. and Biasini, F. J. 2011. Avatar assistant: Improving social skills in students with an ASD through a computer-based intervention. Journal of Autism and Developmental Disorders, 41, 1543–1555.
   PubMed Web of Science ®Google Scholar
• Ip, H. H. S., Wong, S. W. L., Chan, D. F. Y., Byrne, J., Li, C., Yuan, V. S. N., Lau, K. S. Y. and Wong, J. Y. W. 2018. Enhance emotional and social adaptation skills for children with autism spectrum disorder: a virtual reality enabled approach. Computers & Education, 117, 1–15.
   Web of Science ®Google Scholar
• Kandalaft, M. R., Didehbani, N., Krawczyk, D. C., Allen, T. T. and Chapman, S. B. 2013. Virtual reality social cognition training for young adults with high-functioning autism. Journal of Autism and Developmental Disorders, 43, 34–44.
   PubMed Web of Science ®Google Scholar
• Kang, E., Keifer, C. M., Levy, E. J., Foss-Feig, J. H., McPartland, J. C. and Lerner, M. D. 2018. Atypicality of the N170 event-related potential in autism spectrum disorder: a meta-analysis. Biological Psychiatry. Cognitive Neuroscience and Neuroimaging, 3, 657–666.
   PubMedGoogle Scholar
• Karami, B., Koushki, R., Arabgol, F., Rahmani, M. and Vahabie, A. H. 2021. Effectiveness of virtual/augmented reality-based therapeutic interventions on individuals with autism spectrum disorder: a comprehensive meta-analysis. Frontiers in Psychiatry, 12, 665326.
   PubMed Web of Science ®Google Scholar
• Kellmeyer, P. 2018. Neurophilosophical and ethical aspects of virtual reality therapy in neurology and psychiatry. Cambridge Quarterly of Healthcare Ethics: CQ, 27, 610–627.
   PubMed Web of Science ®Google Scholar
• Kim, K., Rosenthal, M. Z., Gwaltney, M., Jarrold, W., Hatt, N., McIntyre, N., Swain, L., Solomon, M. and Mundy, P. 2015. A virtual joy-stick study of emotional responses and social motivation in children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 45, 3891–3899.
   PubMed Web of Science ®Google Scholar
• Kleinhans, N. M., Johnson, L. C., Richards, T., Mahurin, R., Greenson, J., Dawson, G. and Aylward, E. 2009. Reduced neural habituation in the amygdala and social impairments in autism spectrum disorders. The American Journal of Psychiatry, 166, 467–475.
   PubMed Web of Science ®Google Scholar
• Knopf, A. 2020. Autism prevalence increases from 1 in 60 to 1 in 54: CDC. The Brown University Child & Adolescent Psychopharmacology Update, 22, 6–7.
   Google Scholar
• Knott, F., Dunlop, A.-W. and Mackay, T. 2006. Living with ASD: how do children and their parents assess their difficulties with social interaction and understanding? Autism, 10, 609–617.
   PubMed Web of Science ®Google Scholar
• Kouo, J. and Egel, A. 2016. The effectiveness of interventions in teaching emotion recognition to children with autism spectrum disorder. Review Journal of Autism and Developmental Disorders, 3 254–265.
   Web of Science ®Google Scholar
• Lecciso, F., Levante, A., Fabio, R. A., Caprì, T., Leo, M., Carcagnì, P., Distante, C., Mazzeo, P. L., Spagnolo, P. and Petrocchi, S. 2021. Emotional expression in children with ASD: a pre-study on a two-group pre-post-test design comparing robot-based and computer-based training. Frontiers in Psychology, 12, 678052.
   Web of Science ®Google Scholar
• Lech, M., Stolar, M., Best, C. and Bolia, R. 2020. Real-Time Speech Emotion Recognition Using a Pre-trained Image Classification Network: effects of Bandwidth Reduction and Companding. Frontiers of Computer Science, 2, 1–14.
   Web of Science ®Google Scholar
• Leung, J. H. 2021. Improving emotion perception in children with autism spectrum disorder with computer-based training and hearing amplification. Autism Research. 11, 1–20.
   Google Scholar
• Lindner, P., Miloff, A., Hamilton, W. and Carlbring, P. 2019. The potential of consumer-targeted virtual reality relaxation applications: descriptive usage, uptake and application performance statistics for a first-generation application. Frontiers in Psychology, 10, 132.
   PubMed Web of Science ®Google Scholar
• Loth, E., Garrido, L., Ahmad, J., Watson, E., Duff, A. and Duchaine, B. 2018. Facial expression recognition as a candidate marker for autism spectrum disorder: How frequent and severe are deficits? Molecular Autism, 9, 7.
   PubMed Web of Science ®Google Scholar
• Malihi, M., Nguyen, J., Cardy, R. E., Eldon, S., Petta, C. and Kushki, A. 2020. Short report: evaluating the safety and usability of head-mounted virtual reality compared to monitor-displayed video for children with autism spectrum disorder. Autism, 24, 1924–1929.
   PubMed Web of Science ®Google Scholar
• Mantziou, O., Vrellis, I. and Mikropoulos, T. 2015. Do children in the spectrum of autism interact with real-time emotionally expressive human controlled avatars? Procedia Computer Science., 67, 241–251.
   Google Scholar
• Maskey, M., Lowry, J., Rodgers, J., McConachie, H. and Parr, J. R. 2014. Reducing specific phobia/fear in young people with autism spectrum disorders (ASDs) through a virtual reality environment intervention. PLOS One, 9, e100374.
   PubMed Web of Science ®Google Scholar
• Mesa-Gresa, P., Gil-Gómez, H., Lozano-Quilis, J. A. and Gil-Gómez, J. A. 2018. Effectiveness of virtual reality for children and adolescents with autism spectrum disorder: an evidence-based systematic review. Sensors, 18, 2486.
   PubMed Web of Science ®Google Scholar
• Metcalfe, D., McKenzie, K., McCarty, K. and Pollet, T. V. 2019. Emotion recognition from body movement and gesture in children with Autism Spectrum Disorder is improved by situational cues. Research in Developmental Disabilities, 86, 1–10.
   PubMed Web of Science ®Google Scholar
• Miller, H. L. and Bugnariu, N. L. 2016. Level of immersion in virtual environments impacts the ability to assess and teach social skills in autism spectrum disorder. Cyberpsychology, Behavior and Social Networking, 19, 246–256.
   PubMed Web of Science ®Google Scholar
• Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G. and PRISMA Group. 2009. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6, e1000097.
   PubMed Web of Science ®Google Scholar
• Moore, D., Cheng, Y., McGrath, P. and Powell, N. J. 2005. Collaborative virtual environment technology for people with autism. Focus on Autism and Other Developmental Disabilities, 20, 231–243.
   Google Scholar
• Moore, M. and Calvert, S. 2000. Brief report: vocabulary acquisition for children with autism: teacher or computer instruction. Journal of Autism and Developmental Disorders, 30, 359–362.
   PubMed Web of Science ®Google Scholar
• O’riordan, M. A., Plaisted, K. C., Driver, J. and Baron-Cohen, S. 2001. Superior visual search in autism. Journal of Experimental Psychology. Human Perception and Performance, 27, 719–730.
   PubMed Web of Science ®Google Scholar
• O’Connor, K., Hamm, J. P. and Kirk, I. J. 2005. The neurophysiological correlates of face processing in adults and children with Asperger's syndrome. Brain and Cognition, 59, 82–95.
   PubMed Web of Science ®Google Scholar
• Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., McGuinness, L. A., Stewart, L. A., Thomas, J., Tricco, A. C., Welch, V. A., Whiting, P. and Moher, D. 2021. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ (Clinical Research ed.), 372, n71.
   PubMed Web of Science ®Google Scholar
• Parsons, S. and Mitchell, P. 2002. The potential of virtual reality in social skills training for people with autistic spectrum disorders. Journal of Intellectual Disability Research, 46, 430–443.
   PubMed Web of Science ®Google Scholar
• Piana, S., Malagoli, C., Usai, M. C. and Camurri, A. 2021. Effects of computerized emotional training on children with high functioning autism. IEEE Transactions on Affective Computing, 12, 1045–1054.
   Web of Science ®Google Scholar
• Radianti, J., Majchrzak, T. A., Fromm, J. and Wohlgenannt, I. 2020. A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda. Computers & Education, 147, 103778.
   Web of Science ®Google Scholar
• Ramdoss, S., Machalicek, W., Rispoli, M., Mulloy, A., Lang, R. and O'Reilly, M. 2012. Computer-based interventions to improve social and emotional skills in individuals with autism spectrum disorders: A systematic review. Developmental Neurorehabilitation, 15, 119–135.
   PubMed Web of Science ®Google Scholar
• Redlinger, E. and Shao, C. 2021. Comparing brain activity in virtual and non-virtual environments: a VR & EEG study. Measurement: Sensors, 18, 100062.
   Google Scholar
• Rump, K. M., Giovannelli, J. L., Minshew, N. J. and Strauss, M. S. 2009. The development of emotion recognition in individuals with autism. Child Development, 80, 1434–1447.
   PubMed Web of Science ®Google Scholar
• Schubring, D., Kraus, M., Stolz, C., Weiler, N., Keim, D. A. and Schupp, H. 2020. Virtual reality potentiates emotion and task effects of alpha/beta brain oscillations. Brain Sciences, 10, 537.
   PubMed Web of Science ®Google Scholar
• Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., Vesperini, S. and Askenazy, F. 2014. Facing the challenge of teaching emotions to individuals with low- and high-functioning autism using a new Serious game: A pilot study. Molecular Autism, 5, 37.
   PubMed Web of Science ®Google Scholar
• Shibata, T., Nishijo, H., Tamura, R., Miyamoto, K., Eifuku, S., Endo, S. and Ono, T. 2002. Generators of visual evoked potentials for faces and eyes in the human brain as determined by dipole localization. Brain Topography, 15, 51–63.
   PubMed Web of Science ®Google Scholar
• Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X. and Yang, X. 2018. A review of emotion recognition using physiological signals. Sensors, 18, 2074.
   PubMed Web of Science ®Google Scholar
• Silver, M. and Oakes, P. 2001. Evaluation of a new computer intervention to teach people with autism or Asperger syndrome to recognize and predict emotions in others. Autism, 5, 299–316.
   PubMed Web of Science ®Google Scholar
• Song, Z. 2021. Facial expression emotion recognition model integrating philosophy and machine learning theory. Frontiers in Psychology, 12, 759485.
   PubMed Web of Science ®Google Scholar
• Su, J., Chen, C., He, D. and Fang, F. 2012. Effects of face view discrimination learning on N170 latency and amplitude. Vision Research, 61, 125–131.
   PubMed Web of Science ®Google Scholar
• Tentori, M., Escobedo, L. and Balderas, G. 2015. A Smart environment for children with autism. IEEE Pervasive Computing, 14, 42–50.
   Web of Science ®Google Scholar
• Tsai, W. T., Lee, I. J. and Chen, C. H. 2020. Inclusion of third-person perspective in CAVE-like immersive 3D virtual reality role-playing games for social reciprocity training of children with an autism spectrum disorder. Universal Access in the Information Society, 20, 75–389.
   Web of Science ®Google Scholar
• Viechtbauer, W. 2005. Bias and efficiency of meta-analytic variance estimators in the random-effects model. Journal of Educational and Behavioral Statistics, 30, 261–293.
   Web of Science ®Google Scholar
• Wainer, A. L., Hepburn, S. and Griffith, E. M. 2017. Remembering parents in parent-mediated early intervention: an approach to examining impact on parents and families. Autism, 21, 5–17.
   PubMed Web of Science ®Google Scholar
• Wainer, A. L. and Ingersoll, B. R. 2011. The use of innovative computer technology for teaching social communication to individuals with autism spectrum disorders. Research in Autism Spectrum Disorders, 5, 96–107.
   Web of Science ®Google Scholar
• Wedyan, M., Falah, J., Alturki, R., Giannopulu, I., Alfalah, S. F. M., Elshaweesh, O. and Al-Jumaily, A. 2021. Augmented reality for autistic children to enhance their understanding of facial expressions. Multimodal Technologies and Interaction, 5, 48.
   Google Scholar
• Werling, D. M. and Geschwind, D. H. 2013. Sex differences in autism spectrum disorders. Current Opinion in Neurology, 26, 146–153.
   PubMed Web of Science ®Google Scholar
• Yang, Y. J. D., Allen, T., Abdullahi, S. M., Pelphrey, K. A., Volkmar, F. R. and Chapman, S. B. 2017. Brain responses to biological motion predict treatment outcome in young adults with autism receiving Virtual Reality Social Cognition Training: preliminary findings. Behaviour Research and Therapy, 93, 55–66.
   PubMed Web of Science ®Google Scholar
• Yang, Y. J. D., Allen, T., Abdullahi, S. M., Pelphrey, K. A., Volkmar, F. R. and Chapman, S. B. 2018. Neural mechanisms of behavioral change in young adults with high-functioning autism receiving virtual reality social cognition training: a pilot study. Autism Research, 11, 713–725.
   PubMed Web of Science ®Google Scholar
• Young, R. L. and Posselt, M. 2012. Using the transporters DVD as a learning tool for children with Autism Spectrum Disorders (ASD). Journal of Autism and Developmental Disorders, 42, 984–991.
   PubMed Web of Science ®Google Scholar
• Yuan, S. N. V. and Ip, H. H. S. 2018. Using virtual reality to train emotional and social skills in children with autism spectrum disorder. London Journal of Primary Care, 10, 110–112.
   PubMed Web of Science ®Google Scholar