The frequency of facial muscles engaged in expressing emotions in people with visual disabilities via cloud-based video communication

References

• Adolphs, R., H. Damasio, and D. Tranel. 2002. “Neural Systems for Recognition of Emotional Prosody: A 3-D Lesion Study.” Emotion (Washington, D.C.) 2 (1): 23–51. doi:10.1037/1528-3542.2.1.23.
   PubMed Web of Science ®Google Scholar
• Alyüz, N., E. Okur, E. Oktay, U. Genc, S. Aslan, S. E. Mete, D. Stanhill, B. Arnrich, and A. A. Esme. 2016. “Towards an Emotional Engagement Model: Can Affective States of a Learner Be Automatically Detected in a 1: 1 Learning Scenario?” In 24th ACM Conference on User Modeling Adaptation and Personalization (UMAP), Halifax Nova Scotia Canada.
   Google Scholar
• Ashok, A., and J. John. 2018. “Facial Expression Recognition System for Visually Impaired.” In International Conference on Intelligent Data Communication Technologies and Internet of Things (ICICI) 2018. ICICI 2018. Lecture Notes on Data Engineering and Communications Technologies. Vol. 26, edited by J. Hemanth, X. Fernando, P. Lafata, and Z. Baig, 244–250. Cham: Springer. doi:10.1007/978-3-030-03146-6_26.
   Google Scholar
• Aslan, S., Z. Cataltepe, I. Diner, O. Dundar, A. A. Esme, R. Ferens, G. Kamhi, E. Oktay, C. Soysal, and M. Yener. 2014. “Learner Engagement Measurement and Classification in 1: 1 Learning.” In 13th International Conference on Machine Learning and Applications, Detroit, MI.
   Google Scholar
• Aviezer, H., Y. Trope, and A. Todorov. 2012. “Body Cues, Not Facial Expressions, Discriminate between Intense Positive and Negative Emotions.” Science 338 (6111): 1225–1229. doi:10.1126/science.1224313.
   PubMed Web of Science ®Google Scholar
• Bian, C., Y. Zhang, F. Yang, W. Bi, and W. Lu. 2019. “Spontaneous Facial Expression Database for Academic Emotion Inference in Online Learning.” IET Computer Vision 13 (3): 329–337. doi:10.1049/iet-cvi.2018.5281.
   Google Scholar
• Buimer, H. P., M. Bittner, T. Kostelijk, T. M. Van Der Geest, A. Nemri, R. J. Van Wezel, and Y. Zhao. 2018. “Conveying Facial Expressions to Blind and Visually Impaired Persons through a Wearable Vibrotactile Device.” PloS One 13 (3): e0194737. doi:10.1371/journal.pone.0194737.
   PubMed Web of Science ®Google Scholar
• Chiesa, S., D. Galati, and S. Schmidt. 2015. “Communicative Interactions between Visually Impaired Mothers and Their Sighted Children: Analysis of Gaze, Facial Expressions, Voice and Physical Contacts.” Child: Care, Health and Development 41 (6): 1040–1046.
   PubMed Web of Science ®Google Scholar
• Cohn, J. F., Z. Ambadar, and P. Ekman. 2007. “Observer-Based Measurement of Facial Expression with the Facial Action Coding System.” The Handbook of Emotion Elicitation and Assessment 1 (3): 203–221.
   Google Scholar
• Cohn, J. F., K. Schmidt, R. Gross, and P. Ekman. 2002. “Individual Differences in Facial Expression: Stability over Time, Relation to Self-Reported Emotion, and Ability to Inform Person Identification.” In Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, Pittsburgh, PA.
   Google Scholar
• Cole, P. M., P. A. Jenkins, and C. T. Shott. 1989. “Spontaneous Expressive Control in Blind and Sighted Children.” Child Development 60 (3): 683–688. doi:10.2307/1130733.
   PubMedGoogle Scholar
• Crane, E. A. 2009. Measures of Emotion: How Feelings are Expressed in the Body and Face During Walking. Doctoral diss., University of Michigan. http://hdl.handle.net/2027.42/63627.
   Google Scholar
• D’mello, S. K., and A. Graesser. 2010. “Multimodal Semi-Automated Affect Detection from Conversational Cues, Gross Body Language, and Facial Features.” User Modeling and User-Adapted Interaction 20 (2): 147–187. doi:10.1007/s11257-010-9074-4.
   Web of Science ®Google Scholar
• Den Uyl, M., and H. Van Kuilenburg. 2005. “The FaceReader: Online Facial Expression Recognition.” In Proceedings of Measuring Behavior 2005 - 5th International Conference on Methods and Techniques in Behavioral Research, Wageningen, The Netherlands.
   Google Scholar
• Dimberg, U., and B. Karlsson. 1997. “Facial Reactions to Different Emotionally Relevant Stimuli.” Scandinavian Journal of Psychology 38 (4): 297–303. doi:10.1111/1467-9450.00039.
   Web of Science ®Google Scholar
• Dimberg, U., M. Thunberg, and K. Elmehed. 2000. “Unconscious Facial Reactions to Emotional Facial Expressions.” Psychological Science 11 (1): 86–89.
   PubMed Web of Science ®Google Scholar
• D’Mello, S. K., S. D. Craig, and A. C. Graesser. 2009. “Multimethod Assessment of Affective Experience and Expression during Deep Learning.” International Journal of Learning Technology 4 (3/4): 165–187. doi:10.1504/IJLT.2009.028805.
   Google Scholar
• Ekman, P. 1993. “Facial Expression and Emotion.” The American Psychologist 48 (4): 384–392. doi:10.1037//0003-066x.48.4.384.
   PubMed Web of Science ®Google Scholar
• Ekman, P., and E. Friesen. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Palo Alto, CA: Consulting Psychologists Press.
   Google Scholar
• Ekman, P., and W. V. Friesen. 1976. “Measuring Facial Movement.” Environmental Psychology and Nonverbal Behavior 1 (1): 56–75. doi:10.1007/BF01115465.
   Web of Science ®Google Scholar
• Fujimura, T., W. Sato, and N. Suzuki. 2010. “Facial Expression Arousal Level Modulates Facial Mimicry.” International Journal of Psychophysiology : Official Journal of the International Organization of Psychophysiology 76 (2): 88–92.
   PubMedGoogle Scholar
• Galati, D., R. Miceli, and B. Sini. 2001. “Judging and Coding Facial Expression of Emotions in Congenitally Blind Children.” International Journal of Behavioral Development 25 (3): 268–278. doi:10.1080/01650250042000393.
   Web of Science ®Google Scholar
• Galati, D., B. Sini, S. Schmidt, and C. Tinti. 2003. “Spontaneous Facial Expressions in Congenitally Blind and Sighted Children Aged 8–11.” Journal of Visual Impairment & Blindness 97 (7): 418–428. doi:10.1177/0145482X0309700704.
   Web of Science ®Google Scholar
• Geisler, C., and J. Swarts. 2019. Coding Streams of Language: Techniques for the Systematic Coding of Text, Talk, and Other Verbal Data. Collins, CO: WAC Clearinghouse Ft.
   Google Scholar
• Goodmurphy, C. W., and W. K. Ovalle. 1999. “Morphological Study of Two Human Facial Muscles: Orbicularis Oculi and Corrugator Supercilii.” Clinical Anatomy 12 (1): 1–11. doi:10.1002/(SICI)1098-2353(1999)12:1<1::AID-CA1>3.0.CO;2-J.
   PubMedGoogle Scholar
• Grafsgaard, J., J. B. Wiggins, K. E. Boyer, E. N. Wiebe, and J. Lester. 2013. “Automatically Recognizing Facial Expression: Predicting Engagement and Frustration.” In Proceedings of the Sixth International Conference on Educational Data Mining, Memphis, TN.
   Google Scholar
• Grafsgaard, J. F., J. B. Wiggins, K. E. Boyer, E. N. Wiebe, and J. C. Lester. 2013. “Automatically Recognizing Facial Indicators of Frustration: A Learning-Centric Analysis.” In Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva, Switzerland.
   Google Scholar
• Hildebrandt, A., S. Olderbak, and O. Wilhelm. 2015. “Facial Emotion Expression, Individual Differences.” In International encyclopedia of the social & behavioral sciences, 667–675. James D. Wright Publisher Name: Elsevier Location: Oxford.
   Google Scholar
• IBM Corp. 2016. IBM SPSS Statistics for Macintosh, Version 24.0. IBM Corp.
   Google Scholar
• Ji, R., A. Micheletti, N. K. Jerinkic, and Z. Desnica. 2021. “Emotion Pattern Detection on Facial Videos Using Functional Statistics.” arXiv preprint arXiv:2103.00844
   Google Scholar
• Kim, H. N., and S. Sutharson. 2022. “Individual Differences in Spontaneous Facial Expressions in People with Visual Impairment and Blindness.” British Journal of Visual Impairment: 026461962110709. doi:10.1177/02646196211070927.
   Google Scholar
• Kunz, M., N. Faltermeier, and S. Lautenbacher. 2012. “Impact of Visual Learning on Facial Expressions of Physical Distress: A Study on Voluntary and Evoked Expressions of Pain in Congenitally Blind and Sighted Individuals.” Biological Psychology 89 (2): 467–476. doi:10.1016/j.biopsycho.2011.12.016.
   PubMed Web of Science ®Google Scholar
• Landis, T. 2006. “Emotional Words: What’s So Different from Just Words?” Cortex; a Journal Devoted to the Study of the Nervous System and Behavior 42 (6): 823–830. doi:10.1016/S0010-9452(08)70424-6.
   PubMed Web of Science ®Google Scholar
• Landis, J. R., and G. G. Koch. 1977. “The Measurement of Observer Agreement for Categorical Data.” Biometrics 33 (1): 159–174. doi:10.2307/2529310.
   PubMed Web of Science ®Google Scholar
• Leclerc, B.-S., and C. Dassa. 2009. “Interrater Reliability in Content Analysis of Healthcare Service Quality Using Montreal’s Conceptual Framework.” The Canadian Journal of Program Evaluation 24 (2): 81–102.
   Google Scholar
• Lee, Y.-C., Y.-C. Lin, C.-L. Huang, and B. L. Fredrickson. 2013. “The Construct and Measurement of Peace of Mind.” Journal of Happiness Studies 14 (2): 571–590. doi:10.1007/s10902-012-9343-5.
   Web of Science ®Google Scholar
• Matsumoto, D., and B. Willingham. 2009. “Spontaneous Facial Expressions of Emotion of Congenitally and Noncongenitally Blind Individuals.” Journal of Personality and Social Psychology 96 (1): 1–10.
   PubMed Web of Science ®Google Scholar
• McDaniel, B., S. D’Mello, B. King, P. Chipman, K. Tapp, and A. Graesser. 2007. “Facial Features for Affective State Detection in Learning Environments.” In Proceedings of the Annual Meeting of the Cognitive Science Society, Nashville, TN.
   Google Scholar
• Peleg, G., G. Katzir, O. Peleg, M. Kamara, L. Brodsky, H. Hel-Or, D. Keren, and E. Nevo. 2006. “Hereditary Family Signature of Facial Expression.” Proceedings of the National Academy of Sciences 103 (43): 15921–15926. doi:10.1073/pnas.0607551103.
   PubMedGoogle Scholar
• Roch‐Levecq, A. C. 2006. “Production of Basic Emotions by Children with Congenital Blindness: Evidence for the Embodiment of Theory of Mind.” British Journal of Developmental Psychology 24 (3): 507–528.
   Web of Science ®Google Scholar
• Russell, J. A. 1980. “A Circumplex Model of Affect.” Journal of Personality and Social Psychology 39 (6): 1161–1178. doi:10.1037/h0077714.
   Web of Science ®Google Scholar
• Russell, J. A., and M. Bullock. 1985. “Multidimensional Scaling of Emotional Facial Expressions: Similarity from Preschoolers to Adults.” Journal of Personality and Social Psychology 48 (5): 1290–1298. doi:10.1037/0022-3514.48.5.1290.
   Web of Science ®Google Scholar
• Rymarczyk, K., Ł. Żurawski, K. Jankowiak-Siuda, and I. Szatkowska. 2019. “Empathy in Facial Mimicry of Fear and Disgust: Simultaneous EMG-fMRI Recordings during Observation of Static and Dynamic Facial Expressions.” Frontiers in Psychology 10: 701. doi:10.3389/fpsyg.2019.00701.
   PubMedGoogle Scholar
• Sauter, D. A., F. Eisner, P. Ekman, and S. K. Scott. 2010. “Cross-Cultural Recognition of Basic Emotions through Nonverbal Emotional Vocalizations.” Proceedings of the National Academy of Sciences 107 (6): 2408–2412. doi:10.1073/pnas.0908239106.
   PubMed Web of Science ®Google Scholar
• Schmidt, K. L., Z. Ambadar, J. F. Cohn, and L. I. Reed. 2006. “Movement Differences between Deliberate and Spontaneous Facial Expressions: Zygomaticus Major Action in Smiling.” Journal of Nonverbal Behavior 30 (1): 37–52.
   PubMedGoogle Scholar
• Schmidt, K. L., and J. F. Cohn. 2001. “Human Facial Expressions as Adaptations: Evolutionary Questions in Facial Expression Research.” American Journal of Physical Anthropology 116 (S33): 3–24. doi:10.1002/ajpa.20001.
   Google Scholar
• Seibt, B., A. Mühlberger, K. Likowski, and P. Weyers. 2015. “Facial Mimicry in Its Social Setting.” Frontiers in Psychology 6: 1122. doi:10.3389/fpsyg.2015.01122.
   PubMed Web of Science ®Google Scholar
• Thompson, J. 1941. “Development of Facial Expression of Emotion in Blind and Seeing Children.” Archives of Psychology 264 (37): 1–47.
   Google Scholar
• Vail, A. K., J. B. Wiggins, J. F. Grafsgaard, K. E. Boyer, E. N. Wiebe, and J. C. Lester. 2016. “The Affective Impact of Tutor Questions: Predicting Frustration and Engagement.” In 9th International Conference on Educational Data Mining, Raleigh, NC.
   Google Scholar
• Valente, D., A. Theurel, and E. Gentaz. 2018. “The Role of Visual Experience in the Production of Emotional Facial Expressions by Blind People: A Review.” Psychonomic Bulletin & Review 25 (2): 483–497. doi:10.3758/s13423-017-1338-0.
   PubMed Web of Science ®Google Scholar
• Voss, Patrice, Maryse Lassonde, Frederic Gougoux, Madeleine Fortin, Jean-Paul Guillemot, and Franco Lepore. 2004. “Early-and Late-Onset Blind Individuals Show Supra-Normal Auditory Abilities in Far-Space.” Current Biology : CB 14 (19): 1734–1738.
   PubMed Web of Science ®Google Scholar
• Westbrook, K., T. Nessel, and M. Varacallo. 2021. Anatomy, Head and Neck, Face. Treasure Island, FL: StatPearls Publishing. https://www.ncbi.nlm.nih.gov/books/NBK493209/.
   Google Scholar
• Whitehill, J., Z. Serpell, Y.-C. Lin, A. Foster, and J. R. Movellan. 2014. “The Faces of Engagement: Automatic Recognition of Student Engagementfrom Facial Expressions.” IEEE Transactions on Affective Computing 5 (1): 86–98. doi:10.1109/TAFFC.2014.2316163.
   Web of Science ®Google Scholar
• World Health Organization. 2008. Change the Definition of Blindness. Geneva. https://www.who.int/health-topics/blindness-and-vision-loss
   Google Scholar
• Xu, Q., Y. Yang, Q. Tan, and L. Zhang. 2017. “Facial Expressions in Context: Electrophysiological Correlates of the Emotional Congruency of Facial Expressions and Background Scenes.” Frontiers in Psychology 8: 2175. doi:10.3389/fpsyg.2017.02175.
   PubMed Web of Science ®Google Scholar
• Zhang, Z., Z. Li, H. Liu, T. Cao, and S. Liu. 2020. “Data-Driven Online Learning Engagement Detection via Facial Expression and Mouse Behavior Recognition Technology.” Journal of Educational Computing Research 58 (1): 63–86. doi:10.1177/0735633119825575.
   Web of Science ®Google Scholar
• Zhang, J., O. V. Lipp, T. P. Oei, and R. Zhou. 2011. “The Effects of Arousal and Valence on Facial Electromyographic Asymmetry during Blocked Picture Viewing.” International Journal of Psychophysiology : Official Journal of the International Organization of Psychophysiology 79 (3): 378–384.
   PubMedGoogle Scholar
• Zhao, Y., S. Wu, L. Reynolds, and S. Azenkot. 2018. “A Face Recognition Application for People with Visual Impairments. Understanding Use beyond the Lab.” In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montréal, Canada.
   Google Scholar