98
Views
0
CrossRef citations to date
0
Altmetric
Original Research

Differences of people with visual disabilities in the perceived intensity of emotion inferred from speech of sighted people in online communication settings

ORCID Icon &
Pages 633-640 | Received 02 Mar 2022, Accepted 12 Aug 2022, Published online: 23 Aug 2022

References

  • Ooi CS, Seng KP, Ang L-M, et al. A new approach of audio emotion recognition. Expert Syst Appl. 2014;41(13):5858–5869.
  • Pell MD, Skorup V. Implicit processing of emotional prosody in a foreign versus native language. Speech Commun. 2008;50(6):519–530.
  • Plutchik R. The psychology and biology of emotion. New York: HarperCollins College Publishers; 1994.
  • Schmidt J, Janse E, Scharenborg O. Perception of emotion in conversational speech by younger and older listeners. Front Psychol. 2016;7:781.
  • Holz N, Larrouy-Maestri P, Poeppel D. The paradoxical role of emotional intensity in the perception of vocal affect. Sci Rep. 2021;11(1):1–10.
  • Banse R, Scherer KR. Acoustic profiles in vocal emotion expression. J Pers Soc Psychol. 1996;70(3):614–636.
  • Karpf A. The human voice: How this extraordinary instrument reveals essential clues about who we are. New York: Bloomsbury Publishing USA; 2006.
  • Martins AT, Faísca L, Vieira H, et al. Emotional recognition and empathy both in deaf and blind adults. J Deaf Stud Deaf Educ. 2019;24(2):119–127.
  • Bartelink VH, Zay Ya K, Guldbrandsson K, et al. Unemployment among young people and mental health: a systematic review. Scand J Public Health. 2020;48(5):544–558.
  • Kessler RC, Turner JB, House JS. Unemployment, reemployment, and emotional functioning in a community sample. Am Sociolog Rev. 1989;54(4):648–657.
  • McDonnall MC, Sui Z. Employment and unemployment rates of people who are blind or visually impaired: estimates from multiple sources. J Visual Impairment Blindness. 2019;113(6):481–492.
  • American Foundation for the Blind. Reviewing the disability employment research on people who are blind or visually impaired: Key takeaways. 2020. Available from: https://www.afb.org/research-and-initiatives/employment/reviewing-disability-employment-research-people-blind-visuallys.
  • Cimarolli V, Wang S. Differences in social support among employed and unemployed adults who are visually impaired. J Visual Impair Blindn. 2006;100(9):545–556.
  • Isaacowitz DM, Löckenhoff CE, Lane RD, et al. Age differences in recognition of emotion in lexical stimuli and facial expressions. Psychol Aging. 2007;22(1):147–159.
  • Ryan M, Murray J, Ruffman T. Aging and the perception of emotion: processing vocal expressions alone and with faces. Exp Aging Res. 2010;36(1):1–22.
  • Karademas EC, Tsalikou C, Tallarou M-C. The impact of emotion regulation and illness-focused coping strategies on the relation of illness-related negative emotions to subjective health. J Health Psychol. 2011;16(3):510–519.
  • Nyklicek I, Vingerhoets A, Denollet J. Emotional (non-)expression and health: data, questions, and challenges. Psychol Health. 2002;17(5):517–528.
  • Panagopoulou E, Kersbergen B, Maes S. The effects of emotional (non-) expression in (chronic) disease: a meta-analytic review. Psychol Health. 2002;17(5):529–545.
  • Dyck MJ, Farrugia C, Shochet IM, et al. Emotion recognition/understanding ability in hearing or vision‐impaired children: do sounds, sights, or words make the difference? J Child Psychol Psychiatry. 2004;45(4):789–800.
  • Fryer L, Freeman J. Can you feel what I’m saying? The impact of verbal information on emotion elicitation and presence in people with a visual impairment. In: Felnhofer A. and Kothgassner OD, editors. Challenging presence: proceedings of the 15th international conference on presence; 2014. Facultas. p. 99–107.
  • Park HY, Chong HJ. A comparative study of the perception of music emotion between adults with and without visual impairment. Psychol Music. 2019;47(2):225–240.
  • Siegert I, Niebuhr O. Case report: women, be aware that your vocal charisma can dwindle in remote meetings. Front Commun. 2021;5:611555.
  • Yamamoto HW, Kawahara M, Tanaka A. A web-based auditory and visual emotion perception task experiment with children and a comparison of lab data and web data. Front Psychol. 2021;12:3388.
  • Koolagudi SG, Maity S, Kumar VA, et al. IITKGP-SESC: speech database for emotion analysis. In: Ranka S, editor. Contemporary computing. IC3 2009. Communications in computer and information science. Springer: Berlin, Heidelberg; 2009. p. 485–492.
  • Morris JT, Jones ML, Sweatman WM. Wireless technology use by people with disabilities: a national survey. J Technol Persons Disabil. 2016;1:101–113.
  • Wu S, Adamic LA. Visually impaired users on an online social network. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Toronto, ON, Canada; 2014.
  • Chawla A. Coronavirus (COVID-19)–‘Zoom’application boon or bane. SSRN. 2020;2020:1–10.
  • Dolamore S. Accessibility features in ZOOM to improve equity in the MPA classroom. J Public Affairs Educ. 2021;27(3):376–374.
  • Hättich A, Schweizer M. I hear what you see: effects of audio description used in a cinema on immersion and enjoyment in blind and visually impaired people. Br J Visual Impair. 2020;38(3):284–298.
  • Gamond L, Vecchi T, Ferrari C, et al. Emotion processing in early blind and sighted individuals. Neuropsychology. 2017;31(5):516–524.
  • Fragopanagos N, Taylor JG. Emotion recognition in human–computer interaction. Neural Netw. 2005;18(4):389–405.
  • Kessens JM, Neerincx MA, Looije R, et al. Facial and vocal emotion expression of a personal computer assistant to engage, educate and motivate children, in 2009 3rd international conference on affective computing and intelligent interaction and workshops. Amsterdam, The Netherlands: IEEE; 2009. p. 1–7.
  • Bahreini K, Nadolski R, Westera W. Towards real-time speech emotion recognition for affective e-learning. Educ Inf Technol. 2016;21(5):1367–1386.
  • Dai W, Han D, Dai Y, et al. Emotion recognition and affective computing on vocal social media. Inform Manag. 2015;52(7):777–788.
  • World Health Organization. Change the definition of blindness. 2008. Available from: https://www.who.int/health-topics/blindness-and-vision-loss.
  • Livingstone SR, Russo FA. The ryerson audio-visual database of emotional speech and song (RAVDESS): a dynamic, multimodal set of facial and vocal expressions in North American English. PLoS One. 2018;13(5):e0196391.
  • IBM Corp. IBM SPSS statistics for Macintosh, version 24.0.Armonk, NY: IBM Corp; 2016.
  • Sen A, Isaacowitz D, Schirmer A. Age differences in vocal emotion perception: on the role of speaker age and listener sex. Cogn Emot. 2018;32(6):1189–1204.
  • Engelmann J, Pogosyan M. Emotion perception across cultures: the role of cognitive mechanisms. Front Psychol. 2013;4:118.
  • Yeshoda K, Raveendran R, Konadath S. Perception of vocal emotional prosody in children with hearing impairment. Int J Pediatr Otorhinolaryngol. 2020;137:110252.
  • Chaturvedi M, Chander R. Development of emotional stability scale. Ind Psychiatry J. 2010;19(1):37–40.
  • Taylor SE. Asymmetrical effects of positive and negative events: the mobilization-minimization hypothesis. Psychol Bull. 1991;110(1):67–85.
  • Cacioppo JT, Gardner WL. Emotion. Annu Rev Psychol. 1999;50(1):191–214.
  • Pratto F, John OP. Automatic vigilance: the attention-grabbing power of negative social information. J Pers Soc Psychol. 1991;61(3):380–391.
  • Tao J, Kang Y, Li A. Prosody conversion from neutral speech to emotional speech. IEEE trans Audio Speech Lang Pro. 2006;14(4):1145–1154.
  • Klofstad CA, Nowicki S, Anderson RC. How voice pitch influences our choice of leaders: when candidates speak, their vocal characteristics–as well as their words–influence voters’ attitudes toward them. Am Sci. 2016;104(5):282–288.
  • Lolli S, Lewenstein AD, Basurto J, et al. Sound frequency affects speech emotion perception: results from congenital Amusia. Front Psychol. 2015;6:1340.
  • Hyde KL, Peretz I. Brains that are out of tune but in time. Psychol Sci. 2004;15(5):356–360.
  • Vuvan DT, Nunes-Silva M, Peretz I. Meta-analytic evidence for the non-modularity of pitch processing in congenital Amusia. Cortex. 2015;69:186–200.
  • Lima CF, Brancatisano O, Fancourt A, et al. Impaired socio-emotional processing in a developmental music disorder. Sci Rep. 2016;6(1):1–13.
  • Maryn Y. Practical acoustics in clinical voice assessment: a Praat primer. Perspect ASHA SIGs. 2017;2(3):14–32.
  • Mineva K, Peeva К. Predictors of emotional illness perception in patients with chronic diseases. Trakia J Sci. 2016;14(4):367–372.
  • Ebrahimi Belil F, Alhani F, Ebadi A, et al. Self-efficacy of people with chronic conditions: a qualitative directed content analysis. J Clin Med. 2018;7(11):411.
  • Aron EN, Aron A. Sensory-processing sensitivity and its relation to introversion and emotionality. J Pers Soc Psychol. 1997;73(2):345–368.
  • Bolders AC, Tops M, Band GP, et al. Perceptual sensitivity and response to strong stimuli are related. Front Psychol. 2017;8:1642.
  • Acevedo B, Aron E, Pospos S, et al. The functional highly sensitive brain: a review of the brain circuits underlying sensory processing sensitivity and seemingly related disorders. Phil Trans R Soc B. 2018;373(1744):20170161.
  • Batic-Mujanovic O, Poric S, Pranjic N, et al. Influence of unemployment on mental health of the working age population. Mater Sociomed. 2017;29(2):92–96.
  • Llena-Nozal A, OECD F. Are all jobs good for your health? The impact of work status and working conditions on mental health. 2008. Available from: https://www.oecd.org/els/emp/oecdemploymentoutlook2008.htm#CH4.
  • Knabe A, Rätzel S, Schöb R, et al. Dissatisfied with life but having a good day: time‐use and well‐being of the unemployed. The Economic Journal. 2010;120(547):867–889.
  • Farré L, Fasani F, Mueller H. Feeling useless: the effect of unemployment on mental health in the great recession. IZA J Labor Econ. 2018;7(1):1–34.
  • Ebner NC, Fischer H. Emotion and aging: evidence from brain and behavior. Front Psychol. 2014;5:996.
  • Cortes DS, Tornberg C, Bänziger T, et al. Effects of aging on emotion recognition from dynamic multimodal expressions and vocalizations. Sci Rep. 2021;11(1):1–12.
  • Riediger M, Studtmann M, Westphal A, et al. No smile like another: adult age differences in identifying emotions that accompany smiles. Front Psychol. 2014;5:480.
  • English T, Carstensen LL. Emotional experience in the mornings and the evenings: consideration of age differences in specific emotions by time of day. Front Psychol. 2014;5:185.
  • Namkung K. Research on emotional factors and voice trend by country to be considered in designing AI’s Voice-An analysis of interview with experts in Finland and Norway. J Korea Convergence Soc. 2020;11(9):91–97.
  • Chidambaram V, Chiang Y-H, Mutlu B. Designing persuasive robots: how robots might persuade people using vocal and nonverbal cues. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction. Boston, Massachusetts; 2012. p. 293–300.
  • Mehrabian A, Ferris SR. Inference of attitudes from nonverbal communication in two channels. J Consult Psychol. 1967;31(3):248–252.
  • Sjölander K, Beskow J. Wavesurfer-an open source speech tool, in sixth international conference on spoken language processing (ICSLP). Beijing, China; 2000. p. 464–467.
  • SIL Language Technology, Speech Analyzer. 2022. https://software.sil.org/speech-analyzer/.
  • Huckvale M. Speech Filing System. 2022. https://www.phon.ucl.ac.uk/resource/sfs/.
  • Boersma P, Van Heuven V. Speak and unSpeak with PRAAT. Glot International. 2001;5(9/10):341–347.
  • Noll A, Stuefer J, Klingler N, et al. Sound Tools eXtended (STx) 5.0-A powerful sound analysis tool optimized for speech. In INTERSPEECH; 2019.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.