Audio subtitling: dubbing and voice-over effects and their impact on user experience

References

• Backs, R. W., da Silva, S. P., & Han, K. (2005). A comparison of younger and older adults’ self-assessment manikin ratings of affective pictures. Experimental Aging Research, 31(4), 421–440. doi:10.1080/03610730500206808.
   PubMed Web of Science ®Google Scholar
• Betella, A., & Verschure, P. F. M. (2016). The affective slider: A digital self-assessment scale for the measurement of human emotions. PLoS ONE, 11(2), e0148037, online. doi: 10.1371/journal.pone.0148037
   PubMed Web of Science ®Google Scholar
• Bradley, M. M., Codispoti, M., Cuthbert, B. N., & Lang, P. J. (2001). Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion, 1(3), 276–298. doi: 10.1037/1528-3542.1.3.276
   PubMed Web of Science ®Google Scholar
• Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: The self-assessment semantic differential Manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(I), 49–59. doi: 10.1016/0005-7916(94)90063-9
   PubMedGoogle Scholar
• Braun, S., & Orero, P. (2010). Audio description with audio subtitling – an emergent modality of audiovisual localisation. Perspectives: Studies in Translatology, 18(3), 173–188. doi: 10.1080/0907676X.2010.485687
   Web of Science ®Google Scholar
• Cabeza-Cáceres, C. (2013). Efecte de la velocitat de narració, l’entonació i l’explicitació en la comprensió fílmica. Cerdanyola del Vallès: Universitat Autònoma de Barcelona.
   Google Scholar
• Cabeza i Cáceres, C. (2010). Opera audio description at Barcelona’s Liceu theatre. In J. Díaz Cintas, A. Matamala, & J. Neves (Eds.), New insights into audiovisual translation and media accessibility (pp. 227–237). Amsterdam: Rodopi.
   Google Scholar
• Cabeza i Cáceres, C., & Matamala, A. (2008). La audiodescripción de ópera: una nueva propuesta. In A. Pérez-Ugena & R. Vizcaíno-Laorga (Eds.), Ulises y la comunidad sorda (pp. 95–108). Madrid: Observatorio de las Realidades Sociales y de la Comunicación.
   Google Scholar
• Diemer, J., Alpers, G. W., Peperkorn, H. M., Shiban, Y., & Mühlberger, A. (2015). The impact of perception and presence on emotional reactions: A review of research in virtual reality. Frontiers in Psychology, 6, 1–9. doi: 10.3389/fpsyg.2015.00026
   PubMed Web of Science ®Google Scholar
• Dillon, C. (2006). Emotional responses to immersive media. London: University of London.
   Google Scholar
• Di Giovanni, E. (2014). Visual and narrative priorities of the blind and non-blind: Eye tracking and audio description. Perspectives, 22(1), 136–153. doi: 10.1080/0907676X.2013.769610
   Web of Science ®Google Scholar
• Eardley-Weaver, S. (2014). Lifting the curtain on opera translation and accessibility: Translating opera for audiences with varying sensory ability. Durham: Durham University.
   Google Scholar
• Fernández-Torné, A., & Matamala, A. (2016). Text to speech vs. human voiced audio descriptions: A reception study in films dubbed into Catalan. The Journal of Specialised Translation, 2008, 1–13.
   Google Scholar
• Fresno Cañada, N. (2014). La (re)construcción de los personajes fílmicos en la audiodescripción. Efectos de la cantidad de información y de su segmentación en el recuerdo de los receptores. Cerdanyola del Vallès: Universitat Autònoma de Barcelona.
   Google Scholar
• Fryer, L. (2013). Putting it into words: The impact of visual impairment on perception, experience and presence. London: University of London.
   Google Scholar
• Fryer, L., & Freeman, J. (2014). Can you feel what I’m saying? The impact of verbal information on emotion elicitation and presence in people with a visual impairment. In A. Felnhofer & O. D. Kothgassner (Eds.), Proceedings of the International Society for Presence Research 2014 (pp. 99–107). Wien: Facultas Verlags- und Buchhandels AG.
   Google Scholar
• Geethanjali, B., Adalarasu, K., Hemapraba, A., Pravin Kumar, S., & Rajasekeran, R. (2017). Emotion analysis using SAM (Self-assessment Manikin) scale. Biomedical Resarch, 2017(Special Issue), S18–S24.
   Google Scholar
• International Organization for Standardization, & International Electrotechnical Commission. (2015). Information technology – User interface component accessibility - Part 21: Guidance on audio descriptions (ISO/IEC TS 20071-21). Retrieved from https://www.iso.org/obp/ui/fr/#iso:std:iso-iec:ts:20071:-21:ed-1:v1:en
   Google Scholar
• International Organization for Standardization, & International Electrotechnical Commission. (2017). Information Technology — User interface component accessibility — Part 25: Guidance on the audio presentation of text in videos (including captions, subtitles, and other on screen text) (ISO/IEC 20071-25: 2017). Retrieved from https://www.iso.org/standard/69060.html
   Google Scholar
• International Telecommunication Union (Focus Group on Audiovisual Media Accessibility). (2013). Part 5: Final report of activities: Working Group B “Audio/Video description and spoken captions”. Geneva: International Telecommunication Union.
   Google Scholar
• Iturregui-Gallardo, G. (2018). Rendering multilingualism through audio subtitles: Shaping a categorisation for aural strategies. International Journal of Multilingualism, 1–14. doi: 10.1080/14790718.2018.1523173
   Web of Science ®Google Scholar
• Iturregui-Gallardo, G., & Méndez-Ulrich, J. L. (2019). Towards the creation of a tactile version of the self-assessment Manikin (T-SAM) for the emotional assessment of visually impaired people. International Journal of Disability, Development and Education. doi: 10.1080/1034912X.2019.1626007
   Web of Science ®Google Scholar
• Izard, C. E. (2010). The many meanings/aspects of emotion: Definitions, functions, activation, and regulation. Emotion Review, 2(4), 363–370. doi: 10.1177/1754073910374661
   Web of Science ®Google Scholar
• Jakobson, R. (2000). On linguistic aspects of translation. In L. Venuti (Ed.), The translation studies reader (pp. 232–239). London/New York: Routledge. Retrieved from http://www.stanford.edu/~eckert/PDF/jakobson.pdf
   Google Scholar
• Kettunen, J., Ravaja, N., Näätänen, P., Keskivaara, P., & Keltikangas-Järvinen, L. (1998). The synchronization of electrodermal activity and heart rate and its relationship to energetic arousal: A time series approach. Biological Psychology, 48(3), 209–225. doi: 10.1016/S0301-0511(98)00017-9
   PubMed Web of Science ®Google Scholar
• Kreibig, S. D. (2010). Autonomic nervous system activity in emotion: A review. Biological Psychology, 84(3), 394–421. doi: 10.1016/j.biopsycho.2010.03.010
   PubMed Web of Science ®Google Scholar
• Kreibig, S. D., Wilhelm, F. H., Roth, W. T., & Gross, J. J. (2007). Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. Psychophysiology, 44(5), 787–806.
   PubMed Web of Science ®Google Scholar
• Kruger, J.-L., Soto-Sanfiel, M. T., Doherty, S., & Ibrahim, R. (2016). Towards a cognitive audiovisual translatology. In R. Muñoz Martín (Ed.), Reembedding translation process research (pp. 171–194). Amsterdam: John Benjamins. doi: 10.1075/btl.128.09kru
   Google Scholar
• Lang, J. P., Bradley, M. M., & Cuthbert, B. N. (2008). International affective picture system (IAPs): Affective ratings of picture and instruction manual (Technical report A-8). Gainsville, FL: University of Florida.
   Google Scholar
• Lang, P. J. (1969). The mechanics of desensitization and the laboratory study of human fear. (C. M. Franks, Ed.), Assessment and status of the behavior therapies. New York: McGraw Hill.
   Google Scholar
• Lang, P. J. (1988). What are the data of emotion? In V. Hamilton, G. H. Bower, & N. H. Frijda (Eds.), Cognitive perspectives on emotion and motivation (pp. 173–191). Dordrecht: Springer Netherlands. doi: 10.1007/978-94-009-2792-6
   Google Scholar
• Larsen, R. J., & Prizmic-Larsen, Z. (2006). Measuring emotions: Implications of a multimethod perspective. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 337–351). Washington: American Psychological Association. doi: 10.1037/11383-023
   Google Scholar
• Lindquist, K. A., Kober, H., & Barrett, L. F. (2015). The brain basis of emotion: A meta-analytic review. Behavioral and Brain Sciences, 35(3), 121–143. doi: 10.1017/S0140525X11000446
   Google Scholar
• Mandryk, R. L., Inkpen, K. M., & Calvert, T. W. (2006). Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & Information Technology, 25(2), 141–158.
   Web of Science ®Google Scholar
• Matamala, A., & Orero, P. (2007). Accessible opera in Catalan: Opera for all. In J. Díaz Cintas, P. Orero, & A. Remael (Eds.), Media for all: Subtitling for the deaf, audio description, and sign language (pp. 201–214). Amsterdam: Rodopi.
   Google Scholar
• Matamala, A., Perego, E., & Bottiroli, S. (2017). Dubbing versus subtitling yet again? An empirical study on user comprehension. Babel, 63(3), 423–441.
   Google Scholar
• Matamala, A., Soler-Vilageliu, O., Iturregui-Gallardo, G., Jankowska, A., Méndez-Ulrich, J.-L., & Serrano, A. (in press). Electrodermal activity as a measure of emotions in media accessibility research: Methodological considerations. Journal of Specialised Translation, 33(1–23).
   Web of Science ®Google Scholar
• Mauss, I. B., & Robinson, M. D. (2009). Measures of emotion: A review. Cognition and Emotion, 23(2), 209–237. doi: 10.1080/02699930802204677
   PubMed Web of Science ®Google Scholar
• Miesenberger, K., Klaus, J., & Zagler, W. (Eds.). (2002). Computers helping people with special needs. In 8th International Conference, ICCHP 2002. Linz, Austria: Springer.
   Google Scholar
• Mihkla, M., Hein, I., Kiissel, I., Räpp, A., Sirts, R., & Valdna, T. (2014). A system of spoken subtitles for Estonian Television. Human Language Technologies - the Baltic Perspective, 268, 19–26. doi: 10.3233/978-1-61499-442-8-19
   Google Scholar
• Montefinese, M., Ambrosini, E., Fairfield, B., & Mammarella, N. (2014). The adaptation of the affective norms for english words (ANEW) for Italian. Behavior Research Methods, 46(3), 887–903. doi: 10.3758/s13428-013-0405-3
   PubMed Web of Science ®Google Scholar
• Nielsen, S., & Bothe, H. H. (2008). Subpal: A device for reading aloud subtitles from television and cinema. In CEUR Workshop Proceedings (Vol. 415). Retrieved from http://www.scopus.com/inward/record.url?eid=2-s2.0-84876263872&partnerID=tZOtx3y1
   Google Scholar
• Nowlis, V. (1965). Research with the mood adjective check list. In S. S. Tompkins & C. E. Izard (Eds.), Affect, cognition, and personality: Empirical studies (pp. 352–389). Oxford: Springer.
   Google Scholar
• O’Hagan, M. (2016). Game localisation as emotion engineering: Methodological exploration. In Q. Zhang & M. O’Hagan (Eds.), Conflict and communication: A changing asia in a globalising world (pp. 123–144). New York: Nova.
   Google Scholar
• Orero, P. (2007). Audiosubtitling: A possible solution for opera accessibility in Catalonia. Tradterm, 13, 135. doi: 10.11606/issn.2317-9511.tradterm.2007.47470
   Google Scholar
• Orero, P. (2011). The audiodescription of spoken, tactile and written language in Be with me. In A. Matamala, J.-M. Lavaur & A. Serban (Eds.), Audiovisual translation in close-up (pp. 239–255). Bern: Peter Lang.
   Google Scholar
• Orero, P., Doherty, S., Kruger, J.-L., Matamala, A., Pedersen, J., Perego, E., … Szarkowska, A. (2018). Conducting experimental research in audiovisual translation (AVT): A position paper. JoSTrans, 30, 105–126.
   Google Scholar
• Orero, P., & Matamala, A. (2007). Accessible opera: Overcoming linguistic and sensorial barriers. Perspectives: Studies in Translatology, 15(4), 262–277.
   Web of Science ®Google Scholar
• Perego, E., Del Missier, F., & Bottiroli, S. (2014). Dubbing versus subtitling in young and older adults: Cognitive and evaluative aspects. Perspectives, 6623(July), 1–21. doi: 10.1080/0907676X.2014.912343
   Google Scholar
• Perego, E., Del Missier, F., Porta, M., & Mosconi, M. (2010). The cognitive effectiveness of subtitle processing. Media Psychology, 13(3), 243–272. doi: 10.1080/15213269.2010.502873
   Web of Science ®Google Scholar
• Pishghadam, R., Firooziyan, A., & Esfahani, P. (2017). Introducing emotioncy as an effective tool for the acceptance of Persian neologisms. Language Related Research, 8(5), 79–105.
   Google Scholar
• Plutchik, R. (2009). Emotions: A general psychoevolutionary theory. In K. R. Scherer & P. Ekman (Eds.), Approaches to emotion (pp. 197–220). New York, London: Psychology Press.
   Google Scholar
• Ramos, M. (2015). The emotional experience of films: Does audio description make a difference? Translator, 21(1), 68–94. doi: 10.1080/13556509.2014.994853
   Web of Science ®Google Scholar
• Ramos Caro, M. (2016). La traducción de los sentidos. Munich: LINCOM GmbH.
   Google Scholar
• Remael, A., Reviers, N., & Vercauteren, G. (2014). ADLAB audio description guidelines. European Union under the Lifelong Learning Programme (LLP).
   Google Scholar
• Reviers, N., & Remael, A. (2015). Recreating multimodal cohesion in audio description: A case study of audio subtitling in Dutch multilingual films. New Voices in Translation Studies, 13(1), 50–78.
   Google Scholar
• Romero-Fresco, P. (Ed.). (2016). The Reception of Subtitles for the Deaf and Hard of Hearing in Europe. Bern: Peter Lang AG. doi: 10.3726/978-3-0351-0888-0
   Google Scholar
• Rooney, B., Benson, C., & Hennessy, E. (2012). The apparent reality of movies and emotional arousal: A study using physiological and self-report measures. Poetics, 40(5), 405–422. doi: 10.1016/j.poetic.2012.07.004
   Web of Science ®Google Scholar
• Rottenberg, J. (2003). When emotion goes wrong: Realizing the promise of affective science. Clinical Psychology: Science and Practice, 10(2), 227–232. doi: 10.1093/clipsy/bpg012
   Web of Science ®Google Scholar
• Rottenberg, J., Ray, R. D., & Gross, J. J. (2007). Emotion elicitation using films. In J. A. Coan & J. J. B. Allen (Eds.), Handbook of emotion elicitation and assessment (pp. 9–28). New York: Oxford University Press.
   Google Scholar
• Royal National Institute of Blind People. (2017). New iOS 11 accessibility features for people with sight loss. Retrieved from https://www.rnib.org.uk/rnibconnect/new-ios-11-accessibility-features-people-sight-loss
   Google Scholar
• Scherer, K. R. (2005). What are emotions? And how can they be measured? Social Science Information, 44(4), 695–729. doi: 10.1177/0539018405058216
   Web of Science ®Google Scholar
• Sepielak, K. (2016). The effect of subtitling and voice-over on content comprehension and language identification in multilingual movies. International Journal of Sciences: Basic and Applied Research, 25(1), 166–182.
   Google Scholar
• Stearns, P. N., & Stearns, C. Z. (1985). Emotionology: Clarifying the history of emotions and emotional standards. The American Historical Review, 90(4), 813–836.
   PubMed Web of Science ®Google Scholar
• Szarkowska, A. (2011). Text-to-speech audio description: Towards wider availability of AD. The Journal of Specialised Translation, 15, 142–162. Retrieved from http://www.jostrans.org/issue15/art_szarkowska.pdf
   Google Scholar
• Szarkowska, A., & Mączyńska, M. (2011). Text-to-speech audio description with dudio subtitling to a non-fiction film . A case study based on La Soufriere by Werner Herzog. University of Warsaw.
   Google Scholar
• Thrane, L. K. (2013). Text-to-speech on digital TV: An explanatory study of spoken subtitles on DR1Syn. Copenhagen: IT University of Copenhagen.
   Google Scholar
• Udo, J. P., Acevedo, B., & Fels, D. I. (2010). Horatio audio-describes Shakespeare’s Hamlet: Blind and low-vision theatre-goers evaluate an unconventional audio description strategy. British Journal of Visual Impairment, 28(2), 139–156. doi: 10.1177/0264619609359753
   Google Scholar
• Udo, J. P., & Fels, D. (2009). Re-fashioning fashion: An exploratory study of a live audio described fashion show. Universal Access in the Information Society, 9(1), 63–75. doi: 10.1007/s10209-009-0156-1
   Web of Science ®Google Scholar
• Uhrig, M. K., Trautmann, N., Baumgärtner, U., Treede, R.-D., Henrich, F., Hiller, W., & Marschall, S. (2016, February). Emotion elicitation: A comparison of pictures and films. Frontiers in Psychology, 7. doi: 10.3389/fpsyg.2016.00180
   PubMed Web of Science ®Google Scholar
• Watson, D., & Clark, L. A. (1999). The PANAS-X: Manual for the positive and negative affect schedule – expanded form. Iowa City: Department of Psychological & Brain Sciences Publications.
   Google Scholar
• Westermann, R., Spies, K., Stahl, G., & Hesse, F. W. (1996). Relative effectiveness and validity of mood induction procedures: A meta-analysis. European Journal of Social Psychology, 26(4), 557–580. doi:10.1002/(SICI)1099-0992(199607)26:4<557::AID-EJSP769>3.0.CO;2-4
   Web of Science ®Google Scholar
• Wilson, G. M., & Sasse, M. A. (2006). Do users always know what’s good for them? Utilising physiological responses to assess media quality. In S. McDonald, Y. Waern, & G. Cocktrn (Eds.), People and computers XIV — usability or else! proceedings of HCI 2000 (pp. 327–339). London: Springer London.
   Google Scholar