Emotion Resonance and Divergence: a semiotic analysis of music and sound in “The Lost Thing” an animated short film and “Elizabeth” a film trailer

References

• ACARA (Australian Curriculum, Assessment and Reporting Authority). 2016. v8.3. Australian Curriculum: General Capability: Literacy. Accessed May 2017. http://www.australiancurriculum.edu.au.
   Google Scholar
• Barton, G. M. 2018. Music Learning and Teaching in Socio-Culturally Diverse Contexts: Implications for Classroom Practice. London: Palgrave Macmillan.
   Google Scholar
• Barton, G., and R. Ewing. 2017. “Encouraging a Dynamic Relationship Between the Arts and Literacy.” In The Palgrave Handbook of Global Arts Education, edited by G. Barton and M. Baguley, 221–243. London: Palgrave Macmillan.
   Google Scholar
• Barton, G., and L. Unsworth. 2014. “Music, Multiliteracies and Multimodality: Exploring the Book and Movie Versions of Shaun Tan’s ‘The Lost Thing.’” Australian Journal of Language and Literacy 37 (1): 3–20. http://www.alea.edu.au.
   Google Scholar
• Bateman, J. 2017. “Triangulating Transmediality: A Multimodal Semiotic Framework Relating Media, Modes and Genres.” Discourse, Context & Media 20: 160–174. doi: 10.1016/j.dcm.2017.06.009
   Web of Science ®Google Scholar
• Bednarek, M. 2008. Emotion Talk Across Corpora. Hampshire: Palgrave Macmillan.
   Google Scholar
• Bolivar, V., A. Cohen, and J. Fentress. 1994. “Semantic and Formal Congruency in Music and Motion Pictures: Effects on the Interpretation of Visual Action.” Psychomusicology: A Journal of Research in Music Cognition 13: 28–59. doi:10.1037/h0094102.
   Google Scholar
• Boltz, M. 2004. “The Cognitive Processing of Film and Musical Soundtracks.” Memory and Cognition 32 (7): 1194–1205. doi:10.3758/BF03196892.
   PubMed Web of Science ®Google Scholar
• Bordwell, D., and K. Thompson. 2013. Film Art: An Introduction. 10th ed. New York: McGraw-Hill.
   Google Scholar
• Brannigan, E. 2013. Narrative Comprehension and Film. New York: Routledge.
   Google Scholar
• Carroll, N. 1999. “Film, Emotion and Genre.” In Passionate Views: Film, Cognition and Emotion, edited by C. Plantinga, and G. Smith, 1–47. Baltimore, MD: John Hopkins University Press.
   Google Scholar
• Cohen, A. 2001. “Music as a Source of Emotion in Film.” In Music and Emotion, edited by P. N. Juslin, and J. Sloboda, 249–272. New York: Oxford University Press.
   Google Scholar
• Cook, N. 1998. Analysing Music Multimedia. Oxford: Clarendon.
   Google Scholar
• Cook, N., and Dibben, N. 2001. “Musical Approaches to Emotion." In Music and Emotion: Theory and Research, edited by P. N. Juslin, and J. A. Sloboda, 45–70. Oxford: Oxford University Press.
   Google Scholar
• Crystal, D. 1976. Prosodic Systems and Intonation in English. Cambridge: Cambridge University Press.
   Google Scholar
• Davidson, R. J., K. R. Scherer, and H. H. Goldsmith, eds. 2003. Handbook of Affective Sciences. New York: Oxford University Press.
   Google Scholar
• Davies, S. 2010. “Emotions Expressed and Aroused by Music: Philosophical Perspectives.” In Handbook of Music and Emotion: Theory, Research, Applications, edited by P. N. Juslin, and J. A. Sloboda, 15–44. Oxford: Oxford University Press.
   Google Scholar
• Duncum, P. 2004. “Visual Culture Isn’t Just Visual: Multiliteracy, Multimodality and Meaning.” Studies in Art Education 45 (3): 252–264. doi:10.1080/00393541.2004.11651771.
   Google Scholar
• Ekman, P., and W. Friesen. 1978. The Facial Affect Coding System. Palo Alto, CA: Consulting Psychologists P.
   Google Scholar
• Ellis, R., and R. Simons. 2005. “The Impact of Music on Subjective and Physiological Indices of Emotion While Viewing Films..” Psychomusicology: A Journal of Research in Music Cognition 19: 15–40. doi:10.1037/h0094042.
   Google Scholar
• Feng, D., and K. O’Halloran. 2012. “Representing Emotive Meaning in Visual Images: A Social Semiotic Approach.” Journal of Pragmatics 44 (4): 2067–2084. doi:10.1016/j.pragma.2012.10.003.
   Web of Science ®Google Scholar
• Feng, D., and K. O’Halloran. 2013. “The Multimodal Representation of Emotion in Film: Integrating Cognitive and Semiotic Approaches.” Semiotica 197: 79–100. doi:10.1515/sem-2013-0082.
   Web of Science ®Google Scholar
• Frijda, N. H. 1986. The Emotions. Cambridge/Paris: Cambridge UP/ Editions de la Mainson des Sciences de L’Homme.
   Google Scholar
• Frijda, N. H. 2007. The Laws of Emotion.. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Gabrielsson, A., and P. N. Juslin. 2003. “Emotional Expression in Music.” In Handbook of Affective Sciences, edited by R. J. Davidson, K. R. Scherer, and J. J. Goldsmith, 503–534. New York: Oxford University Press.
   Google Scholar
• Gabrielsson, A., and E. Lindstrom. 2010. “The Role of Structure in the Musical Expression of Emotions.” In Handbook of Music and Emotion: Theory, Research, Applications, edited by P. N. Juslin, and J. Sloboda, 367–400. Oxford: Oxford University Press.
   Google Scholar
• Gorbman, C. 1987. Unheard Melodies: Narrative Film Music. Bloomington: Indiana University Press.
   Google Scholar
• Gundlach, R. H. 1935. “Factors Determining the Characterization of Musical Phrases.” The American Journal of Psychology 47: 624–644. doi:10.2307/1416007.
   Google Scholar
• Halliday, M. A. K. 1967. Intonation and Grammar in British English. The Hague: Mouton.
   Google Scholar
• Halliday, M. A. K., and W. Greaves. 2008. Intonation in the Grammar of English. London: Equinox.
   Google Scholar
• Jewitt, C. (ed.) 2009. The Routledge Handbook of Multimodal Analysis. London: Routledge.
   Google Scholar
• Juslin, P. N., and J. Sloboda. ( Eds.) 2010. Handbook of Music and Emotion: Theory, Research, Applications. New York: Oxford University Press.
   Google Scholar
• Kalinak, K. 1992. Settling the Score: Music and the Classical Hollywood Film. Madison: University of Wisconsin.
   Google Scholar
• Kapur, S. ( Director). 2007. Elizabeth the Golden Age. (Motion Picture, Filmtrailer). Nicholson and M. Hirst (Writers). Rahman, A. and C. Armstrong (Composers). Working Title Films production. Universal Pictures distribution. Accessed May 2017 http://www.iMBD.com.
   Google Scholar
• Kress, G. 2009. Multimodality: A Social Semiotic Approach to Communication. London: Routledge.
   Google Scholar
• Lemke, J. 2015. “Feeling and Meaning: A Unitary Bio-Semiotic Account.” In International Handbook of Semiotics, edited by P. Trifonas, 589–617. New York: Springer.
   Google Scholar
• Magliano, J. P., K. Dijkstra, and R. A. Zwaan. 1996. “Generating Predictive Inferences While Viewing a Movie.” Discourse Processes 22 (3): 199–224. doi:10.1080/01638539609544973.
   Web of Science ®Google Scholar
• Marshall, S. K., and A. Cohen. 1988. “Effects of Musical Soundtracks on Attitudes Toward Animated Geometric Figures.” Music Perception: An Interdisciplinary Journal 6 (1): 95–112. doi:10.2307/40285417.
   Web of Science ®Google Scholar
• Martin, J. R. 2008. “Intermodal Reconcilitation: Mates in Arms.” In New Literacies and the English Curriculum: Multimodal Perspectives, edited by L. Unsworth, 112–147. London: Continuum.
   Google Scholar
• Martin, J. 2016. “Meaning Matters: A Short History of Systemic Functional Linguistics.” Word 62 (1): 35–58. doi:10.1080/00437956.2016.1141939.
   Web of Science ®Google Scholar
• Martin, J. R., and D. Rose. 2007. Working With Discourse: Meaning Beyond the Clause. 2nd ed. London: Continuum.
   Google Scholar
• Martin, J. R., and P. White. 2005. The Language of Evaluation: Appraisal in English. Hampshire: Palgrave Macmillan.
   Google Scholar
• Martinec, R. 2001. “Interpersonal Resources in Action.” Semiotica 135 (1): 117–145. doi:10.1515/semi.2001.056.
   Web of Science ®Google Scholar
• McDonald, E. 2010. “Dealing with Musical Meaning.” In Semiotic Margins: Reclaiming Meaning, edited by S. Dreyfus, S. Hood, and M. Stenglin, 102–121. London: Continuum.
   Google Scholar
• Meyer, L. B. 2001. “Music and Emotion: Distinction and Uncertainties.” In Music and Emotion: Theory and Research, edited by P. N. Juslin, and J. Sloboda, 341–360. New York: Oxford University Press.
   Google Scholar
• Nattiez, J. 1990. Music and Discourse: Towards a Semiology of Music. Princeton: Princeton University Press.
   Google Scholar
• Noad, B. 2016. “ Emotions in Filmtrailers: A Social Semiotic Analysis of Wordings, Intonation and Music.” Unpublished PhD thesis, School of Education, University of New England Australia.
   Google Scholar
• Noad, B., and L. Unsworth. 2007. “Aural Perspective and Social Distance in ‘The Queen’ Filmtrailer.” Literacy Learning in the Middle Years 15 (3): 8–19. http://www.alea.edu.au.
   Google Scholar
• O’Halloran, K. 2008. “Systemic Functional-Multimodal Discourse Analysis (SF-MDA): Constructing Ideational Meaning Using Language and Visual Imagery.” Visual Communication 7 (4): 443–475. doi:10.1177/1470357208096210.
   Web of Science ®Google Scholar
• Oatley, K., D. Keltner, and J. Jenkins. eds. 2006. Understanding Emotions. Oxford: Blackwell.
   Google Scholar
• Painter, C., J. Martin, and L. Unsworth. 2013. Reading Visual Narratives: Image Analysis of Children’s Picture Books. Sheffield: Equinox.
   Google Scholar
• Ruhemann, A., and S. Tan. (Directors). 2010 . The Lost Thing (DVD, PAL). Yezerski, M. (Composer). Australia: Madman Entertainment.
   Google Scholar
• Sadie, S. 2001. The New Grove Dictionary of Music and Musicans. 2nd ed. Oxford: Oxford University Press. http://www.oxfordmusiconline.
   Google Scholar
• Scherer, K. R., T. Johnstone, and G. Klasmeyer. 2003. “Vocal Expression of Emotion.” In Handbook of Affective Sciences, edited by R. J. Davidson, K. R. Scherer, and H. H. Goldsmith, 433–456. New York: Oxford University Press.
   Google Scholar
• Scollon, R. 2003. “The Dialogist in a Positivist World: Theory in the Social Sciences and the Humanities at the End of the Twentieth Century.” Social Semiotics 13 (1): 71–88. doi:10.1080/1035033032000133517.
   Google Scholar
• Sloboda, J., and P. N. Juslin. 2001. “Psychological Perspectives on Music and Emotion.” In Music and Emotion: Theory and Research, edited by P. N. Juslin, and J. Sloboda, 71–104. New York: Oxford University Press.
   Google Scholar
• Sloboda, J., and P. Juslin. 2010. "Emotion in Music: Emergent Themes." In Handbook of Music and Emotion: Theory, Research, Applications, edited by P. N. Juslin, and J. A. Sloboda, 73–97. Oxford: Oxford University Press.
   Google Scholar
• Smith, J. 1999. “Movie as Moving Music: Emotion, Cognition and the Film Score.” In Passionate Views: Film, Cognition and Emotions, edited by C. Plantinga, and G. Smith, 146–167. Baltimore, MD: John Hopkins University Press.
   Google Scholar
• Smith, G. M. 2003. Film Structure and the Emotion System. Cambridge: Cambridge University Press.
   Google Scholar
• Tan, E. S. 1996. Emotion and the Structure of Narrative Film: Film as an Emotion Machine.. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Tan, S.-L., M. P. Spackman, and M. A. Bezdek. 2007. “Viewers’ Interpretations of Film Characters’ Emotions: Effects of Presenting Film Music Before or After a Character is Shown.” Music Perception: An Interdisciplinary Journal 25 (20): 135–152. doi:10.1525/mp.2007.25.2.135.
   Web of Science ®Google Scholar
• Tench, P. 1996. The Intonation Systems of English. London: Cassell.
   Google Scholar
• Thompson, W., F. Russo, and D. Sinclair. 1994. “Effects of Underscoring on the Perception of Closure in Filmed Events..” Psychomusicology: A Journal of Research in Music Cognition 13: 9–27. doi:10.1037/h0094103.
   Google Scholar
• van Leeuwen, T. 1999. Speech, Music, Sound. London: Macmillan.
   Google Scholar
• van Leeuwen, T. 2005. Introducing Social Semiotics. London: Routledge.
   Google Scholar
• van Leeuwen, T. 2009. “Parametric Systems: the Case of Voice Quality.” In The Routledge Handbook of Multimodal Analysis, edited by C. Jewitt, 68–77. London: Routledge.
   Google Scholar
• Veronesi, D., and S. Pasquandrea. ( Eds). 2014. “Doing (Things with) Sounds: Introduction to the Special Issue.” Social Semiotics 24 (4): 369–380. doi: 10.1080/10350330.2014.929379
   Web of Science ®Google Scholar
• Walsh, M., C. Durrant, and A. Simpson. 2015. “Moving in a Multimodal Landscape: Examining 21st Century Pedagogy for Multicultural and Multilingual Students.” English in Australia 50 (1): 67–76.
   Web of Science ®Google Scholar