Advanced search
Publication Cover
International Journal of Social Research Methodology Volume 21, 2018 - Issue 1
Submit an article Journal homepage
571
Views
6
CrossRef citations to date
0
Altmetric
Articles

Learning from linguistics: rethinking multimodal enquiry

Kirsten KohrsCulture, Media and Creative Industries, King’s College London, London, UKCorrespondence[email protected]
Pages 49-61 | Received 29 Nov 2016, Accepted 14 Apr 2017, Published online: 10 May 2017

References

  • Abbott, H. P. (2010). The Cambridge introduction to narrative (2nd ed.). Cambridge: Cambridge University Press.
  • Adolphs, S. (2012). Corpora: multimodal. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 1188–1190). Oxford: Blackwell.
  • Aitchison, J. (2010). Aitchison’s linguistics. London: Hodder Education.
  • Aitchison, J. (2012). Linguistics made easy. London: Hodder Education.
  • Akmamjian, A., Demers, R. A., Farmer, A. K., & Harnish, R. M. (2010). Linguistics: An introduction to language and communication (6th ed.). Cambridge: MIT Press.
  • Baker, P. (2010). Will Ms ever be as frequent as Mr? A corpus-based comparison of gendered terms across four diachronic corpora of British English. Gender and Language, 4, 125–149.
  • Baldry, A., & Thibault, P. J. (2006). Multimodal transcription and text analysis: A multimedia toolkit and coursebook. London: Equinox.
  • Baldry, A., & Thibault, P. J. (2008). Applications of multimodal concordances. Hermes – Journal of Language and Communication Studies, 41, 11–41.
  • Barthes, R. (1957/2009). Mythologies (A. Lavers & S. Reynolds, Trans.). London: Vintage.
  • Barthes, R. (1964/1999). Rhetoric of the image. In J. Evans & S. Hall (Eds.), Visual culture: The reader (pp. 33–40). London: Sage.
  • Barthes, R. (1967). Elements of semiology (A. Lavers & C. Smith, Trans.). London: Jonathan Cape.
  • Bateman, J. (2012). Multimodal corpus-based approaches. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 3983–3991). Wiley.
  • Bateman, J., Delin, J., & Henschel, R. (2002). Multimodality and empiricism: methodological issues in the study of multimodal meaning-making. GeM Report, 1. Retrived from http://www.fb10.unibremen.de/anglistik/langpro/projects/gem/downloads/bateman-delin-henschel-Salzburg.pdf
  • Bateman, J., Delin, J., & Henschel, R. (2004). Multimodality and empiricism: Preparing for a corpusbased approach to the study of multimodal meaning-making. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 65–87). Amsterdam: John Benjamins.10.1075/ddcs
  • Bateman, J., Delin, J., & Henschel, R. (2007). Mapping the multimodal genres of traditional and electronic newspapers. In T. D. Royce & W. L. Bowcher (Eds.), New directions in the analysis of multimodal discourse (pp. 147–172). Mahwah, NJ: Lawrence Erlbaum.
  • Bell, P. (2008). Content analysis of visual images. In T. van Leeuwen & C. Jewitt (Eds.), Handbook of visual analysis (pp. 10–34). London: Sage.
  • Bell, P., & Milic, M. (2002). Goffman’s gender advertisements revisited: Combining content analysis with semiotic analysis. Visual Communication, 1, 203–222.10.1177/147035720200100205
  • Bezemer, J., & Jewitt, C. (2010). Multimodal analysis: Key issues. In L. Litosseliti (Ed.), Research methods in linguistics (pp. 180–197). London: Continuum.
  • Bonelli, E. T., & Sinclair, J. (2006). Corpora. In K. Brown (Ed.), Encyclopedia of language & linguistics (2nd ed., pp. 206–220). Oxford: Elsevier.
  • Bordwell, D., & Thompson, K. (2013). Film art: An introduction (10th ed.). New York, NY: McGraw-Hill.
  • Bowen, C. J., & Thompson, R. (2013). Grammar of the shot (3rd ed.). New York, NY: Focal Press.
  • Bresnan, J. (2007). A few lessons from typology. Linguistic Typology, 11, 297–306.
  • Chandler, D. (2007). Semiotics: The basics. London: Routledge.
  • Culicover, P. W., & Jackendoff, R. (2010). Quantitative methods alone are not enough: Response to Gibson and Fedorenko. Trends in Cognitive Sciences, 14, 234–235.10.1016/j.tics.2010.03.012
  • Culler, J. (2000). Literary theory: A very short introduction. Oxford: Oxford University Press.
  • Dean, J. (2016). “Submitting Love?” A sensory sociology of Southbourne. Qualitative Inquiry, 22, 162–168.10.1177/1077800415605050
  • de Saussure, F. (1972/1983). Course in general linguistics (R. Harris, Trans.). London: Duckworth.
  • duChemin, D. (2012). Photographically speaking: A deeper look at creating stronger images. Berkeley, CA: New Riders.
  • Dikovitskaya, M. (2005). Visual culture: The study of the visual after the cultural turn. Cambridge: MIT Press.
  • Ekman, P. (1985). Telling lies: Clues to deceit in the marketplace, politics, and marriage. New York, NY: Norton.
  • Ekman, P. (2003). Emotions revealed: Recognizing faces and feelings to improve communication and emotional life. New York, NY: Holt.
  • Forceville, C. (1998). Pictorial metaphor in advertising. London: Routledge.
  • Forceville, C. (1999). Educating the eye? Kress & Van Leeuwen’s reading images: The grammar of visual design (1996). Language and Literature, 8, 163–178.10.1177/096394709900800204
  • Forceville, C. (2007). Multimodal transcription and text analysis: A multimedia toolkit and coursebook: Anthony Baldry, Paul J. Thibault, Equinox, London/Oakville, 2006, 270 pp., $40/£24.99 (paperback), ISBN 1-904768-07-5. Journal of Pragmatics, 39, 1235–1238.
  • Forceville, C. (2009). New directions in the analysis of multimodal discourse. Journal of Pragmatics, 41, 1459–1463.10.1016/j.pragma.2009.01.007
  • Forceville, C. (2011). Practical cues for helping develop image and multimodal discourse scholarship. In K. Sachs-Hombach & R. Totzke (Eds.), Bilder – Sehen – Denken. Zum Verhältnis von begrifflich-philosophischen und empirisch-psychologischen Ansätzen in der bildwissenschaftlichen Forschung [Images – Looking – Thinking. On the relationship between conceptual-philosophical and empirical-psychological approaches in image-scientific research] (pp. 33–51). Cologne: Halem.
  • Freeman, M. (2013). Michael Freeman’s photo school fundamentals. New York, NY: Focal Press.
  • Gibson, E., & Fedorenko, E. (2010). Weak quantitative standards in linguistics research. Trends in Cognitive Sciences, 14, 233–234.10.1016/j.tics.2010.03.005
  • Gibson, E., & Fedorenko, E. (2013). The need for quantitative methods in syntax and semantics research. Language and Cognitive Processes, 28, 88–124.10.1080/01690965.2010.515080
  • Goffman, E. (1979). Gender advertisements. London: The Macmillan Press.
  • Goldman, R. (1992/2000). Reading ads socially. London: Routledge.
  • Halliday, M. A. K. (1994/2006). Systemic theory. In K. Brown (Ed.), Encyclopedia of language & linguistics (2nd ed., pp. 443–448). Oxford: Elsevier.
  • Harris, R. (2006). Modern linguistics: 1800 to the present day. In K. Brown (Ed.), Encyclopedia of language & linguistics (2nd ed., pp. 203–210). Oxford: Elsevier.
  • Herriman, J. (2012). Systemic functional linguistics. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 5509–5517). Oxford: Blackwell.
  • Hill, C. A. (2009). Visual communication theories. In S. W. Littlejohn & K. A. Foss (Eds.), Encyclopedia of communication theory (pp. 1002–1005). Thousand Oaks, CA: Sage.
  • Hill, C. A., & Helmers, M. (Eds.). (2004). Defining visual rhetorics. Mahwah, NJ: Lawrence Erlbaum.
  • Holsanova, J. (2012). New methods for studying visual communication and multimodal integration. Visual Communication, 11, 251–257.10.1177/1470412912446558
  • Hudson, S., & Noonan, N. (2015). The art of writing about art (2nd ed.). Stamford, CT: Cengage Learning.
  • Hunston, S. (2006). Corpus linguistics. In K. Brown (Ed.), Encyclopedia of language & linguistics (2nd ed., pp. 234–248). Oxford: Elsevier.
  • Hunston, S. (2012). Corpus linguistics: Historical development. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 1366–1372). Oxford: Wiley.
  • Jewitt, C., & Oyama, R. (2001/2008). Visual meaning: A social semiotic approach. In T. van Leeuwen & C. Jewitt (Eds.), Handbook of visual analysis (pp. 134–156). London: Sage.
  • Jewitt, C., Xambo, A., & Price, S. (2016). Exploring methodological innovation in the social sciences: The body in digital environments and the arts. International Journal of Social Research Methodology, 20, 105–120.
  • Kaufmann, J., & Holbrook, T. (2016). Introduction. Qualitative Inquiry, 22, 159–160.10.1177/1077800415615542
  • Kienpointner, M. (2001). Linguistics. In T. O. Sloane (Ed.), Encyclopedia of rhetoric (pp. 426–449). Oxford: Oxford University Press.
  • Kohrs, K., & Gill, R. (in press). Confident appearing: Revisiting ‘Gender Advertisements’ in contemporary culture. In J. Baxter & J. Angouri (Eds.), The Routledge handbook of language, gender and sexuality. Abingdon: Routledge.
  • Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Abingdon: Routledge.
  • Kress, G., & van Leeuwen, T. (1996/2007). Reading images: The grammar of visual design (2nd ed.). New York, NY: Routledge.
  • Krishnamurthy, R. (2006). Corpus lexicography. In K. Brown (Ed.), Encyclopedia of language & linguistics (2nd ed., pp. 250–254). Oxford: Elsevier.
  • Lakoff, G., & Johnson, M. (1980/2003). Metaphors we live by. Chicago, IL: The University of Chicago Press.
  • Langford, M. (2000). Basic photography (7th ed.). Oxford: Focal Press.
  • Lanham, R. A. (1991). A handlist of rhetorical terms (2nd ed.). Berkeley: University of California Press.
  • Leith, S. (2011). You talkin’ to me?: Rhetoric from Aristotle to Obama. London: Profile Books.
  • Lewis, R., & Lewis, S. I. (2014). The power of art (3rd ed.). Boston, MA: Wadsworth, Cengage Learning.
  • Lotman, M. (2006). Rhetoric: Semiotic approaches. In K. Brown (Ed.), Encyclopedia of language & linguistics (2nd ed., pp. 582–589). Oxford: Elsevier.
  • Martin, J.-C., Paggio, P., Kuehnlein, P., Stiefelhagen, R., & Pianesi, F. (2008). Introduction to the special issue on multimodal corpora for modeling human multimodal behavior. Language Resources and Evaluation, 42, 253–264.10.1007/s10579-008-9068-6
  • McLoughlin, L. (2008). The language of magazines. London: Routledge.
  • Messaris, P. (1997). Visual persuasion: The role of images in advertising. Thousand Oaks, CA: Sage.
  • Messaris, P. (2003). Visual communication: Theory and research. Journal of Communication, 53, 551–556.10.1111/jcom.2003.53.issue-3
  • Mitchell, W. J. T. (1994). Picture theory: Essays on verbal and visual representation. Chicago, IL: University of Chicago Press.
  • Müller, M. G. (2007). What is visual communication? Past and future of an emerging field of communication research. Studies in Communication Sciences, 7, 7–34.
  • Müller, M. G., Kappas, A., & Olk, B. (2012). Perceiving press photography: A new integrative model, combining iconology with psychophysiological and eye-tracking methods. Visual Communication, 11, 307–328.10.1177/1470357212446410
  • Norris, S. (2002). The implications of visual research for discourse analysis: Transcription beyond language. Visual Communication, 1, 93–117.
  • Norris, S. (2004). Multimodal discourse analysis: A conceptual framework. In P. LeVine & S. R (Eds.), Discourse and technology: Multimodal discourse analysis (pp. 101–115). Washington, DC: Georgetown University Press.
  • Norris, S. (2013). Multimodal communication: Overview. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 3977–3978. Oxford: Blackwell.
  • O’Halloran, K. L. (2008). Systemic functional-multimodal discourse analysis (SF-MDA): Constructing ideational meaning using language and visual imagery. Visual Communication, 7, 443–475.10.1177/1470357208096210
  • O’Halloran, K. L., Podlasov, A., Chua, A., & K.L.E, M. (2012). Interactive software for multimodal analysis. Visual Communication, 11, 363–381.10.1177/1470357212446414
  • O’Halloran, K. L., & Smith, B. A. (2013a). Multimodal text analysis. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 4124–4129). Oxford: Blackwell.
  • O’Halloran, K. L., & Smith, B. A. (2013b). Multimodality and technology. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 4089–4094). Oxford: Wiley.
  • O’Halloran, K. L., Tan, S., Smith, B. A., & Podlasov, A. (2011). Multimodal analysis within an interactive software environment: Critical discourse perspectives. Critical Discourse Studies, 8, 109–125.10.1080/17405904.2011.558687
  • Ocvirk, O. G., Stinson, R. E., Wigg, P. R., Bone, R. O., & Cayton, D. L. (2013). Art fundamentals: Theory and practice (12th ed.). New York, NY: McGraw Hill.
  • Pinker, S. (1995). The language instinct: The new science of language and mind. London: Penguin Books.
  • Präkel, D. (Ed.). (2010). The visual dictionary of photography. Lausanne: AVA.
  • Rohlfing, K., Loehr, D., Duncan, S., Brown, A., Franklin, A., Kimbarra, I., … Wellinghoff, S. (2006). Comparison of multimodal annotation tools: Workshop report. Online-Zeitschrift zur Verbalen Interaktion, 7, 99–123.
  • Scholz, B. C., Pelletier, F. J., & Pullum, G. K. (2015). Philosophy of linguistics. In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Spring 2015 ed.). Retreived from https://plato.stanford.edu/archives/spr2015/entries/linguistics/
  • Section introduction: Bounds of meaning. (2016). Qualitative inquiry, 22, 200.
  • Section introduction: Disciplining hypermodality. (2016). Qualitative Inquiry, 22, 191.
  • Section introduction: Presence and absence. (2016). Qualitative Inquiry, 22, 161.
  • Section introduction: Textual explosions. (2016). Qualitative Inquiry, 22, 175.
  • Siszsons, H. (2013). Transcribing multimodal interaction. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 5894–5901). Oxford: Blackwell.
  • Sloane, T. O. (Ed.). (2001). Encyclopedia of rhetoric. Oxford: Oxford University Press.
  • Smith, B. A., Tan, S., Podlasov, A., & O’Halloran, K. L. (2011). Analysing multimodality in an interactive digital environment: Software as a meta-semiotic tool. Social Semiotics, 21, 359–380.10.1080/10350330.2011.564386
  • Stubbs, M., & Halbe, D. (2012). Corpus linguistics: Overview. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 1377–1379). Oxford: Blackwell.
  • Talmy, L. (2006). Cognitive linguistics. In K. Brown (Ed.), Encyclopedia of language & linguistics (2nd ed., pp. 542–546). Oxford: Elsevier.
  • Trask, R. L. (1999). Key concepts in language and linguistics. Key Concept Series.
  • Trask, R. L., & Mayblin, B. (2012). Introducing linguistics: A graphic guide. London: Icon Books.
  • van Leeuwen, T. (2000). It was just like magic – A multimodal analysis of children’s writing. Linguistics and Education, 10, 273–305.
  • Waterhouse, A.-H. L., Otterstad, A. M., & Jensen, M. (2016). … anything but synchronized swimming/methodologies … artistic movements in/with unknown inventions. Qualitative Inquiry, 22, 201–209.10.1177/1077800415605063
  • Wells, L. (Ed.). (2015). Photography: A critical introduction (5th ed.). Abingdon: Routledge.
  • Williamson, J. (1978/2002). Decoding advertisements: Ideology and meaning in advertisements. London: Marion Boyars.
  • Wilson, D., & Sperber, D. (2002). Truthfulness and relevance. Mind, 111, 583–632.10.1093/mind/111.443.583

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.