This study investigates how epistemic stance is encoded and perceived in face-to-face communication when language is regarded as comprised by speech and gesture. Two studies were conducted with this goal in mind. The first study consisted of a production task in which participants performed opinion reports. Results showed that speakers communicate epistemic stance both verbally and non-verbally, and that specific prosodic and gestural patterns are used to express different epistemic and evidential meanings. The second study consisted of a rating task in which listeners rated the degree of certainty expressed by the opinion reports. Results showed that the number of gestural high certainty markers used by a speaker was a good predictor of the perception of epistemic high certainty. We thus claim that prosodic and gestural markers can be regarded as overt manifestations of epistemicity and evidentiality, and they appear to be especially effective in the communication of epistemic stance.
Acknowledgments
We thank participants of the Nature of Evidentiality 2012 and Modality, Corpus, Discourse meetings, especially Johan Rooryk, Monica Lau, Margaret Speas, Eric Melac, Carita Paradis, and Jan Nuyts, for their helpful comments. We also acknowledge the assistance given by Maria Dolors Cañada in using the Atlas.ti procedure to code our data and by Núria Esteve Gibert for her participation in the inter-reliability test.
Notes
A preliminary version of this article was presented at The Nature of Evidentiality 2012 (Leiden, June 13–15, 2012), and Modality, Corpus, Discourse (Lund, June 7–8, 2012).
3 Participants gave their informed consent to participate in accordance with EU regulations, Spanish law, and the regulations of the host university.
4 Admittedly, having given the listener instructions not to intervene verbally while listening to the opinion report indeed reduced the spontaneity of the communication, but on the other hand this offered the methodological advantage of reducing the number of factors to be taken into consideration in the latter analysis. Crucially, it controlled for the potential effects of turn-taking, whose importance is well known in the Conversation Analysis literature.
5 In both the listener and the speaker versions of the Likert scales, the sentences referred to the speaker, so that for the speaker it read I think it works, but for the listener it read He/she thinks it works.
6 We decided to abide strictly by McNeill's (Citation1992) labeling rules. We therefore labeled motion, too. According to McNeill's labeling system, motion is described in two dimensions: direction of motion and location in the space where motion is articulated. The description of motion, especially direction, turned out to be the most difficult to label, because movements can have several and complex trajectories. The location in space where the movement is articulated is defined according to McNeill (Citation1992, p. 378) along the center/periphery, left/right, inner/outer, or upper/lower dimensions. Subsequent analyses demonstrated that this aspect of gesture was not especially meaningful in the expression of epistemic stance.
7 As it is common in studies about prosody and/or gesture, the aim of the reliability test is not to assess the reliability of a single transcriber but of the transcription system in general (Breen et al., Citation2012; Escudero et al., 2012; Grice et al., Citation1996; Jun et al., Citation2000; Petrelli et al., 1994; Syrdal & McGory, Citation2000; Yoon et al., Citation2004).
8 A total of five instances of simultaneous gestural and textual markers of evidentiality were found in our database. Because of this low number of occurrences, we were not able to carry out a GLMM analysis to test for the significance of these patterns.
9 As suggested by one of the reviewers, if one were to rely exclusively on textual marking, this sentence might be interpreted as conveying LC because the speaker might be implying that “they” (i.e., someone else, not me) says it works. It could thus easily communicate LC to a hearer because the speaker is setting up a “me/them” situation in which the speaker is distancing him- or herself from the assertion about the efficacy of aspirin/acupuncture. Nevertheless, the examples presented in show that a similar sentence from a textual perspective can be interpreted either as LC or as HC, depending on the gestural and prosodic realization of the sentences (see also for an example of a similar minimal pair).
10 offers examples of the L+H* !H% and H+L* L% nuclear configurations.
11 We acknowledge a point raised by one of our reviewers: Even though the strategy used in this study of isolating discourse into its component parts allows us to get a complete picture of what is happening in multimodal discourse, we should be aware that some information might be lost when we reduce the whole to its parts in this way.
Chafe, W., & Nichols, J. (Eds.). (1986). Evidentiality: The linguistic coding of epistemology. Norwood, NJ: Ablex.
de Haan, F. (2001). The relation between modality and evidentiality. In R. Müller & M. Reis (Eds.), Modalität und Modalverben im Deutschen (pp. 201–216). Linguistische Berichte, Sonderheft 9. Hamburg, Germany: H. Buske.
de Haan, F. (2005). Encoding speaker perspective: Evidentials. In Z. Frajzyngier, A. Hodges, & D. S. Rood (Eds.), Linguistic diversity and language theories (pp. 379–397). Amsterdam, Netherlands: John Benjamins.
Nuyts, J. (2005). Modality: Overview and linguistic issues. In W. Frawley (Ed.), The expression of modality (pp. 1–26). Berlin, Germany: Mouton de Gruyter.
Hoye, L. F. (2008). Evidentiality in discourse: A pragmatic and empirical account. In J. Romero-Trillo (Ed.), Pragmatics and corpus linguistics (pp. 151–174). Berlin, Germany: Mouton de Gruyter.
Marín Arrese, J. (2004). Evidential and epistemic qualifications in the discourse of fact and opinion. In J. Marín Arrese (Ed.), Perspectives on evidentiality and modality (pp. 153–184). Madrid, Spain: Editorial Complutense.
Du Bois, J. W. (2007). The stance triangle. In R. Englebretwson (Ed.), Stancetaking in discourse: Subjectivity, evaluation, interaction (pp. 139–182). Amsterdam, Netherlands: John Benjamins.
Hoye, L. F. (2008). Evidentiality in discourse: A pragmatic and empirical account. In J. Romero-Trillo (Ed.), Pragmatics and corpus linguistics (pp. 151–174). Berlin, Germany: Mouton de Gruyter.
Dohen, M., & Loevenbruck, H. (2009). Interaction of audition and vision for the perception of prosodic contrastive focus. Language and Speech, 52, 177–206.
Krahmer, E., Ruttkay, Z., Swerts, M., & Wesselink, W. (2002). Pitch, eyebrows and the perception of focus. In B. Bel & I. Marlien (Eds.), Proceedings of the First International Conference on Speech Prosody (pp. 443–446). Aix en Provence, France: SProSig.
Swerts, M., & Krahmer, E. (2004). Congruent and incongruent audiovisual cues to prominence. In Proceedings of the Second International Conference on Speech Prosody (Nara) (pp. 69–72). Nara, Japan: SProSig.
Swerts, M., & Krahmer, E. (2008). Facial expressions and prosodic prominence: Comparing modalities and facial areas. Journal of Phonetics, 36, 219–238.
Borràs-Comes, J., & Prieto, P. (2011). ‘Seeing tunes’. The role of visual gestures in tune interpretation. Journal of Laboratory Phonology, 2, 355–380.
Srinivasan, R. J., & Massaro, D. W. (2003). Perceiving prosody from the face and voice. Distinguishing statements from echoic questions in English. Language and Speech, 46, 1–22.
Swerts, M., & Krahmer, E. (2004). Congruent and incongruent audiovisual cues to prominence. In Proceedings of the Second International Conference on Speech Prosody (Nara) (pp. 69–72). Nara, Japan: SProSig.
Swerts, M., & Krahmer, E. (2008). Facial expressions and prosodic prominence: Comparing modalities and facial areas. Journal of Phonetics, 36, 219–238.
Crespo-Sendra, V., Kaland, C., Swerts, M., & Prieto, P. (2013). Perceiving incredulity: The role of intonation and facial gestures. Journal of Pragmatics, 47, 1–13.
Breen, M., Dilley, L. C., Kraemer, J., & Gibson, E. (2012). Inter-transcriber reliability for two systems of prosodic annotation: ToBI (Tones and Break Indices) and RaP (Rhythm and Pitch. Corpus Linguistics and Linguistic Theory, 8, 277–312.
Grice, M., Reyelt, M., Benzmüller, R., Mayer, J., & Batliner, A. (1996). Consistency in transcription and labeling of German intonation with GToBI. In Proceedings of International Conference on Spoken Language Processing (pp. 1716–1719). Philadelphia, PA.
Jun, S.-A., Lee, S.-H., Kim, K., & Lee, Y.-J. (2000). Labeler agreement in transcribing Korean intonation with K-ToBI. In Proceedings of the International Conference on Spoken Language Processing (pp. 211–214). Beijing, China: Chinese Friendship Publishers.
Syrdal, A. K., & McGory, J. (2000). Inter-transcriber reliability of ToBI prosodic labeling. In Proceedings of the International Conference on Spoken Language Processing (pp. 235–238). Beijing, China.
Yoon, T.-J., Chavarría, S., Cole, J., & Hasegawa-Johnson, M. (2004). Intertranscriber reliability of prosodic labeling on telephone conversation using ToBI. In Proceedings of the International Conference on Spoken Language Processing (pp. 2729–2732). Jeju, South Korea: Sunjin Printing Company.
This research was supported by the Spanish Ministerio de Economía y Competitividad (research grants BFU2012-31995 and FFI2011-25755) and by a grant awarded by the Generalitat de Catalunya (2014SGR-925).