1,845
Views
15
CrossRef citations to date
0
Altmetric
Articles

General- and Language-Specific Factors Influence Reference Tracking in Speech and Gesture in Discourse

, &

Figures & data

Figure 1. Stills from, the two video stimuli, kitchen video at the top and office video at the bottom.

Figure 1. Stills from, the two video stimuli, kitchen video at the top and office video at the bottom.

Table 1. The distribution of overt and null pronouns that were used for pragmatically marked and unmarked referents in maintained and re-introduced referent contexts.

Table 2. The total number of referring expressions in speech and gestures accompanying them in maintained and re-introduced referent contexts.

Table 3. Proportion of pragmatically marked and unmarked overt pronouns in speech that were accompanied by gestures. The proportions were calculated as the number of pronouns that were accompanied by gestures divided by the number of pronouns in speech.

Figure 2. The speaker re-introduce the character that is highlighted in the picture with an NP in sppech. Her index-finger pointing gesture temporally aligns with the subject NP in bold.

Figure 2. The speaker re-introduce the character that is highlighted in the picture with an NP in sppech. Her index-finger pointing gesture temporally aligns with the subject NP in bold.

Figure 3. The speaker maintains the character that is highlighted in the picture with an overt pronoun in sppech. Her index-finger pointing gesture temporally aligns with the subject pronoun in bold.

Figure 3. The speaker maintains the character that is highlighted in the picture with an overt pronoun in sppech. Her index-finger pointing gesture temporally aligns with the subject pronoun in bold.

Figure 4. Mean proportions of overt pronouns out of all null pronoun in maintained (N = 503) and re-introduced (N = 108) referent contexts. The Intermediate horizontal lines indicated the median and the cross marks indicate mean values.

Figure 4. Mean proportions of overt pronouns out of all null pronoun in maintained (N = 503) and re-introduced (N = 108) referent contexts. The Intermediate horizontal lines indicated the median and the cross marks indicate mean values.

Figure 5. Mean proportions of overt pronouns out of all null pronoun in maintained (N = 112) and re-introduced (N = 329) referent contexts. The Intermediate horizontal lines indicated the median and the cross marks indicate mean values.

Figure 5. Mean proportions of overt pronouns out of all null pronoun in maintained (N = 112) and re-introduced (N = 329) referent contexts. The Intermediate horizontal lines indicated the median and the cross marks indicate mean values.

Figure 6. Mean proportions of NPs and overt pronouns in maintained and re-introduced referent contexts that were accompanied by gestures (calculated as the number of Res that were accompanied by-gestures divided by the number of Res in speech across participants). The Intermediate horizontal lines indicated the median and the cross marks indicate mean values.

Figure 6. Mean proportions of NPs and overt pronouns in maintained and re-introduced referent contexts that were accompanied by gestures (calculated as the number of Res that were accompanied by-gestures divided by the number of Res in speech across participants). The Intermediate horizontal lines indicated the median and the cross marks indicate mean values.

Figure 7. The speaker first mentions that two women sitting at the table cannot open a jar. Then she re-introduces the character that is highlighted in still (a) with a pronominalized indefinite determiner and the character that is highlighted in still (b) with a third-person pronoun. Her whole-hand gestures temporally align with subject pronoun in bold in both (a) and (b).

Figure 7. The speaker first mentions that two women sitting at the table cannot open a jar. Then she re-introduces the character that is highlighted in still (a) with a pronominalized indefinite determiner and the character that is highlighted in still (b) with a third-person pronoun. Her whole-hand gestures temporally align with subject pronoun in bold in both (a) and (b).

Table A1. Events/states in the kitchen video.

Table A2. Events/states in the office video.

Table B. List of noun phrase types in the elicited narratives.

Table C1. Specifications and outputs of the fixed factors in the models.

Table C2. Specifications and outputs of the random factors in the models for speech and gesture.