The effect of input sensory modality on the multimodal encoding of motion events

Figures & data

Table 1. An example of coding a description.

		Clause 1		Clause 2
Turkish description	koş	-arak	ev	-e	gir	-di
Glossing	run	connective	house	dative	enter	past
Coding	manner				path
English translation	“while running”		“(someone) entered the house”

Figure 1. Example gestures depicting (a) path only, (b) manner only, and (c) both path and manner. The full event descriptions are split into clauses (Cl.) and translations are given under each gesture example. The gesture stroke occurred during the underlined speech.

Table 2. The average number (M) of clauses and gestures across participants with standard deviations (SD, in parentheses).

Group	All clauses M (SD)	Motion event clauses M (SD)	All gestures^a M (SD)	Relevant gestures M (SD)
Audio-only	35.83 (12.77)	20.33 (5.25)	12.03 (6.61)	9.57 (5.40)
Visual-only	32.83 (9.48)	25.53 (5.43)	11.13 (8.86)	8.83 (7.91)
Multimodal	32.40 (8.41)	25.27 (4.65)	11.00 (8.38)	9.07 (7.28)

^aAll iconic gestures (relevant or irrelevant) produced within a motion event clause.

Figure 2. Ratio of motion event descriptions. Coloured dots represent the data for each participant. Black dots represent the group mean.

Figure 3. Path and manner in speech. Coloured dots represent the average data for each participant. Black dots represent the group mean.

Figure 4. Ratio of gesture for motion event descriptions. Coloured dots represent the data for each participant. Black dots represent the group mean.

Figure 5. Path and manner gestures for motion event descriptions. Coloured dots represent the average data for each participant. Black dots represent the group mean.