Pictures, Words, and Sounds: From Which Format Are We Best Able to Reason?

Abstract

The effect of presentation format on reasoning was studied with a sentence verification task. Background information was presented in single-format and combined conditions that included pictured, printed, or spoken versions of the stimulus items. In Experiment 1, a test sentence appeared together with the background at varied stimulus onset asynchronies, to study how format influences the acquisition of the stimulus information. In Experiments 2 and 3, however, the test sentence followed the presentation of the background, to test the effect of format on memory. Reaction time responses to the test sentences showed a consistent picture advantage. However, when participants responded to materials stored in memory, both pictured and spoken formats provided quicker responses in comparison to printed words, and the format difference was smaller than when materials were readily available on the screen. Multimedia presentations, when compared with single-format conditions, did not provide additional benefits.

Key Words:

• format effects
• multimedia
• picture-word differences