Event related message processing: perceiving and remembering changes in films with and without soundtrack

ABSTRACT

Hollywood movies provide continuous audiovisual information. Yet, information conveyed by movies address different sensory systems. For a broad variety of media applications (such as multimedia learning environments) it is important to understand the underlying cognitive principles. This project addresses the interplay of auditory and visual information during movie perception. Because auditory information is known to change basic visual processes, it is possible that movie perception and comprehension depends on stimulus modality. In this project, we report three experiments that studied how humans perceive and remember changes in visual and audiovisual movie clips. We observed basic processes of event perception (event segmentation, change detection, and memory) to be independent of stimulus modality. We thus conclude that event boundary perception is a general perceptual-cognitive mechanism and discuss these findings with respect to current cognitive psychological and media psychological theories.

Disclosure statement

No potential conflict of interest was reported by the authors.

Supplementary material

Supplemental data for this article can be accessed here.

Correction Statement

This article has been republished with minor changes. These changes do not impact the academic content of the article.