The Questionable Ecological Validity of Ecological Momentary Assessment: Considerations for Design and Analysis

Abstract

Experience sampling, diary, ecological momentary assessment, ambulatory monitoring, and related methods are part of a research tradition aimed at capturing the ongoing stream of individuals’ behavior in real-world situations. By design, these approaches prioritize ecological validity. This article examines how the purported ecological validity these study designs provide may be compromised during data analysis. After briefly outlining the benefits of ecological momentary assessment-type designs, the authors highlight design issues that threaten ecological validity, illustrate how the typical multilevel analysis of ecological momentary assessment-type data can compromise generalizability to “real-life,” and consider how unobtrusive monitoring and person-specific analysis may provide for more precise descriptions of individuals’ actual human ecology.

FUNDING

This work was supported by the National Institute on Health (R01 HD076994, RC1-AG035645, P2C HD041025, UL TR000127), the Penn State Social Science Research Institute.

Additional information

Funding

This work was supported by the National Institute on Health (R01 HD076994, RC1-AG035645, P2C HD041025, UL TR000127), the Penn State Social Science Research Institute.