Effects of nonresponse and coverage problems on survey estimates of physical activity

Abstract

To what extent do survey nonresponse and coverage problems bias estimates of physical activity? Research has focused on social desirability as a cause of observed bias but there are relatively few studies of nonresponse and coverage. I analyze data from a survey designed to allow estimation of nonresponse bias using a two-phase sampling design that resamples nonrespondents from an initial wave of telephone and IVR (interactive voice response) interviewing for follow-up face-to-face interviews. Both initial and nonresponse interview waves included measures of physical activity frequency and duration. Estimates are compared between first-round respondents and those from follow-up interviews of nonrespondents, accounting for mode and other design elements. Telephone, but not IVR, interviews were found to include bias from two sources. Findings suggest that coverage is a cause of bias in the measure of frequency of physical activity but nonresponse may bias the measure of physical activity duration.

Acknowledgements

The author would like to acknowledge Lee Hargraves, Jack Fowler, Carol Cosenza, Tony Roman, and the staff at the Center for Survey Research at the University of Massachusetts Boston.

Disclosure statement

The author has no financial or other conflicts of interest to report.

Additional information

Funding

This research was supported by a grant from the National Science Foundation, SES-1424433.

Notes on contributors

Philip S. Brenner

Philip S. Brenner is Associate Professor of Sociology and Senior Research Fellow in the Center for Survey Research at the University of Massachusetts Boston, where he also serves as Director of the Graduate Certificate Program in Survey Research. His research examines social desirability bias and other errors in interviewer- and self-administered surveys.