The End of the (Research) World As We Know It? Understanding and Coping With Declining Response Rates to Mail Surveys

References

• Abraham, K., S. Helms, and S. Presser. 2009. How social processes distort measurement: The impact of survey nonresponse on estimates of volunteer work in the United States. American Journal of Sociology 114 (4):1129–65. doi:10.1086/595945.
   PubMed Web of Science ®Google Scholar
• Allred, S. B., and A. Ross-Davis. 2011. The drop-off and pick-up method: An approach to reduce nonresponse bias in natural resource surveys. Small-Scale Forestry 10 (3):305–18. doi:10.1007/s11842-010-9150-y.
   Web of Science ®Google Scholar
• American Association for Public Opinion Research (AAPOR) 2011. Standard definitions: Final dispositions of case codes and outcome rates for surveys. 7th ed. Deerfield, IL: AAPOR.
   Google Scholar
• Armstrong, J. S., and T. S. Overton. 1977. Estimating nonresponse bias in mail surveys. Journal of Marketing Research 14 (3):396–402. doi:10.1177/002224377701400320.
   Web of Science ®Google Scholar
• Babbie, E. 2015. The practice of social research. Toronto, Canada: Nelson Education.
   Google Scholar
• Baruch, Y., and B. C. Holtom. 2008. Survey response rate levels and trends in organizational research. Human Relations 61 (8):1139–60. doi:10.1177/0018726708094863.
   Web of Science ®Google Scholar
• Bethlehem, J. G., and H. M. P. Kersten. 1985. On the treatment of nonresponse in sample surveys. Journal of Official Statistics 1 (3):287–300.
   Google Scholar
• Brandon, D. M., J. H. Long, T. M. Loraas, J. Mueller-Phillips, and B. Vansant. 2014. Online instrument delivery and participant recruitment services: Emerging opportunities for behavioral accounting research. Behavioral Research in Accounting 26 (1):1–23. doi:10.2308/bria-50651.
   Google Scholar
• Brehm, J. O. 2009. The phantom respondents: Opinion surveys and political representation. Ann Arbor, MI: University of Michigan Press. doi:10.3998/mpub.23659.
   Google Scholar
• Brown, T. L., D. J. Decker, and N. A. Connelly. 1989. Response to mail surveys on resource-based recreation topics: A behavioral model and an empirical analysis. Leisure Sciences 11 (2):99–110. doi:10.1080/01490408909512210.
   Google Scholar
• Callegaro, M., R. Baker, J. Bethlehem, A. S. Göritz, J. A. Krosnick, and P. J. Lavrakas. 2014. Online panel research: A data quality perspective. New York, NY: John Wiley and Sons.
   Google Scholar
• Connelly, N. A., T. L. Brown, and D. J. Decker. 2003. Factors affecting response rates to natural resource-focused mail surveys: Empirical evidence of declining rates over time. Society and Natural Resources 16 (6):541–9. doi:10.1080/08941920309152.
   Web of Science ®Google Scholar
• Deci, E., and R. M. Ryan. 1985. Intrinsic motivation and self-determination in human behavior. New York, NY: Springer Science and Business Media.
   Google Scholar
• Dey, E. L. 1997. Working with low survey response rates: the efficacy of weighting adjustments. Research in Higher Education 38 (2):215–27. doi:10.1023/A:1024985704202.
   Web of Science ®Google Scholar
• Dillman, D. A. 1978. Mail and telephone surveys: The total design method. Vol. 19. New York, NY: Wiley.
   Google Scholar
• Dillman, D. A. 2011. Mail and internet surveys: The tailored design method–2007 update with new internet, visual, and mixed-mode guide. New York, NY: John Wiley & Sons.
   Google Scholar
• Edwards, P., I. Roberts, M. Clarke, C. DiGuiseppi, S. Pratap, R. Wentz, and I. Kwan. 2002. Increasing response rates to postal questionnaires: Systematic review. BMJ 324 (7347):1183. doi:10.1136/bmj.324.7347.1183.
   PubMed Web of Science ®Google Scholar
• Fowler, F., P. Gallagher, V. Stringfellow, A. Zaslavsky, J. Thompson, and P. Cleary. 2002. Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Medical Care 40 (3):190–200. doi:10.1097/00005650-200203000-00003.
   PubMed Web of Science ®Google Scholar
• Groves, R. 2006. Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly 70 (5):646–75. doi:10.1093/poq/nfl033.
   Web of Science ®Google Scholar
• Groves, R., M. Couper, S. Presser, E. Singer, R. Tourangeau, G. P. Acosta, and L. Nelson. 2006. Experiments in producing nonresponse bias. Public Opinion Quarterly 70 (5):720–36. doi:10.1093/poq/nfl036.
   Web of Science ®Google Scholar
• Groves, R., and E. Peytcheva. 2008. The impact of nonresponse rates on nonresponse bias: A meta-analysis. The Public Opinion Quarterly 72 (2):167–89. doi:10.1093/poq/nfn011.
   Web of Science ®Google Scholar
• Heberlein, T. A., and R. Baumgartner. 1978. Factors affecting response rates to mail questionnaires: A quantitative analysis of the published literature. American Sociological Review 43 (4):447–62. doi:10.2307/2094771.
   Web of Science ®Google Scholar
• Heffetz, O., and M. Rabin. 2013. Conclusions regarding cross-group differences in happiness depend on difficulty of reaching respondents. The American Economic Review 103 (7):3001–21. doi:10.1257/aer.103.7.3001.
   PubMed Web of Science ®Google Scholar
• Jackson-Smith, D., M. Dolan, G. Holyoak, C. G. Flint, C. K. Trentelman, B. Thomas, and G. Ma. 2016. Effectiveness of the drop-off/pick-up survey methodology in different neighborhood types. Journal of Rural Social Sciences 31 (3):35. doi:10.13039/100000106.
   Google Scholar
• Kaplowitz, M. D., T. D. Hadlock, and R. Levine. 2004. A comparison of web and mail survey response rates. Public Opinion Quarterly 68 (1):94–101. doi:10.1093/poq/nfh006.
   Web of Science ®Google Scholar
• Kreuter, F. 2013. Facing the nonresponse challenge. Annals of the American Academy of Political and Social Science 645 (1):23–35. doi:10.1177/0002716212456815.
   Web of Science ®Google Scholar
• Landers, R. N., and T. S. Behrend. 2015. An inconvenient truth: Arbitrary distinctions between organizational, mechanical Turk, and other convenience samples. Industrial and Organizational Psychology 8 (2):142–64. doi:10.1017/iop.2015.13.
   Web of Science ®Google Scholar
• Larson, P., and R. Poist. 2004. Improving response rates to mail surveys: A research note. Transportation Journal 43 (4):67–74.
   Web of Science ®Google Scholar
• Martin, E. 2009. Can a deadline and compressed mailing schedule improve mail response in the decennial census? Public Opinion Quarterly 73 (2):361–7. doi:10.1093/poq/nfp018.
   Web of Science ®Google Scholar
• Massey, D., and R. Tourangeau. 2013. Where do we go from here? nonresponse and social measurement. Annals of the American Academy of Political and Social Science 645 (1):222–36. doi:10.1177/0002716212464191.
   PubMed Web of Science ®Google Scholar
• Medway, R., and J. Fulton. 2012. When more gets you less: A meta-analysis of the effect of concurrent web options on mail survey response rates. The Public Opinion Quarterly 76 (4):733–46. doi:10.1093/poq/nfs047.
   Web of Science ®Google Scholar
• Merkle, D. M., and M. Edelman. 2009. An experiment on improving response rates and its unintended impact on survey error. Survey Practice 2 (3):2964.doi:10.29115/sp-2009-0013.
   Google Scholar
• Millar, M. M., and D. A. Dillman. 2011. Improving response to web and mixed-mode surveys. Public Opinion Quarterly 75 (2):249–69. doi:10.1093/poq/nfr003.
   Web of Science ®Google Scholar
• Moghaddam, M. F., and A. Mousavi. 2009. Prediction and control of response rate to surveys. American Journal of Mathematics and Management Science 29:337–70. doi:10.1080/01966324.2009.10737763.
   Google Scholar
• Nulty, D. D. 2008. The adequacy of response rates to online and paper surveys: what can be done? Assessment & Evaluation in Higher Education 33 (3):301–14. doi:10.1080/02602930701293231.
   Web of Science ®Google Scholar
• Peytchev, A. 2013. Consequences of survey nonresponse. Annals of the American Academy of Political and Social Science 645 (1):88–111. doi:10.1177/0002716212461748.
   Web of Science ®Google Scholar
• Phillips, A. W., S. Reddy, and S. J. Durning. 2016. Improving response rates and evaluating nonresponse bias in surveys: AMEE guide no. 102. Medical Teacher 38 (3):217–28. doi:10.3109/0142159X.2015.1105945.
   PubMed Web of Science ®Google Scholar
• Rookey, B. D., S. Hanway, and D. Dillman. 2008. Does a probability-based household panel benefit from assignment to postal response as an alternative to internet-only? The Public Opinion Quarterly 72 (5):962–84. doi:10.1093/poq/nfn061.
   Web of Science ®Google Scholar
• Rookey, B. D., L. Le, M. Littlejohn, and D. A. Dillman. 2012. Understanding the resilience of mail-back survey methods: an analysis of 20 years of change in response rates to national park surveys. Social Science Research 41 (6):1404–14. doi:10.1016/j.ssresearch.2012.06.004.
   PubMed Web of Science ®Google Scholar
• Roulin, N. 2015. Don’t throw the baby out with the bathwater: Comparing data quality of crowdsourcing, online panels, and student samples. Industrial and Organizational Psychology 8 (2):190–6. doi:10.1017/iop.2015.24.
   Web of Science ®Google Scholar
• Shih, T. H., and X. Fan. 2008. Comparing response rates from web and mail surveys: A meta-analysis. Field Methods 20 (3):249–71. doi:10.1177/1525822X08317085.
   Web of Science ®Google Scholar
• Skalland, B. 2011. An alternative to the response rate for measuring a survey's realization of the target population. The Public Opinion Quarterly 75 (1):89–98. doi:10.1093/poq/nfq072.
   Web of Science ®Google Scholar
• Steele, J., L. Bourke, A. E. Luloff, P. S. Liao, G. L. Theodori, and R. S. Krannich. 2001. The drop-off/pick-up method for household survey research. Community Development 32 (2):238–50. doi:10.1080/15575330109489680.
   Google Scholar
• Trentelman, C. K., K. A. Petersen, J. Irwin, N. Ruiz, and C. S. Szalay. 2016. The case for personal interaction: Drop-off/pick-up methodology for survey research. Journal of Rural Social Sciences 31 (3):68.
   Google Scholar
• Van Deursen, A. J., J. A. van Dijk, and O. Peters. 2011. Rethinking internet skills: The contribution of gender, age, education, internet experience, and hours online to medium-and content-related internet skills. Poetics 39 (2):125–44. doi:10.1016/j.poetic.2011.02.001.
   Web of Science ®Google Scholar
• Wright, G. 2015. An empirical examination of the relationship between nonresponse rate and nonresponse bias. Statistical Journal of the IAOS 31 (2):305–15. doi:10.3233/sji-140844.
   Google Scholar