Improving response rates and evaluating nonresponse bias in surveys: AMEE Guide No. 102

References

• AAPOR. 2011. Standard definitions: Final dispositions of case codes and outcome rates for surveys. aapor.org. American Association for Public Opinion Research. Retrieved August 28, 2014, from http://aapor.org/Content/NavigationMenu/AboutAAPOR/StandardsampEthics/StandardDefinitions/StandardDefinitions2011.pdf
   Google Scholar
• Artino AR, La Rochelle JS, Dezee KJ, Gehlbach H. 2014. Developing questionnaires for educational research: AMEE Guide No. 87. Med Teach 36(6):463–474
   PubMed Web of Science ®Google Scholar
• Asch DA, Christakis NA, Ubel PA. 1998. Conducting physician mail surveys on a limited budget. A randomized trial comparing $2 bill versus $5 bill incentives. Med Care 36(1):95–99. Available from http://journals.lww.com/lww-medicalcare/Abstract/1998/01000/Conducting_Physician_Mail_Surveys_on_a_Limited.11.aspx
   Google Scholar
• Avdeyeva OA, Matland RE. 2013. An experimental test of mail surveys as a tool for social inquiry in Russia. Int J Public Opin Res Adv Access. 25(2):173–194
   Google Scholar
• Beatty P, Herrmann D. 2002. To answer or not to answer: Decision processes related to survey item nonresponse. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editors. Survey nonresponse. 1st ed. New York: Wiley-Interscience. pp 71–86
   Google Scholar
• Beebe TJ, Locke GR, Barnes SA, Davern ME, Anderson KJ. 2007. Mixing web and mail methods in a survey of physicians. Health Serv Res 42(3p1):1219–1234
   PubMed Web of Science ®Google Scholar
• Berry SH, Kanouse DE. 1987. Physician response to a mailed survey: An experiment in timing of payment. Public Opin Q 51(1):102–114
   Web of Science ®Google Scholar
• Boudreaux R. (2013). What is the difference between responsive vs. adaptive web design? techrepublic.com. [Accessed 15 September 2014] Available from http://www.techrepublic.com/blog/web-designer/what-is-the-difference-between-responsive-vs-adaptive-web-design/
   Google Scholar
• Bradburn NM, Sudman S. 1991. The current status of questionnaire research. In: Biemer PP, et al., editors. Measurement errors in surveys. Hoboken, NJ, USA: John Wiley & Sons, Inc
   Google Scholar
• Buskirk TD, Andrus C. 2013. Smart Surveys for Smart Phones: Exploring Various Approaches for Conducting Online Mobile Surveys via Smartphones*. Survey Practice. [Accessed 19 August 2015] Available from http://surveypractice.wordpress.com/2012/02/21/smart-surveys-for-smart-phones/
   Google Scholar
• Church AH. 1993. Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opin Q 57:62–79
   Web of Science ®Google Scholar
• Couper MP, Traugott MW, Lamias MJ. 2001. Web survey design and administration. Public Opin Q 65(2):230–253
   PubMed Web of Science ®Google Scholar
• Craig CS, McCann JM. 1978. Item nonresponse in mail surveys: Extent and correlates. J Market Res 15(2):285
   Web of Science ®Google Scholar
• Cullen A. 2013. StatCounter Internet Wars Report. gs.statcounter.com. StatCounter. [Accessed 18 August 2015] Available from http://gs.statcounter.com/download/StatCounter-Internet-Wars-Report.pdf
   Google Scholar
• DeMaio TJ. 1984. Social desirability and survey measurement: A review. In: Turner C, Martin E, editors. Surveying subjective phenomena New York: Russell Sage. pp 257–282
   Google Scholar
• Dijkstra W, Smit J. 2002. Persuading reluctant recipients in telephone surveys. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editors. Survey nonresponse. 1st ed. New York: John Wiley & Sons, Inc. pp 121–234
   Google Scholar
• Dillman DA. 2000a. Mail and internet surveys: The tailored design method. Volume 2. New York: John Wiley & Sons
   Google Scholar
• Dillman DA. 2000b. Internet and interactive voice response surveys. In: Mail and internet surveys: The tailored design method. 2nd ed. New York: John Wiley & Sons
   Google Scholar
• Dillman DA 2011. Mail and internet surveys: The tailored design method–2007 update with new internet, visual, and mixed-mode guide. New York: John Wiley & Sons
   Google Scholar
• Dillman DA, Christian LM. 2005. Survey mode as a source of instability in responses across surveys. Field Methods 17(1):30–52
   Google Scholar
• Dillman DA, Eltinge JL, Groves RM, Little RJ. 2002. Design, data collection, and analysis. In: Dillman DA, Eltinge JL, Groves RM, Little RJA, editors. Survey nonresponse in design, data collection, and analysis. 1st ed. New York: Wiley-Interscience. pp 3–26
   Google Scholar
• Dillman DA, Sinclair MD, Clark JR. 1993. Effects of questionnaire length, respondent-friendly design, and a difficult question on response rates for occupant-addressed census mail surveys. Public Opin Q 57(3):289–304
   Web of Science ®Google Scholar
• Doherty NF, Ellis-Chadwick FE. 2003. The relationship between retailers’ targeting and e-commerce strategies: An empirical analysis. emeraldinsight.com, 13(3):170. [Accessed 18 August 2015] Available from http://www.emeraldinsight.com/doi/pdfplus/10.1108/10662240310478196
   Google Scholar
• Durrant GB, Groves RM, Staetsky L, Steele F. 2010. Effects of interviewer attitudes and behaviors on refusal in household surveys. Public Opin Q 74(1):1–36
   Web of Science ®Google Scholar
• Edwards P. 2002. Increasing response rates to postal questionnaires: Systematic review. BMJ 324(7347):1183–1183
   PubMed Web of Science ®Google Scholar
• Elliott MN, Edwards C, Angeles J, Hambarsoomians K, Hays RD. 2005. Patterns of unit and item nonresponse in the CAHPS® Hospital Survey. Health Serv Res 40(6p2):2096–2119
   PubMed Web of Science ®Google Scholar
• Experian. (2012). Quarterly email benchmark study. experian.com. [Accessed 2 September 2014] Available from http://www.experian.com/assets/cheetahmail/white-papers/email-marketing-quarterly-benchmark-study-q4-2012.pdf
   Google Scholar
• Franko OI, Tirrell TF. 2012. Smartphone app use among medical providers in ACGME training programs. J Med Syst 36(5):3135–3139
   PubMed Web of Science ®Google Scholar
• Gilljam M, Granberg D. 1993. Should We Take Don’t Know for an Answer? Public Opin Q 57(3):348–357
   Web of Science ®Google Scholar
• Groves RM. 2006. Nonresponse rates and nonresponse bias in household surveys. Public Opin Q 70(5):646–675
   Web of Science ®Google Scholar
• Groves RM, Couper MP. 1996. Contact-level influences on cooperation in face-to-face surveys. J Off Stat 12(1):63–83
   Google Scholar
• Groves RM, Couper MP. 1998. Influences of householder–interviewer interactions on survey cooperation. Nonresponse Household Interv Surv 1:247–267
   Google Scholar
• Groves RM, Dillman DA, Eltinge JL, Little RJA. (editors). (2002). Survey nonresponse. 1st ed. New York: John Wiley & Sons
   Google Scholar
• Groves RM, Singer E, Corning A. 2000. Leverage-saliency theory of survey participation. Public Opin Q 64:299–308
   PubMed Web of Science ®Google Scholar
• Halbesleben JR, Whitman MV. 2013. Evaluating survey quality in health services research: A decision framework for assessing nonresponse bias. Health Serv Res 48(3):913–930
   PubMed Web of Science ®Google Scholar
• Hamilton MB. 2003. Online survey response rates and times. supersurvey.com. Ipathia, Inc. [Accessed 18 August 2015] Available from http://www.focoslatin.com.ar:8081/recursos/metodologias/online-research/supersurvey-white-paper-response-rates.pdf/at_download/file
   Google Scholar
• Heberlein TA, Baumgartner R. 1978. Factors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature. Am Sociol Rev 43:447–462
   Web of Science ®Google Scholar
• Hox J, de Leeuw E. 2002. The influence of interviewers’ attitude and behavior on household survey nonresponse: An international comparison. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editors. Survey nonresponse. 1st ed. New York: John Wiley & Sons. pp 103–120
   Google Scholar
• James JM, Bolstein R. 1990. The effect of monetary incentives and follow-up mailings on the response rate and response quality in mail surveys. Public Opin Q 54(3):346–361
   Web of Science ®Google Scholar
• Jepson C, Asch DA, Hershey JC, Ubel PA. 2005. In a mailed physician survey, questionnaire length had a threshold effect on response rate. J Clin Epidemiol 58(1):103–105
   PubMed Web of Science ®Google Scholar
• Johnson TP, Wislar JS. 2012. Response rates and nonresponse errors in surveys. JAMA 307(17):1805–1806
   PubMed Web of Science ®Google Scholar
• Johnson TP, O’Rourke D, Burris J, Owens L. 2002. Culture and survey nonresponse. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editors. Survey nonresponse. New York: John Wiley & Sons. pp 55–70
   Google Scholar
• Jutel A, Menkes DB. 2009. “But Doctors do it…”: Nurses’ views of gifts and information from the pharmaceutical industry. Ann Pharmacother 43(6):1057–1063
   PubMed Web of Science ®Google Scholar
• Keating NL, Zaslavsky AM, Goldstein J, West DW, Ayanian JZ. 2008. Randomized trial of $20 versus $50 incentives to increase physician survey response rates. Med Care 46(8):878–881
   PubMed Web of Science ®Google Scholar
• Kellerman SE, Herold J. 2001. Physician response to surveys. A review of the literature. Am J Prevent Med 20(1):61–67
   PubMed Web of Science ®Google Scholar
• Krosnick JA. 2002. The causes of no-opinion responses to attitude measures in surveys: They are rarely what they appear to be. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editors. Survey nonresponse. 1st ed. New York: John Wiley & Sons
   Google Scholar
• Lynn P, Clarke P, Martin J, Sturgis P. 2002. The effects of extended interviewer efforts on nonresponse bias. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editors. Survey nonresponse. New York: John Wiley & Sons. pp 135–148
   Google Scholar
• Maheux B, Legault C, Lambert J. 1989. Increasing response rates in physicians’ mail surveys: An experimental study. Am J Public Health 79(5): 638–639
   PubMed Web of Science ®Google Scholar
• Mailchimp. (2014). Find your best sending times. kb.mailchimp.com. [Accessed 2 September 2014] Available from http://kb.mailchimp.com/deliverability/deliverability-research/find-your-best-sending-time
   Google Scholar
• Mason R, Lesser V, Traugott MW. 2002. Effect of item nonresponse on nonresponse error and inference. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editors. Survey nonresponse. New York: John Wiley & Sons
   Google Scholar
• Mavletova A. 2013. Data quality in PC and mobile web surveys. Soc Sc Comput Rev 31(6):725–743
   Web of Science ®Google Scholar
• McFarlane E, Olmsted MG, Murphy J, Hill CA. 2007. Nonresponse bias in a mail survey of physicians. Eval Health Prof 30(2):170–185
   PubMed Web of Science ®Google Scholar
• McMahon SR, Iwamoto M, Massoudi MS, Yusuf HR, Stevenson JM, David F, Chu SY, Pickering LK. 2003. Comparison of e-mail, fax, and postal surveys of pediatricians. Pediatrics 111: e299
   PubMed Web of Science ®Google Scholar
• Millar MM, Dillman DA. 2011. Improving response to web and mixed-mode surveys. Public Opin Q 75(2):249–269
   Web of Science ®Google Scholar
• Millar M, Dillman DA. 2012. Encouraging Survey Response via smartphones. Surv Pract 5(3)
   Google Scholar
• NRC. 2013. Nonresponse in social science surveys. Washington, DC: National Academies Press
   Google Scholar
• Redline CD, Dillman DA. 2002. The influence of alternative visual designs on respondents’ performance with branching instructions in self-administered questionnaires. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editors. Survey nonresponse. 1st ed. New York: John Wiley & Sons. pp 179–198
   Google Scholar
• Robertson J, Walkom EJ, McGettigan P. 2005. Response rates and representativeness: A lottery incentive improves physician survey return rates. Annu Rev Psychol 14:571–577
   Google Scholar
• Shettle C, Mooney G. 1999. Monetary incentives in US government surveys. J Off Stat 15(2):231
   Google Scholar
• Singer E. 2002. The use of incentives fo reduce nonresponse in household surveys. In: Groves RM, Dillman DA, Eltinge JL, Little RJ, editor. Survey nonresponse. 1st ed. New York: John Wiley & Sons. pp 163–178
   Google Scholar
• Singer E, Van Hoewyk J, Maher M P. 1998. Does the payment of incentives create expectation effects? Public Opin Q 62:152–164
   Web of Science ®Google Scholar
• Sue VM, Ritter LA. 2012. Conducting online surveys. Los Angeles: SAGE
   Google Scholar
• SurveyMonkey. (2011). What Day of the Week Should You Send Your Survey? surveymonkey.com. [Accessed 2 September 2014] Available from https://www.surveymonkey.com/blog/en/blog/2011/08/16/day-of-the-week/
   Google Scholar
• Visser P S, Krosnick JA, Marquette J, Curtin M. 2000. Improving election forecasting: Allocation of undecided respondents, identification of likely voters, and response effects. In:Lavarkas P, Traugott M, editors. Election polls, the news media and democracy. New York: Chatham House. pp 224–262
   Google Scholar
• Willis GB, Smith T, Lee HJ. 2013. Do additional recontacts to increase response rate improve physician survey data quality? Med Care 51(10):945–948
   PubMed Web of Science ®Google Scholar