Choir of believers? Experimental and longitudinal evidence on survey participation, response bias, and public service motivation

References

• Adigüzel, Feray, and Michel Wedel. 2008. “Split Questionnaire Design for Massive Surveys.” Journal of Marketing Research 45(5):608–17. doi: 10.1509/jmkr.45.5.608.
   Web of Science ®Google Scholar
• Andersen, Lotte Bøgh, and Thomas Pallesen. 2008. “Not Just for the Money?’ How Financial Incentives Affect the Number of Publications at Danish Research Institutions.” International Public Management Journal 11(1):28–47. doi: 10.1080/10967490801887889.
   Web of Science ®Google Scholar
• Andersen, Lotte Bøgh, Thomas Pallesen, and Lene Holm Pedersen. 2011. “Does Ownership Matter? Public Service Motivation among Physiotherapists in the Private and Public Sectors in Denmark.” Review of Public Personnel Administration 31(1):10–27. doi: 10.1177/0734371X10394402.
   Web of Science ®Google Scholar
• Andersen, Lotte Bøgh, and Søren Serritzlew. 2012. “Does Public Service Motivation Affect the Behavior of Professionals?” International Journal of Public Administration 35(1):19–29. doi: 10.1080/01900692.2011.635277.
   Google Scholar
• Angrist, Joshua D., and Jörn-Steffen Pischke. 2014. Mastering’metrics: The Path from Cause to Effect. Princeton, NJ: Princeton University Press.
   Google Scholar
• Bellé, Nicola. 2013. “Experimental Evidence on the Relationship between Public Service Motivation and Job Performance.” Public Administration Review 73(1):143–53. doi: 10.1111/j.1540-6210.2012.02621.x.
   Web of Science ®Google Scholar
• Bellé, Nicola. 2015. “Performance-Related Pay and the Crowding out of Motivation in the Public Sector: A Randomized Field Experiment.” Public Administration Review 75(2):230–41. doi: 10.1111/puar.12313.
   Web of Science ®Google Scholar
• Berkowitz, Leonard, and Louise R. Daniels. 1964. “Affecting the Salience of the Social Responsibility Norm: Effects of past Help on the Response to Dependency Relationships.” Journal of Abnormal Psychology 68(3):275–81. doi: 10.1037/h0040164.
   PubMed Web of Science ®Google Scholar
• Brüggen, Elisabeth, Martin Wetzels, Ko De Ruyter, and Niels Schillewaert. 2011. “Individual Differences in Motivation to Participate in Online Panels: The Effect on Response Rate and Response Quality Perceptions.” International Journal of Market Research 53(3):369–90. doi: 10.2501/IJMR-53-3-369-390.
   Web of Science ®Google Scholar
• Buelens, Marc, and Herman Van den Broeck. 2007. “An Analysis of Differences in Work Motivation between Public and Private Sector Organizations.” Public Administration Review 67(1):65–74.
   Web of Science ®Google Scholar
• Cameron, Adrian Colin, and Pravin K. Trivedi. 2009. Microeconometrics Using Stata. Vol. 5. Texas: Stata Press College Station, TX. doi: 10.1111/j.1540-6210.2006.00697.x.
   Google Scholar
• Chalkley, M., C. Tilley, L. Young, D. Bonetti, and J. Clarkson. 2010. “Incentives for Dentists in Public Service: Evidence from a Natural Experiment.” Journal of Public Administration Research and Theory 20i:207–23. doi: 10.1093/jopart/muq025.
   Google Scholar
• Chromy, James R., and Daniel G. Horvitz. 1978. “The Use of Monetary Incentives in National Assessment Household Surveys.” Journal of the American Statistical Association 73(363):473–8. doi: 10.1080/01621459.1978.10480037.
   Web of Science ®Google Scholar
• Church, Allan H. 1993. “Estimating the Effect of Incentives on Mail Survey Response Rates: A Meta- Analysis.” Public Opinion Quarterly 57(1):62–79. doi: 10.1086/269355.
   Web of Science ®Google Scholar
• Cialdini, Robert B. 1988. Influence: Science and Practice. Glenview, IL: Scott.
   Google Scholar
• Dutz, Deniz Ingrid Huitfeldt, Santiago Lacouture, Magne Mogstad, Alexander Torgovitsky, and Winnie van Dijk. 2021. “Selection in Surveys.” National Bureau of Economic Research, working paper no. 29549. December 2021. https://www.nber.org/papers/w29549.
   Google Scholar
• Edwards, Phil, Ian Roberts, Mike Clarke, Carolyn DiGuiseppi, Sarah Pratap, Reinhard Wentz, and Irene Kwan. 2002. “Increasing Response Rates to Postal Questionnaires: Systematic Review.” BMJ (Clinical Research ed.) 324(7347):1183. doi: 10.1136/bmj.324.7347.1183.
   PubMed Web of Science ®Google Scholar
• Edwards, Philip James, Ian Roberts, Mike J. Clarke, Carolyn DiGuiseppi, Reinhard Wentz, Irene Kwan, Rachel Cooper, Lambert M. Felix, and Sarah Pratap. 2009. Methods to Increase Response to Postal and Electronic Questionnaires. The Cochrane Library.
   Google Scholar
• Esteve, M., and C. Schuster. 2019. Motivating Public Employees (Elements in Public and Nonprofit Administration). Cambridge: Cambridge University Press.
   Google Scholar
• Frey, Bruno S. 1997. Not Just for the Money. Vol. 748. Cheltenham, UK: Citeseer.
   Google Scholar
• Gabris, Gerald T., and Gloria Simo. 1995. “Public Sector Motivation as an Independent Variable Affecting Career Decisions.” Public Personnel Management 24(1):33–51. doi: 10.1177/009102609502400103.
   Web of Science ®Google Scholar
• Göritz, Anja S. 2006. “Cash Lotteries as Incentives in Online Panels.” Social Science Computer Review 24(4):445–59. doi: 10.1177/0894439305286127.
   Web of Science ®Google Scholar
• Göritz, Anja S., and Susanne C. Luthe. 2013. “Effects of Lotteries on Response Behavior in Online Panels.” Field Methods 25(3):219–37. doi: 10.1177/1525822X12472876.
   Web of Science ®Google Scholar
• Göritz, Anja S. 2013. “How Do Lotteries and Study Results Influence Response Behavior in Online Panels?” Social Science Computer Review 31(3):371–85.
   Web of Science ®Google Scholar
• Goyder, John. 1987. The Silent Minority: Nonrespondents on Sample Surveys. Boulder, CO: Polity Press Cambridge.
   Google Scholar
• Green, Kathy E. 1996. “Sociodemographic Factors and Mail Survey Response.” Psychology & Marketing 13(2):171–84. doi: 10.1002/(SICI)1520-6793(199602)13:2<171::AID-MAR4>3.0.CO;2-C.
   Web of Science ®Google Scholar
• Groves, Robert M. 2006. “Nonresponse Rates and Nonresponse Bias in Household Surveys.” Public Opinion Quarterly 70(5):646–75. doi: 10.1093/poq/nfl033.
   Web of Science ®Google Scholar
• Groves, Robert M., Robert B. Cialdini, and Mick P. Couper. 1992. “Understanding the Decision to Participate in a Survey.” Public Opinion Quarterly 56(4):475–95. doi: 10.1086/269338.
   Web of Science ®Google Scholar
• Groves, Robert M., and Emilia Peytcheva. 2008. “The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis.” Public Opinion Quarterly 72(2):167–89. doi: 10.1093/poq/nfn011.
   Web of Science ®Google Scholar
• Groves, Robert M., Stanley Presser, and Sarah Dipko. 2004. “The Role of Topic Interest in Survey Participation Decisions.” Public Opinion Quarterly 68(1):2–31. doi: 10.1093/poq/nfh002.
   Web of Science ®Google Scholar
• Groves, Robert M., Eleanor Singer, and Amy Corning. 2000. “Leverage-Saliency Theory of Survey Participation: Description and an Illustration.” Public opinion Quarterly 64(3):299–308. doi: 10.1086/317990.
   PubMed Web of Science ®Google Scholar
• Herzog, A. Regula, and Willard L. Rodgers. 1988. “Age and Response Rates to Interview Sample Surveys.” Journal of Gerontology 43(6):S200–S205. doi: 10.1093/geronj/43.6.s200.
   PubMedGoogle Scholar
• Hjortskov, Morten, Simon Calmar Andersen, and Morten Jakobsen. 2018. “Encouraging Political Voices of Underrepresented Citizens through Coproduction: Evidence from a Randomized Field Trial.” American Journal of Political Science 62(3):597–609. doi: 10.1111/ajps.12360.
   Web of Science ®Google Scholar
• Houston, David. 2006. “Walking the Walk” of Public Service Motivation: Public Employees and Charitable Gifts of Time, Blood, and Money.” Journal of Public Administration Research and Theory 16(1):67–86.
   Web of Science ®Google Scholar
• Kalantar, Jamshid S., and Nicholas J. Talley. 1999. “The Effects of Lottery Incentive and Length of Questionnaire on Health Survey Response Rates: A Randomized Study.” Journal of Clinical Epidemiology 52(11):1117–22. doi: 10.1016/S0895-4356(99)00051-7.
   PubMed Web of Science ®Google Scholar
• Kim, Sangmook, Wouter Vandenabeele, Bradley E. Wright, Lotte Bøgh Andersen, Francesco Paolo Cerase, Robert K. Christensen, Céline Desmarais, Maria Koumenta, Peter Leisink, and Bangcheng Liu. 2013. “Investigating the Structure and Meaning of Public Service Motivation across Populations: Developing an International Instrument and Addressing Issues of Measurement Invariance.” Journal of Public Administration Research and Theory 23(1):79–102. doi: 10.1093/jopart/mus027.
   Web of Science ®Google Scholar
• Kjeldsen, Anne Mette. 2012. Dynamics of Public Service Motivation. Aarhus, Denmark: Forlaget Politica.
   Google Scholar
• Kjeldsen, Anne Mette, and Christian Bøtcher Jacobsen. 2013. “Public Service Motivation and Employment Sector: Attraction or Socialization?” Journal of Public Administration Research and Theory 23(4):899–926.
   Web of Science ®Google Scholar
• Korkeila, K., S. Suominen, J. Ahvenainen, A. Ojanlatva, P. Rautava, H. Helenius, and M. Koskenvuo. 2001. “Non-Response and Related Factors in a Nation-Wide Health Survey.” European Journal of Epidemiology 17(11):991–9. doi: 10.1023/A:1020016922473.
   PubMed Web of Science ®Google Scholar
• Lambert, Douglas M., and Thomas C. Harrington. 1990. “Measuring Nonresponse Bias in Customer Service Mail Surveys.” Journal of Business Logistics 11(2):5.
   Google Scholar
• Laguilles, J. S., E. A. Williams, and D. B. Saunders. 2013. “Can Lottery Incentives Boost Web Survey Response Rates? Findings from Four Experiments.” Research in Higher Education 52(5):537–53. doi: 10.1007/s11162-010-9203-2.
   Web of Science ®Google Scholar
• Le Grand, Julian. 2003. Motivation, Agency, and Public Policy: Of Knights and Knaves, Pawns and Queens. Oxford, UK: Oxford University Press.
   Google Scholar
• Marrett, Loraine D., Nancy Kreiger, Linda Dodds, and Shelly Hilditch. 1992. “The Effect on Response Rates of Offering a Small Incentive with a Mailed Questionnaire.” Annals of Epidemiology 2(5):745–53. doi: 10.1016/1047-2797(92)90019-M.
   PubMedGoogle Scholar
• Moynihan, Donald P. 2008. “The Normative Model in Decline? Public Service Motivation in the Age of Governance.” Pp. 247–67 in Motivation in Public Management. The Call of Public Service, edited by James L. Perry and Annie Hondeghem. Oxford: Oxford University Press.
   Google Scholar
• Nakash, Rachel A., Jane L. Hutton, Sarah E. Lamb, Simon Gates, and Joanne Fisher. 2008. “Response and Non-Response to Postal Questionnaire Follow-up in a Clinical Trial–a Qualitative Study of the Patient’s Perspective.” Journal of Evaluation in Clinical Practice 14(2):226–35. doi: 10.1111/j.1365-2753.2007.00838.x.
   PubMed Web of Science ®Google Scholar
• Namiranian, L., H. R. Moskowitz, and A. Gofman. 2006. “Motivations to Join.” Panel Research.
   Google Scholar
• Olson, Kristen. 2006. “Survey Participation, Nonresponse Bias, Measurement Error Bias, and Total Bias.” Public Opinion Quarterly 70(5):737–58.
   Web of Science ®Google Scholar
• Pedersen, Mogens Jin, and Christian Videbaek Nielsen. 2016. “Improving Survey Response Rates in Online Panels: Effects of Low-Cost Incentives and Cost-Free Text Appeal Interventions.” Social Science Computer Review 34(2):229–43. doi: 10.1177/0894439314563916.
   Web of Science ®Google Scholar
• Perry, James L. 1996. “Measuring Public Service Motivation: An Assessment of Construct Reliability and Validity.” Journal of Public Administration Research and Theory 6(1):5–22. doi: 10.1093/oxfordjournals.jpart.a024303.
   Google Scholar
• Perry, James L., and Annie Hondeghem. 2008. Motivation in Public Management: The Call of Public Service. Oxford: Oxford University Press on Demand.
   Google Scholar
• Perry, James L., Annie Hondeghem, and Lois Recascino Wise. 2010. “Revisiting the Motivational Bases of Public Service: Twenty Years of Research and an Agenda for the Future.” Public Administration Review 70(5):681–90. doi: 10.1111/j.1540-6210.2010.02196.x.
   Web of Science ®Google Scholar
• Perry, James L., and Lyman W. Porter. 1982. “Factors Affecting the Context for Motivation in Public Organizations.” Academy of Management Review 7(1):89–98. doi: 10.5465/amr.1982.4285475.
   Google Scholar
• Perry, James L., and Lois Recascino Wise. 1990. “The Motivational Bases of Public Service.” Public Administration Review 50(3):367–73. doi: 10.2307/976618.
   Web of Science ®Google Scholar
• Piatak, J. S. 2014. “Altruism by Job Sector: Can Public Sector Employees Lead the Way in Rebuilding Social Capital?” Journal of Public Administration Research and Theory 25(3):877–900. doi: 10.1093/jopart/muu013.
   Web of Science ®Google Scholar
• Ritz, Adrian, Gene A. Brewer, and Oliver Neumann. 2016. “Public Service Motivation: A Systematic Review and Outlook.” Public Administration Review 76(3):414–26. doi: 10.1111/puar.12505.
   Web of Science ®Google Scholar
• Ryan, Richard M., and Edward L. Deci. 2000. “Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions.” Contemporary educational Psychology 25(1):54–67. doi: 10.1006/ceps.1999.1020.
   PubMed Web of Science ®Google Scholar
• Singer, Eleanor, and Robert M. Bossarte. 2006. “Incentives for Survey Participation: When Are They ‘Coercive’?” American journal of Preventive Medicine 31(5):411–8. doi: 10.1016/j.amepre.2006.07.013.
   PubMed Web of Science ®Google Scholar
• Smith, Tom W. 1983. “The Hidden 25 Percent: An Analysis of Nonresponse on the 1980 General Social Survey.” Public Opinion Quarterly 47(3):386–404. doi: 10.1086/268797.
   Web of Science ®Google Scholar
• Steijn, Bram. 2008. “Person-Environment Fit and Public Service Motivation.” International Public Management Journal 11(1):13–27. doi: 10.1080/10967490801887863.
   Web of Science ®Google Scholar
• Vandenabeele, Wouter, Adrian Ritz, and Oliver Neumann. 2018. “Public Service Motivation: State of the Art and Conceptual Cleanup.” Pp. 261–78 in The Palgrave Handbook of Public Administration and Management in Europe, edited by Edoardo Ongaro and Sandra Van Thiel. London: Palgrave MacMillian.
   Google Scholar
• Vogel, Dominik, and Christian B. Jacobsen. 2021. “Nonresponse Bias in Public Leadership Research: An Empirical Assessment.” International Public Management Journal 24(3):435–54. doi: 10.1080/10967494.2021.1906803.
   Web of Science ®Google Scholar
• Vogel, Dominik, and Fabian Homburg. 2021. “P-Hacking, P-Curves, and the PSM–Performance Relationship: Is There Evidential Value?” Public Administration Review 81(2):191–204. doi: 10.1111/puar.13273.
   Web of Science ®Google Scholar
• Whiteman, Maura K., Patricia Langenberg, Kristen Kjerulff, Robert McCarter, and Jodi Anne Flaws. 2003. “A Randomized Trial of Incentives to Improve Response Rates to a Mailed Women’s Health Questionnaire.” Journal of Women’s Health (2002) 12(8):821–8. doi: 10.1089/154099903322447783.
   PubMed Web of Science ®Google Scholar
• Wright, Bradley E. 2008. “Methodological Challenges Associated with Public Service Motivation Research.” In Motivation in Public Management: The Call of Public Service, 80–98. New York: Oxford University Press, USA.
   Google Scholar
• Wright, Bradley E., Robert K. Christensen, and Sanjay K. Pandey. 2013. “Measuring Public Service Motivation: Exploring the Equivalence of Existing Global Measures.” International Public Management Journal 16(2):197–223. doi: 10.1080/10967494.2013.817242.
   Web of Science ®Google Scholar