Nonresponse bias in public leadership research: an empirical assessment

References

• Adigüzel, F. and M. Wedel . 2008. “Split Questionnaire Design for Massive Surveys.” Journal of Marketing Research 45(5):608–17. doi: 10.1509/jmkr.45.5.608.
   Web of Science ®Google Scholar
• Angrist, J. D. and J.-S. Pischke . 2010. “The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con out of Econometrics.” Journal of Economic Perspectives 24(2):3–30. doi: 10.1257/jep.24.2.3.
   Web of Science ®Google Scholar
• Angrist, J. D. and J.-S. Pischke . 2014. Mastering Metrics: The Path from Cause to Effect . Princeton: Princeton University Press.
   Google Scholar
• Armstrong, J. S. and Terry S. Overton . 1977. “Estimating Nonresponse Bias in Mail Surveys.” Journal of Marketing Research 14 (3):396–402. doi: 10.2307/3150783.
   Web of Science ®Google Scholar
• Bass, B. M. 1985. Leadership and Performance beyond Expectations . New York: Free Press.
   Google Scholar
• Bellé, N. 2014. “Leading to Make a Difference: A Field Experiment on the Performance Effects of Transformational Leadership, Perceived Social Impact, and Public Service Motivation.” Journal of Public Administration Research and Theory 24(1):109–36. doi: 10.1093/jopart/mut033.
   Web of Science ®Google Scholar
• Bethlehem, J. , F. Cobben , and B. Schouten . 2011. Handbook of Nonresponse in Household Surveys . Hoboken, NJ: Wiley.
   Google Scholar
• Bickart, B. and D. Schmittlein . 1999. “The Distribution of Survey Contact and Participation in the United States: Constructing a Survey-Based Estimate.” Journal of Marketing Research 36(2):286–94. doi: 10.2307/3152100.
   Web of Science ®Google Scholar
• Bürkner, P.-C. 2017. “brms: An R Package for Bayesian Multilevel Models Using Stan.” Journal of Statistical Software 80(1). doi: 10.18637/jss.v080.i01.
   PubMed Web of Science ®Google Scholar
• Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences . 2nd ed. Hillsdale, NJ: Erlbaum.
   Google Scholar
• de Leeuw, E. and W. de Heer. 2002. “Trends in Household Survey Nonresponse: A Longitudinal and International Comparison.” Pp. 41–54 in Survey Nonresponse , edited by Robert M. Groves , D. A. Dillman , J. L. Eltinge , and R. J. A. Little . New York: Wiley.
   Google Scholar
• Dorsman, S. J. 2017. “Leadership and Innovation in the Public Sector: Studying the Organizational, Team and Individual Level.” PhD thesis, Erasmus University Rotterdam. http://hdl.handle.net/1765/100429.
   Google Scholar
• Edwards, P. J. , I. Roberts , M. J. Clarke , C. Diguiseppi , R. Wentz , I. Kwan , R. Cooper , L. M. Felix , and S. Pratap . 2009. “Methods to Increase Response to Postal and Electronic Questionnaires.” The Cochrane Database of Systematic Reviews (3). doi: 10.1002/14651858.MR000008.pub4.
   Web of Science ®Google Scholar
• Fleenor, J. W. , J. W. Smither , L. E. Atwater , P. W. Braddy , and R. E. Sturm . 2010. “Self–Other Rating Agreement in Leadership: A Review.” The Leadership Quarterly 21(6):1005–34. doi: 10.1016/j.leaqua.2010.10.006.
   Web of Science ®Google Scholar
• Garson, G. D. 2013. “Fundamentals of Hierarchical Linear and Multilevel Modeling.” Pp. 3–25 in Hierarchical Linear Modeling: Guide and Applications , edited by G. D. Garson . Thousand Oaks, CA: Sage.
   Google Scholar
• Gill, J. and C. Witko . 2013. “Bayesian Analytical Methods: A Methodological Prescription for Public Administration.” Journal of Public Administration Research and Theory 23(2):457–94. doi: 10.1093/jopart/mus091.
   Web of Science ®Google Scholar
• Groves, R. M. 2006. “Nonresponse Rates and Nonresponse Bias in Household Surveys.” Public Opinion Quarterly 70(5):646–75. doi: 10.1093/poq/nfl033.
   Web of Science ®Google Scholar
• Groves, R. M. , D. A. Dillman , J. L. Eltinge , and R. J. A. Little , eds. 2002. Survey Nonresponse . New York: Wiley.
   Google Scholar
• Groves, R. M. and E. Peytcheva . 2008. “The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis.” Public Opinion Quarterly 72(2):167–89. doi: 10.1093/poq/nfn011.
   Web of Science ®Google Scholar
• Groves, R. M. , E. Singer , and A. Corning . 2000. “Leverage-Saliency Theory of Survey Participation: Description and an Illustration.” Public Opinion Quarterly 64(3):299–308. doi: 10.1086/317990.
   PubMed Web of Science ®Google Scholar
• Harms, C. and D. Lakens . 2018. “Making ‘Null Effects’ Informative: Statistical Techniques and Inferential Frameworks.” Journal of Clinical and Translational Research 3(Suppl. 2):382–93. doi: 10.18053/jctres.03.2017S2.007.
   PubMedGoogle Scholar
• Hartog, D. N. , J. J. Muijen , and P. L. Koopman . 1997. “Transactional versus Transformational Leadership: An Analysis of the MLQ.” Journal of Occupational and Organizational Psychology 70(1):19–34. doi: 10.1111/j.2044-8325.1997.tb00628.x.
   Google Scholar
• Jacobsen, C. B. and L. B. Andersen . 2015. “Is Leadership in the Eye of the Beholder? A Study of Intended and Perceived Leadership Practices and Organizational Performance.” Public Administration Review 75(6):829–41. doi: 10.1111/puar.12380.
   Web of Science ®Google Scholar
• Jacobsen, C. B. , L. B. Andersen , A. Bøllingtoft , and T. L. M. Eriksen . 2021. “Can Leadership Training Improve Organizational Effectiveness? Evidence from a Randomized Field Experiment on Transformational and Transactional Leadership.” Public Administration Review . doi: 10.1111/puar.13356.
   Web of Science ®Google Scholar
• Jensen, U. T. , L. B. Andersen , L. L. Bro , A. Bøllingtoft , T. L. M. Eriksen , A.-L. Holten , C. B. Jacobsen , J. Ladenburg , P. A. Nielsen , H. H. Salomonsen , et al. 2019. “Conceptualizing and Measuring Transformational and Transactional Leadership.” Administration & Society 51(1):3–33. doi: 10.1177/0095399716667157.
   Web of Science ®Google Scholar
• Jensen, U. T. , L. B. Andersen , and C. B. Jacobsen . 2019. “Only When We Agree! How Value Congruence Moderates the Impact of Goal-Oriented Leadership on Public Service Motivation.” Public Administration Review 79(1):12–24. doi: 10.1111/puar.13008.
   Web of Science ®Google Scholar
• Jose, P. , D. Bates , S. DebRoy , D. Sarkar , and R Core Team 2018. “nlme: Linear and Nonlinear Mixed Effects Models.” (https://cran.r-project.org/package=nlme).
   Google Scholar
• Knies, E. , C. B. Jacobsen , and L. G. Tummers . 2016. “Leadership and Organizational Performance: State of the Art and Research Agenda.” Pp. 404–18 in The Routledge Companion to Leadership , edited by John Storey , Jean Hartley , Jean-Louis Denis , Paul't Hart , and David Ulrich . New York: Routledge.
   Google Scholar
• Kreuter, F. , G. Muller , and M. Trappmann . 2010. “Nonresponse and Measurement Error in Employment Research: Making Use of Administrative Data.” Public Opinion Quarterly 74(5):880–906. doi: 10.1093/poq/nfq060.
   Web of Science ®Google Scholar
• Kroll, A. and D. Vogel . 2014. “The PSM-Leadership Fit: A Model of Performance Information Use.” Public Administration 92(4):974–91. doi: 10.1111/padm.12014.
   Web of Science ®Google Scholar
• Kruschke, J. K. and T. M. Liddell . 2018a. “Bayesian Data Analysis for Newcomers.” Psychonomic Bulletin & Review 25(1):155–77. doi: 10.3758/s13423-017-1272-1.
   PubMed Web of Science ®Google Scholar
• Kruschke, J. K. and T. M. Liddell . 2018b. “The Bayesian New Statistics: Hypothesis Testing, Estimation, Meta-Analysis, and Power Analysis from a Bayesian Perspective.” Psychonomic Bulletin & Review 25(1):178–206. doi: 10.3758/s13423-016-1221-4.
   PubMed Web of Science ®Google Scholar
• Lahaut, V. M. H. C. J. , H. A. M. Jansen , D. van de Mheen , and H. F. L. Garretsen . 2002. “Non-Response Bias in a Sample Survey on Alcohol Consumption.” Alcohol and Alcoholism (Oxford, Oxfordshire) 37(3):256–60. doi: 10.1093/alcalc/37.3.256.
   PubMed Web of Science ®Google Scholar
• Lakens, D. , N. McLatchie , P. M. Isager , A. M. Scheel , and Z. Dienes . 2020. “Improving Inferences about Null Effects with Bayes Factors and Equivalence Tests.” The Journals of Gerontology. Series B, Psychological Sciences and Social Sciences 75(1):45–57. doi: 10.1093/geronb/gby065.
   PubMed Web of Science ®Google Scholar
• Lambert, D. M. and T. C. Harrington . 1990. “Measuring Nonresponse Bias in Customer Service Mail Surveys.” Journal of Business Logistics 11(2):5–25.
   Google Scholar
• Luthans, F. and B. J. Avolio . 2003. “Authentic Leadership: A Positive Development Approach.” Pp. 241–61 in Positive Organizational Scholarship: Foundations of a New Discipline , edited by K. Cameron and Jane E. Dutton . San Francisco, CA: Berrett-Koehler.
   Google Scholar
• Makowski, D. , M. S. Ben-Shachar , and D. Lüdecke . 2019. “Understand and Describe Bayesian Models and Posterior Distributions using bayestestR.” CRAN. doi: 10.5281/zenodo.2556486.
   Google Scholar
• Maner, J. K. 2014. “Let’s Put Our Money Where Our Mouth Is: If Authors Are to Change Their Ways, Reviewers (and Editors) Must Change with Them.” Perspectives on Psychological Science : A Journal of the Association for Psychological Science 9(3):343–51. doi: 10.1177/1745691614528215.
   PubMedGoogle Scholar
• Manfreda, K. L. , M. Bosnjak , J. Berzelak , I. Haas , and V. Vehovar . 2008. “Web Surveys versus Other Survey Modes: A Meta-Analysis Comparing Response Rates.” International Journal of Market Research 50(1):79–104. doi: 10.1177/147078530805000107.
   Web of Science ®Google Scholar
• Meier, K. J. and Laurence J. O’Toole . 2011. “Comparing Public and Private Management: Theoretical Expectations.” Journal of Public Administration Research and Theory 21(Suppl. 3):i283–i299. doi: 10.1093/jopart/mur027.
   Web of Science ®Google Scholar
• Neider, L. L. and C. A. Schriesheim . 2011. “The Authentic Leadership Inventory (ALI): Development and Empirical Tests.” The Leadership Quarterly 22(6):1146–64. doi: 10.1016/j.leaqua.2011.09.008.
   Web of Science ®Google Scholar
• Nielsen, P. A. , S. Boye , A.‐L. Holten , C. B. Jacobsen , and L. B. Andersen . 2019. “Are Transformational and Transactional Types of Leadership Compatible? A Two-Wave Study of Employee Motivation.” Public Administration 97(2):413–28. doi: 10.1111/padm.12574.
   Web of Science ®Google Scholar
• Nosek, B. A. , G. Alter , G. C. Banks , D. Borsboom , S. D. Bowman , S. J. Breckler , S. Buck , C. D. Chambers , G. Chin , G. Christensen , et al. 2015. “Scientific standards. Promoting an open research culture.” Science 348(6242):1422–5. doi: 10.1126/science.aab2374.
   PubMed Web of Science ®Google Scholar
• Oberfield, Z. W. 2014. “Motivation, Change, and Stability: Findings from an Urban Police Department.” The American Review of Public Administration 44(2):210–32. doi: 10.1177/0275074012461297.
   Web of Science ®Google Scholar
• Oberfield, Z. W. 2014. “Public Management in Time: A Longitudinal Examination of the Full Range of Leadership Theory.” Journal of Public Administration Research and Theory 24(2):407–29. doi: 10.1093/jopart/mus060.
   Web of Science ®Google Scholar
• Park, S. M. , and H. G. Rainey . 2008. “Leadership and Public Service Motivation in U.S.” International Public Management Journal 11(1):109–42. doi: 10.1080/10967490801887954.
   Web of Science ®Google Scholar
• Pedersen, M. J. and C. V. Nielsen . 2016. “Improving Survey Response Rates in Online Panels: Effects of Low-Cost Incentives and Cost-Free Text Appeal Interventions.” Social Science Computer Review 34(2):229–43. doi: 10.1177/0894439314563916.
   Web of Science ®Google Scholar
• Perry, J. L. 2017. “Practicing What We Preach! Public Administration Review Promotes Transparency and Openness.” Public Administration Review 77(1):5–6. doi: 10.1111/puar.12705.
   Web of Science ®Google Scholar
• Podsakoff, P. M. , S. B. MacKenzie , and W. H. Bommer . 1996. “Transformational Leader Behaviors and Substitutes for Leadership as Determinants of Employee Satisfaction, Commitment, Trust, and Organizational Citizenship Behaviors.” Journal of Management 22(2):259–98. doi: 10.1177/014920639602200204.
   Web of Science ®Google Scholar
• Potipiroon, W. and S. Faerman . 2016. “What Difference Do Ethical Leaders Make? Exploring the Mediating Role of Interpersonal Justice and the Moderating Role of Public Service Motivation.” International Public Management Journal 19(2):171–207. doi: 10.1080/10967494.2016.1141813.
   Web of Science ®Google Scholar
• R Core Team 2020. R: A Language and Environment for Statistical Computing . Vienna, Austria. (https://www.r-project.org/).
   Google Scholar
• Rainey, H. G. 2014. Understanding and Managing Public Organizations . 5th ed. New York, NY: Jossey-Bass.
   Google Scholar
• Schwarz, G. , A. Newman , B. Cooper , and N. Eva . 2016. “Servant Leadership and Follower Job Performance: The Mediating Effect of Public Service Motivation.” Public Administration 94(4):1025–41. doi: 10.1111/padm.12266.
   Web of Science ®Google Scholar
• Stan Development Team 2019. “Prior Choice Recommendations.” Accessed August 15, 2019 (https://github.com/stan-dev/stan/wiki/Prior-Choice-Recommendations).
   Google Scholar
• Trottier, T. , M. Van Wart , and X. H. Wang . 2008. “Examining the Nature and Significance of Leadership in Government Organizations.” Public Administration Review 68(2):319–33. doi: 10.1111/j.1540-6210.2007.00865.x.
   Web of Science ®Google Scholar
• Tummers, L. G. and E. Knies . 2016. “Measuring Public Leadership: Developing Scales for Four Key Public Leadership Roles.” Public Administration 94(2):433–51. doi: 10.1111/padm.12224.
   Web of Science ®Google Scholar
• Van der Voet, J. and B. Steijn . 2020. “Team Innovation through Collaboration: How Visionary Leadership Spurs Innovation via Team Cohesion.” Public Management Review . doi: 10.1080/14719037.2020.1743344.
   Web of Science ®Google Scholar
• van Dierendonck, D. 2011. “Servant Leadership: A Review and Synthesis.” Journal of Management 37(4):1228–61. doi: 10.1177/0149206310380462.
   Web of Science ®Google Scholar
• van Dierendonck, D., and I. Nuijten. 2011. “The Servant Leadership Survey: Development and Validation of a Multidimensional Measure.” Journal of Business and Psychology 26(3):249–67. doi: 10.1007/s10869-010-9194-1.
   Google Scholar
• Van Wart, M. 2013. “Administrative Leadership Theory: A Reassessment After 10 Years.” Public Administration 91(3):521–43. doi: 10.1111/padm.12017.
   Web of Science ®Google Scholar
• Viechtbauer, W. 2010. “Conducting Meta-Analyses in R with the Meta for Package.” Journal of Statistical Software 36(3):1–48. http://www.jstatsoft.org/v36/i03/. doi: 10.18637/jss.v036.i03.
   Web of Science ®Google Scholar
• Vogel, D. 2018. “Matching Survey Responses with Anonymity in Environments with Privacy Concerns: A Practical Guide.” International Journal of Public Sector Management 31(7):742–54. doi: 10.1108/IJPSM-12-2017-0330.
   Web of Science ®Google Scholar
• Vogel, D. and A. Kroll . 2019. “Agreeing to Disagree? Explaining Self-Other Disagreement on Leadership Behaviour.” Public Management Review 21(12):1867–92. doi: 10.1080/14719037.2019.1577910.
   Web of Science ®Google Scholar
• Vogel, D. , A. Reuber , and R. Vogel . 2020. “Developing a Short Scale to Assess Public Leadership.” Public Administration 98(4):958–73. doi: 10.1111/padm.12665.
   Web of Science ®Google Scholar
• Vogel, R. and D. Masal . 2015. “Public Leadership: A Review of the Literature and Framework for Future Research.” Public Management Review 17(8):1165–89. doi: 10.1080/14719037.2014.895031.
   Web of Science ®Google Scholar
• Wagenmakers, E.-J. , T. Lodewyckx , H. Kuriyal , and R. Grasman . 2010. “Bayesian Hypothesis Testing for Psychologists: A Tutorial on the Savage-Dickey method.” Cognitive Psychology 60(3):158–89. doi: 10.1016/j.cogpsych.2009.12.001.
   PubMed Web of Science ®Google Scholar
• Wagenmakers, E.-J. , J. Love , M. Marsman , T. Jamil , A. Ly , J. Verhagen , R. Selker , Q. F. Gronau , D. Dropmann , B. Boutin , et al. 2018. “Bayesian Inference for Psychology. Part II: Example Applications with JASP.” Psychonomic Bulletin & Review 25(1):58–76. doi: 10.3758/s13423-017-1323-7.
   PubMed Web of Science ®Google Scholar
• Wasserstein, R. L. and N. A. Lazar . 2016. “The ASA Statement on p-Values: Context, Process, and Purpose.” The American Statistician 70(2):129–33. doi: 10.1080/00031305.2016.1154108.
   Web of Science ®Google Scholar
• Wright, B. E. , S. Hassan , and R. K. Christensen . 2017. “Job Choice and Performance: Revisiting Core Assumptions about Public Service Motivation.” International Public Management Journal 20(1):108–31. doi: 10.1080/10967494.2015.1088493.
   Web of Science ®Google Scholar
• Wright, B. E. , D. P. Moynihan , and S. K. Pandey . 2012. “Pulling the Levers: Transformational Leadership, Public Service Motivation, and Mission Valence.” Public Administration Review 72(2):206–15. doi: 10.1111/j.1540-6210.2011.02496.x.
   Web of Science ®Google Scholar