Do citizen perceptual measures align with archival performance measures: a meta-analysis

References

• Aitalieva, Nurgul R., and Andrew L. Morelock. 2019. “Citizens’ Perceptions of Government Policy Success: A Cross-National Study.” Journal of Public and Nonprofit Affairs 5(2):198–216. doi: 10.20899/jpna.5.2.198-216.
   Web of Science ®Google Scholar
• Ammons, David N., and Patrick M. Madej. 2018. “Citizen-Assisted Performance Measurement? Reassessing Its Viability and Impact.” The American Review of Public Administration 48(7):716–29. doi: 10.1177/0275074017713295.
   Web of Science ®Google Scholar
• Andersen, Lotte Bøgh, Andreas Boesen, and Lene Holm Pedersen. 2016. “Performance in Public Organizations: Clarifying the Conceptual Space.” Public Administration Review 76(6):852–62. doi: 10.1111/puar.12578.
   Web of Science ®Google Scholar
• Andrews, Rhys, George A. Boyne, M. Jae Moon, and Richard M. Walker. 2010. “Assessing Organizational Performance: Exploring Differences between Internal and External Measures.” International Public Management Journal 13(2):105–29. doi: 10.1080/10967491003766533.
   Web of Science ®Google Scholar
• Andrews, Rhys, George A. Boyne, and Richard M. Walker. Jr 2006. “Subjective and Objective Measures of Organizational Performance: An Empirical Exploration.” In Pp. 14–34 in Public Service Performance: Perspectives on Measurement and Management, edited by George A. Boyne, Kenneth J. Meier, Laurence J. O’Toole and Richard M. Walker. Cambridge: Cambridge University Press.
   Google Scholar
• Andrews, Rhys, George A. Boyne, and Richard M. Walker. 2011. “The Impact of Management on Administrative and Survey Measures of Organizational Performance.” Public Management Review 13(2):227–55. doi: 10.1080/14719037.2010.532968.
   Web of Science ®Google Scholar
• Andrews, Rhys, George Boyne, and Ahmed Mohammed Sayed Mostafa. 2017. “When Bureaucracy Matters for Organizational Performance: Exploring the Benefits of Administrative Intensity in Big and Complex Organizations.” Public Administration 95(1):115–39. doi: 10.1111/padm.12305.
   Web of Science ®Google Scholar
• Andrews, Rhys, and Gene A. Brewer. 2013. “Social Capital, Management Capacity and Public Service Performance.” Public Management Review 15(1):19–42. doi: 10.1080/14719037.2012.662445.
   Web of Science ®Google Scholar
• Arena, M., M. Arnaboldi, and G. Azzone. 2010. “Student Perceptions and Central Administrative Services: The Case of Higher Education in Italy.” Studies in Higher Education 35(8):941–59. doi: 10.1080/03075070903420708.
   Web of Science ®Google Scholar
• Ariely, Gal. 2011. “Why People (Dis)like the Public Service: Citizen Perception of the Public Service and the Npm Doctrine.” Politics & Policy 39(6):997–1019. doi: 10.1111/j.1747-1346.2011.00329.x.
   Google Scholar
• Barrows, Samuel, Michael Henderson, Paul E. Peterson, and Martin R. West. 2016. “Relative Performance Information and Perceptions of Public Service Quality: Evidence from American School Districts.” Journal of Public Administration Research and Theory 26(3):571–83. doi: 10.1093/jopart/muw028.
   Web of Science ®Google Scholar
• Batley, Richard, and Claire McLoughlin. 2015. “The Politics of Public Services: A Service Characteristics Approach.” World Development 74:275–85. doi: 10.1016/j.worlddev.2015.05.018.
   Web of Science ®Google Scholar
• Baumgartner, Hans, and Christian Homburg. 1996. “Applications of Structural Equation Modeling in Marketing and Consumer Research: A Review.” International Journal of Research in Marketing 13(2):139–61. doi: 10.1016/0167-8116(95)00038-0.
   Google Scholar
• Behn, Robert D. 2003. “Why Measure Performance? Different Purposes Require Different Measures.” Public Administration Review 63(5):586–606. doi: 10.1111/1540-6210.00322.
   Web of Science ®Google Scholar
• Belle, Nicola, and Paola Cantarelli. 2017. “What Causes Unethical Behavior? A Meta-Analysis to Set an Agenda for Public Administration Research.” Public Administration Review 77(3):327–39. doi: 10.1111/puar.12714.
   Web of Science ®Google Scholar
• Bergkvist, Lars, and John R. Rossiter. 2007. “The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs.” Journal of Marketing Research 44(2):175–84. doi: 10.1509/jmkr.44.2.175.
   Web of Science ®Google Scholar
• Berman, Evan, and XiaoHu Wang. 2000. “Performance Measurement in U.S. Counties: Capacity for Reform.” Public Administration Review 60(5):409–20. doi: 10.1111/0033-3352.00104.
   Web of Science ®Google Scholar
• Bledsoe, T., and G. Stoker. 1992. Citizen’s Knowledge of Local Government in the Detroit Metropolitan Area. Detroit, MI: Center for Urban Studies, Wayne State University.
   Google Scholar
• Bommer, William H., Jonathan L. Johnson, Gregory A. Rich, Philip M. Podsakoff, and Scott B. Mackenzie. 1995. “On the Interchangeability of Objective and Subjective Measures of Employee Performance: A Meta-Analysis.” Personnel Psychology 48(3):587–605. doi: 10.1111/j.1744-6570.1995.tb01772.x.
   Web of Science ®Google Scholar
• Boschken, Herman L. 1992. “Analyzing Performance Skewness in Public Agencies: The Case of Urban Mass Transit.” Journal of Public Administration Research and Theory 2(3):265–88.
   Google Scholar
• Bouckaert, Geert, and Steven van de Walle. 2003. “Comparing Measures of Citizen Trust and User Satisfaction as Indicators of ‘Good Governance’: Difficulties in Linking Trust and Satisfaction Indicators.” International Review of Administrative Sciences 69(3):329–43.
   Web of Science ®Google Scholar
• Boyne, George A. 2003. “Sources of Public Service Improvement: A Critical Review and Research Agenda.” Journal of Public Administration Research and Theory 13(3):367–94. doi: 10.1093/jopart/mug027.
   Web of Science ®Google Scholar
• Boyne, George, and Julian Gould-Williams. 2003. “Planning and Performance in Public Organizations an Empirical Analysis.” Public Management Review 5(1):115–32. doi: 10.1080/146166702200002889.
   Google Scholar
• Brewer, Gene A.Jr 2006. “All Measures of Performance Are Subjective: More Evidence on US Federal Agencies.” In Pp. 35–54 in Public Service Performance: Perspectives on Measurement and Management, edited by George A. Boyne, Kenneth J. Meier, Laurence J. O’Toole and Richard M. Walker. Cambridge: Cambridge University Press.
   Google Scholar
• Brown, Karin, and Philip B. Coulter. 1983. “Subjective and Objective Measures of Police Service Delivery.” Public Administration Review 43(1):50–8. doi: 10.2307/975299.
   Web of Science ®Google Scholar
• Brown, Trevor L., and Matthew Potoski. 2003. “Transaction Costs and Institutional Explanations for Government Service Production Decisions.” Journal of Public Administration Research and Theory 13(4):441–68. doi: 10.1093/jopart/mug030.
   Web of Science ®Google Scholar
• Brown, Trevor L. 2007. “Coercion versus Choice: Citizen Evaluations of Public Service Quality across Methods of Consumption.” Public Administration Review 67(3):559–72. doi: 10.1111/j.1540-6210.2007.00737.x.
   Web of Science ®Google Scholar
• Buell, Ryan W., Ethan Porter, and Michael I. Norton. 2021. “Surfacing the Submerged State: Operational Transparency Increases Trust in and Engagement with Government.” Manufacturing & Service Operations Management 23(4):781–802. doi: 10.1287/msom.2020.0877.
   Google Scholar
• Campbell, Donald T., and Donald W. Fiske. 1959. “Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix.” Psychological Bulletin 56(2):81–105. doi: 10.1037/h0046016.
   PubMed Web of Science ®Google Scholar
• Carlson, Kevin D., and Andrew O. Herdman. 2012. “Understanding the Impact of Convergent Validity on Research Results.” Organizational Research Methods 15(1):17–32. doi: 10.1177/1094428110392383.
   Web of Science ®Google Scholar
• Charbonneau, Étienne, and Gregg G. Van Ryzin. 2012. “Performance Measures and Parental Satisfaction with New York City Schools.” The American Review of Public Administration 42(1):54–65. doi: 10.1177/0275074010397333.
   Web of Science ®Google Scholar
• Cheon, Ohbet, Miyeon Song, Austin M. Mccrea, and Kenneth J. Meier. 2021. “Health Care in America: The Relationship between Subjective and Objective Assessments of Hospitals.” International Public Management Journal 24(5):596–622. doi: 10.1080/10967494.2018.1553808.
   Web of Science ®Google Scholar
• Cohen, Jacob. 1992. “Quantitative Methods in Psychology: A Power Primer.” Psychological Bulletin 112(1):155–9. doi: 10.1037//0033-2909.112.1.155.
   PubMed Web of Science ®Google Scholar
• Cooper, Harris. 2017. Research Synthesis and Meta-Analysis: A Step-by-Step Approach. Los Angeles: Sage publications.
   Google Scholar
• Cuijpers, Pim. 2016. Meta-Analyses in Mental Health Research. A Practical Guide. Amsterdam: Vrije Universitieit Amsterdam.
   Google Scholar
• Das, Hari, Mallika Das, and Francis McKenzie. 1995. “Assessing the “Will of the People”: An Investigation into Town Service Delivery Satisfaction.” Canadian Public Administration/Administration Publique du Canada 38(1):77–93. doi: 10.1111/j.1754-7121.1995.tb01130.x.
   Web of Science ®Google Scholar
• DeHoog, Ruth Hoogland, David Lowery, and William E. Lyons. 1990. “Citizen Satisfaction with Local Governance: A Test of Individual, Jurisdictional, and City-Specific Explanations.” The Journal of Politics 52(3):807–37. doi: 10.2307/2131828.
   Web of Science ®Google Scholar
• DeVellis, Robert F. 2016. Scale Development: Theory and Applications. Los Angeles: SAGE.
   Google Scholar
• Diamantopoulos, Adamantios, Marko Sarstedt, Christoph Fuchs, Petra Wilczynski, and Sebastian Kaiser. 2012. “Guidelines for Choosing between Multi-Item and Single-Item Scales for Construct Measurement: A Predictive Validity Perspective.” Journal of the Academy of Marketing Science 40(3):434–49. doi: 10.1007/s11747-011-0300-3.
   Web of Science ®Google Scholar
• Dinsdal, Geoff, and Brian Marson. 1999. Citizen/Client Surveys: Dispelling Myths and Redrawing Maps. Ottawa: Canadian Centre for Management Development.
   Google Scholar
• Doucouliagos, Chris, and T. D. Stanley. 2013. “Are All Economic Facts Greatly Exaggerated? Theory Competition and Selectivity.” Journal of Economic Surveys 27(2):316–39. doi: 10.1111/j.1467-6419.2011.00706.x.
   Web of Science ®Google Scholar
• Evans, M. D. R., and Jonathan Kelley. 2004. “Subjective Social Location: Data from 21 Nations.” International Journal of Public Opinion Research 16(1):3–38. doi: 10.1093/ijpor/16.1.3.
   Web of Science ®Google Scholar
• Evans, M. D. R., Jonathan Kelley, and Tamas Kolosi. 1992. “Images of Class: Public Perceptions in Hungary and Australia.” American Sociological Review 57(4):461–82. doi: 10.2307/2096095.
   Web of Science ®Google Scholar
• Favero, Nathan. 2016. “What’s Really Happening Here? Effectively Using Surveys to Learn about Organizations.” Public Performance & Management Review 40(1):145–57. doi: 10.1080/15309576.2016.1180997.
   Web of Science ®Google Scholar
• Favero, Nathan, and Justin B. Bullock. 2015. “How (Not) to Solve the Problem: An Evaluation of Scholarly Responses to Common Source Bias.” Journal of Public Administration Research and Theory 25(1):285–308. doi: 10.1093/jopart/muu020.
   Web of Science ®Google Scholar
• Favero, Nathan, and Kenneth J. Meier. 2013. “Evaluating Urban Public Schools: Parents, Teachers, and State Assessments.” Public Administration Review 73(3):401–12. doi: 10.1111/puar.12022.
   Web of Science ®Google Scholar
• Feldman, Jack M. 1981. “Beyond Attribution Theory: Cognitive Processes in Performance Appraisal.” Journal of Applied Psychology 66(2):127–48. doi: 10.1037/0021-9010.66.2.127.
   Web of Science ®Google Scholar
• Fountain, Jane E. 2001. “Paradoxes of Public Sector Customer Service.” Governance 14(1):55–73. doi: 10.1111/0952-1895.00151.
   Web of Science ®Google Scholar
• Fuchs, Christoph, and Adamantios Diamantopoulos. 2009. “Using Single-Item Measures for Construct Measurement in Management Research: Conceptual Issues and Application Guidelines.” Die Betriebswirtschaft 69(2):195.
   Google Scholar
• Gardner, Donald G., Lindsey L. Cummings, Randall B. Dunham, and Jon L. Pierce. 1998. “Single-Item versus Multiple-Item Measurement Scales: An Empirical Comparison.” Educational and Psychological Measurement 58(6):898–915. doi: 10.1177/0013164498058006003.
   Web of Science ®Google Scholar
• Garsombke, Perrin H., and Jerry Schrad. 1999. “Performance Measurement Systems: Results from a City and State Survey.” Government Finance Review 15:9–12.
   Google Scholar
• George, Bert, and Sanjay K. Pandey. 2017. “We Know the Yin—but Where is the Yang? Toward a Balanced Approach on Common Source Bias in Public Administration Scholarship.” Review of Public Personnel Administration 37(2):245–70. doi: 10.1177/0734371X17698189.
   PubMed Web of Science ®Google Scholar
• George, Bert, Richard M. Walker, and Joost Monster. 2019. “Does Strategic Planning Improve Organizational Performance? A Meta-Analysis.” Public Administration Review 79(6):810–9. doi: 10.1111/puar.13104.
   Web of Science ®Google Scholar
• Gorsuch, Richard L., and Sam G. McFarland. 1972. “Single vs. Multiple-Item Scales for Measuring Religious Values.” Journal for the Scientific Study of Religion 11(1):53–64. doi: 10.2307/1384298.
   Web of Science ®Google Scholar
• Grizzle, Gloria A. 2002. “Performance Measurement and Dysfunction: The Dark Side of Quantifying Work.” Public Performance & Management Review 25(4):363–9. doi: 10.1080/15309576.2002.11643673.
   Google Scholar
• Grosso, Ashley, Étienne Charbonneau, and Gregg G. Van Ryzin. 2017. “How Citizens Respond to Outputs, Outcomes, and Costs: A Survey Experiment about an HIV/AIDS Program.” International Public Management Journal 20(1):160–81. doi: 10.1080/10967494.2016.1143425.
   Web of Science ®Google Scholar
• Gurevitch, Jessica, Julia Koricheva, Shinichi Nakagawa, and Gavin Stewart. 2018. “Meta-Analysis and the Science of Research Synthesis.” Nature 555(7695):175–82. doi: 10.1038/nature25753.
   PubMed Web of Science ®Google Scholar
• Harris, Daniel, Richard Batley, Claire Mcloughlin, and Joseph Wales. 2013. Understanding the Political Implications of Sector Characteristics for Education Service Delivery. London: ODI.
   Google Scholar
• Hatry, Harry P. 2014. Transforming Performance Measurement for the 21st Century. Washington, DC: The Urban Institute.
   Google Scholar
• Hatry, Harry P. 2006. Performance Measurement: Getting Results. Washington, DC: The Urban Institute.
   Google Scholar
• Heneman, Robert L. 1986. “The Relationship between Supervisory Ratings and Results-Oriented Measures of Performance: A Meta-Analysis.” Personnel Psychology 39(4):811–26. doi: 10.1111/j.1744-6570.1986.tb00596.x.
   Web of Science ®Google Scholar
• Hjortskov, Morten. 2017. “Priming and Context Effects in Citizen Satisfaction Surveys.” Public Administration 95(4):912–26. doi: 10.1111/padm.12346.
   Web of Science ®Google Scholar
• Ho, Alfred T. 2007. “Exploring the Roles of Citizens in Performance Measurement.” International Journal of Public Administration 30(11):1157–77. doi: 10.1080/01900690701225341.
   Google Scholar
• Ho, Alfred T., and Paul Coates. 2006. “Public Participation in Local Performance Measurement and Budgeting.” Pp. 545–66 in Public Financial Management, edited by Howard A. Frank. New York: Routledge.
   Google Scholar
• Hood, Christopher. 2007. “What Happens When Transparency Meets Blame-Avoidance?” Public Management Review 9(2):191–210. doi: 10.1080/14719030701340275.
   Web of Science ®Google Scholar
• Jakobsen, Morten, and Rasmus Jensen. 2015. “Common Method Bias in Public Management Studies.” International Public Management Journal 18(1):3–30. doi: 10.1080/10967494.2014.997906.
   Web of Science ®Google Scholar
• Kelly, Janet M. 2003. “Citizen Satisfaction and Administrative Performance Measures: Is There Really a Link.” ?Urban Affairs Review 38(6):855–66. doi: 10.1177/1078087403038006005.
   Web of Science ®Google Scholar
• Kelly, Janet M., and David Swindell. 2002. “A Multiple–Indicator Approach to Municipal Service Evaluation: Correlating Performance Measurement and Citizen Satisfaction across Jurisdictions.” Public Administration Review 62(5):610–21. doi: 10.1111/1540-6210.00241.
   Web of Science ®Google Scholar
• Lamothe, Meeyoung, Scott Lamothe, and Elizabeth Bell. 2018. “Understanding Local Service Delivery Arrangements: Are the ICMA ASD Data Reliable?” Public Administration Review 78(4):613–25. doi: 10.1111/puar.12939.
   Web of Science ®Google Scholar
• Lee, Geon, Jennifer Benoit-Bryan, and Timothy P. Johnson. 2012. “Survey Research in Public Administration: Assessing Mainstream Journals with a Total Survey Error Framework.” Public Administration Review 72(1):87–97. doi: 10.1111/j.1540-6210.2011.02482.x.
   Web of Science ®Google Scholar
• Lee, Ivan P., Sebastian Jilke, and Oliver James. 2021. “Do More Options Always Benefit the Users of Public Services? An Experimental Study of School Choice, Performance, and Satisfaction.” Public Administration Review 81(1):110–20. doi: 10.1111/puar.13271.
   Web of Science ®Google Scholar
• Licari, Michael J., William McLean, and Tom W. Rice. 2005. “The Condition of Community Streets and Parks: A Comparison of Resident and Nonresident Evaluations.” Public Administration Review 65(3):360–8. doi: 10.1111/j.1540-6210.2005.00460.x.
   Web of Science ®Google Scholar
• Loo, Robert. 2002. “A Caveat on Using Single-Item versus Multiple-Item Scales.” Journal of Managerial Psychology 17(1):68–75. doi: 10.1108/02683940210415933.
   Google Scholar
• Lynn, Laurence E., and Robbie Waters Robichau. 2013. “Governance and Organisational Effectiveness: Towards a Theory of Government Performance.” Journal of Public Policy 33(2):201–28. doi: 10.1017/S0143814X13000056.
   Web of Science ®Google Scholar
• Mani, Anandi, and Sharun Mukand. 2007. “Democracy, Visibility and Public Good Provision.” Journal of Development Economics 83(2):506–29. doi: 10.1016/j.jdeveco.2005.06.008.
   Web of Science ®Google Scholar
• Martini, Mattia, Dario Cavenago, and Laura Mariani. 2018. “When the Outcome is Employability: Leading Indicators for the Governance of Labour Market Services.” Public Organization Review 18(4):507–24. doi: 10.1007/s11115-017-0393-3.
   Google Scholar
• Marvel, John D. 2015. “Unconscious Bias in Citizens’ Evaluations of Public Sector Performance.” Journal of Public Administration Research and Theory 26(1):muu053. doi: 10.1093/jopart/muu053.
   Web of Science ®Google Scholar
• Meier, K. J., and L. J. O’Toole. Jr. 2013. “Subjective Organizational Performance and Measurement Error: Common Source Bias and Spurious Relationships.” Journal of Public Administration Research and Theory 23(2):429–56. doi: 10.1093/jopart/mus057.
   Web of Science ®Google Scholar
• Miller, Thomas I., and Michelle A. Miller. 1991. “Standards of Excellence: U. S. Residents’ Evaluations of Local Government Services.” Public Administration Review 51(6):503–14. doi: 10.2307/976601.
   Web of Science ®Google Scholar
• Moher, David, Larissa Shamseer, Mike Clarke, Davina Ghersi, Alessandro Liberati, Mark Petticrew, Paul Shekelle, and Lesley A. Stewart. 2015. “Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 Statement.” Systematic Reviews 4(1):1. doi: 10.1186/2046-4053-4-1.
   PubMed Web of Science ®Google Scholar
• Mondak, Jeffery J., Edward G. Carmines, Robert Huckfeldt, Dona-Gene Mitchell, and Scot Schraufnagel. 2007. “Does Familiarity Breed Contempt? The Impact of Information on Mass Attitudes toward Congress.” American Journal of Political Science 51(1):34–48. doi: 10.1111/j.1540-5907.2007.00235.x.
   Web of Science ®Google Scholar
• Moynihan, Donald P. 2006. “What Do We Talk about When We Talk about Performance? Dialogue Theory and Performance Budgeting.” Journal of Public Administration Research and Theory 16(2):151–68. doi: 10.1093/jopart/muj003.
   Web of Science ®Google Scholar
• Moynihan, Donald P., Sergio Fernandez, Soonhee Kim, Kelly M. LeRoux, Suzanne J. Piotrowski, Bradley E. Wright, and Kaifeng Yang. 2011. “Performance Regimes Amidst Governance Complexity.” Journal of Public Administration Research and Theory 21(Supplement 1):i141–i155. doi: 10.1093/jopart/muq059.
   Web of Science ®Google Scholar
• Nakamura, Hiroki, and Shunsuke Managi. 2020. “Effects of Subjective and Objective City Evaluation on Life Satisfaction in Japan.” Journal of Cleaner Production 256:120523. doi: 10.1016/j.jclepro.2020.120523.
   Web of Science ®Google Scholar
• Nielsen, Poul A., and Martin Baekgaard. 2015. “Performance Information, Blame Avoidance, and Politicians’ Attitudes to Spending and Reform: Evidence from an Experiment.” Journal of Public Administration Research and Theory 25(2):545–69. doi: 10.1093/jopart/mut051.
   Web of Science ®Google Scholar
• Osborne, David, and Ted Gaebler. 1992. Reinventing Government: How the Entrepreneurial Spirit is Transforming the Public Sector. Reading, Mass.: Addison-Wesley.
   Google Scholar
• Park, Tae-Youn, and Jason Shaw. 2013. “Turnover Rates and Organizational Performance: A Meta-Analysis.” The Journal of Applied Psychology 98(2):268–309. doi: 10.1037/a0030723.
   PubMed Web of Science ®Google Scholar
• Parks, Roger B. 1984. “Linking Objective and Subjective Measures of Performance.” Public Administration Review 44(2):118–27. doi: 10.2307/975862.
   Web of Science ®Google Scholar
• Parola, Heather R., Michael B. Harari, David E. L. Herst, and Palina Prysmakova. 2019. “Demographic Determinants of Public Service Motivation: A Meta-Analysis of PSM-Age and -Gender Relationships.” Public Management Review 21(10):1397–419. doi: 10.1080/14719037.2018.1550108.
   Web of Science ®Google Scholar
• Podsakoff, Philip M., Scott B. MacKenzie, and Nathan P. Podsakoff. 2012. “Sources of Method Bias in Social Science Research and Recommendations on How to Control It.” Annual Review of Psychology 63(1):539–69. doi: 10.1146/annurev-psych-120710-100452.
   PubMed Web of Science ®Google Scholar
• Pritchett, Lant, and Michael Woolcock. 2004. “Solutions When the Solution is the Problem: Arraying the Disarray in Development.” World Development 32(2):191–212. doi: 10.1016/j.worlddev.2003.08.009.
   Web of Science ®Google Scholar
• Radin, Beryl A. 2006. Challenging the Performance Movement: Accountability, Complexity, and Democratic Values, Public Management and Change Series. Washington, DC: Georgetown University Press.
   Google Scholar
• Reed, Jeffrey G., and Pam M. Baxter. 2009. “Using Reference Databases.” Pp. 73–101 in The Handbook of Research Synthesis and Meta-Analysis, edited by Harris Cooper, Larry V. Hedges and Jeffrey C. Valentine. New York: Russell Sage Foundation.
   Google Scholar
• Reisig, Michael D., and Roger B. Parks. 2000. “Experience, Quality of Life, and Neighborhood Context: A Hierarchical Analysis of Satisfaction with Police.” Justice Quarterly 17(3):607–30. doi: 10.1080/07418820000094681.
   Web of Science ®Google Scholar
• Richard, Pierre J., Timothy M. Devinney, George S. Yip, and Gerry Johnson. 2009. “Measuring Organizational Performance: Towards Methodological Best Practice.” Journal of Management 35(3):718–804. doi: 10.1177/0149206308330560.
   Web of Science ®Google Scholar
• Ringquist, Evan J. 2013. Meta-Analysis for Public Management and Policy. San Francisco: Jossey-Bass.
   Google Scholar
• Robbins, Mark D., Bill Simonsen, and Emily Shepard. 2009. “Citizens, Budgets and Performance Measures: A Case Study of West Hartford, Connecticut.” Journal of Public Budgeting, Accounting & Financial Management 21(3):426–53. doi: 10.1108/JPBAFM-21-03-2009-B004.
   Google Scholar
• Rosentraub, M., K. Harlow, and L. Thompson. 1979. “In Defense of Surveys as a Reliable Source of Evaluation Data.” Public Administration Review 39(3):302–3. doi: 10.2307/975962.
   Web of Science ®Google Scholar
• Rossiter, John R. 2002. “The C-OAR-SE Procedure for Scale Development in Marketing.” International Journal of Research in Marketing 19(4):305–35. doi: 10.1016/S0167-8116(02)00097-6.
   Web of Science ®Google Scholar
• Roth, Victor J., Lorne Bozinoff, and Peter MacIntosh. 1990. “Public Opinion and the Measurement of Consumer Satisfaction with Government Services.” Canadian Public Administration/Administration Publique du Canada 33(4):571–83. doi: 10.1111/j.1754-7121.1990.tb01418.x.
   Web of Science ®Google Scholar
• Schachter, Hindy Lauer. 2010. “Objective and Subjective Performance Measures: A Note on Terminology.” Administration & Society 42(5):550–67. doi: 10.1177/0095399710378080.
   Web of Science ®Google Scholar
• Shamseer, Larissa, David Moher, Mike Clarke, Davina Ghersi, Alessandro Liberati, Mark Petticrew, Paul Shekelle, and Lesley A. Stewart. 2015. “Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015: Elaboration and Explanation.” BMJ (Clinical Research ed.) 350: G 7647. doi: 10.1136/bmj.g7647.
   Google Scholar
• Shingler, John, Mollie E. Van Loon, Theodore R. Alter, and Jeffrey C. Bridger. 2008. “The Importance of Subjective Data for Public Agency Performance Evaluation.” Public Administration Review 68(6):1101–11. doi: 10.1111/j.1540-6210.2008.00958.x.
   Web of Science ®Google Scholar
• Sloan, Jeff A., Neil Aaronson, Joseph C. Cappelleri, Diane L. Fairclough, and Claudette Varricchio. 2002. “Assessing the Clinical Significance of Single Items Relative to Summated Scores.” Mayo Clinic Proceedings 77(5):479–87. doi: 10.1016/S0025-6196(11)62218-0.
   PubMed Web of Science ®Google Scholar
• Smith, Peter. 1995. “On the Unintended Consequences of Publishing Performance Data in the Public Sector.” International Journal of Public Administration 18(2-3):277–310. doi: 10.1080/01900699508525011.
   Google Scholar
• Song, Miyeon, Minjung Kim, and Nathan Favero. 2020. “Social Class, Ingroup–Outgroup Comparison, and Citizen Evaluations: Is User Satisfaction Linked to Outcome Disparities?” The American Review of Public Administration 50(2):205–18. doi: 10.1177/0275074019874445.
   Web of Science ®Google Scholar
• Song, Miyeon, and Kenneth J. Meier. 2018. “Citizen Satisfaction and the Kaleidoscope of Government Performance: How Multiple Stakeholders See Government Performance.” Journal of Public Administration Research and Theory 28(4):489–505. doi: 10.1093/jopart/muy006.
   Web of Science ®Google Scholar
• Song, Miyeon, Kenneth J. Meier, and Anna Amirkhanyan. 2020. “Goal Ambiguity, Management, and Performance in U.S. Nursing Homes.” Administration & Society 52(8):1170–208. doi: 10.1177/0095399720901343.
   Web of Science ®Google Scholar
• Stipak, Brian. 1979. “Citizen Satisfaction with Urban Services: Potential Misuse as a Performance Indicator.” Public Administration Review 39(1):46–52. doi: 10.2307/3110378.
   Web of Science ®Google Scholar
• Thomas, Paul G. 2006. Performance Measurement, Reporting, Obstacles and Accountability: Recent Trends and Future Directions. Canberra: ANU Press.
   Google Scholar
• Thompson, Lyke. 1997. “Citizen Attitudes about Service Delivery Modes.” Journal of Urban Affairs 19(3):291–302. doi: 10.1111/j.1467-9906.1997.tb00498.x.
   Web of Science ®Google Scholar
• Van de Walle, Steven. 2016. “Context-Specific Images of the Archetypical Bureaucrat: Persistence and Diffusion of the Bureaucracy Stereotype.” Public Voices 7(1):3–12. doi: 10.22140/pv.192.
   Google Scholar
• Van Ryzin, Gregg G. 2004. “The Measurement of Overall Citizen Satisfaction.” Public Performance & Management Review 27(3):9–28.
   Google Scholar
• Van Ryzin, Gregg G. 2008. “Citizen Perceptions of Road Smoothness: Evidence from New York with Implications for Comparative Performance Measurement.” International Review of Administrative Sciences 74(4):575–88. doi: 10.1177/0020852308098469.
   Web of Science ®Google Scholar
• Van Ryzin, Gregg G., Ashley Grosso, and Étienne Charbonneau. 2021. “Evidence of an Output Bias in the Judgment of Public Performance: A Replication and Extension.” Public Performance & Management Review 44(3):451–70. doi: 10.1080/15309576.2020.1835679.
   Web of Science ®Google Scholar
• Van Ryzin, Gregg G., and Stephen Immerwahr. 2004. “Derived Importance-Performance Analysis of Citizen Survey Data.” Public Performance & Management Review 27(4):144–73.
   Google Scholar
• Van Ryzin, Gregg G., and Stephen Immerwahr. 2007. “Importance-Performance Analysis of Citizen Satisfaction Surveys.” Public Administration 85(1):215–26. doi: 10.1111/j.1467-9299.2007.00641.x.
   Web of Science ®Google Scholar
• Van Ryzin, Gregg G., Stephen Immerwahr, and Stan Altman. 2008. “Measuring Street Cleanliness: A Comparison of New York City’s Scorecard and Results from a Citizen Survey.” Public Administration Review 68(2):295–303. doi: 10.1111/j.1540-6210.2007.00863.x.
   Web of Science ®Google Scholar
• Van Slyke, David M., and Christine H. Roch. 2004. “What Do They Know, and Whom Do They Hold Accountable? Citizens in the Government–Nonprofit Contracting Relationship.” Journal of Public Administration Research and Theory 14(2):191–209. doi: 10.1093/jopart/muh013.
   Web of Science ®Google Scholar
• van Thiel, Sandra, and Frans L. Leeuw. 2002. “The Performance Paradox in the Public Sector.” Public Performance & Management Review 25(3):267–81. doi: 10.2307/3381236.
   Google Scholar
• Walker, Richard M., and Rhys Andrews. 2015. “Local Government Management and Performance: A Review of Evidence.” Journal of Public Administration Research and Theory 25(1):101–33. doi: 10.1093/jopart/mut038.
   Web of Science ®Google Scholar
• Walker, Richard M., George A. Boyne, and Gene A. Brewer. 2010. “Introduction.” Pp. 1–33 in Public Management and Performance: Research Directions, edited by Richard M. Walker, George A. Boyne and Gene A. Brewer. New York: Cambridge University Press.
   Google Scholar
• Wall, Toby D., Jonathan Michie, Malcolm Patterson, Stephen J. Wood, Maura Sheehan, Chris W. Clegg, and Michael West. 2004. “On the Validity of Subjective Measures of Company Performance.” Personnel Psychology 57(1):95–118. doi: 10.1111/j.1744-6570.2004.tb02485.x.
   Web of Science ®Google Scholar
• Weaver, R. Kent. 1986. “The Politics of Blame Avoidance.” Journal of Public Policy 6(4):371–98. doi: 10.1017/S0143814X00004219.
   Google Scholar
• Wholey, Joseph S. 1999. “Performance-Based Management: Responding to the Challenges.” Public Productivity & Management Review 22(3):288–307. doi: 10.2307/3380705.
   Google Scholar
• Wholey, Joseph S., and Harry P. Hatry. 1992. “The Case for Performance Monitoring.” Public Administration Review 52(6):604–10. doi: 10.2307/977173.
   Web of Science ®Google Scholar
• Woolum, Janet. 2011. “Citizen Involvement in Performance Measurement and Reporting: A Comparative Case Study from Local Government.” Public Performance & Management Review 35(1):79–102. doi: 10.2753/PMR1530-9576350104.
   Web of Science ®Google Scholar
• World Bank 2003. World Development Report 2004: Making Services Work for Poor People. Washington, DC: World Bank.
   Google Scholar
• Zhang, Jiasheng, Hui Li, and Kaifeng Yang. 2022. “A Meta-Analysis of the Government Performance—Trust Link: Taking Cultural and Methodological Factors into Account.” Public Administration Review 82(1):39–58. doi: 10.1111/puar.13439.
   Web of Science ®Google Scholar