Challenges in the Use of Performance Data in Management: Results of a National Survey of Human Service Nonprofit Organizations

References

• Alexander, J., Brudney, J. L., & Yang, K. (2010). Introduction to the symposium: Accountability and performance measurement: The evolving role of nonprofits in the hollow state. Nonprofit and Voluntary Sector Quarterly, 39(4), 565–570.
   Web of Science ®Google Scholar
• Ammons, D. N., & Rivenbark, W. C. (2008). Factors influencing the use of performance data to improve municipal services: Evidence from the North Carolina benchmarking project. Public Administration Review, 68(2), 304–318.
   Web of Science ®Google Scholar
• Baruch, Y., & Holtom, B. (2008). Survey response rate levels and trends in organizational research. Human Relations, 61(8), 1139–1160.
   Web of Science ®Google Scholar
• Behn, R. D. (2003). Why measure performance? Different purposes require different measures. Public Administration Review, 63(5), 586–606.
   Web of Science ®Google Scholar
• Benjamin, L. M. (2013). The potential of outcome measurement for strengthening nonprofits’ accountability to beneficiaries. Nonprofit and Voluntary Sector Quarterly, 42(6), 1224–1244.
   Web of Science ®Google Scholar
• Calderwood, L., & Lessof, C. (2009). Enhancing longitudinal surveys by linking to administrative data. In P. P. Lynn. (Ed). Methodology of Longitudinal Surveys. New York, NY: Wiley.
   Google Scholar
• Campbell, D. (2002). Outcomes assessment and the paradox of nonprofit accountability. Nonprofit Management and Leadership, 12(3), 243–259.
   Google Scholar
• Carman, J. G. (2007). Evaluation practice among community-based organizations: Research into the reality. American Journal of Evaluation, 28(1), 60–75.
   Web of Science ®Google Scholar
• Carman, J. G. (2010). The accountability movement: What’s wrong with this theory. Of Change? Nonprofit and Voluntary Sector Quarterly, 39(2), 256–274.
   Web of Science ®Google Scholar
• Carman, J. G., & Fredericks, K. A. (2010). Evaluation capacity and nonprofit organizations: Is the glass half-empty or half-full? American Journal of Evaluation, 31(1), 84–104.
   Web of Science ®Google Scholar
• Carnochan, S., Samples, M., Myers, M., & Austin, M. J. (2014). Performance measurement challenges in nonprofit human service organizations. Nonprofit and Voluntary Sector Quarterly, 43(6), 1014–1032.
   Web of Science ®Google Scholar
• Cordery, C., & Sinclair, R. (2013). Measuring performance in the third sector. Qualitative Research in Accounting & Management, 10(3/4), 196–212.
   Google Scholar
• Cycyota, C. S., & Harrison, D. A. (2006). What (not) to expect when surveying executives: A meta-analysis of top manager response rates and techniques over time. Organizational Research Methods, 9(2), 133–160.
   Web of Science ®Google Scholar
• Dart, R. (2004). Being “business-like” in a nonprofit organization: A grounded and inductive typology. Nonprofit and Voluntary Sector Quarterly, 33(2), 290–310.
   Web of Science ®Google Scholar
• Derrick-Mills, T., Sandstrom, H., Pettijohn, S., Fyffe, S., & Koulish, J. (2014). Data use for continuous quality improvement: What the head start field can learn from other disciplines. A literature review and conceptual framework (Report No. 2014-77). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U. S. Department of Health and Human Services. Available at https://www.acf.hhs.gov/sites/default/files/opre/hsleadslitreview_final_12_8_14_rv2_0.pdf
   Google Scholar
• Dull, M. (2008). Results-model reform leadership: Questions of credible commitment. Journal of Public Administration Research and Theory, 19(2), 255–284.
   Web of Science ®Google Scholar
• Eckerd, A., & Moulton, S. (2011). Heterogeneous roles and heterogeneous practices: Understanding the adoption and uses of nonprofit performance evaluations. American Journal of Evaluation, 32(1), 98–117.
   Web of Science ®Google Scholar
• Glassman, D. M., & Spahn, K. (2012). Performance measurement for nonprofits. Journal of Applied Corporate Finance, 24(2), 72–77.
   Google Scholar
• Harris, E. E. (2014). The impact of board diversity and expertise on nonprofit performance. Nonprofit Management and Leadership, 25(2), 113–130.
   Web of Science ®Google Scholar
• Hatry, H. P., Morley, E., Rossman, S. B., & Wholey, J., (2005). How federal programs use outcome information: Opportunities for federal managers. In J. M., Kamensky, & A., Morales, (Eds.), Managing for Results 2005 (pp. 197–274). Lanham, MD: Rowman & Littlefield Publishers.
   Google Scholar
• Herman, R. D., & Renz, D. O. (1997). Multiple constituencies and the social construction of nonprofit organization effectiveness. Nonprofit and Voluntary Sector Quarterly, 26(2), 185–206.
   Web of Science ®Google Scholar
• Julnes, P., & Holzer, M. (2001). Promoting the utilization of performance measures in public organizations: An empirical study of factors affecting adoption and implementation. Public Administration Review, 61(6), 693–708.
   Web of Science ®Google Scholar
• Kaplan, R. (2001). Strategic performance management and management in Non-Profit organizations. Nonprofit Management and Leadership, 11(3), 353–370.
   Google Scholar
• Kroll, A. (2015). Drivers of performance information use: Systematic literature review and directions for future research. Public Performance & Management Review, 38(3), 459–486.
   Web of Science ®Google Scholar
• Lecy, J., Schmitz, H. P., & Swedlund, H. (2012). Non-governmental and not-for-profit organizational effectiveness: A modern synthesis. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations, 23(2), 434–457.
   Web of Science ®Google Scholar
• Lee, C., & Clerkin, R. M. (2017). Exploring the use of outcome measures in human service nonprofits: Combining agency, institutional, and organizational capacity perspectives. Public Performance and Management Review, 40(3), 601–624.
   Web of Science ®Google Scholar
• LeRoux, K., & Wright, N. S. (2010). Does performance measurement improve strategic decision making? Findings from a national survey of nonprofit social service agencies. Nonprofit and Voluntary Sector Quarterly, 39(4), 571–587.
   Web of Science ®Google Scholar
• Lindell, M., & Whitney, D. J. (2001). Accounting for common method variance in cross-sectional research designs. Journal of Applied Psychology, 86(1), 114–121.
   PubMed Web of Science ®Google Scholar
• Lindenberg, M. (2001). Are we at the cutting edge or the blunt edge? Improving NGO organizational performance with private and public sector strategic management frameworks. Nonprofit Management and Leadership, 11(3), 247–270.
   Google Scholar
• Lindgren, L. (2001). The non-profit sector meets the performance-management movement: A programme-theory approach. Evaluation, 7(3), 285–303.
   Google Scholar
• Lynch-Cerullo, K., & Cooney, K. (2011). Moving from outputs to outcomes: A review of the evolution of performance measurement in the human service nonprofit sector. Administration in Social Work, 35(4), 364–388.
   Web of Science ®Google Scholar
• MacIndoe, H., & Barman, E. (2013). How organizational stakeholders shape performance measurement in nonprofits: Exploring a multidimensional measure. Nonprofit and Voluntary Sector Quarterly, 42(4), 716–738.
   Web of Science ®Google Scholar
• Melkers, J., & Willoughby, K. (2005). Models of performance‐measurement use in local governments: Understanding budgeting, communication, and lasting effects. Public Administration Review, 65(2), 180–190.
   Web of Science ®Google Scholar
• Mitchell, G. E. (2014). Creating a philanthropic marketplace through accounting, disclosure, and intermediation. Public Performance & Management Review, 38(1), 23–47.
   Web of Science ®Google Scholar
• Mitchell, G., & Berlan, D. (2018). Evaluation in nonprofit organizations: An empirical analysis. Public Performance and Management Review, 41(2), 415–437.
   Web of Science ®Google Scholar
• Morley, E., Vinson, E., & Hatry, H. P. (2001). Outcome measurement in nonprofit organizations: Current practices and recommendations. Waldorf, MD: Independent Sector.
   Google Scholar
• Moxham, C. (2010). Help or hindrance? Public Performance and Management Review, 33(3), 342–354.
   Web of Science ®Google Scholar
• Moynihan, D. P., & Ingraham, P. W. (2004). Integrative leadership in the public sector: A model of performance-information use. Administration and Society, 36(4), 427–453.
   Web of Science ®Google Scholar
• Moynihan, D. P., & Ingraham, P. W. (2007). The reality of results: Managing for results in state and local government. In P. W. Ingraham (Eds.), In pursuit of performance: Management systems in state and local government (pp. 151–177). Baltimore, MD: The Johns Hopkins University Press.
   Google Scholar
• Moynihan, D. P., & Landuyt, N. (2009). How do public organizations learn? Bridging structural and cultural divides. Public Administration Review, 69(6), 1097–1105.
   Web of Science ®Google Scholar
• Moynihan, D. P., & Pandey, S. K. (2010). The big question for performance management: Why do managers use performance information? Journal of Public Administration Research and Theory, 20(4), 849–866.
   Web of Science ®Google Scholar
• Moynihan, D. P., Pandey, S. K., & Wright, B. E. (2012). Setting the table: How transformational leadership fosters performance information use. Journal of Public Administration Research and Theory, 22(1), 143–164.
   Web of Science ®Google Scholar
• Newcomer, K. E. (1997). Using performance measurement to improve programs. New Directions for Evaluation, 1997(75), 5–14.
   Google Scholar
• Newcomer, K., Baradei, L. E., & Garcia, S. (2013). Expectations and capacity of performance measurement in NGOs in the development context. Public Administration and Development, 33(1), 62–79.
   Web of Science ®Google Scholar
• Pandey, S. K., Stazyk, E. C., (2008). Antecedents correlates of public service motivation. In J. L., Perry & A., Hondeghem, (Eds.), Motivation in public management: The call of public service (pp. 101–117). Oxford, UK: Oxford University Press.
   Google Scholar
• Pettijohn, S. L. (2014). Understanding the use of nonprofit performance measures: The case of nonprofit nursing homes (Unpublished doctoral dissertation). Washington, DC: American University.
   Google Scholar
• Podsakoff, P., MacKenzie, S., Lee, J., & Podsakoff, N. (2003). Common method variance in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.
   PubMed Web of Science ®Google Scholar
• Podsakoff, P., MacKenzie, S., & Podsakoff, N. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63(1), 539–569.
   PubMed Web of Science ®Google Scholar
• Poister, T., Aristigueta, M., & Hall, J. (2014). Managing and measuring performance in public and nonprofit organizations: An integrated approach. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Poister, T., & Streib, G. (1999). Performance measurement in municipal government: Assessing the state of the practice. Public Administration Review, 59(4), 325–335.
   Web of Science ®Google Scholar
• Sanger, M. (2008). From measurement to management: Breaking through the barriers to state and local performance. Public Administration Review, 68(s1), S70–S585.
   Google Scholar
• Sawhill, J., & Williamson, D. (2001). Mission impossible? Measuring success in nonprofit organizations. Nonprofit Management and Leadership, 11(3), 371–386.
   Google Scholar
• Schein, E. H. (1992). Organizational culture and leadership: A dynamic view, 2nd ed. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Shah, S., Horne, A., & Capellá, J. (2012). Good data won’t guarantee good decisions, Harvard. Business Review, 90(4), 23–25.
   Google Scholar
• Siemsen, E., Roth, A., & Oliveira, P. (2010). Common method bias in regression models with linear, quadratic, and interaction effects. Organizational Research Methods, 13(3), 456–476.
   Web of Science ®Google Scholar
• Taylor, J. (2014). Organizational culture and the paradox of performance management. Public Performance and Management Review, 38(1), 7–22.
   Web of Science ®Google Scholar
• Thomson, D. E. (2011). The role of funders in driving nonprofit performance measurement and use in strategic management. Public Performance & Management Review, 35(1), 54–78.
   Web of Science ®Google Scholar
• Urban Institute. (2014). Understanding Nonprofit Performance. Washington D. C.: The Urban Institute.
   Google Scholar
• Van Dooren, W., & Van de Walle, S. (2008). Performance Information in the public sector. How it is used. Hampshire, UK: Palgrave Macmillan.
   Google Scholar
• Wholey, J. (2001). Managing for results: Roles for evaluators in a new management era. American Journal of Evaluation, 22(3), 343–347.
   Web of Science ®Google Scholar
• Wilensky, A., & Hansen, C. (2001). Understanding the work beliefs of nonprofit executives through organizational stories. Human Resource Development Quarterly, 12(3), 223–239.
   Google Scholar
• Willems, J., Boenigk, S., & Jegers, M. (2014). Seven trade-offs in measuring nonprofit performance and effectiveness. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations, 25(6), 1648–1670.
   Web of Science ®Google Scholar
• Zimmerman, J. A. M., & Stevens, B. W. (2006). The use of performance measures in South Carolina nonprofits. Nonprofit Management and Leadership, 16(3), 315–327.
   Google Scholar