The public reporting of organizational performance in mental health: coming soon to a mental health service near you

References

• Commonwealth of Australia. Fourth National Mental Health Plan: an agenda for collaborative government action in mental health 2009–2014. Canberra: Commonwealth of Australia, 2009.
   Google Scholar
• Berwick DM, James B, Coye MJ. Connections between quality measurement and improvement. Med Care 2003; 41:130–138.
   Google Scholar
• Bird SM, Cox D, Farewell VT, Goldstein H, Holt T, Smith PC. Royal Statistical Society Working Party on Performance Monitoring in the Public Services. Performance indicators: good, bad, and ugly. London: Royal Statistical Society, 2003.
   Google Scholar
• Marshall M, Shekelle P, Brook R, Leatherman S. Dying to know: public release of information about quality of health care. London: Nuffield Trust, 2000.
   Google Scholar
• Propper C, Wilson D. The use and usefulness of performance measures in the public sector. Oxf Rev Econ Policy 2003; 19:250–267.
   Web of Science ®Google Scholar
• Pidd M. Perversity in public service performance measurement. Int J Product Perf Manag 2005; 54:482–493.
   Google Scholar
• Neil DA, Clarke S, Oakley JG. Public reporting of individual surgeon performance information: United Kingdom developments and Australian issues. Med J Aust 2004; 181:266–268.
   Google Scholar
• Merle V, Moret L, Pidhorz L . Does comparison of performance lead to better care? A pilot observational study in patients admitted for hip fracture in three French public hospitals. Int J Qual Health Care 2009; 21:321–329.
   Google Scholar
• Williams SC, Schmaltz SP, Morton DJ, Koss RG, Loeb JM. Quality of care in US hospitals as reflected by standardized measures, 2002–2004. N Engl J Med 2005; 353:255–264.
   PubMed Web of Science ®Google Scholar
• Guru V, Fremes SE, Naylor D . Public versus private institutional performance reporting: what is mandatory for quality improvement? Am Heart J 2006; 152:573–578.
   Google Scholar
• Davies HTO. Public release of performance data and quality improvement: internal responses to external data by US health care providers. Qual Health Care 2001; 10:104–110.
   Google Scholar
• Barr JK, Giannotti TE, Sofaer S, Duquette CE, Waters WJ, Petrillo MK. Using public reports of patient satisfaction for hospital quality improvement. Health Serv Res 2006; 41:663–682.
   PubMed Web of Science ®Google Scholar
• Goldman LE, Henderson S, Dohan DP, Talavera JA, Dudley RA. Public reporting and pay-for-performance: safety-net hospital executives’ concerns and policy suggestions. Inquiry: Excellus Health Plan 2007; 44:137–145.
   Google Scholar
• Fung CH, Lim Y-W, Mattke S, Damberg C, Shekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med 2008; 148:111–123.
   PubMed Web of Science ®Google Scholar
• Shekelle PG, Lim Y-W, Mattke S, Damberg C. Does public release of performance results improve quality of care? A systematic review. London: The Health Foundation, 2008.
   Google Scholar
• Shekelle PG. Public performance reporting on quality information, Smith PC, Mossialos E, Papanicolas I. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge: Cambridge University Press, 2010.
   Google Scholar
• Heckman J, Heinrich C, Smith J. The performance of performance standards. J Hum Resour 2002; 37:778–811.
   Web of Science ®Google Scholar
• Ringel SP, Grading neurologists: is it wise? Neurology Today 2005; 5:7–8.
   Google Scholar
• Casalino LP, Alexander GC, Jin L, Konetzka RT. General internists’ views on pay-for-performance and public reporting of quality scores: a national survey. Health Aff (Millwood) 2007; 26:492–499.
   Google Scholar
• Neuman HB, Michelassi F, Turner JW, Bass BL. Surrounded by quality metrics: what do surgeons think of ACS-NSQIP? Surgery 2009; 145:27–33.
   Google Scholar
• Jacobs R, McDaid D. Performance measurement in mental health services. Smith PC, Mossialos E, Papanicolas I. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge: Cambridge University Press, 2010.
   Google Scholar
• Rothberg MB, Benjamin EM, Lindenauer PK. Public reporting of hospital quality: recommendations to benefit patients and hospitals. J Hosp Med 2009; 4:541–545.
   Google Scholar
• Utzon J, Kaergaard J. Publication of healthcare quality data to citizens: status and perspectives. Ugeskr Laeger 2009; 171: 1670–1674.
   Google Scholar
• Schneider EC, Lieberman T. Publicly disclosed information about the quality of health care: response of the US public. Qual Health Care 2001; 10:96–103.
   PubMedGoogle Scholar
• Canto JG. Selecting the ideal cardiovascular surgeon: is it possible with public dissemination of clinical outcomes? Editorial. Med Care 2007; 45:585–586.
   Google Scholar
• Hibbard JH. What can we say about the impact of public reporting? Inconsistent execution yields variable results. Ann Intern Med 2008; 148:160–161.
   PubMed Web of Science ®Google Scholar
• Smith PC. On the unintended consequences of publishing performance data in the public sector. Int J Public Admin 1995; 18: 277–310.
   Google Scholar
• Werner RM, Konetzka TR, Kruse GB. Impact of public reporting on unreported quality of care. Health Serv Res 2009; 44:379–398.
   Google Scholar
• Werner RM, Konetzka TR, Stuart EA, Norton EC, Polsky D, Park J. Impact of public reporting on quality of postacute care. Health Serv Res 2009; 44:1169–1187.
   PubMed Web of Science ®Google Scholar
• Ganz DA, Wenger NS, Roth CP . The effect of a quality improvement initiative on the quality of other aspects of health care: the law of unintended consequences? Med Care 2007; 45:8–18.
   Google Scholar
• Goodhart CAE. Monetary relationships: a view from Threadneedle Street. Papers in Monetary Economics. Canberra: Reserve Bank of Australia, 1975.
   Google Scholar
• Danielsson J. The Emperor Has No Clothes: Limits to Risk Modelling. Journal of Banking and Finance 2002; 26:1273–1296.
   Web of Science ®Google Scholar
• Lester H, Roland M. Performance measurement in primary care. Smith PC, Mossialos E, Papanicolas I, Leatherman S. Performance measurement for health system improvement. Cambridge: Cambridge University Press, 2010.
   Google Scholar
• Checkland K, Marshall M, Harrison S. Re-thinking accountability: trust versus confidence in medical practice. Qual Saf Health Care 2004; 13:130–135.
   PubMedGoogle Scholar
• O'Neill O. Trust with accountability? J Health Serv Res Policy 2003; 8:3–4.
   PubMedGoogle Scholar
• Thomas JW. Risk adjustment for measuring health care outcomes, 3rd edition. Book review. Int J Qual Health Care 2004; 16:181–182.
   Google Scholar
• Dow MG, Boaz TL, Thornton D. Risk adjustment of Florida mental health outcomes data: concepts, methods, and results. J Behav Health Serv Res 2001; 28:258–272.
   Google Scholar
• Hendryx MS, Teague GB. Comparing alternative risk-adjustment models. J Behav Health Serv Res 2001; 28:247.
   Google Scholar
• Li Y, Cai X, Glance LG, Spector WD, Mukamel DB. national release of the nursing home quality report cards: implications of statistical methodology for risk adjustment. Health Serv Res 2009; 44:79–102.
   Google Scholar
• Shahian DM, Edwards FH. Statistical risk modeling and outcomes analysis. Ann Thorac Surg 2008; 86:1717–1720.
   Google Scholar
• Shahian DM, Normand S-LT. Comparison of ‘risk-adjusted’ hospital outcomes. Circulation 2008; 117:1955–1963.
   PubMed Web of Science ®Google Scholar
• Shahian DM, Hutter MM, Torchiana DF, Iezzoni LI. Transparency: a mandatory requirement for risk models. J Am Coll Surg 2008; 206:1240–1242.
   Google Scholar
• Romano PS. Peer group benchmarks are not appropriate for health care quality report cards. Am Heart J 2004; 148:921–923.
   Google Scholar
• Austin PC, Alter DA, Anderson GM, Tu JV. The impact of the choice of benchmark on the conclusions of hospital report cards. Am Heart J 2004; 148:1041–1046.
   Google Scholar
• McLoughlin V, Leatherman S, Fletcher M, Owen JW. Improving performance using indicators. Recent experiences in the United States, the United Kingdom, and Australia. Int J Qual Health Care 2001; 13:455–462.
   Google Scholar
• Scott IA, Ward M. Public reporting of hospital outcomes based on administrative data: risks and opportunities. Med J Aust 2006; 184:571–575.
   Google Scholar
• Mor V, Angelelli J, Jones R, Roy J, Moore T, Morris J. Inter-rater reliability of nursing home quality indicators in the US. BMC Health Serv Res 2003; 3:20.
   PubMed Web of Science ®Google Scholar
• Roy J, Mor V. The effect of provider-level ascertainment bias on profiling nursing homes. Stat Med 2005; 24:3609–3629.
   Google Scholar
• Sangl J, Saliba D, Gifford DR, Hittle DF. Challenges in measuring nursing home and home health quality: lessons from the first national healthcare quality report. Med Care 2005; 43: 124–132.
   Google Scholar
• Goldstein H, Speigelhalter DJ. League tables and their limitations: statistical issues in comparisons of institutional performance. J R Stat Soc A 1996; 159:385–443.
   Web of Science ®Google Scholar
• Shahian DM, Torchiana DF, Shemin RJ, Rawn JD, Normand S-LT. Massachusetts cardiac surgery report card: implications of statistical methodology. Ann Thorac Surg 2005; 80:2106–2113.
   Google Scholar
• Mor V. Improving the quality of long-term care with better information. Milbank Q 2005; 83:333–364.
   PubMed Web of Science ®Google Scholar
• Staiger DO, Dimick JB, Baser O, Fan Z, Birkmeyer JD. Empirically derived composite measures of surgical performance. Med Care 2009; 47:226–233.
   Google Scholar
• Willis CD, Stoelwinder JU, Lecky FE . Applying composite performance measures to trauma care. J Trauma Injury Infect Crit Care 2010; 69:256–262.
   Google Scholar
• Smith PC, Mossialos E, Papanicolas I. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge: Cambridge University Press, 2010.
   Google Scholar
• Fong J, Marsh GM, Stokan LA, Sang W, Vinson C, Ruhl LP. Hospital quality performance report: an application of composite scoring. Am J Med Qual 2008; 23:287–295.
   Google Scholar
• O'Brien SM, Shahian DM, DeLong ER . Quality measurement in adult cardiac surgery: part 2. Statistical considerations in composite measure scoring and provider rating. Ann Thorac Surg 2007; 83:S13–26.
   PubMed Web of Science ®Google Scholar
• O'Brien SM, DeLong ER, Dokholyan RS, Edwards FH, Peterson ED. Exploring the behavior of hospital composite performance measures: an example from coronary artery bypass surgery. Circulation 2007; 116:2969–2975.
   Google Scholar
• Jacobs R, Goddard M, Smith PC. Are composite measures a robust reflection of performance in the public sector? Centre for Health Economics Research Paper 16. York: CHE, 2006.
   Google Scholar
• Leckie G, Goldstein H. The limitations of using school league tables to inform school choice. J R Stat Soc A 2009; 172:835–851.
   Web of Science ®Google Scholar
• Rothberg MB, Morsi E, Benjamin EM, Pekow PS, Lindenauer PK. Choosing the best hospital: the limitations of public quality reporting. Health Aff (Millwood) 2008; 27:1680–1687.
   Google Scholar
• Australian Curriculum, Assessment and Reporting Authority (ACARA). MySchool. Frequently Asked Questions about MySchool [accessed 17 March 2011] Available from URL: http://www.acara.edu.au/verve/_resources/FAQs.pdf.
   Google Scholar
• Edgeman-Levitan S, Cleary PD. What information do consumers want and need? Health Aff (Millwood) 1996; 15:42–56.
   Google Scholar
• Leatherman S, McCarthy D. Public disclosure of health care performance reports: experience, evidence and issues for policy. Int J Qual Health Care 1999; 11:93–101.
   Web of Science ®Google Scholar
• Hibbard JH, Jewitt JJ. Will quality report cards help consumers? Health Aff (Millwood) 1997; 16:218–228.
   PubMed Web of Science ®Google Scholar
• Oldham JM, Golden WE, Rosof BM. Quality improvement in psychiatry: why measures matter. J Psychiatr Practice 2007; 14:S8–17.
   Google Scholar
• Hibbard JH, Peters E. supporting informed consumer health care decisions: data presentation approaches that facilitate the use of information in choice. Annu Rev Public Health 2003; 24:413–433.
   PubMed Web of Science ®Google Scholar
• Peters E, Dieckmann N, Dixon A, Hibbard JH, Mertz CK. Less is more in presenting quality information to consumers. Med Care Res Rev 2007; 64:169–190.
   PubMed Web of Science ®Google Scholar
• Hibbard JH, Greene J, Daniel D. What is quality anyway? Performance reports that clearly communicate to consumers the meaning of quality of care. Med Care Res Rev 2010.
   Google Scholar
• Mattke S, Reilly K, Martinez-Vidal E, McLean B, Gifford D. Reporting quality of nursing home care to consumers: the Maryland experience. Int J Qual Health Care 2003; 15:169–177.
   PubMed Web of Science ®Google Scholar
• Vaiana ME, McGlynn EA. What cognitive science tells us about the design of reports for consumers. Med Care Res Rev 2002; 59:3–35.
   Google Scholar
• Donnelley RR. Mental Health Project Final Report: National Benchmarking Project Report 2. Edinburgh: The Scottish Government, 2008.
   Google Scholar
• Bremer RW, Scholle SH, Keyser D, Houtsinger JV, Pincus HA. Pay for performance in behavioral health. Psychiatr Serv 2008; 59: 1419–1429.
   PubMed Web of Science ®Google Scholar
• Bauer MS. A review of quantitative studies of adherence to mental health clinical practice guidelines. Harv Rev Psychiatry 2002; 10:138–153.
   PubMed Web of Science ®Google Scholar
• McGlynn EA, Asch SM, Adams J . The quality of health care delivered to adults in the United States. N Engl J Med 2003; 348:2635–2645.
   PubMed Web of Science ®Google Scholar
• Institute of Medicine. Improving the quality of health care for mental and substance-use conditions. Washington, DC, 2005. [cited 17 March 2011]. Available from URL: www.nap.edu/catalog.php?record_id = 11470#toc or www.iom.edu/?id = 30858.
   Google Scholar
• Stein BD, Kogan JN, Essock S, Fudurich S. Views of mental health care consumers on public reporting of information on provider performance. Psychiatr Serv 2009; 60:689–692.
   Google Scholar
• Astagneau P, L'Heriteau F. Surveillance of surgical-site infections: impact on quality of care and reporting dilemmas. Curr Opin Infect Dis 2010; 23:306–310.
   Google Scholar
• Fletcher M. Hand hygiene and infection in hospitals: what do the public know; what should the public know? J Hosp Infect 2009; 73:397–399.
   Google Scholar
• Kravchuk RS, Schack RW. Designing effective performance-measurement systems under the Government Performance and Results Act of 1993 Public Adm Rev 1996; 564:348–358.
   Google Scholar
• Guru V, Naylor CD, Fremes SE, Teoh K, Tu JV. Publicly reported provider outcomes: the concerns of cardiac surgeons in a single-payer system. Can J Cardiol 2009; 25:33–38.
   Google Scholar
• Duckett SJ, Collins J, Kamp M, Walker K. An improvement focus in public reporting: the Queensland approach. Med J Aust 2008; 189:616–617.
   Google Scholar
• Ferguson TB. Reporting for provider performance: should we punish the bad, or try to make them all good? Am Heart J 2006; 152:410–413.
   Google Scholar
• Henderson A, Henderson S. Provision of a surgeon's performance data for people considering elective surgery. Cochrane Database of Systematic Reviews 2010;11:CD006327.
   Google Scholar
• Bassilios B, Pirkis J, Fletcher J, Burgess P, Gurrin L, King K, Kohn F, Blashki G. The complementarity of two major Australian primary mental health care initiatives. Aust N Z J Psychiatry 2010; 44:997–1004.
   PubMed Web of Science ®Google Scholar
• Australian Mental Health Outcomes and Classification Network. Public reporting of organisational performance: a review of the literature, 2010.
   Google Scholar