Setting and maintaining standards for patient-reported outcome measures: can we rely on the COSMIN checklists?

References

• Hambleton R, Arrasmith G, Sheehan D, et al. Standards for educational and psychological testing: six reviews. J Educ Meas. 1986;23:83–98.
   Google Scholar
• Buros OK (editor). The nineteen thirty-eight mental measurements yearbook. New Brunswick (NJ): Rutgers University Press; 1938.
   Google Scholar
• Mokkink LB, Prinsen CA, Bouter LM, et al. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105–113.
   PubMed Web of Science ®Google Scholar
• Hendrikx J, de Jonge MJ, Fransen J, et al. Systematic review of patient-reported outcome measures (PROMs) for assessing disease activity in rheumatoid arthritis. RMD Open. 2016;2(2):e000202
   PubMed Web of Science ®Google Scholar
• Mokkink LB, De Vet HC, Prinsen CA, et al. COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1171–1179.
   PubMed Web of Science ®Google Scholar
• Higgins JPT, Green S, (editors). Cochrane handbook for systematic reviews of interventions. Version 5.1.0 (updated March 2011). Cochrane. Chichester: Wiley; 2011. Available from https://training.cochrane.org/handbook/archive/v5.1/
   Google Scholar
• Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–549.
   PubMed Web of Science ®Google Scholar
• Mokkink LB, Terwee CB, Knol DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Medical Res Methodol. 2010;10:1–8.
   PubMed Web of Science ®Google Scholar
• Prinsen CA, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147–1157.
   PubMed Web of Science ®Google Scholar
• Kirshner B, Guyatt G. A methodological framework for assessing health indices. J Chronic Dis. 1985;38(1):27–36.
   PubMedGoogle Scholar
• Bombardier C, Tugwell P. Methodological considerations in functional assessment. J Rheumatol. 1987;14(Suppl 15):6–10.
   PubMed Web of Science ®Google Scholar
• Streinmer DL. A checklist for evaluating the usefulness of rating scales. Can J Psychiatry. 1993;38(2):140–148.
   PubMed Web of Science ®Google Scholar
• Alrubaiy L, Hutchings HA, Williams JG. Assessing patient reported outcome measures: a practical guide for gastroenterologists. United European Gastroenterol J. 2014;2(6):463–470.
   PubMed Web of Science ®Google Scholar
• Van Zile-Tamsen C. Using Rasch analysis to inform rating scale development. Res High Educ. 2017;58(8):922–933.
   Web of Science ®Google Scholar
• Committee for Medicinal Products for Human Use. Reflection paper on the regulatory guidance for the use of health-related quality of life (HRQL) measures in the evaluation of medicinal products. London (UK): European Medicines Agency; 2005. (EMEA/CHMP/EWP/139391/2004).
   Google Scholar
• U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research., U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research., & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health. Guidance for Industry: patient-Reported Outcome Measures: use in Medical Product Development to Support Labeling Claims: draft Guidance. Health Qual Life Outcomes. 2006;4:79.
   Google Scholar
• Eremenco S, Pease S, Mann S, et al. Patient-reported outcome (PRO) consortium translation process: Consensus development of updated best practices. J Patient-Reported Outcomes. 2018;2:12.
   Google Scholar
• McKenna SP, Heaney A, Wilburn J, et al. Measurement of patient-reported outcomes. 1: The search for the Holy Grail. J Med Econ. 2019;22(6):516–522.
   PubMed Web of Science ®Google Scholar
• Stenner AJ. Measuring reading comprehension with the lexile framework. Durham (NC): MetaMetrics, Inc; 1996.
   Google Scholar
• Stevens SS. On the theory of scales of measurement. Science. 1946;103(2684):677–680.
   Web of Science ®Google Scholar
• Wright BD, Linacre JM. Observations are always ordinal; measurements, however, must be interval. Arch Phys Med Rehabil. 1989;70(12):857–860.
   PubMed Web of Science ®Google Scholar
• Merbitz C, Morris J, Grip JC. Ordinal scales and foundations of misinference. Arch Phys Med Rehabil. 1989;70(4):308–312.
   PubMed Web of Science ®Google Scholar
• Wright BD, Stone MH. Best test design. Chicago (IL): MESA Press; 1979.
   Google Scholar
• Koch W, Schulz EM, Wright R, et al. What is a ratio scale? Rasch Measurement Transactions. 1996;9(4):457.
   Google Scholar
• Rasch G. Probabilistic Models for Some Intelligence and Attainment Tests. Chicago (IL): MESA Press; 1992.
   Google Scholar
• Beckie TM, Hayduk LA. Measuring quality of life. Soc Indic Res. 1997;42(1):21–39.
   Web of Science ®Google Scholar
• Velozo CA, Seel RT, Magasi S, et al. Improving measurement methods in rehabilitation: core concepts and recommendations for scale development. Arch Phys Med Rehabil. 2012;93(8 Suppl):S154–S163.
   PubMed Web of Science ®Google Scholar
• Heene M, Kyngdon A, Sckopke P. Detecting violations of unidimensionality by order-restricted inference methods. Front Appl Math Stat. 2016;2:3.
   Google Scholar
• Ley P. Quantitative aspects of psychological assessment: an introduction. Oxford (UK): Duckworth & Co; 1972.
   Google Scholar
• Kersten P, Vandal AC, Elder H, et al. Strengths and Difficulties Questionnaire: internal validity and reliability for New Zealand preschoolers. BMJ Open. 2018;8(4):e021551.
   PubMed Web of Science ®Google Scholar
• Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value Health. 2004;7:S22–S26.
   PubMed Web of Science ®Google Scholar
• Planinic M, Boone WJ, Susac A, et al. Rasch analysis in physics education research: Why measurement matters. Phys Rev Phys Edu Res. 2019;15(2):020111.
   Web of Science ®Google Scholar
• Hocaoglu MB, Gaffan EA, Ho AK. The Huntington's Disease health-related quality of life questionnaire (HDQoL): a disease-specific measure of health-related quality of life. Clin Genet. 2012;81(2):117–122.
   PubMed Web of Science ®Google Scholar
• Yorke J, Corris P, Gaine S, et al. emPHasis-10: development of a health-related quality of life measure in pulmonary hypertension. Eur Respir J. 2014;43(4):1106–1113.
   PubMed Web of Science ®Google Scholar
• Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Rheum. 2007;57(8):1358–1362.
   PubMed Web of Science ®Google Scholar
• Siemons L, ten Klooster PM, Taal E, et al. Modern psychometrics applied in rheumatology-a systematic review. BMC Musculoskelet Disord. 2012;13:216.
   PubMed Web of Science ®Google Scholar
• Rusch T, Lowry PB, Mair P, et al. Breaking free from the limitations of classical test theory: Developing and measuring information systems scales using item response theory. Inf Manag. 2017;54(2):189–203.
   Web of Science ®Google Scholar
• Christensen KB, Engelhard G, Salzberger JT. Ask the experts: Rasch vs. factor analysis. Rasch Measurement Transactions. 2012;26(3):1373–1378.
   Google Scholar
• McKenna SP, Wilburn J. Patient value: its nature, measurement, and role in real world evidence studies and outcomes-based reimbursement. J Med Econ. 2018;21(5):474–480.
   PubMed Web of Science ®Google Scholar
• Szekeres M. Clinical relevance commentary in response to: The validity and clinical utility of the Disabilities of the Arm Shoulder and Hand questionnaire for hand injuries in developing country contexts: A systematic review. J Hand Ther. 2018;31(1):91–92.
   PubMed Web of Science ®Google Scholar
• Mokkink LB, Terwee CB, Gibbons E, et al. Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) checklist. BMC Med Res Methodol. 2010;10:82.
   PubMed Web of Science ®Google Scholar
• Woodcock AJ, Julious SA, Kinmonth AL, Diabetes Care From Diagnosis Group, et al. Problems with the performance of the SF-36 among people with type 2 diabetes in general practice. Qual Life Res. 2001;10(8):661–670.
   PubMed Web of Science ®Google Scholar
• Mallinson S. The Short-Form 36 and older people: some problems encountered when using postal administration. J Epidemiol Community Health. 1998;52(5):324–328.
   PubMed Web of Science ®Google Scholar
• Velanovich V. Behavior and analysis of 36-item Short-Form Health Survey data for surgical quality-of-life research. Arch Surg. 2007;142(5):473–478.
   PubMedGoogle Scholar
• McKenna SP, Heaney A, Wilburn J. Measurement of patient-reported outcomes. 2: Are current measures failing us? J Med Econ. 2019;22(6):523–530.
   PubMed Web of Science ®Google Scholar
• Treanor C, Donnelly M. A methodological review of the Short Form Health Survey 36 (SF-36) and its derivatives among breast cancer survivors. Qual Life Res. 2015;24(2):339–362.
   PubMed Web of Science ®Google Scholar
• Ertzgaard P, Nene A, Kiekens C, et al. A review and evaluation of patient-reported outcome measures for spasticity in persons with spinal cord damage: Recommendations from the Ability Network–an international initiative. J Spinal Cord Med. 2020;43:813–823.
   PubMed Web of Science ®Google Scholar
• Eyles JP, Hunter DJ, Meneses SR, et al. Instruments assessing attitudes toward or capability regarding self-management of osteoarthritis: a systematic review of measurement properties. Osteoarthritis Cartilage. 2017;25(8):1210–1222.
   PubMed Web of Science ®Google Scholar
• Janssen CA, Oude Voshaar MAH, Ten Klooster PM, et al. A systematic literature review of patient-reported outcome measures used in gout: an evaluation of their content and measurement properties. Health Qual Life Outcomes. 2019;17(1):63.
   PubMed Web of Science ®Google Scholar
• Marti C, Hensler S, Herren DB, et al. Measurement properties of the EuroQoL EQ-5D-5L to assess quality of life in patients undergoing carpal tunnel release. J Hand Surg Eur Vol. 2016;41(9):957–962.
   PubMed Web of Science ®Google Scholar
• Qian X, Tan RL, Chuang LH, et al. Measurement properties of commonly used generic preference-based measures in east and south-east Asia: A systematic review. Pharmacoeconomics. 2020;38(2):159–170.
   PubMed Web of Science ®Google Scholar
• Whynes DK, McCahon RA, Ravenscroft A, et al. Responsiveness of the EQ-5D health-related quality-of-life instrument in assessing low back pain. Value Health. 2013;16(1):124–132.
   PubMed Web of Science ®Google Scholar
• Mason SJ, Catto JW, Downing A, et al. Evaluating patient-reported outcome measures (PROMs) for bladder cancer: a systematic review using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. BJU Int. 2018;122(5):760–773.
   PubMed Web of Science ®Google Scholar
• Craxford S, Deacon C, Myint Y, et al. Assessing outcome measures used after rib fracture: A COSMIN systematic review. Injury. 2019;50(11):1816–1825.
   PubMed Web of Science ®Google Scholar
• Poku E, Aber A, Phillips P, et al. Systematic review assessing the measurement properties of patient-reported outcomes for venous leg ulcers. BJS Open. 2017;1(5):138–147.
   PubMed Web of Science ®Google Scholar
• Angst F. The new COSMIN guidelines confront traditional concepts of responsiveness. BMC Medical Res Methodol. 2011;11:152.
   PubMed Web of Science ®Google Scholar
• Chen XL, Zhong LH, Wen Y, et al. Inflammatory bowel disease-specific health-related quality of life instruments: a systematic review of measurement properties. Health Qual Life Outcomes. 2017;15(1):177.
   PubMed Web of Science ®Google Scholar
• Guyatt G, Mitchell A, Irvine EJ, et al. A new measure of health status for clinical trials in inflammatory bowel disease. Gastroenterology. 1989;96(3):804–810.
   PubMed Web of Science ®Google Scholar
• Wilburn J, McKenna SP, Twiss J, et al. Assessing quality of life in Crohn’s disease: development and validation of the Crohn’s Life Impact Questionnaire (CLIQ). Qual Life Res. 2015;24(9):2279–2288.
   PubMed Web of Science ®Google Scholar
• Irvine EJ. Development and subsequent refinement of the inflammatory bowel disease questionnaire: a quality-of-life instrument for adult patients with inflammatory bowel disease. J Pediatr Gastroenterol Nutr. 1999;28(4):S23–S27.
   PubMed Web of Science ®Google Scholar
• Boye B, Lundin KE, Jantschek G, et al. INSPIRE study: does stress management improve the course of inflammatory bowel disease and disease-specific quality of life in distressed patients with ulcerative colitis or Crohn's disease? A randomized controlled trial. Inflamm Bowel Dis. 2011;17(9):1863–1873.
   PubMed Web of Science ®Google Scholar
• Cross RK, Cheevers N, Rustgi A, et al. Randomized, controlled trial of home telemanagement in patients with ulcerative colitis (UC HAT). Inflamm Bowel Dis. 2012;18(6):1018–1025.
   PubMed Web of Science ®Google Scholar
• Panés J, Su C, Bushmakin AG, et al. Randomized trial of tofacitinib in active ulcerative colitis: analysis of efficacy based on patient-reported outcomes. BMC Gastroenterol. 2015;15:14
   PubMed Web of Science ®Google Scholar
• van Andel EM, Koopmann BD, Crouwel F, et al. Systematic review of development and content validity of patient-reported outcome measures in Inflammatory Bowel Disease: do we measure what we measure? J Crohns Colitis. 2020;14(9):1299–1315.
   PubMed Web of Science ®Google Scholar
• Sierevelt IN, Zwiers R, Schats W, et al. Measurement properties of the most commonly used Foot- and Ankle-Specific Questionnaires: the FFI, FAOS and FAAM. A systematic review. Knee Surg Sports Traumatol Arthrosc. 2018;26(7):2059–2073.
   PubMed Web of Science ®Google Scholar
• Jia Y, Huang H, Gagnier JJ. A systematic review of measurement properties of patient-reported outcome measures for use in patients with foot or ankle diseases. Qual Life Res. 2017;26(8):1969–2010.
   PubMed Web of Science ®Google Scholar
• Morley D, Jenkinson C, Doll H, et al. The Manchester–Oxford Foot Questionnaire (MOXFQ) development and validation of a summary index score. Bone Jt Res. 2013;2(4):66–69.
   PubMed Web of Science ®Google Scholar
• Eechaute C, Vaes P, Van Aerschot L, et al. The clinimetric qualities of patient-assessed instruments for measuring chronic ankle instability: a systematic review. BMC Musculoskelet Disord. 2007;8:6.
   PubMed Web of Science ®Google Scholar