Bias caused by reliance on patient-reported outcome measures in non-blinded randomized trials: an in-depth look at exercise therapy for chronic fatigue syndrome

References

• Nacul LC, Lacerda EM, Pheby D, et al. Prevalence of myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS) in three regions of England: a repeated cross-sectional study in primary care. BMC Med. 2011;9:91.
   PubMed Web of Science ®Google Scholar
• Jason LA, Richman JA, Rademaker AW, et al. A community-based study of chronic fatigue syndrome. Arch Intern Med. 1999;159:2129–2137.
   PubMed Web of Science ®Google Scholar
• Fukuda K, Straus SE, Hickie I, et al. The chronic fatigue syndrome: a comprehensive approach to its definition and study. International chronic fatigue syndrome study group. Ann Intern Med. 1994;121:953–959.
   PubMed Web of Science ®Google Scholar
• Institute of Medicine. Beyond myalgic encephalomyelitis/chronic fatigue syndrome: redefining an illness [Internet]. Washington (DC): National Academies Press (US); 2015. Available from: http://www.ncbi.nlm.nih.gov/books/NBK274235/
   Google Scholar
• Edwards JCW, McGrath S, Baldwin A, et al. The biological challenge of myalgic encephalomyelitis/chronic fatigue syndrome: a solvable problem. Fatigue Biomed Health Behav. 2016;4:63–69.
   PubMed Web of Science ®Google Scholar
• Smith MEB, Nelson HD, Haney E, et al. Diagnosis and treatment of myalgic encephalomyelitis/chronic fatigue syndrome. Evid ReportTechnology Assess. 2014 Dec;(219):1–433.
   Google Scholar
• Carruthers BM, Sande Mvd, Meirleir KLD, et al. Myalgic encephalomyelitis: international consensus criteria. J Intern Med. 2011;270:327–338.
   PubMed Web of Science ®Google Scholar
• White PD, Goldsmith KA, Johnson AL, et al. Comparison of adaptive pacing therapy, cognitive behaviour therapy, graded exercise therapy, and specialist medical care for chronic fatigue syndrome (PACE): a randomised trial. Lancet Lond Engl. 2011;377:823–836.
   PubMed Web of Science ®Google Scholar
• Powell P, Bentall RP, Nye FJ, et al. Randomised controlled trial of patient education to encourage graded exercise in chronic fatigue syndrome. Br Med J. 2001;322:387–390.
   PubMed Web of Science ®Google Scholar
• Clark LV, White PD. The role of deconditioning and therapeutic exercise in chronic fatigue syndrome (CFS). J Ment Health. 2005;14:237–252.
   Google Scholar
• ME Association. Petition: The NICE guideline for CFS/ME is unfit for purpose and needs a complete revision. [Internet]. Change.org. [cited 2019 Nov 26]. Available from: https://www.change.org/p/petition-the-nice-guideline-for-cfs-me-is-unfit-for-purpose-and-needs-a-complete-revision
   Google Scholar
• Kindlon T. Reporting of harms associated with graded exercise therapy and cognitive behavioural therapy in myalgic encephalomyelitis/chronic fatigue syndrome. Bull IACFSME. 2011;19:59–111.
   Google Scholar
• Geraghty K, Hann M, Kurtev S. Myalgic encephalomyelitis/chronic fatigue syndrome patients’ reports of symptom changes following cognitive behavioural therapy, graded exercise therapy and pacing treatments: analysis of a primary survey compared with secondary surveys. J Health Psychol. 2019;24:1318–1333.
   PubMed Web of Science ®Google Scholar
• Edwards J. PACE team response shows a disregard for the principles of science. J Health Psychol. 2017;22:1155–1158.
   PubMed Web of Science ®Google Scholar
• Wilshire CE, Kindlon T, Courtney R, et al. Rethinking the treatment of chronic fatigue syndrome-a reanalysis and evaluation of findings from a recent major trial of graded exercise and CBT. BMC Psychol. 2018;6:6.
   PubMedGoogle Scholar
• Hróbjartsson A, Boutron I. Blinding in randomized clinical trials: imposed impartiality. Clin Pharmacol Ther. 2011;90:732–736.
   PubMed Web of Science ®Google Scholar
• Kamper SJ. Blinding: linking evidence to practice. J Orthop Sports Phys Ther. 2018;48:825–826.
   PubMed Web of Science ®Google Scholar
• Larun L, Brurberg KG, Odgaard-Jensen J, et al. Exercise therapy for chronic fatigue syndrome. Cochrane common mental disorders group, editor. Cochrane Database Syst Rev [Internet]. 2019 [cited 2019 Nov 26]; Available from: http://doi.wiley.com/https://doi.org/10.1002/14651858.CD003200.pub8
   Google Scholar
• Smid DE, Franssen FME, Houben-Wilke S, et al. Responsiveness and MCID estimates for CAT, CCQ, and HADS in patients with COPD Undergoing pulmonary rehabilitation: a prospective analysis. J Am Med Dir Assoc. 2017;18:53–58.
   PubMed Web of Science ®Google Scholar
• Hróbjartsson A, Emanuelsson F, Skou Thomsen AS, et al. Bias due to lack of patient blinding in clinical trials. A systematic review of trials randomizing patients to blind and nonblind sub-studies. Int J Epidemiol. 2014;43:1272–1283.
   PubMed Web of Science ®Google Scholar
• Clark LV, Pesola F, Thomas JM, et al. Guided graded exercise self-help plus specialist medical care versus specialist medical care alone for chronic fatigue syndrome (GETSET): a pragmatic randomised controlled trial. The Lancet. 2017;390:363–373.
   PubMed Web of Science ®Google Scholar
• Ridsdale L, Godfrey E, Seed P. Chronic fatigue in general practice: authors reply. Br J Gen Pract. 2001;51:317–318.
   PubMed Web of Science ®Google Scholar
• Goligher EC, Pouchot J, Brant R, et al. Minimal clinically important difference for 7 measures of fatigue in patients with systemic lupus erythematosus. J Rheumatol. 2008;35:635–642.
   PubMed Web of Science ®Google Scholar
• Pouchot J, Kherani RB, Brant R, et al. Determination of the minimal clinically important difference for seven fatigue measures in rheumatoid arthritis. J Clin Epidemiol. 2008;61:705–713.
   PubMed Web of Science ®Google Scholar
• Pettersson S, Lundberg IE, Liang MH, et al. Determination of the minimal clinically important difference for seven measures of fatigue in Swedish patients with systemic lupus erythematosus. Scand J Rheumatol. 2015;44:206–210.
   PubMed Web of Science ®Google Scholar
• Nøstdahl T, Bernklev T, Fredheim OM, et al. Defining the cut-off point of clinically significant postoperative fatigue in three common fatigue scales. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 2019;28:991–1003.
   PubMed Web of Science ®Google Scholar
• Ware JE, Kosinski M, Dewey JE. How to score version 2 of the SF-36 health survey: standards & acute forms. Lincoln (R.I.): QualityMetric; 2001.
   Google Scholar
• Clark LV, McCrone P, Ridge D, et al. Graded exercise therapy guided self-help trial for patients with chronic fatigue syndrome (GETSET): protocol for a randomized controlled trial and interview study. JMIR Res Protoc. 2016;5:e70.
   PubMedGoogle Scholar
• Brigden A, Parslow RM, Gaunt D, et al. Defining the minimally clinically important difference of the SF-36 physical function subscale for paediatric CFS/ME: triangulation using three different methods. Health Qual Life Outcomes. 2018;16:202.
   PubMed Web of Science ®Google Scholar
• Kosinski M, Zhao SZ, Dedhiya S, et al. Determining minimally important changes in generic and disease-specific health-related quality of life questionnaires in clinical trials of rheumatoid arthritis. Arthritis Rheum. 2000;43:1478–1487.
   PubMed Web of Science ®Google Scholar
• Ward MM, Guthrie LC, Alba MI. Clinically important changes in short form 36 health survey scales for use in rheumatoid arthritis clinical trials: the impact of low responsiveness. Arthritis Care Res. 2014;66:1783–1789.
   PubMed Web of Science ®Google Scholar
• Hays RD, Spritzer KL, Fries JF, et al. Responsiveness and minimally important difference for the patient-reported outcomes measurement information system (PROMIS) 20-item physical functioning short form in a prospective observational study of rheumatoid arthritis. Ann Rheum Dis. 2015;74:104–107.
   PubMed Web of Science ®Google Scholar
• de Groot V, Beckerman H, Uitdehaag BMJ, et al. The usefulness of evaluative outcome measures in patients with multiple sclerosis. Brain J Neurol. 2006;129:2648–2659.
   Google Scholar
• Robinson D, Zhao N, Gathany T, et al. Health perceptions and clinical characteristics of relapsing-remitting multiple sclerosis patients: baseline data from an international clinical trial. Curr Med Res Opin. 2009;25:1121–1130.
   PubMed Web of Science ®Google Scholar
• Devilliers H, Amoura Z, Besancenot J-F, et al. Responsiveness of the 36-item Short Form Health Survey and the Lupus Quality of Life questionnaire in SLE. Rheumatol Oxf Engl. 2015;54:940–949.
   PubMed Web of Science ®Google Scholar
• McElhone K, Abbott J, Sutton C, et al. Sensitivity to change and minimal important differences of the LupusQoL in patients with systemic Lupus Erythematosus. Arthritis Care Res. 2016;68:1505–1513.
   Web of Science ®Google Scholar
• Coteur G, Feagan B, Keininger DL, et al. Evaluation of the meaningfulness of health-related quality of life improvements as assessed by the SF-36 and the EQ-5D VAS in patients with active Crohn’s disease. Aliment Pharmacol Ther. 2009;29:1032–1041.
   PubMed Web of Science ®Google Scholar
• Erez G, Selman L, Murtagh FEM. Measuring health-related quality of life in patients with conservatively managed stage 5 chronic kidney disease: limitations of the medical outcomes study Short Form 36: SF-36. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 2016;25:2799–2809.
   PubMed Web of Science ®Google Scholar
• Wyrwich KW, Metz SM, Kroenke K, et al. Measuring patient and clinician perspectives to evaluate change in health-related quality of life among patients with chronic obstructive pulmonary disease. J Gen Intern Med. 2007;22:161–170.
   PubMed Web of Science ®Google Scholar
• Wyrwich KW, Metz SM, Kroenke K, et al. Triangulating patient and clinician perspectives on clinically important differences in health-related quality of life among patients with heart disease. Health Serv Res. 2007;42:2257–2274. discussion 2294-2323.
   PubMed Web of Science ®Google Scholar
• Puhan MA, Frey M, Büchi S, et al. The minimal important difference of the Hospital Anxiety and Depression Scale in patients with chronic obstructive pulmonary disease. Health Qual Life Outcomes. 2008;6:46.
   PubMed Web of Science ®Google Scholar
• Lemay KR, Tulloch HE, Pipe AL, et al. Establishing the minimal clinically important difference for the hospital anxiety and depression scale in patients with cardiovascular disease. J Cardiopulm Rehabil Prev. 2019;39:E6–E11.
   PubMed Web of Science ®Google Scholar
• Dodd JW, Hogg L, Nolan J, et al. The COPD assessment test (CAT): response to pulmonary rehabilitation. A multicentre, prospective study. Thorax. 2011;66:425–429.
   PubMed Web of Science ®Google Scholar
• Chan KS, Aronson Friedman L, Bienvenu OJ, et al. Distribution-based estimates of minimal important difference for Hospital Anxiety and Depression Scale and impact of event scale-revised in survivors of acute respiratory failure. Gen Hosp Psychiatry. 2016;42:32–35.
   PubMed Web of Science ®Google Scholar
• CFS/ME Working Group. Report to the Chief Medical Officer of an independent Working Group. [Internet]. Department of Health; 2002 [cited 2019 Dec 13]. Available from: https://www.meassociation.org.uk/wp-content/uploads/CMO-Report-2002.pdf
   Google Scholar
• Working Group convened under the auspices of, the Royal Australasian College of Physicians. Chronic fatigue syndrome. Clinical practice guidelines. [Internet]. Health Policy Unit, Royal Australasian College of Physicians; 2002 [cited 2019 Nov 26]. Available from: https://www.mja.com.au/system/files/issues/cfs2_2.pdf
   Google Scholar
• Tuller D. Trial by error: the troubling case of the PACE Chronic Fatigue Syndrome study. (second installment). [Internet]. Virol. Blog. 2015 [cited 2019 Nov 26]. Available from: http://www.virology.ws/2015/10/22/trial-by-error-ii/
   Google Scholar
• Powell P. FINE trial patient booklet version 9. [Internet]. Royal Liverpool University Hospital; 2005 [cited 2019 Dec 28]. Available from: https://web.archive.org/web/20140811161130/http://www.fine-trial.net/downloads/Patient%20PR%20Manual%20ver9%20Apr05.pdf
   Google Scholar
• Bavinton J, Dyer N, White PD. PACE. Graded exercise therapy, information for participants. Final trial version: (MREC version 1). [Internet]. PACE Trial Management Group; 2004 [cited 2019 Dec 28]. Available from: https://me-pedia.org/images/d/d4/PACE-get-participant-manual.pdf
   Google Scholar
• Bavinton J, Darbishire L, White PD. PACE manual for therapists. Graded Exercise Therapy (GET) for CFS/ME. Final trial version: version 7 (MREC Version 2). [Internet]. PACE Trial Management Group; 2004 [cited 2019 Nov 26]. Available from: https://me-pedia.org/images/8/89/PACE-get-therapist-manual.pdf
   Google Scholar
• Wearden AJ, Dowrick C, Chew-Graham C, et al. Nurse led, home based self help treatment for patients in primary care with chronic fatigue syndrome: randomised controlled trial. Br Med J. 2010;340:c1777.
   PubMedGoogle Scholar
• Wearden AJ, Riste L, Dowrick C, et al. Fatigue intervention by nurses evaluation – the FINE trial. A randomised controlled trial of nurse led self-help treatment for patients in primary care with chronic fatigue syndrome: study protocol. [ISRCTN74156610]. BMC Med 2006;4:9.
   PubMed Web of Science ®Google Scholar
• Forbes D. Blinding: an essential component in decreasing risk of bias in experimental designs. Evid Based Nurs. 2013;16:70–71.
   PubMedGoogle Scholar
• Kahan BC, Cro S, Doré CJ, et al. Reducing bias in open-label trials where blinded outcome assessment is not feasible: strategies from two randomised trials. Trials. 2014;15:456.
   PubMed Web of Science ®Google Scholar
• Savović J, Jones H, Altman D, et al. Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies. Health Technol Assess Winch Engl. 2012;16:1–82.
   PubMed Web of Science ®Google Scholar
• Jason LA, Torres-Harding S, Friedberg F, et al. Non-pharmacologic interventions for CFS: a randomized trial. J Clin Psychol Med Settings. 2007;14:275–296.
   Web of Science ®Google Scholar
• McCrone P, Sharpe M, Chalder T, et al. Adaptive pacing, cognitive behaviour therapy, graded exercise, and specialist medical care for chronic fatigue syndrome: a cost-effectiveness analysis. PLOS ONE. 2012;7:e40808.
   PubMed Web of Science ®Google Scholar
• Wallman KE, Morton AR, Goodman C, et al. Randomised controlled trial of graded exercise in chronic fatigue syndrome. Med J Aust. 2004;180:444–448.
   PubMed Web of Science ®Google Scholar
• Wearden AJ, Emsley R. Mediators of the effects on fatigue of pragmatic rehabilitation for chronic fatigue syndrome. J Consult Clin Psychol. 2013;81:831–838.
   PubMed Web of Science ®Google Scholar
• Chalder T, Goldsmith KA, White PD, et al. Rehabilitative therapies for chronic fatigue syndrome: a secondary mediation analysis of the PACE trial. Lancet Psychiatry. 2015;2:141–152.
   PubMed Web of Science ®Google Scholar
• Vink M, Vink-Niese A. Graded exercise therapy for myalgic encephalomyelitis/chronic fatigue syndrome is not effective and unsafe. Re-analysis of a Cochrane review. Health Psychol Open. 2018;5; 2055102918805187.
   Web of Science ®Google Scholar
• Fulcher KY, White PD. Randomised controlled trial of graded exercise in patients with the chronic fatigue syndrome. Br Med J. 1997;314:1647–1652.
   PubMed Web of Science ®Google Scholar
• Wearden AJ, Morriss RK, Mullis R, et al. Randomised, double-blind, placebo-controlled treatment trial of fluoxetine and graded exercise for chronic fatigue syndrome. Br J Psychiatry J Ment Sci. 1998;172:485–490.
   PubMed Web of Science ®Google Scholar
• Moss-Morris R, Sharon C, Tobin R, et al. A randomized controlled graded exercise trial for chronic fatigue syndrome: outcomes and mechanisms of change. J Health Psychol. 2005;10:245–259.
   PubMed Web of Science ®Google Scholar
• Cheshire A, Ridge D, Clark L, et al. Guided graded exercise self-help for chronic fatigue syndrome: patient experiences and perceptions. Disabil Rehabil. 2020 Feb;42(3):368–377.
   PubMed Web of Science ®Google Scholar
• Moustgaard H, Clayton GL, Jones HE, et al. Impact of blinding on estimated treatment effects in randomised clinical trials: meta-epidemiological study. Br Med J. 2020;368:l6802.
   PubMedGoogle Scholar
• Cho HJ, Hotopf M, Wessely S. The placebo response in the treatment of chronic fatigue syndrome: a systematic review and meta-analysis. Psychosom Med. 2005;67:301–313.
   PubMed Web of Science ®Google Scholar
• Sharpe M, Hawton K, Simkin S, et al. Cognitive behaviour therapy for the chronic fatigue syndrome: a randomized controlled trial. Br Med J. 1996;312:22–26.
   PubMed Web of Science ®Google Scholar
• Fluge Ø, Rekeland IG, Lien K, et al. B-Lymphocyte depletion in patients with myalgic encephalomyelitis/chronic fatigue syndrome: A randomized, double-blind, placebo-controlled trial. Ann Intern Med. 2019;170:585–593.
   PubMed Web of Science ®Google Scholar