Should low-quality evidence dominate high-level evidence? A systematic review and meta-analysis of systematic reviews of musculoskeletal physical therapy interventions

References

• Burns PB, Rohrich RJ, Chung KC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg. 2011 Jul;128(1):305–310. . PubMed PMID: 21701348; PubMed Central PMCID: PMCPMC3124652.
   PubMed Web of Science ®Google Scholar
• Zadro J, O’Keeffe M, Maher C. Do physical therapists follow evidence-based guidelines when managing musculoskeletal conditions? Systematic review. BMJ Open. 2019 Oct 7;9(10):e032329. PubMed PMID: 31591090; PubMed Central PMCID: PMCPMC6797428.
   PubMed Web of Science ®Google Scholar
• Mandel D, Littner Y, Mimouni FB, et al. Conclusiveness of the Cochrane neonatal reviews: a systematic analysis. Acta Paediatr. 2006 Oct;95(10):1209–1212. PubMed PMID: 16982491.
   PubMed Web of Science ®Google Scholar
• Cohen S, Lubetzky R, Mimouni FB, et al. Conclusiveness of the Cochrane reviews in pediatric-gastroenterology: a systematic analysis. Eur J Gastroenterol Hepatol. 2013 Feb;25(2):252–254. PubMed PMID: 23044810.
   PubMed Web of Science ®Google Scholar
• Cohen S, Mandel D, Mimouni FB, et al. Conclusiveness of the Cochrane reviews in nutrition: a systematic analysis. Eur J Clin Nutr. 2014 Feb;68(2):143–145. PubMed PMID: 24327125.
   PubMed Web of Science ®Google Scholar
• Mimouni M, Mimouni F, Segev F. Conclusiveness of the Cochrane eye and vision group reviews. BMC Res Notes. 2015 June 16;8:242. PubMed PMID: 26076817; PubMed Central PMCID: PMCPMC4468979.
   PubMedGoogle Scholar
• Yin S, Chuai Y, Wang A, et al. Conclusiveness of the Cochrane reviews in gynaecological cancer: A systematic analysis. J Int Med Res. 2015 Jun;43(3):311–315. PubMed PMID: 25870179.
   PubMed Web of Science ®Google Scholar
• Zhang X, Wu Z, Zhao H, et al. Conclusiveness of the Cochrane reviews in palliative and supportive care for cancer. Am J Hosp Palliat Care. 2017 Feb;34(1):53–56. PubMed PMID: 26353985.
   PubMed Web of Science ®Google Scholar
• Momosaki R, Tsuboi M, Yasufuku Y, et al. Conclusiveness of Cochrane Reviews in physiotherapy: a systematic search and analytical review. Int J Rehabil Res. 2019 Jan 16. DOI:10.1097/MRR.0000000000000338. PubMed PMID: 30664013.
   Web of Science ®Google Scholar
• Uttley L, Montgomery P. The influence of the team in conducting a systematic review. Syst Rev. 2017 Aug 1;6(1):149. PubMed PMID: 28764779; PubMed Central PMCID: PMCPMC5540536.
   PubMedGoogle Scholar
• Oliveira CB, Elkins MR, Lemes IR, et al. A low proportion of systematic reviews in physical therapy are registered: a survey of 150 published systematic reviews. Braz J Phys Ther. 2018 May - Jun;22(3):177–183. PubMed PMID: 29128407; PubMed Central PMCID: PMCPMC5993937.
   PubMed Web of Science ®Google Scholar
• Riley SP, Swanson B, Brismee JM, et al. A systematic review of orthopaedic manual therapy randomized clinical trials quality. J Man Manip Ther. 2016 Dec;24(5):241–252. PubMed PMID: 27956817; PubMed Central PMCID: PMCPMC5125432.
   PubMed Web of Science ®Google Scholar
• Gentles SJ, Charles C, Nicholas DB, et al. Reviewing the research methods literature: principles and strategies illustrated by a systematic overview of sampling in qualitative research. Syst Rev. 2016 Oct 11;5(1):172. PubMed PMID: 27729071; PubMed Central PMCID: PMCPMC5059917.
   PubMedGoogle Scholar
• Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009 Jul;21(339):b2700. PubMed PMID: 19622552; PubMed Central PMCID: PMCPMC2714672.
   PubMed Web of Science ®Google Scholar
• Green S, Higgins JPT, Alderson P, et al. Cochrane handbook for systematic reviews of interventions version 5.1.0 (updated March 2011). The Cochrane Collaboration; 2011 [Cited 2019 Oct 2]. Available from: https://training.cochrane.org/handbook
   Google Scholar
• Shamseer L, Hopewell S, Altman DG, et al. Update on the endorsement of CONSORT by high impact factor journals: a survey of journal “Instructions to Authors” in 2014. Trials. 2016 June 24;17(1):301. PubMed PMID: 27343072; PubMed Central PMCID: PMCPMC4921029.
   PubMed Web of Science ®Google Scholar
• Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017 Sep 21;358:j4008. PubMed PMID: 28935701; PubMed Central PMCID: PMCPMC5833365 at http://www.icmje.org/coi_disclosure.pdf and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years, no other relationships or activities that could appear to have influenced the submitted work.
   PubMed Web of Science ®Google Scholar
• Nascimento DP, Gonzalez GZ, Araujo AC, et al. Eight out of every ten abstracts of low back pain systematic reviews presented spin and inconsistencies with the full text: an analysis of 66 systematic reviews. J Orthop Sports Phys Ther. 2019 August;23(1):34. PubMed PMID: 31443622.
   Google Scholar
• Furland AD, Malmivaara A, Chou R, et al. Updated method guideline for systematic reviews in the Cochrane back and neck group. Spine (Phila Pa 1976). 2015;40(21):1660–1673.
   PubMed Web of Science ®Google Scholar
• Lefebvre C, Manheimer E, Glanville J. Searching for studies. Cochrane handbook for systematic reviews of interventions. Chichester (UK): John Wiley & Sons, Ltd; 2008. p. 95–150.
   Google Scholar
• McGowan J, Sampson M, Salzwedel DM, et al. Press peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016;75(Supplement C):40–46.
   PubMedGoogle Scholar
• Rethlefsen ML, Farrell AM, Osterhaus Trzasko LC, et al. Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews. J Clin Epidemiol. 2015 Jun;68(6):617–626. PubMed PMID: 25766056.
   PubMed Web of Science ®Google Scholar
• Meert D, Torabi N, Costella J. Impact of librarians on reporting of the literature searching component of pediatric systematic reviews. J Med Libr Assoc. 2016 Oct;104(4):267–277. . PubMed PMID: 27822147; PubMed Central PMCID: PMCPMC5079487.
   PubMed Web of Science ®Google Scholar
• Koffel JB. Use of recommended search strategies in systematic reviews and the impact of librarian involvement: a cross-sectional survey of recent authors. PLoS One. 2015;10(5):e0125931. PubMed PMID: 25938454; PubMed Central PMCID: PMCPMC4418838.
   PubMed Web of Science ®Google Scholar
• Li L, Tian J, Tian H, et al. Network meta-analyses could be improved by searching more sources and by involving a librarian. J Clin Epidemiol. 2014 Sep;67(9):1001–1007. PubMed PMID: 24841794.
   PubMed Web of Science ®Google Scholar
• Maher CG, Sherrington C, Herbert RD, et al. Reliability of the PEDro scale for rating quality of randomized controlled trials. Phys Ther. 2003 Aug;83(8):713–721. PubMed PMID: 12882612.
   PubMed Web of Science ®Google Scholar
• Foley NC, Bhogal SK, Teasell RW, et al. Estimates of quality and reliability with the physiotherapy evidence-based database scale to assess the methodology of randomized controlled trials of pharmacological and nonpharmacological interventions. Phys Ther. 2006 Jun;86(6):817–824. PubMed PMID: 16737407.
   PubMed Web of Science ®Google Scholar
• Macedo LG, Elkins MR, Maher CG, et al. There was evidence of convergent and construct validity of Physiotherapy Evidence Database quality scale for physiotherapy trials. J Clin Epidemiol. 2010 Aug;63(8):920–925. PubMed PMID: 20171839.
   PubMed Web of Science ®Google Scholar
• Sherrington C, Herbert RD, Maher CG, et al. PEDro. A database of randomized trials and systematic reviews in physiotherapy. Man Ther. 2000 Nov 5;(4):223–226. DOI:10.1054/math.2000.0372. PubMed PMID: 11052901.
   PubMedGoogle Scholar
• Yamato TP, Maher C, Koes B, et al. The PEDro scale had acceptably high convergent validity, construct validity, and interrater reliability in evaluating methodological quality of pharmaceutical trials. J Clin Epidemiol. 2017 Jun;86:176–181. PubMed PMID: 28288916.
   PubMed Web of Science ®Google Scholar
• de Almeida MO, Saragiotto BT, Maher C, et al. Allocation concealment and intention-to-treat analysis do not influence the treatment effects of physical therapy interventions in low back pain trials: a meta-epidemiologic study. Arch Phys Med Rehabil. 2019 Jul;100(7):1359–1366. PubMed PMID: 30710510.
   PubMed Web of Science ®Google Scholar
• Riley SP, Swanson BT, Brismee JM, et al. Low reproducibility of randomized clinical trials methodology related to sampling: a systematic methodological review. J Man Manip Ther. 2019 Dec;27(5):258–266. PubMed PMID: 30935323; PubMed Central PMCID: PMCPMC6830291.
   PubMed Web of Science ®Google Scholar
• Almeida MO, Yamato TP, Parreira P, et al. Overall confidence in the results of systematic reviews on exercise therapy for chronic low back pain: a cross-sectional analysis using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) 2 tool. Braz J Phys Ther. 2020 Mar - Apr;24(2):103–117. PubMed PMID: 31113734; PubMed Central PMCID: PMCPMC7082685.
   PubMed Web of Science ®Google Scholar
• Think Check Submit. 2020 [Cited 2020 Jan 22]. Available from: https://thinkchecksubmit.org/check/
   Google Scholar
• Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika. 1988;7:800–802.
   Google Scholar
• Salvador-Olivan JA, Marco-Cuenca G, Arquero-Aviles R. Errors in search strategies used in systematic reviews and their effects on information retrieval. J Med Libr Assoc. 2019 Apr;107(2):210–221. . PubMed PMID: 31019390; PubMed Central PMCID: PMCPMC6466507.
   PubMed Web of Science ®Google Scholar
• Opheim E, Andersen PN, Jakobsen M, et al. Poor quality in systematic reviews on PTSD and EMDR - An examination of search methodology and reporting. Front Psychol. 2019;10:1558. PubMed PMID: 31354575; PubMed Central PMCID: PMCPMC6630178.
   PubMed Web of Science ®Google Scholar
• Moseley AM, Rahman P, Wells GA, et al. Agreement between the Cochrane risk of bias tool and Physiotherapy Evidence Database (PEDro) scale: A meta-epidemiological study of randomized controlled trials of physical therapy interventions. PLoS One. 2019;14(9):e0222770. PubMed PMID: 31536575; PubMed Central PMCID: PMCPMC6752782 Six authors (AMM, PR, GAW, CS, LB, KT-A) have contributed to nearly 50 Cochrane reviews. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
   PubMed Web of Science ®Google Scholar
• Nascimento DP, Gonzalez GZ, Araujo AC, et al. Eight out of every ten abstracts of low back pain systematic reviews presented spin and inconsistencies with the full text: an analysis of 66 systematic reviews. J Orthop Sports Phys Ther. 2020 Jan;50(1):17–23. PubMed PMID: 31443622.
   PubMed Web of Science ®Google Scholar
• Saginur M, Fergusson D, Zhang T, et al. Journal impact factor, trial effect size, and methodological quality appear scantly related: a systematic review and meta-analysis. Syst Rev. 2020 March 9;9(1):53. PubMed PMID: 32164791; PubMed Central PMCID: PMCPMC7069162.
   PubMedGoogle Scholar
• Nascimento DP, Gonzalez GZ, Araujo AC, et al. Journal impact factor is associated with PRISMA endorsement, but not with the methodological quality of low back pain systematic reviews: a methodological review. Eur Spine J. 2020 Mar;29(3):462–479. PubMed PMID: 31707453.
   PubMed Web of Science ®Google Scholar
• Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences. JAMA. 2005 May 18;293(19):2362–2366. PubMed PMID: 15900006.
   PubMed Web of Science ®Google Scholar
• Increasing citations and improving your impact factor. Sage Publishing; 2020 [Cited 2020 May 26]. Available from: https://us.sagepub.com/en-us/nam/increasing-citations-and-improving-your-impact-factor
   Google Scholar