‘Trustworthy’ systematic reviews can only result in meaningful conclusions if the quality of randomized clinical trials and the certainty of evidence improves: an update on the ‘trustworthy’ living systematic review project

References

• Yao L, Guyatt GH, Djulbegovic B. Can we trust strong recommendations based on low quality evidence? BMJ. 2021 Nov 25; 375(2833). doi: 10.1136/bmj.n2833
   Google Scholar
• Gaylor JM. An overused phrase: interpreted with caution. J Clin Epidemiol. 2013 Feb;66(2):238–239. doi: 10.1016/j.jclinepi.2012.01.007
   Web of Science ®Google Scholar
• Riley SP, Swanson BT, Shaffer SM, et al. Protocol for the development of a ‘trustworthy’ living systematic review and meta analyses of manual therapy interventions to treat neuromusculoskeletal impairments. J Man Manip Ther. 2022 Sep;9:1–11.
   Google Scholar
• Cook C, Garcia AN. Post-randomization bias. J Man Manip Ther. 2020 May;28(2):69–71. doi: 10.1080/10669817.2020.1739153
   PubMed Web of Science ®Google Scholar
• Riley SP, Swanson BT, Cook CE. “Trustworthiness,” confidence in estimated effects, and confidently translating research into clinical practice. Arch Physiother. 2023 Apr 6;13(1):8. doi: 10.1186/s40945-023-00162-9
   Google Scholar
• Riley SP, Swanson BT, Shaffer SM, et al. Why do ‘Trustworthy’ living systematic reviews matter? J Man Manip Ther. 2023 Aug;31(4):215–219. doi: 10.1080/10669817.2023.2229610
   PubMed Web of Science ®Google Scholar
• Riley SP, Swanson BT, Shaffer SM, et al. Protocol for the development of a ‘trustworthy’ living systematic review and meta analyses of manual therapy interventions to treat neuromusculoskeletal impairments. J Man Manip Ther. 2022:1–11. doi: 10.1080/10669817.2022.2119528
   Web of Science ®Google Scholar
• Riley SP, Shaffer SM, Flowers DW, et al. Manual therapy for non-radicular cervical spine related impairments: establishing a ‘Trustworthy’ living systematic review and meta-analysis. J Man Manip Ther. 2023:1–15. doi: 10.1080/10669817.2023.2201917
   Web of Science ®Google Scholar
• Valera-Calero A, Gallego-Izquierdo T, Malfliet A, et al. Endocrine response after cervical manipulation and mobilization in people with chronic mechanical neck pain: a randomized controlled trial. Eur J Phys Rehabil Med. 2019;55(6):792–805. doi: 10.23736/S1973-9087.19.05475-3
   PubMed Web of Science ®Google Scholar
• Carrasco-Martínez F, Ibáñez-Vera AJ, Martínez-Amat A, et al. Short-term effectiveness of the flexion-distraction technique in comparison with high-velocity vertebral manipulation in patients suffering from low-back pain. Complement Ther Med. 2019;44:61–67. doi: 10.1016/j.ctim.2019.02.012
   PubMed Web of Science ®Google Scholar
• de Oliveira, RF, Costa LOP, Nascimento LP, et al. Directed vertebral manipulation is not better than generic vertebral manipulation in patients with chronic low back pain: a randomised trial. J Physiother. 2020;66(3):174–179. doi: 10.1016/j.jphys.2020.06.007
   PubMed Web of Science ®Google Scholar
• Riley SP, Swanson BT, Shaffer SM, et al. Does manual therapy meaningfully change quantitative sensory testing and patient reported outcome measures in patients with musculoskeletal impairments related to the spine?: a ‘trustworthy’systematic review and meta-analysis. J Man & Manipulative Ther. 2023:1–16. doi: 10.1080/10669817.2023.2247235
   Web of Science ®Google Scholar
• Flowers DW, Swanson BT, Shaffer SM, et al. Is there ‘trustworthy’ evidence for using manual therapy to treat patients with shoulder dysfunction?: a systematic review. PLOS ONE. 2024;19(1):e0297234. doi: 10.1371/journal.pone.0297234
   Web of Science ®Google Scholar
• Practice BB. What is GRADE? BMJ Publishing Group Limited; 2024 [cited 2024 Feb 1]. Available from: https://bestpractice.bmj.com/info/us/toolkit/learn-ebm/what-is-grade/
   Google Scholar
• Andrews JC, Schunemann HJ, Oxman AD, et al. GRADE guidelines: 15. Going from evidence to recommendation-determinants of a recommendation’s direction and strength. J Clin Epidemiol. 2013 Jul;66(7):726–735. doi: 10.1016/j.jclinepi.2013.02.003
   PubMed Web of Science ®Google Scholar
• Feres M, Feres MFN. Absence of evidence is not evidence of absence. J Appl Oral Sci. 2023 Mar 27; 31:ed001. doi: 10.1590/1678-7757-2023-ed001
   Web of Science ®Google Scholar
• Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017 Sep 21;358:j4008. doi: 10.1136/bmj.j4008
   PubMed Web of Science ®Google Scholar
• Karpen SC. P value problems. Am J Pharm Educ. 2017 Nov;81(9):6570. doi: 10.5688/ajpe6570
   Web of Science ®Google Scholar
• Deeks JJ HJ, Altman DG. Chapter 10: analysing data and undertaking meta-analyses. In: Higgins JT, Chandler J, Cumpston M. , editors. Cochrane handbook for systematic reviews of interventions version 6.3 (updated February 2022). Cochrane: Cochrane; 2022.
   Google Scholar
• Borenstein M. Research note: In a meta-analysis, the I2 index does not tell us how much the effect size varies across studies. J Physiother. 2020;66(2):135–139. doi: 10.1016/j.jphys.2020.02.011
   PubMed Web of Science ®Google Scholar
• Higgins JP, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–560. doi: 10.1136/bmj.327.7414.557
   PubMed Web of Science ®Google Scholar
• Israel H, Richter RR. A guide to understanding meta-analysis. J Orthop Sports Phys Ther. 2011;41(7):496–504. doi: 10.2519/jospt.2011.3333
   PubMed Web of Science ®Google Scholar
• Teichert F, Karner V, Doding R, et al. Effectiveness of exercise interventions for preventing neck pain: a systematic review with meta-analysis of randomized controlled trials. J Orthop Sports Phys Ther. 2023 Oct;53(10):594–609. doi: 10.2519/jospt.2023.12063
   Web of Science ®Google Scholar
• von Hippel PT. The heterogeneity statistic I2 can be biased in small meta-analyses. BMC Med Res Methodol. 2015;15(1):1–8. doi: 10.1186/s12874-015-0024-z
   PubMedGoogle Scholar
• IntHout J, Ioannidis JP, Rovers MM, et al. Plea for routinely presenting prediction intervals in meta-analysis. BMJ Open. 2016;6(7):e010247. doi: 10.1136/bmjopen-2015-010247
   PubMed Web of Science ®Google Scholar
• Kovanur Sampath K, Treffel L, Pt O, et al. Changes in biochemical markers following a spinal manipulation - a systematic review update. J Man Manip Ther. 2024 Feb;32(1):28–50. doi: 10.1080/10669817.2023.2252187
   PubMed Web of Science ®Google Scholar
• Riley SP, Swanson BT, Shaffer SM, et al. Is the quality of systematic reviews influenced by prospective registration: a methods review of systematic musculoskeletal physical therapy reviews. J Man Manip Ther. 2022 Aug;8:1–14.
   Google Scholar
• Jette AM. Without scientific integrity, there can be no evidence base. Phys Ther. 2005 Nov;85(11):1122–1123. doi: 10.1093/ptj/85.11.1122
   PubMed Web of Science ®Google Scholar
• Miller BC, Tirko AW, Shipe JM, et al. The systemic effects of blood flow restriction training: a systematic review. Int J Sports Phys Ther. 2021;16(4):978–990. doi: 10.26603/001c.25791
   PubMed Web of Science ®Google Scholar
• Fordham B, Sugavanam T, Edwards K, et al. Cognitive-behavioural therapy for a variety of conditions: an overview of systematic reviews and panoramic meta-analysis. Health Technol Assess. 2021 Feb;25(9):1–378. doi: 10.3310/hta25090
   PubMed Web of Science ®Google Scholar
• Konrad A, Tilp M, Nakamura M. A comparison of the effects of foam rolling and stretching on physical performance. A systematic review and meta-analysis. Front Physiol. 2021;12:720531. doi: 10.3389/fphys.2021.720531
   Web of Science ®Google Scholar
• Seffrin CB, Cattano NM, Reed MA, et al. Instrument-assisted soft tissue mobilization: a systematic review and effect-size analysis. J Athl Train. 2019 Jul;54(7):808–821. doi: 10.4085/1062-6050-481-17
   PubMed Web of Science ®Google Scholar
• Ramirez-Velez R, Hormazabal-Aguayo I, Izquierdo M, et al. Effects of kinesio taping alone versus sham taping in individuals with musculoskeletal conditions after intervention for at least one week: a systematic review and meta-analysis. Physiotherapy. 2019 Dec;105(4):412–420. doi: 10.1016/j.physio.2019.04.001
   PubMed Web of Science ®Google Scholar
• Azevedo DC, Ferreira PH, Santos HO, et al. Movement system impairment-based classification treatment versus general exercises for chronic low back pain: randomized controlled trial. Phys Ther. 2018 Jan 1;98(1):28–39. doi: 10.1093/ptj/pzx094
   Web of Science ®Google Scholar
• Salamh PA, Hanney WJ, Boles T, et al. Is it time to normalize scapular dyskinesis? The incidence of scapular dyskinesis in those with and without symptoms: a systematic review of the literature. Int J Sports Phys Ther. 2023;V18(3):558–576. doi: 10.26603/001c.74388
   Google Scholar
• Wood L, Hendrick PA. A systematic review and meta-analysis of pain neuroscience education for chronic low back pain: short-and long-term outcomes of pain and disability. Eur J Pain. 2019 Feb;23(2):234–249. doi: 10.1002/ejp.1314
   PubMed Web of Science ®Google Scholar
• Rhon DI, Greenlee TA, Poehlein E, et al. Effect of risk-stratified care on disability among adults with low back pain treated in the military health system: a randomized clinical trial. JAMA Netw Open. 2023 Jul 3;6(7):e2321929. doi: 10.1001/jamanetworkopen.2023.21929
   Web of Science ®Google Scholar
• Karlsson M, Bergenheim A, Larsson MEH, et al. Effects of exercise therapy in patients with acute low back pain: a systematic review of systematic reviews. Syst Rev. 2020 Aug 14;9(1):182. doi: 10.1186/s13643-020-01412-8
   Web of Science ®Google Scholar
• Hayden JA, Ellis J, Ogilvie R, et al. Exercise therapy for chronic low back pain. Cochrane Database Syst Rev. 2021 Sep 28;9(9): CD009790.doi: 10.1002/14651858.CD009790.pub2
   Google Scholar
• Gattie E, Cleland JA, Snodgrass S. The effectiveness of trigger point dry needling for musculoskeletal conditions by physical therapists: a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2017 Mar;47(3):133–149. doi: 10.2519/jospt.2017.7096
   PubMed Web of Science ®Google Scholar
• Goldacre B, Drysdale H, Powell-Smith A, et al. The COMPare trials project 2016. [cited 2023 Feb 16]. Available from: www.COMPare-trials.org
   Google Scholar
• Goldacre B, Drysdale H, Dale A, et al. COMPare: a prospective cohort study correcting and monitoring 58 misreported trials in real time. Trials. 2019 Feb 14;20(1):118. doi: 10.1186/s13063-019-3173-2
   PubMedGoogle Scholar
• Carlisle JB. False individual patient data and zombie randomised controlled trials submitted to Anaesthesia. Anaesthesia. 2021 Apr;76(4):472–479. doi: 10.1111/anae.15263
   PubMed Web of Science ®Google Scholar
• Van Noorden R. Medicine is plagued by untrustworthy clinical trials. How many studies are faked or flawed? Nature. 2023 Jul;619(7970):454–458. doi: 10.1038/d41586-023-02299-w
   PubMed Web of Science ®Google Scholar