Selective outcome reporting in trials of behavioural health interventions in health psychology and behavioural medicine journals: a review

References

• Agnoli, F., Wicherts, J. M., Veldkamp, C. L. S., Albiero, P., & Cubelli, R. (2017). Questionable research practices among Italian research psychologists. PLoS One, 12(3), e0172792. https://doi.org/10.1371/journal.pone.0172792
   PubMed Web of Science ®Google Scholar
• Bellucci, C., Hughes, K., Toomey, E., Williamson, P. R., & Matvienko-Sikar, K. (2021). A survey of knowledge, perceptions and use of core outcome sets among clinical trialists. Trials, 22(1), 937. https://doi.org/10.1186/s13063-021-05891-5
   PubMed Web of Science ®Google Scholar
• Bradley, H., Rucklidge, J., & Mulder, R. (2017). A systematic review of trial registration and selective outcome reporting in psychotherapy randomized controlled trials. Acta Psychiatrica Scandinavica, 135(1), 65–77. https://doi.org/10.1111/acps.12647
   PubMed Web of Science ®Google Scholar
• Cairo, A. H., Green, J. D., Forsyth, D. R., Behler, A. M. C., & Raldiris, T. L. (2020). Gray (Literature) matters: Evidence of selective hypothesis reporting in social psychological research. Personality and Social Psychology Bulletin, 46(9), 1344–1362. https://doi.org/10.1177/0146167220903896
   PubMed Web of Science ®Google Scholar
• Calméjane, L., Dechartres, A., Tran, V. T., & Ravaud, P. (2018). Making protocols available with the article improved evaluation of selective outcome reporting. Journal of Clinical Epidemiology, 104, 95–102. https://doi.org/10.1016/j.jclinepi.2018.08.020
   PubMed Web of Science ®Google Scholar
• Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004). Empirical evidence for selective reporting of outcomes in randomized trials: Comparison of protocols to published articles. JAMA, 291(20), 2457. https://doi.org/10.1001/jama.291.20.2457
   PubMed Web of Science ®Google Scholar
• Chauvin, A., Ravaud, P., Moher, D., Schriger, D., Hopewell, S., Shanahan, D., Alam, S., Baron, G., Regnaux, J.-P., Crequit, P., Martinez, V., Riveros, C., Le Cleach, L., Recchioni, A., Altman, D. G., & Boutron, I. (2019). Accuracy in detecting inadequate research reporting by early career peer reviewers using an online CONSORT-based peer-review tool (COBPeer) versus the usual peer-review process: A cross-sectional diagnostic study. BMC Medicine, 17(1), 205. https://doi.org/10.1186/s12916-019-1436-0
   PubMed Web of Science ®Google Scholar
• Chen, T., Li, C., Qin, R., Wang, Y., Yu, D., Dodd, J., Wang, D., & Cornelius, V. (2019). Comparison of clinical trial changes in primary outcome and reported intervention effect size between trial registration and publication. JAMA Network Open, 2(7), e197242. https://doi.org/10.1001/jamanetworkopen.2019.7242
   PubMed Web of Science ®Google Scholar
• Cristea, I. A., & Naudet, F. (2019). Increase value and reduce waste in research on psychological therapies. Behaviour Research and Therapy, 123, 103479. https://doi.org/10.1016/j.brat.2019.103479
   PubMed Web of Science ®Google Scholar
• DeVito, N. J., & Goldacre, B. (2019). Catalogue of bias: Publication bias. BMJ Evidence-Based Medicine, 24(2), 53–54. https://doi.org/10.1136/bmjebm-2018-111107
   PubMedGoogle Scholar
• Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C, Ghersi, D, Ioannidis, J. P. A., Simes, J., & Williamson, P. R. (2008). Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One, 3(8), e3081. https://doi.org/10.1371/journal.pone.0003081
   PubMed Web of Science ®Google Scholar
• Dwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group. (2013). Systematic review of the empirical evidence of study publication bias and outcome reporting bias—an updated review. PLoS One, 8(7), e66844. https://doi.org/10.1371/journal.pone.0066844
   PubMed Web of Science ®Google Scholar
• Gardner, H., Elfeky, A., Pickles, D., Dawson, A., Gillies, K., Warwick, V., & Treweek, S. (2022). A good use of time? Providing evidence for how effort is invested in primary and secondary outcome data collection in trials. Trials, 23(1), 1047. https://doi.org/10.1186/s13063-022-06973-8
   PubMed Web of Science ®Google Scholar
• Grant, S., Mayo-Wilson, E., Montgomery, P., Macdonald, G., Michie, S., Hopewell, S., Moher, D. &, on Behalf of the CONSORT-SPI Group. (2018). CONSORT-SPI 2018 explanation and elaboration: Guidance for reporting social and psychological intervention trials. Trials, 19(1), 406. https://doi.org/10.1186/s13063-018-2735-z
   PubMedGoogle Scholar
• Hagger, M. S. (2019). Embracing open science and transparency in health psychology. Health Psychology Review, 13(2), 131–136. https://doi.org/10.1080/17437199.2019.1605614
   PubMed Web of Science ®Google Scholar
• Heneghan, C., Goldacre, B., & Mahtani, K. R. (2017). Why clinical trial outcomes fail to translate into benefits for patients. Trials, 18(1), 122. https://doi.org/10.1186/s13063-017-1870-2
   PubMed Web of Science ®Google Scholar
• Hopewell, S., Collins, G. S., Boutron, I., Yu, L.-M., Cook, J., Shanyinde, M., Wharton, R., Shamseer, L., & Altman, D. G. (2014). Impact of peer review on reports of randomised trials published in open peer review journals: Retrospective before and after study. BMJ, 349(jul01 8), g4145–g4145. https://doi.org/10.1136/bmj.g4145
   PubMedGoogle Scholar
• Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009). Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database of Systematic Reviews, 2009(1), MR000006. https://doi.org/10.1002/14651858.MR000006.pub3
   PubMedGoogle Scholar
• Howard, B., Scott, J. T., Blubaugh, M., Roepke, B., Scheckel, C., & Vassar, M. (2017). Systematic review: Outcome reporting bias is a problem in high impact factor neurology journals. PLoS One, 12(7), e0180986. https://doi.org/10.1371/journal.pone.0180986
   PubMed Web of Science ®Google Scholar
• Hughes, K. L., Williamson, P. R., & Young, B. (2022). In-depth qualitative interviews identified barriers and facilitators that influenced chief investigators’ use of core outcome sets in randomised controlled trials. Journal of Clinical Epidemiology, 144, 111–120. https://doi.org/10.1016/j.jclinepi.2021.12.004
   PubMed Web of Science ®Google Scholar
• Hutton, J. L., & Williamson, P. R. (2000). Bias in meta-analysis due to outcome variable selection within studies. Journal of the Royal Statistical Society Series C: Applied Statistics, 49(3), 359–370. https://doi.org/10.1111/1467-9876.00197
   Google Scholar
• Ioannidis, J. P. A. (2008). Why most discovered true associations are inflated. Epidemiology, 19(5), 640–648. https://doi.org/10.1097/EDE.0b013e31818131e7
   PubMed Web of Science ®Google Scholar
• Ioannidis, J. P., Caplan, A. L., & Dal-Ré, R. (2017). Outcome reporting bias in clinical trials: Why monitoring matters. BMJ, 356, j408. https://doi.org/10.1136/bmj.j408
   PubMedGoogle Scholar
• John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23(5), 524–532. https://doi.org/10.1177/0956797611430953
   PubMed Web of Science ®Google Scholar
• Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010). The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ, 340(feb15 1), c365. https://doi.org/10.1136/bmj.c365
   PubMedGoogle Scholar
• Komukai, K., Sugita, S., & Fujimoto, S. (2024). Publication bias and selective outcome reporting in randomized controlled trials related to rehabilitation: A literature review. Archives of Physical Medicine and Rehabilitation, 105(1), 150–156. https://doi.org/10.1016/j.apmr.2023.06.006
   PubMed Web of Science ®Google Scholar
• Kwasnicka, D., ten Hoor, G. A., van Dongen, A., Gruszczyńska, E., Hagger, M. S., Hamilton, K., Hankonen, N., Heino, M. T. J., Kotzur, M., Noone, C., Rothman, A. J., Toomey, E., Warner, L. M., Kok, G., Peters, G.-J., & Luszczynska, A. (2021). Promoting scientific integrity through open science in health psychology: Results of the Synergy Expert Meeting of the European health psychology society. Health Psychology Review, 15(3), 333–349. https://doi.org/10.1080/17437199.2020.1844037
   PubMed Web of Science ®Google Scholar
• Lancee, M., Schuring, M., Tijdink, J. K., Chan, A., Vinkers, C. H., & Luykx, J. J. (2022). Selective outcome reporting across psychopharmacotherapy randomized controlled trials. International Journal of Methods in Psychiatric Research, 31(1), e1900. https://doi.org/10.1002/mpr.1900
   PubMed Web of Science ®Google Scholar
• Macura, A., Abraha, I., Kirkham, J., Gensini, G. F., Moja, L., & Iorio, A. (2010). Selective outcome reporting: Telling and detecting true lies. The state of the science. Internal and Emergency Medicine, 5(2), 151–155. https://doi.org/10.1007/s11739-010-0371-z
   PubMed Web of Science ®Google Scholar
• Mathieu, S. (2009). Comparison of registered and published primary outcomes in randomized controlled trials. JAMA, 302(9), 977. https://doi.org/10.1001/jama.2009.1242
   PubMed Web of Science ®Google Scholar
• Matvienko-Sikar, K., Byrne, M., Clarke, M., Kirkham, J., Kottner, J., Mellor, K., Quirke, F., Saldanha, J., Smith, I., Toomey, V., & & Williamson, E. (2022). Using behavioural science to enhance use of core outcome sets in trials: Protocol. HRB Open Research, 5, 23. https://doi.org/10.12688/hrbopenres.13510.1
   PubMedGoogle Scholar
• Matvienko-Sikar, K., Terwee, C. B., Gargon, E., Devane, D., Kearney, P. M., & Byrne, M. (2020). The value of core outcome sets in health psychology. British Journal of Health Psychology, 25(3), 377–389. https://doi.org/10.1111/bjhp.12447
   PubMed Web of Science ®Google Scholar
• McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia medica, 22(3), 276–282. https://doi.org/10.11613/BM.2012.031
   PubMed Web of Science ®Google Scholar
• Michaelsen, M. M., & Esch, T. (2022). Functional mechanisms of health behavior change techniques: A conceptual review. Frontiers in Psychology, 13, 725644. https://doi.org/10.3389/fpsyg.2022.725644
   PubMed Web of Science ®Google Scholar
• Moher, D. (2007). Reporting research results: A moral obligation for all researchers. Canadian Journal of Anesthesia/Journal canadien d'anesthésie, 54(5), 331–335. https://doi.org/10.1007/BF03022653
   PubMed Web of Science ®Google Scholar
• Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010). CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ, 340(mar23 1), c869. https://doi.org/10.1136/bmj.c869
   PubMed Web of Science ®Google Scholar
• Montgomery, P., Grant, S., Mayo-Wilson, E., Macdonald, G., Michie, S., Hopewell, S., & Moher, D. (2018). Reporting randomised trials of social and psychological interventions: The CONSORT-SPI 2018 Extension. Trials, 19(1), 1–14. https://doi.org/10.1186/s13063-018-2733-1
   PubMed Web of Science ®Google Scholar
• Norris, E., & O’Connor, D. B. (2019). Science as behaviour: Using a behaviour change approach to increase uptake of open science. Psychology & Health, 34(12), 1397–1406. https://doi.org/10.1080/08870446.2019.1679373
   PubMed Web of Science ®Google Scholar
• Norris, E., Prescott, A., Noone, C., Green, J. A., Reynolds, J., Grant, S., & Toomey, E. (2022a). Open Science Research Priorities in Health Psychology [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/a7vrz
   Google Scholar
• Norris, E., Sulevani, I., Finnerty, A. N., & Castro, O. (2022b). Assessing Open Science practices in physical activity behaviour change intervention evaluations. BMJ Open Sport & Exercise Medicine, 8(2), e001282. https://doi.org/10.1136/bmjsem-2021-001282
   PubMedGoogle Scholar
• O’Connor, D. B. (2021). Leonardo da Vinci, preregistration and the Architecture of Science: Towards a More Open and Transparent Research Culture. Health Psychology Bulletin, 5, 39–45. https://doi.org/10.5334/hpb.30
   Google Scholar
• Olsson-Collentine, A., Van Aert, R. C. M., Bakker, M., & Wicherts, J. (2023). Meta-analyzing the multiverse: A peek under the hood of selective reporting. Psychological Methods. https://doi.org/10.1037/met0000559
   PubMed Web of Science ®Google Scholar
• Osborne, C., & Norris, E. (2022). Pre-registration as behaviour: Developing an evidence-based intervention specification to increase pre-registration uptake by researchers using the Behaviour Change Wheel. Cogent Psychology, 9(1), 2066304. https://doi.org/10.1080/23311908.2022.2066304
   Web of Science ®Google Scholar
• Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71
   PubMed Web of Science ®Google Scholar
• Rabelo, A. L. A., Farias, J. E. M., Sarmet, M. M., Joaquim, T. C. R., Hoersting, R. C., Victorino, L., Modesto, J. G. N., & Pilati, R. (2020). Questionable research practices among Brazilian psychological researchers: Results from a replication study and an international comparison. International Journal of Psychology, 55(4), 674–683. https://doi.org/10.1002/ijop.12632
   PubMed Web of Science ®Google Scholar
• Rankin, J., Ross, A., Baker, J., O’Brien, M., Scheckel, C., & Vassar, M. (2017). Selective outcome reporting in obesity clinical trials: A cross-sectional review. Clinical Obesity, 7(4), 245–254. https://doi.org/10.1111/cob.12199
   PubMedGoogle Scholar
• Schulz, K. F., & Grimes, D. A. (2005). Sample size calculations in randomised trials: Mandatory and mystical. The Lancet, 365(9467), 1348–1353. https://doi.org/10.1016/S0140-6736(05)61034-3
   PubMed Web of Science ®Google Scholar
• Segerstrom, S. C., Diefenbach, M. A., Hamilton, K., O’Connor, D. B., Tomiyama, A. J., Bacon, S. L., Behavioral Medicine Research Council, Bennett, G. G., Brondolo, E., Czajkowski, S. M., Davidson, K. W., Epel, E. S., Revenson, T. A., & Ruiz, J. M. (2023). Open science in health psychology and behavioral medicine: A statement from the behavioral medicine research council. Annals of Behavioral Medicine, 57(5), 357–367. https://doi.org/10.1093/abm/kaac044
   PubMed Web of Science ®Google Scholar
• Severin, A., & Chataway, J. (2021). Overburdening of peer reviewers: A multi-stakeholder perspective on causes and effects. Learned Publishing, 34(4), 537–546. https://doi.org/10.1002/leap.1392
   Web of Science ®Google Scholar
• Shah, K., Egan, G., Huan, L. N., Kirkham, J., Reid, E., & Tejani, A. M. (2020). Outcome reporting bias in Cochrane systematic reviews: A cross-sectional analysis. BMJ Open, 10(3), e032497. https://doi.org/10.1136/bmjopen-2019-032497
   PubMed Web of Science ®Google Scholar
• Smyth, R. M. D., Kirkham, J. J., Jacoby, A., Altman, D. G., Gamble, C., & Williamson, P. R. (2011). Frequency and reasons for outcome reporting bias in clinical trials: Interviews with trialists. BMJ, 342(jan06 1), c7153–c7153. https://doi.org/10.1136/bmj.c7153
   PubMedGoogle Scholar
• Taylor, N. J., & Gorman, D. M. (2022). Registration and primary outcome reporting in behavioral health trials. BMC Medical Research Methodology, 22(1), 41. https://doi.org/10.1186/s12874-021-01500-w
   PubMed Web of Science ®Google Scholar
• Thomas, E. T., & Heneghan, C. (2022). Catalogue of bias: Selective outcome reporting bias. BMJ EBM, 27(6), 370–372.
   Google Scholar
• Wang, A., Menon, R., Li, T., Harris, L., Harris, I. A., Naylor, J., & Adie, S. (2023). Has the degree of outcome reporting bias in surgical randomized trials changed? A meta-regression analysis. ANZ Journal of Surgery, 93(1–2), 76–82. https://doi.org/10.1111/ans.18273
   PubMed Web of Science ®Google Scholar
• Weston, J., Dwan, K., Altman, D., Clarke, M., Gamble, C., Schroter, S., Williamson, P., & Kirkham, J. (2016). Feasibility study to examine discrepancy rates in prespecified and reported outcomes in articles submitted to The BMJ. BMJ Open, 6(4), e010075. https://doi.org/10.1136/bmjopen-2015-010075
   PubMed Web of Science ®Google Scholar
• Yordanov, Y., Dechartres, A., Atal, I., Tran, V.-T., Boutron, I., Crequit, P., & Ravaud, P. (2018). Avoidable waste of research related to outcome planning and reporting in clinical trials. BMC Medicine, 16(1), 87. https://doi.org/10.1186/s12916-018-1083-x
   PubMedGoogle Scholar