Demystifying Open Science in health psychology and behavioral medicine: a practical guide to Registered Reports and Data Notes

References

• Allen, C., & Mehler, D. M. A. (2019). Open science challenges, benefits and tips in early career and beyond. PLoS Biology, 17(5), e3000246. https://doi.org/10.1371/journal.pbio.3000246
   PubMed Web of Science ®Google Scholar
• Baldwin, J. R. (2024). Editorial perspective: Misaligned incentives in mental health research–the case for Registered Reports. Journal of Child Psychology and Psychiatry, 65(2), 251–255. https://doi.org/10.1111/jcpp.13898
   Web of Science ®Google Scholar
• Beyene, S. D. (2023). Dataset of the impact of food insecurity on health outcomes in sub-Saharan Africa. BMC Research Notes, 16(1), 349. https://doi.org/10.1186/s13104-023-06623-5
   PubMed Web of Science ®Google Scholar
• BMC. (2024). BMC research notes: Data note. https://bmcresnotes.biomedcentral.com/submission-guidelines/preparing-your-manuscript/data-note
   Google Scholar
• Bosnjak, M., Fiebach, C. J., Mellor, D., Mueller, S., O'Connor, D. B., Oswald, F. L., & Sokol, R. I. (2022). A template for preregistration of quantitative research in psychology: Report of the joint psychological societies preregistration task force. American Psychologist, 77(4), 602–615. https://doi.org/10.1037/amp0000879
   PubMed Web of Science ®Google Scholar
• Branney, P. E., Brooks, J., Kilby, L., Newman, K., Norris, E., Pownall, M., Talbot, C. V., Treharne, G. J., & Whitaker, C. M. (2023). Three steps to open science for qualitative research in psychology. Social and Personality Psychology Compass, 17(4), e12728. https://doi.org/10.1111/spc3.12728
   Web of Science ®Google Scholar
• Callaway, E. (2019). Scooped in science? Relax, credit will come your way. Nature, 575(7784), 576–577. https://doi.org/10.1038/d41586-019-03648-4
   PubMed Web of Science ®Google Scholar
• Cashin, A. G., Bagg, M. K., Richards, G. C., Toomey, E., McAuley, J. H., & Lee, H. (2020). Limited engagement with transparent and open science standards in the policies of pain journals: a cross-sectional evaluation. BMJ Evidence-Based Medicine, 26(6), 313–319. https://doi.org/10.1136/bmjebm-2019-111296
   PubMedGoogle Scholar
• Center for Open Science. (2024). Registered reports: Peer review before results are known to align scientific values and practices. https://www.cos.io/initiatives/registered-reports
   Google Scholar
• Chambers, C. D. (2013). Registered reports: a new publishing initiative at Cortex. Cortex, 49(3), 609–610. https://doi.org/10.1016/j.cortex.2012.12.016
   PubMed Web of Science ®Google Scholar
• Chambers, C. D. (2015). Ten reasons why journals must review manuscripts before results are known. Addiction, 110(1), 10–11. https://doi.org/10.1111/add.12728
   PubMed Web of Science ®Google Scholar
• Chambers, C. D., & Tzavella, L. (2022). The past, present and future of Registered Reports. Nature Human Behaviour, 6(1), 29–42. https://doi.org/10.1038/s41562-021-01193-7
   PubMed Web of Science ®Google Scholar
• Clark, R., Drax, K., Chambers, C. D., Munafò, M., & Thompson, J. (2021). Evaluating registered reports funding partnerships: A feasibility study [version 1; peer review: 2 approved with reservations]. Wellcome Open Research, 6, 231. https://doi.org/10.12688/wellcomeopenres.17028.1
   Google Scholar
• Drax, K., Clark, R., Chambers, C. D., Munafò, M., & Thompson, J. (2021). A qualitative analysis of stakeholder experiences with registered reports funding partnerships. Wellcome Open Research, 6(6), 230. https://doi.org/10.12688/wellcomeopenres.17029.1
   PubMedGoogle Scholar
• Dwan, K., Gamble, C., Williamson, P. R., & Kirkham, J. J. (2013). Systematic review of the empirical evidence of study publication bias and outcome reporting bias — An updated review. PLoS One, 8(7), e66844. https://doi.org/10.1371/journal.pone.0066844
   PubMed Web of Science ®Google Scholar
• Egan, S., Tobin, M., Palmer, B., Coffey, A., Dahly, D., Houghton, C., … Matvienko-Sikar, K. (2020). Developing an open educational resource for open research: Protocol for the PaPOR TRAIL project. HRB Open Research, 3. https://doi.org/10.12688/hrbopenres.13171.1
   PubMedGoogle Scholar
• Foster, E. D., & Deardorff, A. (2017). Open science framework (OSF). Journal of the Medical Library Association, 105(2), 203. https://doi.org/10.5195/jmla.2017.88
   Google Scholar
• Fraser, N., Brierley, L., Dey, G., Polka, J. K., Pálfy, M., Nanni, F., & Coates, J. A. (2021). The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape. PLoS Biology, 19(4), e3000959. https://doi.org/10.1371/journal.pbio.3000959
   PubMed Web of Science ®Google Scholar
• Gardener, A. D., Hick, E. J., Jacklin, C., Tan, G., Cashin, A. G., Lee, H., … Richards, G. C. (2022). Open science and conflict of interest policies of medical and health sciences journals before and during the COVID-19 pandemic: A repeat cross-sectional study: Open science policies of medical journals. JRSM open, 13(11), 205427042211321. https://doi.org/10.1177/20542704221132139
   Google Scholar
• Henderson, E. L. (2019). Why you’ll love writing a registered report. Prolific blog. https://www.prolific.com/blog/why-youll-love-writing-a-registered-report
   Google Scholar
• Henderson, E. L., & Chambers, C. D. (2022). Ten simple rules for writing a registered report. PLoS Computational Biology, 18(10), e1010571. https://doi.org/10.1371/journal.pcbi.1010571
   PubMed Web of Science ®Google Scholar
• Hopewell, S., Ravaud, P., Baron, G., & Boutron, I. (2012). Effect of editors’ implementation of CONSORT guidelines on the reporting of abstracts in high impact medical journals: interrupted time series analysis. Bmj, 344, e4178. https://doi.org/10.1136/bmj.e4178
   PubMedGoogle Scholar
• Hunter, A., Yargawa, J., Notley, C., Ussher, M., Bobak, A., Murray, R. L., Nath, S., & Cooper, S. (2021). Healthcare professionals’ beliefs, attitudes, knowledge, and behavior around vaping in pregnancy and postpartum: A qualitative study. Nicotine & Tobacco Research, 23(3), 471–478. https://doi.org/10.1093/ntr/ntaa126
   PubMed Web of Science ®Google Scholar
• Karhulahti, V. M., Branney, P., Siutila, M., & Syed, M. (2023). A primer for choosing, designing and evaluating registered reports for qualitative methods [version 2; peer review: 2 approved]. Open Research Europe, 3, 22. https://doi.org/10.12688/openreseurope.15532.1
   PubMedGoogle Scholar
• Kathawalla, U. K., Silverstein, P., & Syed, M. (2021). Easing into open science: A guide for graduate students and their advisors. Collabra: Psychology, 7(1), 18684. https://doi.org/10.1525/collabra.18684
   Google Scholar
• Kathawalla, U. K., & Syed, M. (2021). Discrimination, life stress, and mental health among muslims: A preregistered systematic review and meta-analysis. Collabra: Psychology, 7(1), 28248. https://doi.org/10.1525/collabra.28248
   Google Scholar
• Kiyonaga, A., & Scimeca, J. M. (2019). Practical considerations for navigating registered reports. Trends in neurosciences, 42(9), 568–572. https://doi.org/10.1016/j.tins.2019.07.003
   PubMed Web of Science ®Google Scholar
• Kwasnicka, D., Ten Hoor, G. A., van Dongen, A., Gruszczyńska, E., Hagger, M. S., Hamilton, K., … Luszczynska, A. (2021). Promoting scientific integrity through open science in health psychology: results of the Synergy Expert Meeting of the European health psychology society. Health Psychology Review, 15(3), 333–349. https://doi.org/10.1080/17437199.2020.1844037
   PubMed Web of Science ®Google Scholar
• Lee, H., Lamb, S. E., Bagg, M. K., Toomey, E., Cashin, A. G., & Moseley, G. L. (2018). Transparent and reproducible pain research: a critical review. Pain, 159(9), 1872–6623. https://doi.org/10.1097/j.pain.0000000000001254
   Web of Science ®Google Scholar
• McGillivray, B., Marongiu, P., Pedrazzini, N., Ribary, M., Migdorowitz, M., & Zordan, E. (2022). Deep impact: A study on the impact of data papers and datasets in the humanities and social sciences. Publications, 10(4), 39. https://doi.org/10.3390/publications10040039
   Web of Science ®Google Scholar
• McIntosh, R. D. (2017). Exploratory reports: A new article type for Cortex. Cortex, 96, A1–A4. https://doi.org/10.1016/j.cortex.2017.07.014
   PubMed Web of Science ®Google Scholar
• McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., … Yarkoni, T. (2016). How open science helps researchers succeed. eLife, 5, e16800. https://doi.org/10.7554/eLife.16800
   PubMed Web of Science ®Google Scholar
• McVay, M. A., & Conroy, D. E. (2021). Transparency and openness in behavioral medicine research. Translational Behavioral Medicine, 11(1), 287–290. https://doi.org/10.1093/tbm/ibz154
   PubMed Web of Science ®Google Scholar
• McVay, M. A., Cooper, K. B., Carrera Seoane, M., Donahue, M. L., & Scherer, L. D. (2021). Transparent reporting of hypotheses and analyses in behavioral medicine research: An audit of publications in 2018 and 2008. Health Psychology and Behavioral Medicine, 9(1), 285–297. https://doi.org/10.1080/21642850.2021.1907186
   PubMed Web of Science ®Google Scholar
• Michie, S., van Stralen, M. M., & West, R. (2011). The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implementation Science, 6(1), 42. https://doi.org/10.1186/1748-5908-6-42
   PubMed Web of Science ®Google Scholar
• Montoya, A. K., Krenzer, W. L. D., & Fossum, J. L. (2021). Opening the door to registered reports: Census of journals publishing registered reports (2013–2020). Collabra: Psychology, 7(1), 24404. https://doi.org/10.1525/collabra.24404
   Google Scholar
• Morey, C. C., & Tzavella, L. (2018). Going for a registered report? The mnemonic lode. https://www.candicemorey.org/?p=265
   Google Scholar
• Munafò, M. R., Nosek, B. A., Bishop, D. V., Button, K. S., Chambers, C. D., Percie du Sert, N., … Ioannidis, J. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1(1), 1–9. https://doi.org/10.1038/s41562-016-0021
   Web of Science ®Google Scholar
• Norris, E., & O’Connor, D. B. (2019). Science as behaviour: Using a behaviour change approach to increase uptake of open science. Psychology & Health, 34(12), 1397–1406. https://doi.org/10.1080/08870446.2019.1679373
   PubMed Web of Science ®Google Scholar
• Norris, E., Prescott, A., Noone, C., Green, J. A., Reynolds, J., Grant, S. P., & Toomey, E. (2022). Establishing open science research priorities in health psychology: A research prioritisation Delphi exercise. Psychology & Health, 1–25.
   PubMed Web of Science ®Google Scholar
• Norris, E., & Toomey, E. (2020). Open science in health psychology: Launching the EHPS open science SIG. The European Health Psychologist, 21(5), 679–682.
   Google Scholar
• Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., … Yarkoni, T. S. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374
   PubMed Web of Science ®Google Scholar
• Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018). The preregistration revolution. Proceedings of the National Academy of Sciences, 115(11), 2600–2606. https://doi.org/10.1073/pnas.1708274114
   PubMed Web of Science ®Google Scholar
• NPQIP Collaborative group. (2019). Did a change in Nature journals’ editorial policy for life sciences research improve reporting? BMJ Open Sci, 3(1), e000035.
   PubMedGoogle Scholar
• Osborne, C., & Norris, E. (2022). Pre-registration as behaviour: developing an evidence-based intervention specification to increase pre-registration uptake by researchers using the Behaviour Change Wheel. Cogent Psychology, 9(1), 2066304. https://doi.org/10.1080/23311908.2022.2066304
   Web of Science ®Google Scholar
• Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., … Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery, 88, 105906. https://doi.org/10.1016/j.ijsu.2021.105906
   PubMed Web of Science ®Google Scholar
• Parsons, P., Azevedo, F., Elsherif, M. M., Guay, S., Shahim, O. N., Govaart, G. H., Norris, E., O'Mahony, A., Parker, A. J., Todorovic, A., Pennington, C. R., Garcia-Pelegrin, E., Lazic, A., Robertson, O., Middleton, S. L., Valentini, B., McCuaig, J., Baker, B. J., Collins, E., … Aczel, B. (2022). A community-sourced glossary of open scholarship terms. Nature Human Behaviour, 6(3), 312–318. https://doi.org/10.1038/s41562-021-01269-4
   PubMed Web of Science ®Google Scholar
• Peer Community In. (2023a). Full policies and procedures. https://rr.peercommunityin.org/about/full_policies#h_61998243643551613309672490
   Google Scholar
• Peer Community In. (2023b). Guide for reviewers. https://rr.peercommunityin.org/PCIRegisteredReports/help/guide_for_reviewers#h_97949820420921613309536944
   Google Scholar
• Pennington, C. R. (2023). Open data through Registered Reports can accelerate cumulative knowledge. Addiction Research & Theory, 31(3), 155–156. https://doi.org/10.1080/16066359.2023.2176848
   Web of Science ®Google Scholar
• Pennington, C. R., & Heim, D. (2022). Reshaping the publication process: Addiction research and theory joins peer community in registered reports. Addiction Research & Theory, 30(1), 1–4. https://doi.org/10.1080/16066359.2021.1931142
   Web of Science ®Google Scholar
• Peters, G.-J., Kok, G., Crutzen, R., & Sanderman, R. (2017). Health psychology bulletin: Improving publication practices to accelerate scientific progress. Health Psychology Bulletin, 1(1), 1–6. https://doi.org/10.5334/hpb.2
   Google Scholar
• Pownall, M., Azevedo, F., Aldoh, A., Elsherif, M., Vasilev, M., Pennington, C. R., Robertson, O., Tromp, M. V., Liu, M., Makel, M. C., Tonge, N., Moreau, D., Horry, R., Shaw, J., Tzavella, L., McGarrigle, R., Talbot, C., Parsons, S., & FORRT. (2021). Embedding open and reproducible science into teaching: A bank of lesson plans and resources. Scholarship of Teaching and Learning in Psychology. Advance online publication. https://doi.org/10.1037/stl0000307
   Google Scholar
• Sarafoglou, A., Kovacs, M., Bakos, B., Wagenmakers, E. J., & Aczel, B. (2022). A survey on how preregistration affects the research workflow: Better science but more work. Royal Society Open Science, 9(7), 211997. https://doi.org/10.1098/rsos.211997
   PubMed Web of Science ®Google Scholar
• Scheel, A. M., Schijen, M. R. M. J., & Lakens, D. (2021). An excess of positive results: Comparing the standard psychology literature with Registered Reports. Advances in Methods and Practices in Psychological Science, 4(2). https://doi.org/10.1177/25152459211007467
   Google Scholar
• Segerstrom, S. C., Diefenbach, M. A., Hamilton, K., O'Connor, D. B., & Tomiyama, J. A. (2023). Open science in health psychology and behavioral medicine: A statement from the Behavioral Medicine Research Council. Health Psychology, 42(5), 287–298. https://doi.org/10.1037/hea0001236
   PubMed Web of Science ®Google Scholar
• Silverstein, P., Pennington, C., Branney, P., O’Connor, D. B., Lawlor, E., O’Brien, E., & Lynott, D. (2024). A registered report survey of open research practices in psychology departments in the UK and Ireland. British Journal of Psychology. Early online view. https://doi.org/10.1111/bjop.12700
   PubMed Web of Science ®Google Scholar
• Soderberg, C. K., Errington, T. M., Schiavone, S. R., Bottesini, J., Singleton Thorn, F., Vazire, S., Esterling, K. M., & Nosek, B. A. (2021). Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5(8), 990–997. https://doi.org/10.1038/s41562-021-01142-4
   PubMed Web of Science ®Google Scholar
• Taylor & Francis. (2024). Data notes. https://authorservices.taylorandfrancis.com/data-sharing/share-your-data/data-notes/
   Google Scholar
• Thibault, R. T., Amaral, O. B., Argolo, F., Bandrowski, A. E., Davidson, A. R., & Drude, N. I. (2023). Open Science 2.0: Towards a truly collaborative research ecosystem. PLOS Biology, 21(10), e3002362. https://doi.org/10.1371/journal.pbio.3002362
   PubMed Web of Science ®Google Scholar
• Van den Akker, O. R., Peters, G. J. Y., Bakker, C. J., Carlsson, R., Coles, N. A., Corker, K. S., … Pfeiffer, N. (2023). Increasing the transparency of systematic reviews: presenting a generalized registration form. Systematic Reviews, 12(1), 170. https://doi.org/10.1186/s13643-023-02281-7
   PubMed Web of Science ®Google Scholar
• Van't Veer, A. E., & Giner-Sorolla, R. (2016). Pre-registration in social psychology—A discussion and suggested template. Journal of Experimental Social Psychology, 67, 2–12. https://doi.org/10.1016/j.jesp.2016.03.004
   Web of Science ®Google Scholar
• Von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007). The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. The Lancet, 370(9596), 1453–1457. https://doi.org/10.1016/S0140-6736(07)61602-X
   PubMed Web of Science ®Google Scholar
• Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J. W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., … Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3(1), 1–9.
   Web of Science ®Google Scholar
• Zečević, K., Houghton, C., Noone, C., Lee, H., Matvienko-Sikar, K., & Toomey, E. (2020). Exploring factors that influence the practice of Open Science by early career health researchers: a mixed methods study. HRB Open Research, 3. https://doi.org/10.12688/hrbopenres.13119.1
   PubMedGoogle Scholar