Interdisciplinary Approaches and Strategies from Research Reproducibility 2020: Educating for Reproducibility

Figures & data

Table 1 Thirteen approaches and key lessons for interdisciplinary research reproducibility education organized by Nosek’s “Strategies for Culture Change” guiding principles (2019, 2020).

Approach	Key Lesson
	Make It Possible
Practice lifelong learning	Foster an expectation that research practices be reproducible, even if that means changing them over time
Cultivate bottom-up change	Build broad support through localized and targeted approaches to embed and promote open science practices
Sneak in learning	Restructure curricula to embed, tailor, and align reproducible practices with discipline specific research norms
Just-in-time learning	Incorporate reproducible practices in task- and context-oriented training to promote learner satisfaction and retention
	Make It Easy
Engage learners where they are	Target training by career stage and audience type
Balance practical skills development with conceptual learning	Promote broad, flexible mental models by aligning specific practices with theoretical concepts
Learn by doing	Use hands-on experiences in replicating studies to show the importance of transparent and clear reporting of methods
Learn how to learn	Guide learners to reflect on their own thinking, to promote critical thinking, self-directed learning, and peer-learning
	Make It Normative
Establish communities of practice	Establish groups that meet regularly, to maintain, share, and expand on skills in a social setting
Librarians as interdisciplinary leaders	Librarians are uniquely equipped as early leaders and collaborators of open science and reproducible research practices
Effective teamwork skills	Reproducible research practices also enhance the ability of researchers to collaborate and resolve conflict
	Make It Rewarding
Incentives and rewards	Offering incentives and rewards can help shift research culture toward greater reproducibility
	Make It Required
Implement top-down change	Top-down mandated efforts can be used as a pathway to introduce and/or improve rigor and transparency in reporting practices

Table 2 Select resources shared by speakers and attendees.

Name of Resource	Web Address	Audience/Purpose
ReproducibiliTea Journal Clubs	https://reproducibilitea.org/journal-clubs/	Journal club leaders; provides materials for reuse and ideas for content
Berkeley Initiative for Transparency in the Social Sciences	https://www.bitss.org/	Learners, instructors; exercises, workshops and programs, and templates
The Carpentries Curricula	https://carpentries.org/workshops-curricula/	Learners, instructors; provides modular, step by step lessons on data and code-related topics
Center for Open Science	https://www.cos.io	All; platform of open science tools and initiatives, including registered reports
Reproducibility for Everyone	www.repro4everyone.org	Learners, instructors; workshop lessons that can be used and adapted
GitHub Learning Lab	https://lab.github.com/	Learners; tutorials on using GitHub
Frictionless Data for Reproducible Research Fellows Programme	https://fellows.frictionlessdata.io/	Learners; contains lessons, resources, and syllabus for a fellowship program
Data Carpentry for Biologists	https://datacarpentry.org/semester-biology/	Learners, instructors; semester-long syllabus and class materials, lessons
ProjectTIER	https://www.projecttier.org/	Learners, instructors; exercises, workshops and programs, and templates
Psychology’s Credibility Revolution course	https://docs.google.com/presentation/d/e/	Learners; course by Carleton College
	2PACX-1vREwmeADm5WZCBfjAKyAkzYC	faculty member Julia Strand with
	_cQb7xtYv6C7e_wBJx0BUhJ3lFY0WABpI	lectures, exercises, and more
	b0XotJake0Xrh-CC6g1Vwy/pub?start =fal
	se&loop =false&delayms =99999
	999#slide =id.g950fb47fc8_0_16
STAT 545: Data wrangling, exploration, and analysis with R	https://stat545.com/	Learners; course by University of British Columbia faculty member Jennifer Bryan