Data sharing and big data in health professions education: Ottawa consensus statement and recommendations for scholarship

References

• [SQUIRE-EDU] Standards for Quality Improvement Reporting Excellence for Education. 2022. SQUIRE. SQUIRE EDU; [accessed 2022 Jul 6]. squire-statement.org.
   Google Scholar
• Ahsaan Shafqat U, Kaur H, Naaz S. 2019. An empirical study of big data: opportunities, challenges and technologies. In: Patnaik S, Ip A, Tavana M, Jain V, editors. New paradigm in decision science and management: advances in intelligent systems and computing. Vol. 1005. Singapore: Springer.
   Google Scholar
• Asch DA, Nicholson S, Srinivas SK, Herrin J, Epstein J. 2014. How do you deliver a good obstetrician? Outcome-based evaluation of medical education. Acad Med. 89(1):24–26. doi: 10.1097/ACM.0000000000000067.
   PubMed Web of Science ®Google Scholar
• Barber C, Hammond R, Gula L, Tithecott G, Chahine S. 2018. In search of black swans: identifying students at risk of failing licensing examinations. Acad Med. 93(3):478–485. doi: 10.1097/ACM.0000000000001938.
   PubMed Web of Science ®Google Scholar
• Barocas S, Nissenbaum H. 2014. Big data’s end run around anonymity and consent. In: Jane L, Stodden V, Bender S, Nissenbaum H, editors. Privacy, big data, and the public good. New York (NY): Cambridge University Press; p. 44–75.
   Google Scholar
• Bayazit A, Ilgaz H, Gönüllü İ, Erden Ş. 2023. Profiling students via clustering in a flipped clinical skills course using learning analytics. Med Teach. 45(7):724–731. doi: 10.1080/0142159X.2022.2152663.
   PubMed Web of Science ®Google Scholar
• Ben-Portah S, Ben Shara TH. 2017. Introduction: big data and education: ethical and moral challenges. Theory Res Educ. 15(3):243–248.
   Google Scholar
• Braunack-Mayer AJ, Street JM, Tooher R, Feng X, Scharling-Gamba K. 2020. Student and staff perspectives on the use of big data in the tertiary education sector: a scoping review and reflection on the ethical issues. Rev Educ Res. 90(6):788–823. doi: 10.3102/0034654320960213.
   Web of Science ®Google Scholar
• Burk-Rafel J, Reinstein I, Feng J, Kim MB, Miller LH, Cocks PM, Marin M, Aphinyanaphongs Y. 2021. Development and validation of a machine learning-based decision support tool for residency applicant screening and review. Acad Med. 96(11S):S54–S61. doi: 10.1097/ACM.0000000000004317.
   PubMed Web of Science ®Google Scholar
• Carroll SR, Garba I, Figueroa-Rodríguez OL, Holbrook J, Lovett R, Materechera S, Parsons M, Raseroka K, Rodriguez-Lonebear D, Rowe R, et al. 2020. The CARE principles for indigenous data governance. Data Sci J. 19:1–12. doi: 10.5334/dsj-2020-043.
   Google Scholar
• Cathaoir KÓ, Gunnarsdóttir HD, Hartlev M. 2022. The journey of research data: accessing Nordic Health Data for the purposes of developing an algorithm. Med Law Int. 22(1):52–74. doi: 10.1177/09685332211046179.
   Google Scholar
• Chahine S, Kulasegaram KM, Wright S, Monteiro S, Grierson LEM, Barber C, Sebok-Syer SS, McConnell M, Yen W, De Champlain A, et al. 2018. A call to investigate the relationship between education and health outcomes using big data. Acad Med. 93(6):829–832. Jun doi: 10.1097/ACM.0000000000002217.
   PubMed Web of Science ®Google Scholar
• Chan T, Sebok-Syer S, Thoma B, Wise A, Sherbino J, Pusic M. 2018. Learning analytics in medical education assessment: the past, the present, and the future. AEM Educ Train. 22(2(2):178–187.
   Google Scholar
• Chen X, Liu CY. 2015. Big data ethics in education: connecting practices and ethical awareness. J Educ Technol Dev Exchange. 8(2):5–9. doi: 10.18785/jetde.0802.05.
   Google Scholar
• Cleland JA, Cook DA, Maloney S, Tolsgaard MG. 2022. "Important but risky": attitudes of global thought leaders towards cost and value research in health professions education. Adv Health Sci Educ Theory Pract. 27(4):989–1001. doi: 10.1007/s10459-022-10123-9.
   PubMed Web of Science ®Google Scholar
• Cook DA, Kuper A, Hatala R, Ginsburg S. 2016. When assessment data are words: validity evidence for qualitative educational assessments. Acad Med. 91(10):1359–1369. doi: 10.1097/ACM.0000000000001175.
   PubMed Web of Science ®Google Scholar
• Crawford KK, Miltner K, Gray ML. 2014. Critiquing big data: politics, ethics, epistemology special section introduction. Int J Commun Health. 8:1663–1672.
   Google Scholar
• Davis D, Dorsey JK, Franks RD, Sackett PR, Searcy CA, Zhao X. 2013. Do racial and ethnic group differences in performance on the MCAT exam reflect test bias? Acad Med. 88(5):593–602. doi: 10.1097/ACM.0b013e318286803a.
   PubMed Web of Science ®Google Scholar
• De Mauro, A, Greco, M, Grimaldi, M. 2016b. Beyond data scientists: A review of Big Data skills and job families. Proceedings of 11th International Forum of Knowledge Asset Dynamics: FKAD 2016. Towards a new architecture of knowledge: Big Data, culture and creativity (pp.1844–1857). IFKAD.
   Google Scholar
• Demchenko Y, Grosso P, de Latt C, Membrey P. 2013. Addressing big data issues in scientific data infrastructure. In: 2013 International Conference on Collaboration Technologies and Systems (CTS). San Diego, CA, USA. May 20–24 2013; p. 48–55. doi: 10.1109/CTS.2013.6567203.
   Google Scholar
• Dowell J, Cleland J, Fitzpatrick S, McManus C, Nicholson S, Oppé T, Petty-Saphon K, King OS, Smith D, Thornton S, et al. 2018. The UK Medical Education Database (UKMED) what is it? Why and how might you use it? BMC Med Educ. 18(1):6. doi: 10.1186/s12909-017-1115-9.
   PubMedGoogle Scholar
• Downing SM, Haladyna TM. 2004. Validity threats: overcoming interference with proposed interpretations of assessment data. Med Educ. 38(3):327–333. doi: 10.1046/j.1365-2923.2004.01777.x.
   PubMed Web of Science ®Google Scholar
• Duong MT, Rauschecker AM, Rudie JD, Chen PH, Cook TS, Bryan RN, Mohan S. 2019. Artificial intelligence for precision education in radiology. Br J Radiol. 92(1103):20190389. doi: 10.1259/bjr.20190389.
   PubMed Web of Science ®Google Scholar
• Ellaway RH, Pusic MV, Galbraith RM, Cameron T. 2014. Developing the role of big data and analytics in health professional education. Med Teach. 36(3):216–222. doi: 10.3109/0142159X.2014.874553.
   PubMed Web of Science ®Google Scholar
• Ellaway RH, Topps D, Pusic M. 2019. Data, big and small: emerging challenges to medical education scholarship. Acad Med. 94(1):31–36. doi: 10.1097/ACM.0000000000002465.
   PubMed Web of Science ®Google Scholar
• Ellis R, Brennan P, Scrimgeour DS, Lee AJ, Cleland J. 2022. Performance at medical school selection correlates with success in part A of the intercollegiate Membership of the Royal College of Surgeons (MRCS) examination. Postgrad Med J. 98(1161):e19. doi: 10.1136/postgradmedj-2021-139748.
   PubMed Web of Science ®Google Scholar
• Ellis R, Brennan PA, Lee AJ, Scrimgeour DS, Cleland J. 2022. Differential attainment at MRCS according to gender, ethnicity, age and socioeconomic factors: a retrospective cohort study. J R Soc Med. 115(7):257–272. doi: 10.1177/01410768221079018.
   PubMed Web of Science ®Google Scholar
• Elouazizi N. 2014. Critical factors in data governance for learning analytics. Learn Anal. 1(3):211–222. doi: 10.18608/jla.2014.13.25.
   Google Scholar
• Eva KW, Reiter HI, Rosenfeld J, Trinh K, Wood TJ, Norman GR. 2012. Association between a medical school admission process using the multiple mini-interview and national licensing examination scores. JAMA. 308(21):2233–2240. doi: 10.1001/jama.2012.36914.
   PubMed Web of Science ®Google Scholar
• Ferretti A, Ienca M, Sheehan M, Blasimme A, Dove ES, Farsides B, Friesen P, Kahn J, Karlen W, Kleist P, et al. 2021. Ethics review of big data research: what should stay and what should be reformed? BMC Med Ethics. 22(1):51. doi: 10.1186/s12910-021-00616-4.
   PubMed Web of Science ®Google Scholar
• Florea D, Florea S. 2020. Big data and the ethical implications of data privacy in higher education research. Sustainability. 12(20):8744. doi: 10.3390/su12208744.
   Web of Science ®Google Scholar
• Fyfe M, Horsburgh J, Blitz J, Chiavaroli N, Kumar S, Cleland J. 2021. The do’s, don’ts and don’t knows of redressing differential attainment related to race/ethnicity in medical schools. Perspect Med Educ. 11(1):1–14. doi: 10.1007/S40037-021-00696-3.
   PubMed Web of Science ®Google Scholar
• Gale TCE, Lambe PJ, Roberts MJ. 2017. Factors associated with junior doctors’ decisions to apply for general practice training programmes in the UK: secondary analysis of data from the UKMED project. BMC Med. 15(1):220. doi: 10.1186/s12916-017-0982-6.
   PubMedGoogle Scholar
• Ghiringhelli LM, Carbogno C, Levchenko S, Mohamed F, Huhs G, Lüders M, Oliveira M, Scheffler M. 2017. Towards efficient data exchange and sharing for big-data driven materials science: metadata and data formats. Npj Comput Mater. 3(1):1–9. doi: 10.1038/s41524-017-0048-5.
   Google Scholar
• Ginsburg S, Stroud L, Lynch M, Melvin L, Kulasegaram K. 2022. Beyond the ratings: gender effects in written comments from clinical teaching assessments. Adv Health Sci Educ Theory Pract. 27(2):355–374. doi: 10.1007/s10459-021-10088-1.
   PubMed Web of Science ®Google Scholar
• Grierson L, Cavanagh A, Youssef A, Lee-Krueger R, McNeill K, Button B, Kulasegaram K. 2023. Inter-institutional data-driven education research: consensus values, principles, and recommendations to guide the ethical sharing of administrative education data in the Canadian medical education research context. Canadian Medical Education. Nov 8;14(5):113–120. doi: 10.36834/cmej.75874.
   Google Scholar
• Grierson LEM, Mercuri M, Brailovsky C, Cole G, Abrahams C, Archibald D, Bandiera G, Phillips SP, Stirrett G, Walton JM, et al. 2017. Admission factors associated with international medical graduate certification success: a collaborative retrospective review of postgraduate medical education programs in Ontario. CMAJ Open. 5(4):E785–E790. 24 doi: 10.9778/cmajo.20170073.
   PubMedGoogle Scholar
• Han M, Hamstra SJ, Hogan SO, Holmboe E, Harris K, Wallen E, Hickson G, Terhune KP, Brady DW, Trock B, et al. 2023. Trainee physician milestone ratings and patient complaints in early posttraining practice. JAMA Netw Open. 6(4):e23758. 3 doi: 10.1001/jamanetworkopen.2023.7588.
   Web of Science ®Google Scholar
• Hodges BD, Kuper A. 2012. Theory and practice in the design and conduct of graduate medical education. Acad Med. 87(1):25–33. doi: 10.1097/ACM.0b013e318238e069.
   PubMed Web of Science ®Google Scholar
• Ibrahim SA, Charlson ME, Neill DB. 2020. Big data analytics and the struggle for equity in health care: the promise and perils. Health Equity. 4(1):99–101. doi: 10.1089/heq.2019.0112.
   PubMedGoogle Scholar
• Jerant A, Fancher T, Fenton JJ, Fiscella K, Sousa F, Franks P, Henderson M. 2015. How medical school applicant race, ethnicity, and socioeconomic status relate to multiple mini-interview-based admissions outcomes: findings from one medical school. Acad Med. 90(12):1667–1674. doi: 10.1097/ACM.0000000000000766.
   PubMed Web of Science ®Google Scholar
• Jerant A, Fancher T, Henderson MC, Griffin EJ, Hall TR, Kelly CJ, Peterson EM, Franks P. 2021. Associations of postbaccalaureate coursework with underrepresented race/ethnicity, academic performance, and primary care training among matriculants at five California medical schools. J Health Care Poor Underserved. 32(2):971–986. doi: 10.1353/hpu.2021.0075.
   PubMed Web of Science ®Google Scholar
• Kalkman S, Mostert M, Gerlinger C, van Delden JJM, van Thiel GJMW. 2019. Responsible data sharing in international health research: a systematic review of principles and norms. BMC Med Ethics. 20(1):21. doi: 10.1186/s12910-019-0359-9.
   PubMed Web of Science ®Google Scholar
• Kalkman S, Mostert M, Udo-Beauvisage N, van Delden JJ, van Thiel GJ. 2019. Responsible data sharing in a big data-driven translational research platform: lessons learned. BMC Med Inform Decis Mak. 19(1):283. doi: 10.1186/s12911-019-1001-y.
   PubMed Web of Science ®Google Scholar
• Kalkman S, van Delden J, Banerjee A, Tyl B, Mostert M, van Thiel G. 2022. Patients’ and public views and attitudes towards the sharing of health data for research: a narrative review of the empirical evidence. J Med Ethics. 48(1):3–13. doi: 10.1136/medethics-2019-105651.
   PubMed Web of Science ®Google Scholar
• Knight S, Buckingham S. 2017. Theory and learning analytics. In: Lang C, Siemens AF, Wise AF, et al., editors. Handbook of learning analytics. Society for Learning Analytics Research. SoLAR, Vancouver, BC. doi: 10.18608/hla22.
   Google Scholar
• Krieger N. 2020. Measures of racism, sexism, heterosexism, and gender binarism for health equity research: from structural injustice to embodied harm—an ecosocial analysis. Annu Rev Public Health. 41(1):37–62. doi: 10.1146/annurev-publhealth-040119-094017.
   PubMed Web of Science ®Google Scholar
• Kush RD, Warzel D, Kush MA, Sherman A, Navarro EA, Fitzmartin R, Pétavy F, Galvez J, Becnel LB, Zhou FL, et al. 2020. FAIR data sharing: the roles of common data elements and harmonization. J Biomed Inform. 107:103421. doi: 10.1016/j.jbi.2020.103421.
   PubMed Web of Science ®Google Scholar
• Lawrence N. 2017. Data readiness levels. arXiv:1705.02245.
   Google Scholar
• Lefaivre S, Behan B, Vaccarino A, Evans K, Dharsee M, Gee T, Dafnas C, Mikkelsen T, Theriault E. 2019. Big data needs big governance: best practices from Brain-CODE, the Ontario-Brain Institute’s neuroinformatics platform. Front Genet. 10:191. doi: 10.3389/fgene.2019.00191.
   PubMed Web of Science ®Google Scholar
• Levin MA, Wanderer JP, Ehrenfeld JM. 2015. Data, big data, and metadata in anesthesiology. Anesth Analg. 121(6):1661–1667. doi: 10.1213/ANE.0000000000000716.
   PubMed Web of Science ®Google Scholar
• Luan H, Tsai CC. 2021. A review of using machine learning approaches for precision education. Educ Technol Soc. 24(1):250–266.
   Web of Science ®Google Scholar
• Markus ML, Topi H. 2015. Big data, big decisions for science, society, and business. Arlington (VA): National Science Foundation.
   Google Scholar
• Masters K, Taylor D, Loda T, Herrmann-Werner A. 2022. AMEE Guide to ethical teaching in online medical education: AMEE Guide No. 146. Med Teach. 44(11):1194–1208. doi: 10.1080/0142159X.2022.2057286.
   PubMed Web of Science ®Google Scholar
• Masters K. 2019. Artificial intelligence in medical education. Med Teach. 41(9):976–980. doi: 10.1080/0142159X.2019.1595557.
   PubMed Web of Science ®Google Scholar
• Mazzocchi F. 2015. Could big data be the end of theory in science? A few remarks on the epistemology of data-driven science. EMBO Rep. 16(10):1250–1255. Oct doi: 10.15252/embr.201541001.
   PubMed Web of Science ®Google Scholar
• McGaghie WC. 2010. Medical education research as translational science. Sci Transl Med. 2(19):19cm8. doi: 10.1126/scitranslmed.3000679.
   PubMed Web of Science ®Google Scholar
• Metcalf J, Crawford K. 2016. Where. are human subjects in big data research? The emerging ethics divide. Big Data Soc. 3(1):205395171665021. doi: 10.1177/2053951716650211.
   Web of Science ®Google Scholar
• Mihailescu M, Neiterman EA. 2019. A scoping review of the literature on the current mental health status of physicians and physicians-in-training in North America. BMC Public Health. 19(1):1363. doi: 10.1186/s12889-019-7661-9.
   PubMed Web of Science ®Google Scholar
• Norcini JJ, Boulet JR, Opalek A, Dauphinee WD. 2020. Specialty board certification rate as an outcome metric for GME training institutions: a relationship with quality of care. Eval Health Prof. 43(3):143–148. doi: 10.1177/0163278718796128.
   PubMed Web of Science ®Google Scholar
• Nundy S, Cooper LA, Mate KS. 2022. The quintuple aim for health care improvement: a new imperative to advance health equity. JAMA. 327(6):521–522. doi: 10.1001/jama.2021.25181.
   PubMed Web of Science ®Google Scholar
• O’Neil C. 2016. Weapons of math destruction: how big data increases inequality and threatens democracy. New York (NY): Crown Publishing Group.
   Google Scholar
• O'Mara DA, Canny BJ, Rothnie IP, Wilson IG, Barnard J, Davies L. 2015. The Australian Medical Schools Assessment Collaboration: benchmarking the preclinical performance of medical students. Med J Aust. 202(2):95–98. doi: 10.5694/mja14.00772.
   PubMed Web of Science ®Google Scholar
• Ona FF, Amutah-Onukagha NN, Asemamaw R, Schlaff AL. 2020. Struggles and tensions in antiracism education in medical school: lessons learned. Acad Med. 95:S163–S168. doi: 10.1097/ACM.0000000000003696.
   PubMed Web of Science ®Google Scholar
• Piwowar HA, Becich MJ, Bilofsky H, Crowley RS, on behalf of the caBIG Data Sharing and Intellectual Capital Workspace. 2008. Towards a data sharing culture: recommendations for leadership from academic health centers. PLoS Med. 5(9):e183. doi: 10.1371/journal.pmed.0050183.
   PubMed Web of Science ®Google Scholar
• Polanin J, Terzian M. 2018. A data-sharing agreement helps to increase researchers’ willingness to share primary data: results from a randomized controlled trial. J Clin Epidemiol. 106:60–69. doi: 10.1016/j.jclinepi.2018.10.006.
   PubMed Web of Science ®Google Scholar
• Pusic MV, Birnbaum RJ, Thoma B, Hamstra SJ, Cavalcanti RB, Warm EJ, Janssen A, Shaw T. 2023. Frameworks for integrating learning analytics with the electronic health record. J Contin Educ Health Prof. 43(1):52–59. doi: 10.1097/CEH.0000000000000444.
   PubMed Web of Science ®Google Scholar
• Regan PM, Jesse M. 2019. Ethical challenges of edtech, big data and personalized learning: twenty-first century student sorting and tracking. Ethics Inf Technol. 21(3):167–179. doi: 10.1007/s10676-018-9492-2.
   Web of Science ®Google Scholar
• Reiter HI, Lockyer J, Ziola B, Courneya CA, Eva K, Canadian Multiple Mini-Interview Research Alliance (CaMMIRA). 2012. Should efforts in favor of medical student diversity be focused during admissions or farther upstream? Acad Med. 87(4):443–448. doi: 10.1097/ACM.0b013e318248f7f3.
   PubMed Web of Science ®Google Scholar
• Riley J. 2017. Understanding metadata. Washington (DC): National Information Standards Organization; p. 23. http://www.niso.org/publications/press/UnderstandingMetadata.pdf
   Google Scholar
• Rubio DM, Schoenbaum EE, Lee LS, Schteingart DE, Marantz PR, Anderson KE, Platt LD, Baez A, Esposito K. 2010. Defining translational research: implications for training. Acad Med. 85(3):470–475. doi: 10.1097/ACM.0b013e3181ccd618.
   PubMed Web of Science ®Google Scholar
• Sander I. 2020. What is critical big data literacy and how can it be implemented? Internet Policy Rev. 9(2):1–22. doi: 10.14763/2020.2.1479.
   Web of Science ®Google Scholar
• Schumacher DJ, West DC, Schwartz A, Li S, Millstein L, Griego EC, Turner TL, Herman BE, Englander R, Hemond J, for the Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network General Pediatrics EPAs Study Group. 2020. Longitudinal assessment of resident performance using entrustable professional activities: a multi-site study. JAMA Netw Open. 3(1):e1919316. doi: 10.1001/jamanetworkopen.2019.19316.
   PubMed Web of Science ®Google Scholar
• Shaw DM. 2019. Defining data donation after death: metadata, families, directives, guardians and the route to big consent. In: The ethics of medical data donation; p. 151–159. eds. Krutzinna J & Floridi L. Springer Cham.
   Google Scholar
• Shilton K, Moss E, Gilbert SA, Bietz MJ, Fiesler C, Metcalf J, Vitak J, Zimmer M. 2021. Excavating awareness and power in data science: a manifesto for trustworthy pervasive data research. Big Data Soc. 8(2):205395172110407. doi: 10.1177/20539517211040759.
   Web of Science ®Google Scholar
• Smirnova A, Chahine S, Milani C, Schuh A, Sebok-Syer SS, Swartz JL, Wilhite JA, Kalet A, Durning SJ, Lombarts KMJMH, et al. 2023. Using resident-sensitive quality measures derived from electronic health record data to assess residents’ performance in pediatric emergency medicine. Acad Med. 98(3):367–375. doi: 10.1097/ACM.0000000000005084.
   PubMed Web of Science ®Google Scholar
• Smith BK, Yamazaki K, Tekian A, Holmboe E, Hamstra SJ, Mitchell EL, Park YS. 2021. The use of learning analytics to enable detection of underperforming trainees: an analysis of National Vascular Surgery Trainee ACGME Milestones Assessment Data. Ann Surg. 277(4):e971–e977. doi: 10.1097/SLA.0000000000005243.
   PubMed Web of Science ®Google Scholar
• Someh I, Davern M, Breidbach CF, Shanks G. 2019. Ethical issues in big data analytics: a stakeholder perspective. Commun Assoc Inform Syst. 44(1):718–747. doi: 10.17705/1CAIS.04434.
   Google Scholar
• Statistics Canada. 2022. [accessed 2022 Jul 31]. https://www150.statcan.gc.ca/n1/pub/75-202-x/2009000/know-savoir-eng.htm.
   Google Scholar
• Sweet LE, Moulaison LH. 2013. Electronic health records data and metadata: challenges for big data in the United States. Big Data. 1(4):245–251. doi: 10.1089/big.2013.0023.
   PubMed Web of Science ®Google Scholar
• Tamblyn R, Abrahamowicz M, Dauphinee D, Wenghofer E, Jacques A, Klass D, Smee S, Blackmore D, Winslade N, Girard N, et al. 2007. Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities. JAMA. 298(9):993–1001. doi: 10.1001/jama.298.9.993.
   PubMed Web of Science ®Google Scholar
• Te Māori Data Sovereignty Network Te Mana Raraunga. 2022. [accessed 2022 Aug 1]. https://www.temanararaunga.maori.nz/#:∼:text=The%20purpose%20of%20Te%20Mana,can%20be%20safeguarded%20and%20protected.
   Google Scholar
• ten Cate O, Dahdal S, Lambert T, Neubauer F, Pless A, Pohlmann PF, van Rijen H, Gurtner C. 2020. Ten caveats of learning analytics in health professions education: a consumer’s perspective. Med Teach. 42(6):673–678. doi: 10.1080/0142159X.2020.1733505.
   PubMed Web of Science ®Google Scholar
• The First Nations Information Governance Centre. 2014. Ownership, Control, Access and Possession (OCAP™): the path to first nations information governance. Ottawa: The First Nations Information Governance Centre.
   Google Scholar
• Thelen AE, George BC, Burkhardt JC, Khamees D, Haas MR, Weinstein D. 2023. Improving graduate medical education by aggregating data across the medical education continuum. Acad Med. 4:10–97. doi: 10.1097/ACM.0000000000005313.
   Google Scholar
• Thoma B, Ellaway RH, Chan TM. 2021. From Utopia through dystopia: charting a course for learning analytics in competency-based medical education. Acad Med. 96(7S):S89–S95. 1 doi: 10.1097/ACM.0000000000004092.
   PubMed Web of Science ®Google Scholar
• Tolsgaard MG, Boscardin CK, Park YS, Cuddy MM, Sebok-Syer SS. 2020. The role of data science and machine learning in health professions education: practical applications, theoretical contributions, and epistemic beliefs. Adv Health Sci Educ Theory Pract. 25(5):1057–1086. doi: 10.1007/s10459-020-10009-8.
   PubMed Web of Science ®Google Scholar
• Tolsgaard MG, Pusic MV, Sebok-Syer SS, Gin B, Svendsen MB, Syer MD, Brydges R, Cuddy MM, Boscardin CK. 2023. The fundamentals of artificial intelligence in medical education research: AMEE Guide No. 156. Med Teach. 45(6):565–573. doi: 10.1080/0142159X.2023.2180340.
   PubMed Web of Science ®Google Scholar
• Triola MM, Pusic MV. 2012. The education data warehouse: a transformative tool for health education research. J Grad Med Educ. 4(1):113–115. doi: 10.4300/JGME-D-11-00312.1.
   PubMedGoogle Scholar
• Vellinga A, Cormican M, Hanahoe B, Bennett K, Murphy AW. 2011. Opt-out as an acceptable method of obtaining consent in medical research: a short report. BMC Med Res Methodol. 11(1):40. doi: 10.1186/1471-2288-11-40.
   PubMed Web of Science ®Google Scholar
• Walter M, Lovett R, Maher B, Williamson B, Prehn J, Gawaian B, Lee V. 2021. Indigenous data sovereignty in the era of big data and open data. Aust J Social Issues. 56(2):143–156. doi: 10.1002/ajs4.141.
   Web of Science ®Google Scholar
• Wenghofer E, Klass D, Abrahamowicz M, Dauphinee D, Jacques A, Smee S, Blackmore D, Winslade N, Reidel K, Bartman I, et al. 2009. Doctor scores on national qualifying examinations predict quality of care in future practice. Med Educ. 43(12):1166–1173. doi: 10.1111/j.1365-2923.2009.03534.x.
   PubMed Web of Science ®Google Scholar
• Wenghofer EF, Hogenbirk JC, Timony PE. 2017. Impact of the rural pipeline in medical education: practice locations of recently graduated family physicians in Ontario. Hum Resour Health. 15(1):16. doi: 10.1186/s12960-017-0191-6.
   PubMedGoogle Scholar
• Wesson P, Hswen Y, Valdes G, Stojanovski K, Handley MA. 2022. Risks and opportunities to ensure equity in the application of big data research in public health. Annu Rev Public Health. 43(1):59–78. doi: 10.1146/annurev-publhealth-051920-110928.
   PubMedGoogle Scholar
• West CP, Dyrbye LN, Erwin PJ, Shanafelt TD. 2016. Interventions to prevent and reduce physician burnout: a systematic review and meta-analysis. Lancet. 388(10057):2272–2281. doi: 10.1016/S0140-6736(16)31279-X.
   PubMed Web of Science ®Google Scholar
• Whitehead CR, Hodges BD, Austin Z. 2013. Captive on a carousel: discourses of 'new’ in medical education 1910–2010. Adv Health Sci Educ Theory Pract. 18(4):755–768. doi: 10.1007/s10459-012-9414-8.
   PubMed Web of Science ®Google Scholar
• Wilhite JA, Altshuler L, Zabar S, Gillespie C, Kalet A. 2020. Development and maintenance of a medical education research registry. BMC Med Educ. 20(1):199. doi: 10.1186/s12909-020-02113-5.
   PubMed Web of Science ®Google Scholar
• Wise AF, Shaffer DW. 2015. Why theory matters more than ever in the age of big data. Learn Anal. 2(2):5–13. doi: 10.18608/jla.2015.22.2.
   Google Scholar
• Wise AF, Vytasek J. 2017. Handbook of learning analytics. Society for Learning Analytics Research. SoLAR Vancouber BC.
   Google Scholar
• Yang CC, Chen IY, Ogata H. 2021. Toward precision education. Educ Technol Soc. 24(1):152–163.
   Google Scholar