3,978
Views
3
CrossRef citations to date
0
Altmetric
Observations; SERIES: Philosophy in Medical Education; Action Editor: Mario Veen, PhD, Erasmus Medical Centre Rotterdam

A Matter of Trust: Online Proctored Exams and the Integration of Technologies of Assessment in Medical Education

ORCID Icon & ORCID Icon
Pages 444-453 | Received 18 Mar 2021, Accepted 14 Feb 2022, Published online: 25 Apr 2022

Abstract

Issue: Technology is pervasive in medicine, but we too rarely examine how it shapes assessment, learning, knowledge, and performance. Cultures of assessment also shape identities, social relations, and the knowledge and behavior recognized as legitimate by a profession. Therefore, the combination of technology and assessment within medical education is worthy of review. Online proctoring services have become more prevalent during the Covid-19 pandemic, as a means of continuing high-stakes invigilated examinations online. With criticisms about increased surveillance, discrimination, and the outsourcing of control to commercial vendors, is this simply “moving exams online”, or are there more serious implications? What can this extreme example tell us about how our technologies of assessment influence relationships between trainees and medical education institutions? Evidence: We combine postdigital and postphenomenology approaches to analyze the written component of the 2020 online proctored United Kingdom Royal College of Physicians (MRCP) membership exam. We examine the scripts, norms, and trust relations produced through this example of online proctoring, and then locate them in historical and economic contexts. We find that the proctoring service projects a false objectivity that is undermined by the tight script with which examinees must comply in an intensified norm of surveillance, and by the interpretation of digital data by unseen human proctors. Nonetheless, such proctoring services are promoted by an image of data-driven innovation, a rhetoric of necessity in response to a growing problem of online cheating, and an aversion, within medical education institutions, to changing assessment formats (and thus the need to accept different forms of knowledge as legitimate). Implications: The use of online proctoring technology by medical education institutions intensifies established norms, already present within examinations, of surveillance and distrust. Moreover, it exacerbates tensions between conflicting agendas of commercialization, accountability, and the education of trustworthy professionals. Our analysis provides an example of why it is important to stop and consider the holistic implications of introducing technological “solutions”, and to interrogate the intersection of technology and assessment practices in relation to the wider goals of medical education.

Introduction: the technology of assessment

Technology is pervasive in medicine and medical education. Respiratory monitors, mobile phones, digital patient records, social media, and digital education platforms have all changed knowledge, practice, and relationships.Citation1–4 Technologies have reshaped professional roles and specialisms such as radiology and pharmacy.Citation5 Alongside the many benefits, there are also risks. Technology changes more than how we work and learn; it also influences our wider moral relations, beliefs, norms and values.Citation6,Citation7 As educators negotiate new technologies, they are confronted not only with technical challenges but also highly-complex, moral, and pedagogical ones.Citation5 Despite this, technology often goes unexamined by those who use it,Citation8 or our understanding is limited to questions about individual interactions, experiences, learning, and outcomes.Citation9

Cultures of assessment also shape identities, social relations, and the legitimate knowledge and behavior recognized by a profession.Citation10–13 Assessment practice and culture have, in turn, been shaped over time by technologies such as rubrics, mark sheets, virtual learning environments, and plagiarism detection software.Citation14 Hodges,Citation15 speculating on future directions of technology in assessment, warns of an intensification of performativity in high stakes examinations through surveillance and automated judgements. Thus far, research on assessment technologies (and assessment more generally)Citation13 has focused on individual outcomes, framed around neutral and objective tools, rather than issues of equity, ethics, or values.Citation16

One technology worth investigating is online proctoring—a service that creates invigilated examination conditions outside of the exam hall.Citation17 Such services existed before the Covid-19 pandemic, but their use increased significantly in 2020 as institutions sought continuity of secure assessment.Citation18 While exam halls still represent the standard to which it aspires, online proctoring has been positioned as an alternative to “not being able to run exams at all”.Citation18(p8) Across a variety of services,Citation19 a combination of regular software updates and data-driven approaches produces a sense of innovationCitation18,Citation20 which, along with efficiency, is a key factor in technology adoption in assessment.Citation21 However, proctoring has been criticized as introducing new risks around learner privacy, foregrounding distrust,Citation18 discriminating against nonwhite and disabled people, and misusing data.Citation22

Research on online proctoring is just emerging. Reviews of the field often rely on journalistic sources,Citation18,Citation23,Citation24 and few studies have adopted critical approaches. Coghlin et al.Citation24 raise concerns about increasing distrust toward institutions and an acceleration of surveillance and control. Lee and FanguyCitation25 apply Foucault’s “disciplinary governmentality”Citation26 to online proctoring at a South Korean university. They propose that surveillance constrains possibilities for thinking and behavior, and positions students as opponents in an atmosphere of competition. In Australia, Selwyn et al. analyze interviews, documents, and media to critically examine relations between universities, proctoring companies, and students.Citation18 Alongside surveillance, they question “the surrender of control to commercial providers”, and the need for teachers to subvert the technology to maintain their educational values.

In medical education, online proctoring has not yet been subject to critical research. This is worrying, given medicine’s emphasis on cultivating practitioners with integrity and professionalism. The technologized process of proctoring may reassure medical schools, employers, and the public that results are fair and objective.Citation25 However, while “all forms of examination are surveillance”,Citation15(p3) and while normative conceptions of trust, professionalism, and knowledge were already embedded within traditional assessment practice in medical education,Citation27,Citation28 it is important to consider whether something more is going on than simply “moving exams online”.

In this paper, we follow Veen and Ciancolo’sCitation29 suggestion to slow down, consider context, and reflect on the interplay between assessment technology and culture in medical education, and the kinds of knowledge and professional identity they promote. We combine postdigital and postphenomenology approaches to analyze the 2020 online proctored United Kingdoml College of Physicians (MRCP) membership exam. We examine the scripts, norms, and trust relations produced through this example of online proctoring, and locate them in historical and economic contexts. Through this, we consider what is valued in terms of knowledge, professionalism, and relations between trainees and medical education institutions, before drawing out implications for the integration of technologies of assessment in medical education.

Theoretical framework: combining the postdigital and postphenomenological

While medical education research has been largely preoccupied with individualism, and the treatment of knowledge as “private capital”,Citation30(p849) some have employed more complex frameworks to examine technology within medical education. Body pedagogicsCitation3 considers learning and practising as embodied processes that occur in interaction with the material environment (which includes technologies). Activity theory,Citation31,Citation32 practice theory,Citation33 and other sociomaterial approachesCitation34 have helped us see how technology and people act together, in particular situations, such that neither can be understood in isolation. Such work focuses primarily on practice settings, and has not yet, to our knowledge, been used to examine assessment technology in medical education.

An emerging perspective for interrogating the complex entanglements of digital technology is that of the “postdigital”.Citation35,Citation36 Related to sociomaterial understandings of technology, it asserts that anything “digital” must be understood as embedded in a broader context. Outcomes of technology are contingent on the methods by which it is used, and the purposes, values, and contexts of multiple stakeholders.Citation37 Further, encounters with digital activity are embodied and emergent. Online exams take place in physical settings with physical bodies, and there can be no straightforward online versions of traditional educational practices.Citation35,Citation38,Citation39 Online proctored exams inevitably involve a different reality from the exam hall, albeit with some commonalities.Citation40 To augment this broader perspective, we first employ a postphenomenology of technology approach,Citation41–44 for a closer interrogation of the human-technology relations (behavioral scripts, social norms, and trust relations) promoted by an instance of proctoring technology. We then zoom out to consider how the assessment reality created by this technology is embedded in historical, political, pedagogical, and economic contexts, and what this means for relationships between trainees, institutions, and cultures of assessment technology.

Both postdigital and postphenomenological perspectives reject the idea that reality is based on human, subjective interpretation and action alone. We do not fully determine the world around us. On the other hand, both perspectives also criticize the view that reality is just “out there” and we can know it objectively. The world around us does not fully determine us. Conversely, both perspectives emphasize that “reality arises in relations, as do the humans who encounter it”,Citation43(p568) and technology has a role in shaping these relations.

Online proctored exams

Online proctoring creates a remote version of exam-hall conditions by monitoring and constraining possibilities for action and movement. The technology verifies each candidate’s identity, and that they are alone and isolated from resources that could aid their performance. Wearing earplugs or handling textbooks or mobile devices may be considered a “serious breach of exam protocol”.Citation45(p5) Some services require exam-takers to install software on their device to block access to documents, applications, and websites. Authentication normally requires permission for the software to control webcams and microphones, which monitor the environment during the examination. Other data can include keyboard strokes, network traffic, and computer memory usage.Citation17 Monitoring can be live or retrospective via recordings, or both, and may involve an algorithm, or a human who is unknown to, and unseen by, the student. Before the exam, candidates must scan the examination space (often a bedroom, kitchen, or other private space within their home) with their webcams.

A recent example of high-stakes online proctoring is the United Kingdom’s Royal College of Physicians (MRCP) membership exam. This two-part exam acts as a gateway into specialist training.Citation46 It is “the largest high stakes postgraduate clinical examination in the world” with “5000 candidates examined each year”.Citation47(p2) Part One is an introductory, written examination. Part Two is more advanced, consisting of two, three-hour written exams, both sat on the same day. Finally, there is the Practical Assessment of Clinical Examination Skills (PACES). In 2020, MRCP offered the option of remote examination using different invigilation services for the different components. According to the MRCP guidance, proctoring would be performed “by a specialist provider” who would “be monitoring your activity throughout the exam, just as they would in a face to face exam encounter.”Citation45(p5)

In this paper, we limit our analysis to the written element in Part Two of the MRCP exam, excluding the practical component. While there are obvious concerns about the capacity for online proctoring to create equivalent assessment environments for demonstrating clinical skills, limiting our scope allows us to focus on how the technology creates constrained physical environments even for written assessments. In 2020, Part Two of the MRCP membership exam used the ProctorExam service. Examinees were required to choose a quiet location where they were “guaranteed” not be disturbed.Citation45 The exam space needed to be well lit and have reliable WiFi. Requirements included a laptop with webcam and microphone, Google Chrome browser, and a minimum Internet speed. ProctorExam did not measure eye movements or keystrokes, but prided itself as a “leader” in adding extra cameras (e.g. the candidate’s smartphone) for additional “accuracy”.Citation48 Screen and camera footage was recorded for “internal use” and not made available to candidates or examiners.Citation45

Human proctors (either ProctorExam or institutional employees) watched the candidates, to ensure they started at the correct time and to provide assistance when needed (e.g. where candidates felt unwell or needed the bathroom). Moreover, they ensured that the exam environment was secure. This supportive framework underplayed the primary function, which was to flag abnormal behavior as potential cheating. In such cases, the medical education institution would have the final say on any action taken. Proctors were not visible to candidates; communication occurred via text chat. Candidates had to remain seated at their computer until the end of the allocated time, even if they had finished earlier.Citation45

Postphenomology of proctoring: how technology creates reality

Postphenomenology, as developed by IhdeCitation41 and Verbeek,Citation42 challenges the idea that technology is an instrument designed with a certain purpose that simply does what we intend it to do.Citation49 Instead, technology mediates relations between human and world in non-neutral ways.Citation50 With this lens, we scrutinize how technology offers users particular scripts that shape how they can act in the world, and how technology presents the world to them.

Scripts and norms

Technological objects have a script, that is an “inclination or trajectory that shapes the ways in which they are used.”Citation43(p569) For example, fountain pens require us to think ahead and compose sentences before writing them down, while word processors invoke quick, flexible writing that mimics speech. One can write slowly and quickly with either, but each promotes a certain type of use while discouraging others.Citation43,Citation51 Moreover, technologies are socially embedded and shape cultural norms. Early ballpoint pens were thought to impair children’s quality of work by eliciting quicker, sloppy writing, whereas fountain pens were seen as producing neat and careful work.Citation43

In online proctoring, examinees behavior is governed by the technology’s surveillance function. ProctorExam claims to provide a pure context, with greater security and accuracy, through their multi-camera solution.Citation48 Purity of context is, however, undermined by the strict control of examinees’ behavior, and by the inevitable interpretation by examiners.Citation51 In exam halls, candidates only need to purify their person (e.g. by excluding prohibited notes or devices); in online proctoring, they must purify their whole environment and range of bodily movement.

Thus, although exam hall invigilation also involves surveillance and interpretation of behavior (e.g. does looking toward a neighbor imply cheating or mind-wandering?), there are important differences. Firstly, whereas in the exam hall, (potential) cheating is framed as looking at prohibited resources, or speaking to other candidates, in online proctoring it is framed more widely: looking away from the screen, moving in an atypical fashion, unsanctioned use of the device being used for exam-taking, poor Internet connectivity, other technical issues, someone entering the room, etc. While many students do not seem to experience online proctoring as overly intrusive, and some forget about being watched or become apathetic to it,Citation18 strict monitoring of bodily movements, nonetheless, compels them to conform to an ideal model of an examinee.Citation22,Citation27

Secondly, in online proctoring, there is a variety of behavioral data (e.g. eye-movement, keystrokes, video feeds), and each represents a digitized slice of the test world. These data cannot directly confirm whether behavior is inappropriate. Proctors must “read” the benchmarks that indicate cheating, and examinees are encouraged by the technology to adapt to these standards. Thirdly, candidates cannot see online proctors, and neither they, nor their assessors, have access to how the software works, disrupting normal trust relations of exam hall invigilation.Citation24,Citation25 Examinees are at a disadvantage, since their behavior is minutely recorded, while their understanding of what proctors do and observe is nearly absent.

Trust

Online proctoring technology intensifies norms of surveillance over trust by enforcing stricter protocols, while also conveying a false sense of objectivity. Technology becomes transparent to us when we use it (as with proctored examinees who forget they are watched).Citation18,Citation43,Citation50 We expect pens to write, Google to yield search results and proctor technology to identify cheaters. Nguyen applies the concept of trust, not only to relations between people, but also to those (technological) objects that we trust constantly.Citation52 To cope with an overwhelming world that poses demands beyond our physical and cognitive limitations, we outsource agency to human others, animals, and objects.Citation52 We may outsource our sight to a guide dog, the education of our children to teachers, and exam surveillance to proctor technologies. In each case, trust implies an unquestioning attitude to the technology’s reliability. Consider a novice mountaineer, who requires training to forget their rope,Citation52 trusting it to stop them from falling, so that they can direct their precious attention elsewhere. The technology is no longer visible, or has become transparent. To work effectively with proctoring technology, examinees must learn to trust it not to flag them inappropriately, while examiners must trust it to appropriately detect cheating.

While multiple video feeds seemingly create objectivity for proctors, for examinees, the assessment is located in a highly-contrived reality in which their bodies are constrained, monitored, and controlled by external forces, in more detail than in exam halls. Breakdowns of transparency are provoked by notifications and warnings produced by the software when a candidate engages in potentially suspicious behavior (e.g. looking in the wrong place or moving in the wrong way). These forces are conveyed by proctoring companies as benevolent or neutral, but their primary function is enforcing constraint and reporting subversion through the minute technological scripting of movement and environment.

A postdigital view of online proctoring

We have argued that online proctoring involves a tighter script and more interpretation than exam hall invigilation. In this section, we broaden our postdigital view to zoom out and investigate the historical and economic contexts and assessment cultures in which the MRCP exam is located.

Historical context

Online proctoring is interpreted through a lens colored by the historical context of traditional examination settings. As CarlessCitation53 argues, we trust exams, in part, due to their long tradition. They “represent continuity and stability, whilst other more innovative forms of assessment may be seen as risk-taking.” Citation53(p82) Further, equivalence between online and traditional exams is necessary for comparing candidates over time.

To reassure its customers, online proctoring mimics a preexisting distrust within the “established logics of university study” through which “students are placed in disempowered surveilled positions during any examination setting.”Citation18(p13) This mimicry of traditional invigilation practices is explicit in the MRCP guidance. It frames online proctors as working “just as they would in a face to face exam encounter”.Citation45(p5)

However, our case involved invisible online proctors, multiple cameras, control of shared environments, partnerships with 3rd party companies, and more. Further, while ProctorExam’s datafication of behavior echoes the quantification of knowledge through exams, and a tradition of seeing numbers as more objective than other forms of information,Citation20,Citation54 it is also part of an increasing trend of big data and algorithmically adjudicated truth.Citation20 With data-driven processes and constantly updating software, ProctorExam is imbued with a sense of relentless innovation,Citation18 while also being perceived as a lower-risk practice of continuity.

Economic context

As a commercial product, proctoring technology must create value. First, it frames medical schools as clients, inserting itself into the relationship between assessors and students.Citation18,Citation48 Having spent considerable money, the medical school is invested in the system, and it is in its interests for the technology to be perceived as a success. Moreover, it would be expensive and complicated to change to a different assessment format that did not require proctoring.Citation18 This incentivises decision-makers to defend the technology against critiques, and to continue using it.

Second, proctoring technology frames students as potential cheaters and, therefore, as threats to the academic integrity of the medical school and the medical profession.Citation25 This is important for commercial sustainability, since the software is only necessary if people cheat.

Third, it also frames students as clients through its rhetoric of fairness and support. Online proctors are there to “assist you with any issues … They will not be visible on your screen but will be available should you need to alert them to a problem.”Citation45(p13) Hard-working, non-cheating students can be reassured that they are not disadvantaged by the cheating of others.Citation24,Citation25 Finally, the technology’s perceived effectiveness is also contingent on students as sources that generate data,Citation55 with no choice but to comply if they want to pass the exam.

Assessment culture

Assessment has a powerful influence over what and how students learn, and over what is valued within education systemsCitation13 and professional disciplines.Citation10,Citation56 Exams, for example, value “objective” knowledge, and constrain possibilities for demonstrating and validating other kinds of knowledge.Citation10 All invigilation is aimed at creating an environment for fair assessment of performance, based on standardization and equality of experience.Citation57 Yet preventing access to external resources and controlling bodily behavior prioritizes individualized, abstract, and propositional knowledgeCitation58 at the expense of embodied, social, material and collective knowledge on which trust, relationships, and teamwork are founded.Citation59 It marginalizes critical or creative knowledge and inhibits the development of future autonomous practitioners.Citation10

What was already a narrow view of knowledge is further tightened through online proctoring. In exam halls, all candidates perform in the same physical location, and are allowed only a highly-restricted set of materials. In online proctored exams, anyone not considered by the technology to conform to its model of how a student should behave, move, or look during an exam is associated with signifiers of a lack of integrity. The restriction of gaze and movement to a single digital interface is a strong commitment to the denial of material, non-cognitive knowledge and of diverse bodily characteristics and conditions. This is harder for some than others, and there are reports of online proctoring services discriminating against candidates in relation to gender, race, disability, language, culture, and more.Citation22,Citation24,Citation55 These, along with other circumstantial disadvantages (e.g. those with shared living spaces, caring responsibilities, limited technological resources, or physical challenges) are at odds with fair and objective assessment.

Discussion

Integrity, professionalism, and surveillance

In exams, definitive answers, the exclusion of resources, and behavioral control close down possibilities of being, thinking, knowing, and acting.Citation11 Further, “objective” assessment requires breaking ability down into standardized and decontextualized knowledge at the potential expense of collective, collaborative, and complex professional performance.Citation59–61 In online proctoring, the flexibility of enabling trainees to take exams from home increases the requirements of rules and surveillance. We have argued that this intensifies existing problematic framings of examinees, trust, and knowledge, in which more authentic or meaningful forms of assessment are sacrificed in the name of “fairness.”Citation25

In the 2020 MRCP exam, online proctoring may also have exacerbated existing forms of discrimination by heightening performativity, through which learners contort themselves to portray an imagined ideal candidate.Citation15 Surveillance in assessment is part of a broader process of normalization, through which “techniques of objectification… are constantly used to evaluate and control us because they exclude those who cannot conform to ‘normal’ categories.”Citation27(p445) Despite claims like the UK General Medical Council’s that “equality, diversity and inclusion are integral to our work as a regulator,”Citation62(p3) students may feel they need to amplify, sanitize, or suppress their ethnicity, “gender, sexuality, culture, religion, language or disability/ability.”Citation15(p3)

Further, surveillance may produce a kind of pseudo-integrity that is bound to conditions of being watched. This exacerbates a problem for exam assessment more generally, in how it prepares students to become part of and contribute to their disciplines,Citation10,Citation63 since enforced integrity is likely to be counterproductive to the development of independent professionalism.Citation64–67 Technological surveillance promotes distrust between educators and students,Citation68 and the presence of cameras implies that students are potential cheaters who must be closely watched. Proctoring companies seek to normalize coercive and invasive measures in the homes of candidates, positioning surveillance as a “necessary evil” to protect the “academic integrity” of institutions and the rights of trustworthy students to a fair examination.Citation18

It is in the commercial interest of proctoring companies to frame candidates as potential cheaters and cheating as a significant, growing, and dynamic problem,Citation69 with a technological solution.Citation18,Citation22 MRCP’s use of online proctoring as a “temporary emergency solution” follows a broader trend of technological automation and establishes “private and commercial providers as essential infrastructural intermediaries between students and their universities”.Citation55(p2)

Complex perspectives on technology in medical education

Philosophical approaches allow analyses to go beyond the usual forms of evidence, which are often limited in terms of how they address complexity.Citation11 Our broader postdigital perspective helps us see that there is no straightforward equivalence between exam halls and online proctoring. The “digital” technology of the 2020 MRCP exam was embedded in an assessment culture in ways that are entangled in a historical and economic context. The postphenomenological lens draws attention to scripts and how they shape the assessment reality. Combined, these two approaches “provide a convincing and defensible account of both the practice and its effects.”Citation33(p219) These or other complex frameworks can, and should, be applied to other applications of technology in medical education. For example, we might question the kinds of learning promoted via learning analytics,Citation35,Citation70 or what it means for on campus teaching to “move online”,Citation71 since the social and material context of online learningCitation72 is very different. In each case, the moral and ethical implications require looking beyond outcomes, terms, and conditions,Citation40 to how technology is embedded in particular cultures and practices.

Broader lessons for assessment technology in medical education

Nieminen and Lahdenperä call for research into how student agency in higher education assessment promotes or hinders future development.Citation10 Professional doctors must not only be competent but also trustworthy, and act with integrity without being monitored. Furthermore, they should be professional members of teams and wider systems. Conversely, in online proctored exams, trainees are constructed not only as potential cheaters, but also as objects of control

who cannot think for themselves, take responsibility, or create new knowledge.Citation11

It is unclear what will happen with online proctoring as the Covid-19 situation stabilizes. The challenge ahead is not simply to decide whether online proctoring tools are worthwhile,Citation73 or whether we need to soften their scripts and surveillance. While we acknowledge that exams might be effective under certain conditions, and we would not advocate letting candidates do whatever they want, we call for medical educators to ask questions about how we conduct high stakes assessment and why it is so reliant on invigilation. Our aim here is not to propose alternatives to invigilated examinations, nor that educators should avoid technology in assessment. Rather, we aim to provoke critical consideration of how the combination of technology and assessment promotes particular kinds of knowledge, identity, professionalism, and trust relations.Citation43 This is no simple task. It involves confronting a longstanding reluctance, across education more broadly, to ask fundamental questions about the purpose of assessment, how it affects educational relationships, or how it relates to “truth, fairness, trust, humanity or social justice”.Citation74(p2) A good starting point is to engage in honest dialogue around how we currently do assessment, and how we might reimagine our practices in ways that reinforce relations between trainees and medical education institutions, such that we no longer place trust in technology above trust in our students.

Conclusion

Assessment both reflects and shapes what is valued in medical education. Our analysis of the 2020 MRCP membership exam shows how online proctoring technology intensifies a norm of surveillance over trust that already exists in exam hall invigilation. This exacerbates some established tensions within the assessment culture of medical education, namely: a narrow conception of legitimate knowledge as standardized and decontextualized, a narrow model of the ideal, solitary exam candidate, and a default distrust of trainees. By examining the historical and economic contexts of the MRCP exam, we have showed how these tensions are reinforced by the commercial interests of proctoring companies that incentivise distrust and data-driven normative models of invigilation.

Veen and CiancioloCitation29(pp337-338) wrote, in the paper that launched this series, to slow down and consider context “to examine carefully what we are doing to care for learners and improve their performance, professionalism, and well-being.” While we are confident that, in general, medical educators trust students, and work hard to support them to become trustworthy, we have argued that the assessment culture promoted by online proctoring technology, and our employment of assessment technology more widely, are in need of review. If, as BearmanCitation75 suggests, the test world shapes the practice world, we must also ask: what kind of world do we generate through our use of assessment technology?

Acknowledgements

Thanks to Mario Veen for the invitation and for help along the way. Thanks also to Anna Cianciolo and two anonymous reviewers for their comments.

Previous Philosophy in Medical Education Installments

Mario Veen & Anna T. Cianciolo (2020) Problems No One Looked For: Philosophical Expeditions into Medical Education, Teaching and Learning in Medicine, 32:3, 337-344, DOI: 10.1080/10401334.2020.1748634

Gert J. J. Biesta & Marije van Braak (2020) Beyond the Medical Model: Thinking Differently about Medical Education and Medical Education Research, Teaching and Learning in Medicine, 32:4, 449-456, DOI: 10.1080/10401334.2020.1798240

Mark R. Tonelli & Robyn Bluhm (2021) Teaching Medical Epistemology within an Evidence-Based Medicine Curriculum, Teaching and Learning in Medicine, 33:1, 98-105, DOI: 10.1080/10401334.2020.1835666

John R. Skelton (2021) Language, Philosophy, and Medical Education, Teaching and Learning in Medicine, 33:2, 210-216, DOI: 10.1080/10401334.2021.1877712

Zareen Zaidi, Ian M. Partman, Cynthia R. Whitehead, Ayelet Kuper & Tasha R. Wyatt (2021) Contending with Our Racial Past in Medical Education: A Foucauldian Perspective, Teaching and Learning in Medicine, DOI: 10.1080/10401334.2021.1945929

Chris Rietmeijer & Mario Veen (2021) Phenomenological Research in Health Professions Education: Tunneling from Both Ends, Teaching and Learning in Medicine, DOI: 10.1080/10401334.2021.1971989

Madeleine Noelle Olding, Freya Rhodes, John Humm, Phoebe Ross & Catherine McGarry (2022) Black, White and Gray: Student Perspectives on Medical Humanities and Medical Education, Teaching and Learning in Medicine, 34:2, 223-233, DOI: 10.1080/10401334.2021.1982717

Camillo Coccia & Mario Veen (2022) Because We Care: A Philosophical Investigation into the Spirit of Medical Education, Teaching and Learning in Medicine, DOI: 10.1080/10401334.2022.2056744

Associated Podcast

Let Me Ask You Something (iTunes, Spotify, Google Podcasts and https://marioveen.com/letmeaskyousomething/)

Disclosure statement

No potential conflict of interest was reported by the authors.

Funding

The author(s) reported there is no funding associated with the work featured in this article.

References

  • Ebeling MFE. Patient disempowerment through the commercial access to digital health records. Health (London). 2019;23(4):385–400. doi:10.1177/1363459319848038.
  • Asan O, Smith PD, Montague E. More screen time, less face time - Implications for EHR design. J Eval Clin Pract. 2014;20(6):896–901. doi:10.1111/jep.12182.
  • Kelly M, Ellaway RH, Scherpbier A, King N, Dornan T. Body pedagogics: embodied learning for the health professions. Med Educ. 2019;53(10):967–977. doi:10.1111/medu.13916.
  • Greenhalgh T, Stones R, Swinglehurst D. Choose and Book: A sociological analysis of “ ‘resistance’ to an expert system. Soc Sci Med. 2014;104:210–219. doi:10.1016/j.socscimed.2013.12.014.
  • Ellaway RH. Medical education and the war with the machines. Med Teach. 2014;36(10):917–918. doi:10.3109/0142159X.2014.955088.
  • Swierstra T. Identifying the normative challenges posed by technology’s “soft” impacts. Etikk i praksis. Nord J Appl Ethics. 2015;9(1):5–20.
  • Kiran AH. Four dimensions of technological mediation. In: Rosenberger DI, Verbeek PP, eds. Essays on Human–Technology Relations. London: Lexington Books; 2015:123–140.
  • Hew KF, Lan M, Tang Y, Jia C, Lo CK. Where is the “theory” within the field of educational technology research? Br J Educ Technol. 2019;50(3):956–971. doi:10.1111/bjet.12770.
  • Lupton D. Critical perspectives on digital health technologies. Sociol Compass. 2014;8(12):1344–1359. doi:10.1111/soc4.12226.
  • Nieminen JH, Lahdenperä J. Assessment and epistemic (in)justice: how assessment produces knowledge and knowers. Teach High Educ. 2021. doi:10.1080/13562517.2021.1973413.
  • Biesta GJJ, van Braak M. Beyond the medical model: Thinking differently about medical education and medical education research. Teach Learn Med. 2020;32(4):449–456. doi:10.1080/10401334.2020.1798240.
  • Hodges BD. Validity and the OSCE. Med Teach. 2003;25(3):250–254. doi:10.1080/01421590310001002836.
  • Leathwood C. Assessment policy and practice in higher education: Purpose, standards and equity. Assess Eval High Educ. 2005;30(3):307–324. doi:10.1080/02602930500063876.
  • Schuwirth LWT, van der Vleuten CPM. A history of assessment in medical education. Adv Health Sci Educ Theory Pract. 2020;25(5):1045–1056. doi:10.1007/s10459-020-10003-0.
  • Hodges BD . Performance-based assessment in the 21st century: When the examiner is a machine. Perspect Med Educ. 2021;10(1):3–5. doi:10.1007/s40037-020-00647-4.
  • Thoma B, Turnquist A, Zaver F, Hall AK, Chan TM. Communication, learning and assessment: Exploring the dimensions of the digital learning environment. Med Teach. 2019;41(4):385–390. doi:10.1080/0142159X.2019.1567911.
  • Dawson P. Defending Assessment Security in a Digital World. London: Routledge; 2020. doi:10.4324/9780429324178.
  • Selwyn N, O’Neill C, Smith G, Andrejevic M, Gu X. A necessary evil? The rise of online exam proctoring in Australian universities. Media Int Aust. 2021. doi:10.1177/1329878X211005862.
  • Arnò S, Galassi A, Tommasi M, Saggino A, Vittorini P. State-of-the-art of commercial proctoring systems and their use in academic online exams. Int J Distance Educ Technol. 2021;19(2):41–62. doi:10.4018/IJDET.20210401.oa3.
  • Hodges BD. Ones and zeros: Medical education and theory in the age of intelligent machines. Med Educ. 2020;54(8):691–693. doi:10.1111/medu.14149.
  • Bennett S, Dawson P, Bearman M, Molloy E, Boud D. How technology shapes assessment design: Findings from a study of university teachers. Br J Educ Technol. 2017;48(2):672–682. doi:10.1111/bjet.12439.
  • Swauger S. Our Bodies Encoded: Algorithmic test proctoring in higher education. In: Stommel J, Friend C, Morris SM, eds. Critical Digital Pedagogy, 2020. Montreal, Quebec: Pressbooks. https://cdpcollection.pressbooks.com/. Accessed April 12, 2021.
  • Eaton SE, Turner KL. Exploring academic integrity and mental health during COVID-19: Rapid review. J Contemp Educ Theory Res. 2020;4:35–41. doi:10.5281/zenodo.4256825.
  • Coghlan S, Miller T, Paterson J. Good proctor or “big brother”? Ethics of online exam supervision technologies. Philos Technol. 2021;34(4):1581–1606. doi:10.1007/s13347-021-00476-1.
  • Lee K, Fanguy M. Online exam proctoring technologies: Educational innovation or deterioration? Br J Educ Technol. 2022. doi:10.1111/bjet.13182.
  • Foucault M. Discipline and Punish: The Birth of the Prison/Michel Foucault; Translated from the French by Alan Sheridan. Harmondsworth: Penguin; 1979.
  • Zaidi Z, Partman IM, Whitehead CR, Kuper A, Tasha R. Contending with our racial past in medical education: A foucauldian perspective. Teach Learn Med. 2021; 33(4):453–462. doi:10.1080/10401334.2021.1945929.
  • Holtman MC. A theoretical sketch of medical professionalism as a normative complex. Adv Health Sci Educ Theory Pract. 2008;13(2):233–245. doi:10.1007/s10459-008-9099-1.
  • Veen M, Cianciolo AT. Problems no one looked for: Philosophical expeditions into medical education. Teach Learn Med. 2020;32(3):337–344. doi:10.1080/10401334.2020.1748634.
  • Bleakley A. Blunting Occam’s razor: aligning medical education with studies of complexity. J Eval Clin Pract. 2010;16(4):849–855. doi:10.1111/j.1365-2753.2010.01498.x.
  • Engeström Y, Sannino A. Studies of expansive learning: Foundations, findings and future challenges. Educ Res Rev. 2010;5(1):1–24. doi:10.1016/j.edurev.2009.12.002.
  • Bleakley A. Broadening conceptions of learning in medical education: The message from teamworking. Med Educ. 2006;40(2):150–157. doi:10.1111/j.1365-2929.2005.02371.x.
  • Nicolini D. Bringing it all together: A toolkit to study and represent practice at work. In: Practice Theory, Work, and Organization: An Introduction. Oxford: Oxford University Press; 2013:213–242.
  • Fenwick T, Edwards R. Exploring the impact of digital technologies on professional responsibilities and education. Eur Educ Res J. 2016;15(1):117–131. doi:10.1177/1474904115608387.
  • Fawns T. Postdigital education in design and practice. Postdigit Sci Educ. 2019;1(1):132–145. doi:10.1007/s42438-018-0021-8.
  • Jandrić P, Knox J, Besley T, Ryberg T, Suoranta J, Hayes S. Postdigital science and education. Educ Philos Theory. 2018;50(10):893–899. doi:10.1080/00131857.2018.1454000.
  • Fawns T. An entangled pedagogy: Looking beyond the pedagogy – technology dichotomy. Postdigital Sci Educ. 2022. doi:10.1007/s42438-022-00302-7
  • Sinclair C, Macleod H. Literally Virtual: The reality of the online teacher. In: Jandrić P, Boras D, eds. Critical Learning in Digital Networks. Research in Networked Learning. Cham: Springer International Publishing; 2015:77–99. doi:10.1007/978-3-319-13752-0_5.
  • Gourlay L. There is no “Virtual Learning”: The materiality of digital education. NApprEdR. 2021;10(1):57–66. doi:10.7821/naer.2021.1.649.
  • Adams C. TPACK’s arc of technology transparency and teachers’ ethical obligations: Understanding the digital as the new materia medica of pedagogy. In: Ochoa MN, Gibson D, eds. Research Highlights in Technology and Teacher Education. Fairmont: AACE;2020:49–58. doi:10.1016/B978-0-323-02998-8.50028-7.
  • Ihde D. Preface. Positioning postphenomenology. In: Rosenberger DI, Verbeek P-P, eds. Essays on Human–Technology Relations. London: Lexington Books; 2015.
  • Verbeek P-P. Moralizing Technology. Understanding and Designing the Morality of Things. Chicago: The University of Chicago Press; 2011.
  • Verbeek P-P. Postphenomenology and technology. In: Scharff RC, Dusek V, eds. Philosophy of Technology. Chichester: Wiley; 2014:561–572.
  • Rosenberger R, Verbeek P-P. A field guide to postphenomenology. In: Rosenberger DI, Verbeek P-P, eds. Essays on Human–Technology Relations. London: Lexington Books; 2015:9–42.
  • (MRCPUK) Membership of the Royal Colleges of Physicians of the United Kingdom. Preparing for Your MRCP (UK) Part 2 Online Examination. 2020. https://www.mrcpuk.org/sites/default/files/documents/PROCTOREXAMCandidateguide.pdf.
  • (MRCPUK) Membership of the Royal Colleges of Physicians UK. MRCP(UK) examinations. 2020. https://www.mrcpuk.org/mrcpuk-examinations.
  • Verma A, Griffin A, Dacre J, Elder A. Exploring cultural and linguistic influences on clinical communication skills: A qualitative study of International Medical Graduates. BMC Med Educ. 2016;16(1):1–10. doi:10.1186/s12909-016-0680-7.
  • Haven D, Portnaar D-P. Landelijke studentenvakbond op het matje bij ProctorExam. Risk and Compliance. 2021. https://www.riskcompliance.nl/news/landelijke-studentenvakbond-op-het-matje-bij-proctorexam/.
  • Visser G. Heideggers Vraag Naar de Techniek. Amsterdam: Vantilt; 2013.
  • Verbeek P-P. Moralizing technology: On the morality of technological artifacts and their design. In: Kaplan M, ed. Readings in the Philosophy of Technology. New York: Rowman & Littlefield; 2009:265–284.
  • Ihde DA. Phenomenology of technics. In: Scharff RC, Dusek V, eds. Philosophy of Technology. Chichester: Wiley; 2014:539–560.
  • Nguyen CT. Trust as an Unquestioning Attitude. In: Oxford Studies in Epistemology. Oxford: Oxford University Press; forthcoming.
  • Carless D. Trust, distrust and their impact on assessment reform. Assess Eval High Educ. 2009;34(1):79–89. doi:10.1080/02602930801895786.
  • Pacheco JA . The “new normal” in education. Prospects (Paris). 2021;51(1-3):3–14. doi:10.1007/s11125-020-09521-x.
  • Williamson B, Hogan A. Pandemic Privatisation in Higher Education: Edtech & University Reform. Brussels: Education International; 2021.
  • McArthur J. Assessment for social justice: the role of assessment in achieving social justice. Assess Eval High Educ. 2016;41(7):967–981. doi:10.1080/02602938.2015.1053429.
  • Kaposy C. Postphenomenology of the robot medical student. In: Rosenberger DI, Verbeek P-P, eds. Essays on Human–Technology Relations. London: Lexington Books; 2015:191–202.
  • Beckett D, Hager P. Life, Work and Learning. New York: Routledge; 2005.
  • Hager P, Beckett D. The Emergence of Complexity: Rethinking Education as a Social Science. Cham: Springer; 2019.
  • Hodges BD. Assessment in the post-psychometric era: Learning to love the subjective and collective. Med Teach. 2013;35(7):564–568. doi:10.3109/0142159X.2013.789134.
  • Bleakley A, Bligh J, Browne J. Medical Education of the Future: Identity. Power and Location. New York: Springer; 2011. doi:10.1016/S0140-6736(00)70457-0.
  • General Medical Council. Outcomes for Graduates. 2018. https://www.gmc-uk.org/education/undergraduate/undergrad_outcomes.asp.
  • Fawns T, Mulherin T, Hounsell D, Aitken G. Seamful learning and professional education. Stud Contin Educ. 2021;43(3):360–376. doi:10.1080/0158037X.2021.1920383.
  • Ross J, Macleod H. Surveillance, (dis)trust and teaching with plagiarism detection technology. In: Bajić M, Dohn N, de Laat M, Jandrić P, Ryberg T, eds. 11th International Conference on Networked Learning. Zagreb: Zagreb University of Applied Sciences; 2018:235–242.
  • Ajjawi R, Molloy E, Bearman M, Rees CE. Scaling up assessment for learning in higher education. In: Carless D, ed. The Enabling Power of Assessment. Vol 5. Singapore: Springer; 2017:129–143. doi:10.1007/978-981-10-3045-1.
  • Carless D. Trust and its role in facilitating dialogic feedback. In: Boud D, Molloy E, eds. Feedback in Higher and Professional Education. London: Routledge; 2013:90–103.
  • Fawns T, Ross J. Spotlight on Alternative Assessment Methods: Alternatives to exams. Teaching Matters. 2020. https://www.teaching-matters-blog.ed.ac.uk/spotlight-on-alternative-assessment-methods-alternatives-to-exams/.
  • Darbyshire P, Thompson DR. Can nursing educators learn to trust the world’s most trusted profession? Nurs Inq. 2021;28(2). doi:10.1111/nin.12412.
  • Rapanta C, Botturi L, Goodyear P, et al. Online university teaching during and after the Covid-19 crisis: Refocusing teacher presence and learning activity. Postdigit Sci Educ. 2020;2(3):923–945. doi:10.1007/s42438-020-00155-y.
  • Knox J, Williamson B, Bayne S. Machine behaviourism: future visions of ‘learnification’ and ‘datafication’ across humans and digital technologies. Learn Media Technol. 2020;45(1):31–45. doi:10.1080/17439884.2019.1623251.
  • Fawns T, Jones D, Aitken G. Challenging assumptions about “moving online” in response to COVID-19, and some practical advice. MedEdPublish. 2020;9(1):83. doi:10.15694/mep.2020.000083.1.
  • Fawns T, Aitken G, Jones D. Online learning as embodied, socially meaningful experience. Postdigit Sci Educ. 2019;1(2):293–297. doi:10.1007/s42438-019-00048-9.
  • Nigam A, Pasricha R, Singh T, Churi P. A systematic review on AI-based proctoring systems: Past, present and future. Educ Inf Technol (Dordr). 2021;26(5):6421–6445. doi:10.1007/s10639-021-10597-x.
  • Rowntree D. Assessing Students : How Shall We Know Them? London: Kogan Page; 1987.
  • Bearman M. Bringing reality to assessment: lessons from clinical simulation. Med Educ. 2020;54(10):870–872. doi:10.1111/medu.14293.