621
Views
0
CrossRef citations to date
0
Altmetric
RESEARCH ARTICLE

Clues for improvement of research in objective structured clinical examination

ORCID Icon, , , , , , , , , , , , & show all
Article: 2370617 | Received 27 Nov 2023, Accepted 18 Jun 2024, Published online: 27 Jun 2024

ABSTRACT

While objective clinical structured examination (OSCE) is a worldwide recognized and effective method to assess clinical skills of undergraduate medical students, the latest Ottawa conference on the assessment of competences raised vigorous debates regarding the future and innovations of OSCE. This study aimed to provide a comprehensive view of the global research activity on OSCE over the past decades and to identify clues for its improvement. We performed a bibliometric and scientometric analysis of OSCE papers published until March 2024. We included a description of the overall scientific productivity, as well as an unsupervised analysis of the main topics and the international scientific collaborations. A total of 3,224 items were identified from the Scopus database. There was a sudden spike in publications, especially related to virtual/remote OSCE, from 2020 to 2024. We identified leading journals and countries in terms of number of publications and citations. A co-occurrence term network identified three main clusters corresponding to different topics of research in OSCE. Two connected clusters related to OSCE performance and reliability, and a third cluster on student’s experience, mental health (anxiety), and perception with few connections to the two previous clusters. Finally, the United States, the United Kingdom, and Canada were identified as leading countries in terms of scientific publications and collaborations in an international scientific network involving other European countries (the Netherlands, Belgium, Italy) as well as Saudi Arabia and Australia, and revealed the lack of important collaboration with Asian countries. Various avenues for improving OSCE research have been identified: i) developing remote OSCE with comparative studies between live and remote OSCE and issuing international recommendations for sharing remote OSCE between universities and countries; ii) fostering international collaborative studies with the support of key collaborating countries; iii) investigating the relationships between student performance and anxiety.

Introduction

Objective structured clinical examination (OSCE), first described in 1975 [Citation1], is an examination method dedicated to assess clinical competence in under- or post-graduate medical and allied healthcare students through a series of simulated tasks and interactions [Citation2]. Since its initial description, OSCE method has been the object of worldwide research, with leading countries in North America and the United Kingdom. Many previously published data exist regarding the reliability and validity of OSCE to discriminate students [Citation3,Citation4] as well as the determinants of students’ performances during OSCE [Citation5,Citation6]. However, only scarce studies explored student’s perception during OSCE, especially the relationship between anxiety and students’ performances during OSCE [Citation7] despite the well-known effects of anxiety on cognitive functioning [Citation8,Citation9].

Furthermore, besides the exponential increase in OSCE scientific production during the past decade, the COVID-19 pandemic led to innovations such as remote OSCE and suggested the development of international collaborations. More recently, OSCE was at the heart of a debate during the latest Ottawa Conference in 2022 on the Assessment of Competence in Medicine and the Healthcare Professions [Citation10]. Issues such as abandoning high-stakes OSCE and replacing them with some forms of workplace-based assessment (WBA) were widely discussed. These debates highlighted the need for additional research and improvement, especially regarding OSCE-related innovations such as virtual OSCE.

As previously described in many scientific disciplines [Citation11–13], bibliometric and scientometric analysis is relevant to inventory published articles and provide an analytic overview on research production in a specific field. Assessing the quantity and quality of scientific publications in OSCE may help to identify research gaps and pave the way toward future programs [Citation14–16]. To date, despite accumulating scientific production, a scientometric analysis of OSCE research production is still lacking. Guidelines for informative and publication-worthy scientometric analysis of literature reporting have been published [Citation17]. According to these guidelines, research in OSCE seems to fulfil appropriateness criteria for scientometric analysis since OSCE 1) corresponds to a mature research field with a first publication in 1979 with increasing publications, 2) covers an appropriate number of publications (i.e., more than 1,000 but not too excessive), and 3) is an unambiguous ‘medical subject heading’ for literature search.

Thus, we proposed to perform a bibliometric and scientometric analysis of research on OSCE worldwide. Our specific goal was to assess the assumption that research in OSCE is experiencing a paradigm shift towards 1) the development of remote/virtual OSCE; 2) the need for more considering student’s perception; 3) the need to develop the international scientific network conducted by leading countries such as the United States of America, the United Kingdom, and Canada.

Material and methods

Database and search strategy

We performed a literature search using Elsevier’s Scopus database for OSCE. The Scopus database was selected because it offers more coverage for citation analysis and covers a wider journal range, especially related to human social sciences, and more scientific publications compared to other databases [Citation18–21]. Moreover, Scopus has the advantage of providing advanced export functionality of structured data. Using the document ‘search’ functionality, we performed a search query for all publications containing the following words in their titles, abstracts, and/or keywords: ‘objective structured clinical examination’. The acronym ‘OSCE’ was not included in the literature search as it also refers to the Organization for Security and Co-operation in Europe. The research was limited to all published or in-press documents until March 10th 2024. Using Scopus ‘export’ functionalities, we exported the number of publications per journal, as well as the type of publication and the journal. Cleaning and filtering data was performed using the OpenRefine Software with the General Refine Expression Language (GREL), in order to detect duplicates and misspelled elements.

Bibliometric performance indicators

To assess each journal’s productivity, we analyzed the number of items per journal. As previously described [Citation12,Citation13], we also defined the publishing rate (pR) as the number of items divided by publication time in years (i.e., number of years from the first to the last year of publication until 2024). Finally, we defined the citation rate (cR) of each journal and each country as the sum of the total times cited divided by the total number of items published by the journal or country.

Network map of the literature on OSCE

The VOSviewer software [Citation22] (versions 1.6.18) was used to construct and visualize a co-occurrence network of relevant terms related to OSCE research. We performed a term co-occurrence map based on text data extracted from the abstract field of Scopus, using the full counting method (i.e., all occurrences of a term in a document are counted). The most relevant terms were selected using a minimum number of occurrences of 40. As described in similar studies [Citation23–25], this threshold was arbitrarily chosen to obtain a significant and reasonable number of ‘relevant terms’ (~300). Limiting the number of terms allows constructing a more readable map of co-occurrent terms. A relevance score was computed for each term, and the 60% most relevant terms (default parameter) were used for mapping. Mapping was automatically done using the VOS clustering technique and visualized using the ‘network visualization’ functionality.

International scientific network

The bibliometric dataset exported from Scopus was cleaned using the OpenRefine opensource software to retrieve the country corresponding to each publication. More precisely, the General Refine Expression Language (GREL) was used to extract the country name corresponding to each author’s affiliation for one publication.

We performed a Density Equalizing Map Projection (DEMP) to visualize the number of publications on OSCE by country. The DEMP was illustrated using ScapeToad [Citation26], and then QGIS software [Citation27,Citation28] was used for the addition of the color legend. Using the Gastner/Newman diffusion-based algorithm [Citation29], map surfaces were adapted to the number of published items by country, without altering their topological relationships.

Cleaned and filtered bibliometric data, including publications per country, were then imported to Table 2 Net [Citation30], in order to build worldwide scientific networks including all countries contributing to research in OSCE. This network was visualized using the Gephi software [Citation31], with which we ran the ‘Map of countries’ and ‘Geolayout’ algorithms. The Gephi software was also used to calculate occurrence counts as well as ‘betweenness centrality’, a measure of how often a node lies on the shortest path between nodes in the network. Betweenness centrality is an indirect way to assess the influence a country has over the international research network.

Results

Bibliometric analysis

From 1979 (year of the first publication by Harden) to 2024, a total of 3,224 items were retrieved from the Scopus database, including 2819 (87.4%) articles, 182 (5.6%) reviews, 80 (2.5%) conference papers or reviews; 61 (1.9%) letters or editorials, 27 (0.8%) notes, 39 (1.2%) books or book chapters, 10 (0.3%) short surveys, 4 (0.1%) errata, one data paper, and one preprint. Most documents were published in four leading journals in the field, with more than 100 publications per journal: Medical Education, BMC Medical Education, Medical Teacher, and Academic Medicine ().

Table 1. Top 10 journals contributing to research on OSCE.

A substantial increase in publications was observed in the early 2000s. There was also a spike in OSCE-related publications from 2019 to 2022 (), corresponding to the start of the COVID-19 pandemic. We observed that 7 of the top 10 most cited articles during the period 2020–2022 were related to remote/virtual OSCE, and one article was related to the impact of COVID-19 on evaluation of medical students, including OSCE. Conversely, before 2019, none of the top 10 most cited articles were related to remote/virtual OSCE ().

Figure 1. Time trend analysis of publications.

Figure 1. Time trend analysis of publications.

Table 2. Top 10 most cited studies from a literature search for OSCE using the SCOPUS database before (A) and after (B) COVID-19 pandemic.

Term co-occurrence network

From the 51,178 terms extracted from the abstract field of the Scopus dataset, 321 relevant terms were selected. Three distinct clusters () were identified in this term co-occurrence network and analyzed according to the top 15 most occurrent terms. Cluster 1 (blue) included terms related to relevance and robustness of OSCE: station, reliability, communication, skill, validity, checklist, OSCE score, clerkship, rating, evidence, and standardized patient. Cluster 2 (green) included terms related to the methodology of OSCE evaluation: training, group, course, teaching, simulation, learning, difference, intervention, and confidence. Cluster 3 (red) included terms referring to student’s perception and experience: survey, interview, perception, anxiety, challenge, and preparation. The list of the different terms included in each cluster, and their corresponding statistical measurements, are detailed in the supplementary Table S1.

Figure 2. Co-occurrence network of most relevant terms related to OSCE research.

The VOSviewer software was used to perform a term co-occurrence map based on text data extracted from the abstract field of Scopus, using the full counting method. The thickness of the line between two co-occurring terms is associated with closer links. Co-occurring terms were clustered, and clusters were identified using different colors (red, blue, and green).
Figure 2. Co-occurrence network of most relevant terms related to OSCE research.

Terms from clusters 1 and 2 were close in the network with many interconnecting lines, while very few connections were observed between these two clusters and cluster 3. Notably, compared to other terms, ‘anxiety’ and ‘stress’ were more isolated within this network, without connections with student’s performance.

International scientific network

Among the 3,224 selected items, 3,117 originated from 108 different countries, and 107 (3.3%) could not be assigned to a specific country. Seven hundred and fourteen (22%) were from international collaborations involving a total of 89 different countries. The United States of America (USA), Canada, and the United Kingdom (UK) were the most productive countries, contributing in 923 (28.6%), 476 (14.8%), and 355 (11.0%) publications, respectively. The density equalizing mapping of this set of data also showed that the Netherlands, Germany, Saudi Arabia, Australia, and Taiwan significantly contributed to the research effort ().

Figure 3. Density Equalizing Map Projection (DEMP) of countries contributing to OSCE research.

The DEMP was built using the total number of published items by each country.
Figure 3. Density Equalizing Map Projection (DEMP) of countries contributing to OSCE research.

International collaborative publications were analyzed in terms of scientific networks. The USA, UK, and Canada were the top three collaborating countries, in terms of number of items as well as betweenness centrality (). In addition to an important interconnection between these three countries, with more than 10 collaborative studies, they were also individually connected to many other countries worldwide. Some discrepancies emerged between the top 10 contributor countries and the top 10 producer countries (). Some countries, such as Italy, Trinidad & Tobago and Belgium, were major contributors, but not among the most productive. In contrast, other countries, such as India, Taiwan, and Japan with a high number of published items, had few connections with other countries.

Figure 4. Network of international scientific collaboration in OSCE research.

International scientific network was built using Table2Net and then exported to the Gephi software where the ‘Map of countries’ and ‘geolayout’ were used to visualize the network. The network includes nodes (countries) as well as edges (connection of two countries in a collaborative work). Node size and color are defined by the number of published items and betweenness centrality, respectively.
Figure 4. Network of international scientific collaboration in OSCE research.

Table 3. Top 10 countries contributing to research in OSCE.

Finally, the analysis revealed that Asia was poorly connected within this international scientific network on research in OSCE.

Discussion

To the best of our knowledge, this is the first bibliometric and scientometric analysis of educational research publications in the field of OSCE. This study confirms our assumption that OSCE is experiencing a recent paradigm shift towards its methodology and topics of research and its related scientific international network. Compared to previous study, our study provides novel insights and clues to promote research in OSCE, through different original observations. First, in the context of flourished debates regarding OSCE evolution, we noticed a recent increase in the number of highly cited articles focusing on remote OSCE. Moreover, we observed a lack of important connections between research related to student’s perception and research related to reliability, performance, and methodology of OSCE. Finally, besides the confirmation of a strong leadership from the USA, UK, and Canada in terms of volume of publications and collaborations, our study also highlighted an important scientific contribution of other countries which are scarcely connected within the international network. This point is even more important regarding the development of virtual/remote OSCE worldwide, to promote international guidelines on this new type of OSCE.

Although these results suggest several areas for improvement in OSCE research and organization, our study has some limitations. First, some countries, especially from Latin America and Africa, could also publish items in non-English language journals indexed in other databases than Scopus, such as SciELO (Scientific Electronic Library Online), that could underestimate the scientific contribution of those countries. Moreover, it is noteworthy that our study does not provide an in-depth look at the actual research being published as done in a systematic review, but rather records the locations and fields in which research relating to our topic is being published. However, we used quantitative parameters for co-occurrent terms and scientific networks, in order to limit subjectivity in data interpretation. It is through this broad analysis that the leading fields in this topic and the gaps between them become apparent, allowing us to propose what we believe to be worthwhile solutions.

The sudden increase in OSCE-related publications from 2019 occurred at the beginning of the COVID-19 pandemic (). Between 2020 and 2024, 70% of the 10 most cited studies were related to virtual/remote OSCE organization, highlighting the growing and persistent interest of the scientific community for this alternative method. Although our study does not allow establishing a causal link between these two observations, it is plausible that the pandemic may have prompted the development of research in this field. However, the data comparing remote/virtual to live OSCE are scarce, and only one recent study reported no significant difference between these two OSCE modalities [Citation32]. These observations call for additional studies assessing the feasibility and reliability of remote-OSCE. In addition, the development of consensual international guidelines could promote virtual and remote OSCE sharing between universities and countries.

The co-occurrence term network showed a gap between research on the modalities of OSCE and the student’s perception suggested a need for more studies on the association between performance/reliability of OSCE and student’s perception/experience or mental health (e.g., anxiety). Although co-occurrence term networks could appeal to subjective data interpretation at first glance, this network is based on a computational method, ranking terms according to the number of occurrences. In order to provide a more quantitative and objective analysis of our results, we selected the top 15 most co-occurrent terms for each cluster. Thus, anxiety was identified as one of the most co-occurrent terms for the cluster 3. Together with other consistent terms from this cluster, such as ‘stress’, ‘perception’, ‘student’s perception’, and ‘fairness’, we emphasized the importance of student’s perception in this research cluster. The lack of connections between cluster 3 and the clusters 1 and 2 suggests the lack of studies linking student’s perception (e.g., anxiety) to OSCE performance. This observation is important when considering that medical students represent a population at high-risk of mental disorders including anxiety and depression [Citation33–35]. In France, 20.5% are regular anxiolytic consumers and 12.5% are followed-up by a psychiatrist or psychologist [Citation36]. OSCE involves the use of body and voice, directly impacting physiological parameters such as heart rate respiratory variation, which is related to anxiety. Besides, the live interaction with a standardized patient during OSCE might increase the amplitude of emotional reactions and contribute to generating greater anxiety than written exams. The level of anxiety is high in undergraduate medical students during OSCE [Citation37], but the effects of anxiety on students’ performance are still debated [Citation37–39]. In our institution, we organize monthly open workshops to help under-graduate medical students in mitigating their level of anxiety. Our results emphasize this research gap between anxiety and OSCE performance and suggest that future investigations should address this issue. Describing the relationship between anxiety and performance during OSCE might allow improving students’ preparation and training.

Finally, the international scientific network appeared to be led by the United States of America, the United Kingdom, and Canada and to have expanded mainly to European countries, Saudi Arabia, and Australia. Although Taiwan, India, and Japan are important individual contributors to OSCE publications, international collaborative studies involving Asian countries are lacking. Based on the results of betweenness centrality analysis, the United States, United Kingdom, Canada, and the Netherlands were identified as the most influential countries that could improve the future development of the international research network in OSCE.

In conclusion, this overall landscape of OSCE publications identified several clues to promote OSCE educational research. Studies comparing live and remote OSCE are needed to complete the assessment of this recently developed method. International recommendations on remote OSCE would promote collaboration and sharing between universities across the world. Although the interplay between stress and performance is well demonstrated in other educational contexts, our study suggests the need for additional studies investigating the relationship between anxiety and performance during OSCE. With the support of leading countries in this field, the international research network on OSCE could be developed to promote larger collaborative research projects.

Supplemental material

Supplementary Table 1.docx

Download MS Word (51.5 KB)

Disclosure statement

No potential conflict of interest was reported by the author(s).

Supplemental material

Supplemental data for this article can be accessed online at https://doi.org/10.1080/10872981.2024.2370617

Additional information

Funding

The author(s) reported that there is no funding associated with the work featured in this article.

References

  • Harden RMG, Downie WW, Stevenson M, et al. Assessment of clinical competence using objective structured examination. Br Med J. 1975 Feb 22;1(5955):447–9. doi: 10.1136/bmj.1.5955.447
  • Wass V, Van Der Vleuten C, Shatzer J, et al. Assessment of clinical competence. Lancet. 2001 Mar 24 [cited 2023 Mar 20];357(9260):945–949. doi: 10.1016/S0140-6736(00)04221-5
  • Brannick MT, Erol-Korkmaz HT, Prewett M. A systematic review of the reliability of objective structured clinical examination scores. Med Educ. 2011;45(12):1181–1189. doi: 10.1111/j.1365-2923.2011.04075.x
  • Assessment of clinical competence using an objective structured clinical examination (OSCE) - PubMed [Internet]. [cited 2023 Mar 20]. Available from: https://pubmed-ncbi-nlm-nih-gov.proxy.insermbiblio.inist.fr/763183/
  • Al Rushood M, Al-Eisa A, Nkomazana O. Factors predicting students’ performance in the final pediatrics OSCE. PLOS ONE. 2020 Sep 1;15(9 September):e0236484. doi: 10.1371/journal.pone.0236484
  • Leclercq M, Vannier M, Benhamou Y, et al. Identification of factors associated with performance in objective structured clinical examination in Rouen medical school. Rev Med Interne. 2022 May 1;43(5):278–285. doi: 10.1016/j.revmed.2022.02.007
  • Martin RD, Naziruddin Z. Systematic review of student anxiety and performance during objective structured clinical examinations. Curr Pharm Teach Learn. 2020;12(12):1491–1497. Elsevier Inc doi: 10.1016/j.cptl.2020.07.007
  • Bishop S, Duncan J, Brett M, et al. Prefrontal cortical function and anxiety: controlling attention to threat-related stimuli. Nat Neurosci. 2004 Feb;7(2):184–188. doi: 10.1038/nn1173
  • Klumpp H, Ho SS, Taylor SF, et al. Trait anxiety modulates anterior cingulate activation to threat interference. Depress Anxiety. 2011 Mar;28(3):194–201. doi: 10.1002/da.20802
  • Boursicot K, Kemp S, Norcini J, et al. Synthesis and perspectives from the Ottawa 2022 conference on the assessment of competence. Med Teach [Internet]. 2023 [cited 2023 Mar 20];45(9):978–983. doi: 10.1080/0142159X.2023.2174420
  • Bender ME, Edwards S, von Philipsborn P, et al. Using Co-authorship networks to map and analyse global neglected tropical disease research with an affiliation to Germany. PLOS Negl Trop Dis [Internet]. 2015;9(12):e0004182. doi: 10.1371/journal.pntd.0004182
  • Gotting M, Schwarzer M, Gerber A, et al. Pulmonary hypertension: scientometric analysis and density-equalizing mapping. PLOS ONE [Internet]. 2017;12(1):e0169238. doi: 10.1371/journal.pone.0169238
  • Foy J-P, Bertolus C, Goudot P, et al. Bibliometric analysis of a century of research on oral erythroplakia and leukoplakia. J Oral Pathol Med. 2018;47(4):388–395. doi: 10.1111/jop.12683
  • Groneberg-Kloft B, Scutaru C, Fischer A, et al. Analysis of research output parameters: density equalizing mapping and citation trend analysis. BMC Health Serv Res [Internet]. 2009;9(1):16. doi: 10.1186/1472-6963-9-16
  • Sun GH, Moloci NM, Schmidt K, et al. Representation of women as authors of collaborative cancer clinical trials. JAMA Intern Med [Internet]. 2014;174(5):806–808. doi: 10.1001/jamainternmed.2014.250
  • Ladapo JA, Rodwin BA, Ryan AM, et al. Scientific publications on firearms in youth before and after congressional action prohibiting federal research funding. JAMA [Internet]. 2013;310(5):532–534. doi: 10.1001/jama.2013.119355
  • Haghani M. What makes an informative and publication-worthy scientometric analysis of literature: a guide for authors, reviewers and editors. Transp Res Interdiscip Perspect. 2023 Nov 1;22:100956. doi: 10.1016/j.trip.2023.100956
  • Vezyridis P, Timmons S. Evolution of primary care databases in UK: a scientometric analysis of research output. BMJ Open [Internet]. 2016;6(10):e012785. doi: 10.1136/bmjopen-2016-012785
  • Falagas ME, Pitsouni EI, Malietzis GA, et al. Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses. FASEB J [Internet]. 2008;22(2):338–342. doi: 10.1096/fj.07-9492LSF
  • Powell KR, Peterson SR. Coverage and quality: a comparison of Web of Science and Scopus databases for reporting faculty nursing publication metrics. Nurs Outlook [Internet]. 2017;65(5):572–578. http://www.ncbi.nlm.nih.gov/pubmed/28377037
  • Kokol P, Vošner HB. Discrepancies among Scopus, Web of Science, and PubMed coverage of funding information in medical journal articles. J Med Libr Assoc. 2018 Jan 1;106(1):81–86. doi: 10.5195/jmla.2018.181
  • van Eck NJ, Waltman L. Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics [Internet]. 2010;84(2):523–538. doi: 10.1007/s11192-009-0146-3
  • Kirby A. Exploratory bibliometrics: using VOSviewer as a preliminary research tool. Publications [Internet]. 2023 Feb 20 [cited 2023 Jul 28];11(1):10. doi: 10.3390/publications11010010
  • Samadbeik M, Bastani P, Fatehi F. Bibliometric analysis of COVID-19 publications shows the importance of telemedicine and equitable access to the internet during the pandemic and beyond. Health Info Libr J. 2022;40(4):390–399. doi: 10.1111/hir.12465
  • Foy J-P, Bertolus C, Saintigny P. Oral cancer prevention worldwide: challenges and perspectives. Oral Oncol. 2019;88:91–94. doi: 10.1016/j.oraloncology.2018.11.008
  • ScapeToad - cartogram software by the Choros laboratory - credits [Internet]. [cited 2023 Mar 31]. Available from: http://scapetoad.choros.place/credits.php
  • QGIS User Guide — QGIS Documentation documentation [Internet]. [cited 2023 Mar 31]. Available from: https://docs.qgis.org/3.28/en/docs/user_manual/index.html
  • Bienvenue sur le projet QGIS! [Internet]. [cited 2023 Mar 31]. Available from: https://www.qgis.org/fr/site/
  • Gastner MT, Newman ME. From the Cover: Diffusion-based method for producing density-equalizing maps. Proc Natl Acad Sci USA [Internet]. 2004;101(20):7499–7504. doi: 10.1073/pnas.0400280101
  • Medialab S-P. table2 Net [Internet]. p. table2 net, developed by Mathieu Jacomy at the S. Available from: http://tools.medialab.sciences-po.fr/table2net/
  • Bastian M, Heymann S, Jacomy M. Gephi: an open source software for exploring and manipulating networks [Internet]. 2009. Available from: http://www.aaai.org/ocs/index.php/ICWSM/09/paper/view/154
  • Bouzid D, Mullaert J, Ghazali A, et al. eOSCE stations live versus remote evaluation and scores variability. BMC Med Educ [Internet]. 2022 Dec 1 [cited 2023 Mar 20];22(1). doi: 10.1186/s12909-022-03919-1
  • Dahlin M, Joneborg N, Runeson B. Stress and depression among medical students: a cross-sectional study. Med Educ [Internet]. 2005 Jun [cited 2022 Nov 8];39(6):594–604. doi: 10.1111/j.1365-2929.2005.02176.x
  • Reed DA, Shanafelt TD, Satele DW, et al. Relationship of pass/fail grading and curriculum structure with well-being among preclinical medical students: a multi-institutional study. Acad Med [Internet]. 2011 [cited 2022 Nov 8];86(11):1367–1373. https://pubmed.ncbi.nlm.nih.gov/21952063/
  • Dyrbye LN, Thomas MR, Harper W, et al. The learning environment and medical student burnout: a multicentre study. Med Educ [Internet]. 2009 Mar [cited 2022 Nov 8];43(3):274–282. https://pubmed.ncbi.nlm.nih.gov/19250355/
  • Fond G, Bourbon A, Lançon C, et al. Psychiatric and psychological follow-up of undergraduate and postgraduate medical students: prevalence and associated factors. Results from the national BOURBON study. Psychiatry Res [Internet]. 2019 Feb 1 [cited 2022 Nov 8];272:425–430. doi: 10.1016/j.psychres.2018.12.174
  • Ferreira ÉDMR, Pinto RZ, Arantes PMMH, et al. Stress, anxiety, self-efficacy, and the meanings that physical therapy students attribute to their experience with an objective structured clinical examination. BMC Med Educ [Internet]. 2020 Sep 10 [cited 2022 Nov 11];20(1):1–9. https://pubmed.ncbi.nlm.nih.gov/32912221/
  • Vasli P, Shahsavari A, Estebsari F, et al. The predictors of nursing students’ clinical competency in pre-internship objective structured clinical examination: the roles of exam anxiety and academic success. Nurse Educ Today [Internet]. 2021 Dec 1 [cited 2022 Nov 11];107:105148. doi: 10.1016/j.nedt.2021.105148
  • Hadi MA, Ali M, Haseeb A, et al. Impact of test anxiety on pharmacy students’ performance in objective structured clinical examination: a cross-sectional survey. Int J Pharm Pract [Internet]. 2018 Apr 1 [cited 2022 Nov 11];26(2):191–194. doi: 10.1111/ijpp.12389