2,595
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Anxiety is associated with extraneous cognitive load during teaching using high-fidelity clinical simulation

, , , , , , ORCID Icon & show all
Article: 1994691 | Received 27 Mar 2021, Accepted 13 Oct 2021, Published online: 28 Oct 2021

ABSTRACT

High-fidelity clinical simulation is currently a well-established teaching tool. However, high-fidelity representations of patients in critical conditions have the potential to elicit emotions among learners and impact their cognitive load (CL). Teaching with clinical simulation may induce both emotional and cognitive overloads. The relationship between anxiety and CL during clinical simulation was studied. Forty-one undergraduate medical students participated in this study; 19 males and 22 females. The state-anxiety component of State-Trait Anxiety Inventory was administered during clinical simulation teaching sessions at time points: pre-scenario, post-scenario and post-debriefing. The Cognitive Load Scale (Leppink et al.) questionnaire was also completed post-scenario. This assessed the three components of CL: intrinsic cognitive load (ICL), extraneous cognitive load (ECL) and self-perceived learning (SPL). Median CL scores for ICL, ECL and SPL were compared between groups of low-anxiety and high-anxiety participants using a Mann-Whitney U test. State-anxiety scores were high for both the pre-scenario and post-scenario time points with a significant reduction following post-debriefing. The median (interquartile range) state-anxiety scores were 41.0 (33.0–50.0), 46.0 (33.0–52.0) and 31.0 (23.0–39.0) for the pre-scenario, post-scenario and post-debriefing time points respectively. Students with high state-anxiety had higher ECL scores (median = 2.0) than students with low state-anxiety (median = 0.9) at the post scenario time point (U = 220, p = 0.043). No statistical relation was seen with state-anxiety for either ICL or SPL. State-anxiety immediately after the simulation scenario is associated with ECL but not ICL or SPL.

Introduction

Currently, clinical simulation is well-established as an effective teaching tool for use with medical students and for the training of qualified professionals [Citation1,Citation2]. The acquisition of clinical skills has become the most common learning objective for simulation in medical education[Citation1]. Complex clinical scenarios such as team-responses to emergencies may be simulated with life-like computer-controlled mannequins. Modern mannequins are sophisticated in their design and generate real-time changes in haemodynamics, blood gases, and vital signs in response to clinical interventions. This allows for simulated interventions to be performed that are deemed too dangerous or too complex to practise on actual patients. The use of high-fidelity simulation, therefore, seems appropriate for teaching compound clinical competencies in a safe, supported, and controlled manner. However, the very nature and the realism of clinical simulations have both favourable and unfavourable consequences. Although the educational benefits of clinical simulations are clear, these high-fidelity representations of human frailties and critically ill patients can elicit negative emotions in learners [Citation3–5]. These emotions may adversely impact the process of learning[Citation6]. Clinical simulation teaching sessions, as with many other novel learning environments, induce anxiety in learners[Citation7]. High levels of anxiety are detrimental to learning as they overload learning processes [Citation8,Citation9]. In contrast, low levels of anxiety provide insufficient stimuli to motivate individuals to learn. Thus, boredom and lack of engagement may be associated with low anxiety. Therefore, a precarious balance exists between optimal learning and anxiety levels during teaching using simulation[Citation5].

Detrimental effects of anxiety also impact cognitive capacity, with high anxiety being associated with low performance during problem-solving[Citation10]. The more authentic the simulation and the more dynamic the interactions within the simulation setting, the greater the potential for cognitive overload. The finite capacity of the working memory of learners with high anxiety levels becomes deluged with the excessive superfluous thoughts generated through anxiety. This notion of working memory is central to the conceptual framework of cognitive load theory (CLT), which has been used to describe how instructional design may influence effective learning[Citation11]. The CLT framework is considered appropriate for designing teaching activities involving simulation[Citation12]. CLT assumes that working memory capacity is fixed and that learning is hindered when this memory capacity is overloaded. This overloading inhibits the process of transferring information from the narrow realm of working memory to the more expansive long-term memory [Citation11,Citation13]. The CLT framework is based on the premise that three components contribute to the total cognitive load (CL) placed upon the learner[Citation13]. These three components being: the intrinsic cognitive load (ICL) [Citation14] of the learning task itself, the extraneous cognitive load (ECL) of the actual learning situation, and the germane cognitive load [Citation14] or self-perceived learning (SPL)[Citation15]. Intrinsic and extraneous CL are widely accepted factors of the CL framework, whilst germane is more controversial [Citation16,Citation17]. Germane cognitive load has been reinterpreted as ‘self-perceived learning’ [Citation15,Citation18]; i.e., the individual’s perception that learning has taken place as assessed by one particular subjective measure of CL (Leppink et al.; 2013) [Citation19,Citation20]. High scores on the SPL scale have been reported to be predictive of high academic performance[Citation15]. However, few published studies report upon the components of CL in relation to simulation. Research has focused on measures of total CL[Citation21]. Studies have shown that high CL during training with clinical simulation is associated with decreased learning and impaired performance of clinical skills [Citation22,Citation23]. Further, emotions experienced during training with simulation are associated with total CL ratings and poorer learning outcomes are associated with higher total CL scores [Citation24,Citation25].

This theoretical understanding of the components of memory overload offers the practical application of being a guide for instructional design and helps explain how learning a new complex task taxes the learner’s cognitive system[Citation13]. Drawing upon the two concepts of intrinsic and extraneous CL is particularly helpful in evaluating learning activities and learning environments [Citation12,Citation26]. The intrinsic load of a simulation teaching session is the inherent difficulty imposed upon a learner within the learning task and the complexity of the simulation scenario itself. Learners that are new to a task are more prone to experience cognitive overload. The learner’s prior knowledge and experience are the primary factors affecting ICL, with emotional states having minimal influence.

In contrast, emotional states such as anxiety would be expected to affect the extraneous load[Citation27], i.e., the working memory consumed by mental processes imposed by instructional or context elements that are neither necessary nor appropriate for learning. Clinical environments contain several elements that trigger specific cognitive interactions between the individuals involved and the general setting. Simulations faithfully replicate these same elements and interactions; although, they may not be core to the learning objectives. Thus, the scenario, the relevant clinal data, the associated assessments and the instructions provided all contribute to the consumption of the working memory capacity. Moreover, the high-fidelity representations of life or death scenarios influence emotional states, affecting CL and impacting learning [Citation4,Citation28–30]. Studies relating emotional states to CL have suggested that emotions are associated with ECL rather than ICL. Fraser et al. demonstrated that exposing learners to the unexpected death of a simulated patient increased total CL and had poorer learning outcomes. The authors suggested that this relationship between emotional and total cognitive loads stems from an extraneous overload[Citation24]. Pawar et al. investigated the impacts of simulation on emotional states and CL in an intensive care setting. They expressly avoided the unexpected death of a critically ill patient within the scenario in order to reduce ECL. They reported no correlation between total CL and the various emotional descriptors investigated[Citation21]. It has been argued that both positive and negative emotions can lower the capacity of working memory by generating an extraneous CL; triggered by task-irrelevant processing[Citation25]. Thus, both cognitive overload and situational anxiety are potential barriers to effective learning. Therefore, there is a need to understand cognitive overload in relation to high-anxiety prone learners within the context of clinical simulation classes in order to develop suitable and targeted protocols to enhance their learning.

The aim of this study was to assess the effect of participating in clinical simulation on subjective measures of anxiety and CL with final year undergraduate medical students. Further, the relationship between measured anxiety scores and the three components, ICL, ECL and SPL, was examined. The hypothesis of the present study was that high levels of anxiety during the enactment of the scenario segment of simulation sessions are associated with an extraneous overload in learners.

Methods

Study design and participants

This cross-sectional study was conducted in the ANON. State-anxiety, trait-anxiety, and CL were assessed at three distinct time points during clinical simulation teaching sessions. Participants were recruited from students enrolled on a five-year undergraduate medical programme structured with an integrated curriculum. All students in their fifth and final year (semester 10) were invited to participate. Participation in this study was voluntary and written informed consent was collected from all participants before enrolment onto the study. The study was approved by the Research Ethics Committee of ANON.

Clinical simulation teaching sessions

Teaching sessions using simulation took place over the period from January to April 2019. Data were collected over nine teaching sessions which were scheduled to last for 90 minutes. Each clinical teaching event had a group of 5–8 students and three facilitators. All students entered the scenario as a group and played the role of interns. Generally, the scenarios aimed to provide students with experiential training in inpatient competencies relevant to caring for hospitalised patients. More specifically students were expected to work as a group to gather relevant clinical information to obtain a focussed patient history and a collateral patient history, examine the simulated patient, order and interpret the results of investigations, commence appropriate treatment and communicate effectively with the patient, staff and patient’s family members. One student was always appointed as the team-leader for each session. Students had not had previous exposure to teaching with simulation in earlier years on the course.

The three facilitator and two actors followed pre-determined scripts during the scenario. The same facilitators and actors were involved in all sessions. The fascinators played the roles of a nurse and two senior medical residents. The nurse was available in the simulation theatre, and medical staff were available via the telephone. The patient and the patient’s family members were voiced by actors. The scenarios were run in an Emergency Bay in a purpose-built patient simulation centre. The level of the simulation fidelity was considered high[Citation31], it had strong components of equipment fidelity, environmental fidelity, and psychological fidelity[Citation32]. All sessions were conducted using the same human patient simulator (HAL® S3101, Gaumard Scientific, FL, USA). Medications and equipment required were available in the simulated clinical environment. Necessary imaging was provided digitally in the simulated setting. All scenarios were video recorded for later use during debriefing.

Each teaching session comprised of three segments: briefing, scenario, and debriefing. The briefing segment (approximately 10 minutes) focused on introducing the students to the physical environment including the mannequin. Discussions of the expected learning outcomes and objectives of the session were also outlined. The scenario segment (approximately 15 minutes) involved a very brief description of the scenario. The students were then asked to manage the case while supported by their facilitators. During the debriefing segment (approximately 45 minutes) the students reflected upon their thoughts and actions during the simulation session. Principles of ‘debriefing with good judgment’ were adopted[Citation33]. No formal assessments were included. Feelings regarding their behaviours and decisions made were explored during debriefing. Issues such as history taking, examination, investigation and management, team dynamics, and communication were discussed. A review of the video recording of the enacted scenario was used as an adjunct to oral feedback during debriefing. The senior facilitator lead all the briefing sessions.

Scenarios

There were two distinct scenarios delivered on two separate occasions. One scenario involved managing a medical emergency and the other a surgical emergency. The first session to which students were exposed, either medical or surgical, was dependent on block-randomisation using the class list and the timetabling procedure.

The medical scenario was titled infective exacerbation of chronic obstructive pulmonary disease (COPD). The scenario involved a 68-year-old underweight Caucasian male. The students in their roles as interns were asked to see this patient who presents to the Emergency Department with a three-day history of a worsening productive cough, wheeze, and dyspnoea. His temperature was 38.5°C, BP: 122/78, HR: 98 RR: 24 and O2 saturation of 87% on room air. He had two previous presentations with the same complaint over the last six months. He had a history of smoking (40 pack years, and he quit two years ago). He lived alone and his daughter lived nearby. His wife had died a year earlier. His was diagnosed with infective exacerbation of COPD, complicated by type II respiratory failure.

The surgical scenario small bowel obstruction involved a 75-year-old male who complained of abdominal pain and vomiting. At the time of presentation, he was three days post-resection of a small bowel lymphoma with primary anastomosis. He had a history of prostate cancer (successfully treated 10 years ago) and cholecystectomy (five years earlier). He had clinical signs of dehydration including dry mucus membranes and tachycardia. His abdomen is distended with diffuse tenderness and hyperactive bowel sounds. His temperature was 37°C, BP: 135/85, HR: 120 RR: 18 and O2 saturation of 99% on room air. At the time he was married with adult children. He was diagnosed with small bowel obstruction based upon PFA and CT scan imaging.

Data collection methods

Questionnaires were used to assess state-anxiety, trait-anxiety, and CL. Each participant had his or her state-anxiety measured at three time points: before the initial briefing (pre-scenario), after the management of the scenario (post-scenario), and once again after the debriefing (post-debriefing). A self-administered questionnaire that measured CL was completed following the scenario (post-scenario). Trait-anxiety was assessed only once for each study participant. This was on a separate day usually one week after the scheduled teaching session, this was to reduce the number of forms to be filled out by the participants on the day of the study. These time points and data collections are summarised in .

Figure 1. Data collection time-points in relation to the structure of each clinical simulation teaching session. STAI: State-Trait Anxiety Inventory, CLS: cognitive load scale

Figure 1. Data collection time-points in relation to the structure of each clinical simulation teaching session. STAI: State-Trait Anxiety Inventory, CLS: cognitive load scale

State-Trait Anxiety Inventory (STAI)

The State Trait-Anxiety Inventory-Trait (STAI-T) was used to assess the each participant’s natural tendency to be anxious (trait-anxiety) one week after the simulation-teaching session[Citation34]. The State Trait-Anxiety Inventory-State (STAI-S) was used to assess each participant’s transitory emotional state caused by the situation (state-anxiety) at three time points across the teaching session[Citation34]. It was administered once again following the debriefing session when the whole teaching activity was completed. STAI-S consisted of 20 items with a four-point Likert scale for each item. Thus, scores for both trait-anxiety and state-anxiety ranged between 20 and 80 where 20 indicated a low level of anxiety and 80 indicated a high level. The time for completion of the questionnaires varied from three to six minutes. Calculations were based on the scores generated for individual questionnaires. In addition, scores were dichotomised into descriptions of anxiety levels i.e., ‘low-anxiety’ or ‘high anxiety’. High trait-anxiety was defined by a STAI-T score ≥40 and high state-anxiety was defined by a STAI-S score ≥36. These two anxiety cut-off values were based on scores greater than the mean baseline scores for college students as reported in the STAI manual[Citation35]. Several research reports have used the same cut-off values [Citation28,Citation36]. The reported internal consistency of the STAI is high, with Cronbach’s alpha values of 0.92 for both STAI-T and STAI-S[Citation35].

Cognitive load scale

CL was measured using a subjective scale. The cognitive load scale (CLS) is a 13-item inventory that was developed and validated by Leppink and et al [Citation19], and written permission was obtained from its developer by e-mail prior to the study. The CLS used a 10-point semantic rating scale ranging from ‘not at all the case’ to ‘completely the case’. CLS measured participant’s subjective ratings of the listed 13 items: items 1 to 4 measured the ICL; items 5 to 8 measured the ECL; and the items 9 to 13 measured the students’ self-perceived learning (SPL) formally referred to as germane cognitive load[Citation15]. Examples of items from CLS survey included: ‘The content of the activity was very complex.’, ‘I invested a very high mental effort in unclear and ineffective explanations and instructions in this activity’, and ‘This activity really enhanced my understanding of the content that was covered’, which are representative items from the ICL, ECL and SPL sections respectively. The internal consistency of the three components of CL is reported to be high, with Cronbach’s alpha values of 0.81, 0.75 and 0.82 for ICL, ECL and SPL respectively[Citation19]. Participants were asked to return completed CLS paper forms to the researchers immediately after the clinical simulation component of the teaching session. The time for completion of the questionnaire varied between three to six minutes.

Data analyses

Non-parametric methods were used to analyse the data. Data were expressed as median and interquartile ranges for continuous variables and as number and percentage for categorical variables. Chi-squared or Fisher’s exact tests were performed to compare the frequencies. Friedman tests were performed to compare median scores used for assessing the levels of self-reported state-anxiety (STAI-S) at the pre-scenario, post-scenario, and post-debriefing time points. Mann-Whitney U-tests were performed to compare median anxiety scores between gender, and medical versus surgical scenarios. The normality of distribution of results was determined using a Sharipo-Wilk test. To assess the relationship between CL rating and anxiety scores Pearson’s correlation coefficients were used. P values < 0.05 were considered statistically significant. The reliability of STAI and CLS tools was assessed using Cronbach’s alpha coefficient with a value of 0.7 or above considered as indicative of acceptable reliability[Citation37]. All statistical tests were carried out using IBM SPSS Statistics 25.

Results

Forty-five students were enrolled on the compulsory clinical simulation classes during the period in which the study was carried out. Forty-one of the 45 of the students agreed to participate. There were 19 male and 22 female student participants. The median age of the students was 23 (IQR: 22–24). Data were collected for STAI and CLS surveys. Initial analysis of the results showed that neither STAI scores (Sharipo-Wilk, n = 59, p < 0.01) nor ECL scores (n = 59, p < 0.01), were normally distributed, so further analysis used non-parametric methodology.

State-anxiety scores were high for both the pre- scenario and post-scenario time points with a significant fall following debriefing. The median STAI-S scores were 41.0 (IQR: 33.0–50.0), 46.0 (IQR: 33.0–52.0) and 31.0 (IQR: 23.0–39.0) for the pre-scenario, post-scenario, and post-debriefing time points, respectively. State-anxiety was measured across all three time points of pre-scenario, post-scenario, and post-debriefing on a total of 59 occasions. This included a maximum of two sessions (the medical scenario and the surgical scenario) for each student. A Friedman test was carried out to compare the STAI-S scores across the three time points. There was found to be a significant difference between the scores χ2 (2) = 45.313, p < 0.001. Dunn-Bonferroni post hoc tests were carried out and there were significant differences between the pre-scenario and post-debriefing (p < 0.001) as well as the post-scenario and post-debriefing (p < 0.001) after Bonferroni adjustments. There were no significant differences between pre-scenario and post-scenario.

The average STAI-S scores were significantly higher for females when compared to males. Three Mann-Whitney U tests showed that female students had higher STAI-S scores than male students (p < 0.05) for the pre-scenario, post-scenario, and post-debriefing collection time points. Similarly, there were significant differences in these state-anxiety scores for those participants with low or high trait-anxiety scores. Three Mann-Whitney U tests also showed that students with high trait-anxiety had higher STAI-S scores (p < 0.001) when compared to students with low trait-anxiety for the three time points. Two teaching sessions were conducted, and these teaching slots were randomised as either medical or surgical scenarios for the first or second session. A Mann-Whitney U test showed that students with their first exposure to simulation (Mdn = 48) had higher STAI-S scores when compared to students on their second exposure to simulation for that academic year (Mdn = 37) at the post-scenario time point only (U = 315.5, p = 0.017). These data are summarised on . No statistically significant differences were seen for trait-anxiety between any of the groups (i.e., male v’s female, leaders v’s non-leaders, first v’s second exposure to teaching with simulation and medical v’s surgery scenarios).

Table 1. Median (interquartile range) STAI-state scores for demographic data across the three data collection points. Friedman test was used to compare the STAI-state scores across the three time points. Significant differences were seen between; male v female, low v high trait-anxiety, 1st v 2nd exposure to simulation and medicine v surgery scenarios as indicated: p < 0.05 and p < 0.01

High trait-anxiety was associated with high ECL scores. Post-scenario STAI-S scores and ECL rating were found to be positively correlated (r = 0.356, p < 0.010). Students with high state-anxiety had higher ECL scores (Mdn = 2.0) than students with low state-anxiety (Mdn = 0.9) at the post scenario time point, as tested using a Mann-Whitney U test (U = 220.0, p = 0.034). No significant correlations were found for either ICL or SPL with any of the STAI scores. CLS are summarised in relation to anxiety scores on .

Table 2. Median (interquartile range) rating for: intrinsic cognitive load (ICL); extraneous cognitive load (ECL); and self-perceived learning (SPL) as related to low and high anxiety groups. Anxiety was assessed using State Trait Anxiety Inventory – Trait (STAI-T) and State Trait Anxiety Inventory – State (STAI-S) at pre-scenario, post- scenario, and post-debriefing time points. Mann-Whitney U test was used to compare median cognitive load rating from low and high anxiety groups

The Cronbach’s alpha coefficient was used to assess the reliability of the composite scores generated by the questionnaires employed. STAI-S consisted of 20 items (Alpha = 0.93) and the STAI-T also consisted of 20 items (Alpha = 0.91). The CL questionnaire consisted of 13 items with three subscales. ICL subscale consisted of 4 items (Alpha = 0.84), ECL subscale consisted of 4 items (Alpha = 0. 70), and SPL subscale consisted of 5 items (Alpha = 0.94).

Discussion

This study aimed to assess the effect of participation in teaching with simulation on anxiety, ICL, ECL and SPL. A further aim was to compare participants’ anxiety ratings with their ICL, ECL, and SPL ratings. State-anxiety ratings were high for both the pre- and post-scenario time points, with a reduction after debriefing, suggesting an association between simulation and anxiety. Students with high state-anxiety had higher ECL ratings at the post scenario time point than students with low state-anxiety. This correlation suggests that state-anxiety during simulation is associated with ECL. In contrast, there were no statistical relationships between state-anxiety and ICL or SPL, suggesting that state-anxiety is neither associated with ICL nor SPL.

The post-scenario increase in anxiety as described here may impact learning[Citation10]. Previous studies have shown that emotional states affect measures of cognitive load at the post-scenario stage of training with simulation [Citation21,Citation24]. However, these studies focused on total CL rather than ICL and ECL components. Young and Sewell have commented that several factors, internal to the learner, may contribute to extraneous load during teaching with simulation. These factors include: learner’s self-consciousness at being observed, fatigue, internal thoughts and distractions and also anxiety[Citation27]. Therefore, the focus of the current study was to examine both ICL and ECL in relation to one of these factors that are internal to the learner, anxiety. ECL may be influenced by the generation of superfluous thoughts that are associated with anxiety. Our finding supports this notion that emotional load is associated with extraneous CL, specifically, and that state-anxiety correlates with ECL but not ICL or SPL. Dissimilar to ECL, ICL is highly dependent on prior knowledge and experience and not on the learner’s emotional state. It is widely accepted that the optimal design for teaching with simulation should minimise ECL [Citation11,Citation13,Citation21]. Measures taken to reduce anxiety during simulations may help to minimise ECL.

The observed peak in state-anxiety followed by a fall after debriefing suggests that enacting the simulation scenario may have an anxiogenic effect whilst debriefing reduces anxiety. Participants with high trait-anxiety had high state-anxiety scores across the three data collection time points: i.e., pre-scenario, post-scenario and post-debriefing. These findings are in agreement with those of Evain et al., who also showed a reduction in state-anxiety scores after debriefing and that participants with anxious personalities were at risk of having high state-anxiety even after the debriefing[Citation38]. The calming effect of debriefing may be related to the reflective bidirectional discussions during this segment of the teaching session [Citation2,Citation39]. Effective debriefing may allow students experiencing high anxiety during the scenario to attain a successful learning experience.

This study has certain limitations. The first limitation was the small sample size. The study was conducted in a small medical school, and the number of participants could not be increased for a student year group. There was no statistical difference in STAI-S scores between leaders and non-leaders. However, there were few sessions, and therefore the number of participants who were leaders was low. We could not draw firm conclusions about the role of group leaders concerning state-anxiety or CL. Moreover, the singling out of leaders in each scenario may be an important confounder that could not be easily controlled for in this setting. Increasing the sample size may have elucidated important issues related to the appointed leaders. Secondly, variability would have existed among the facilitators and the debriefers. Although the same facilitators and debriefers conducted each of the sessions and standardised scripts were employed, the nature of this form of teaching means that the student responses and reactions would be unique and specific for each simulation. There would be inevitable variations in the debriefing discussions and slight deviations from scripts in the scenarios. This variability may directly or indirectly affect variation in measured anxiety and CL scores. Thirdly, we did not include any measures of effective learning. Objective assessments of performance outcomes may have better elucidated the relationship between performance, CL, and anxiety. It has been shown that highly anxious individuals perform better than individuals with low-anxiety levels in non-stressful situations[Citation9]. Neither cognitive nor emotional load during teaching activities translate into performance in the clinic. Lastly, this study was conducted in a single higher educational institution. Therefore, the findings may not necessarily be generalisable to other settings.

Conclusions

Debriefing reduces state-anxiety associated with clinical simulation. High state-anxiety, immediately after the simulation scenario is associated with extraneous but not intrinsic CL or self-perceived learning.

Author contributions

Ethics approval and consent to participate

Participation was voluntary and written informed consent was collected from all participants before enrolment onto the study. The study was approved by the Research Ethics Committee of ANON.

Consent for publication

No individual data are included.

Acknowledgments

We express our thanks to all study participants, technical-staff, clinical-facilitators and to the elective project students for ensuring the smooth running of this study.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

No external funding was sought to support this study.

References

  • McGaghie WC, Issenberg SB, Petrusa ER, et al. A critical review of simulation-based medical education research: 2003–2009. Med Educ. 2010;44(1):50–8.
  • Issenberg SB, McGaghie WC, Petrusa ER, et al. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27(1):10–28.
  • Dias RD, Scalabrini-Neto A. Acute stress in residents playing different roles during emergency simulations: a preliminary study. Int J Med Educ. 2017;8:239–243.
  • Keitel A, Ringleb M, Schwartges I, et al. Endocrine and psychological stress responses in a simulated emergency situation. Psychoneuroendocrinology. 2011;36(1):98–108.
  • DeMaria S, Silverman ER, Lapidus KA, et al. The impact of simulated patient death on medical students’ stress response and learning of ACLS. Med Teach. 2016;38(7):730–737.
  • Fraser K, Ma I, Teteris E, et al. Learning during simulation training is prone to retroactive interference. Med Educ. 2012;46(3):299–305.
  • Bong CL, Lightdale JR, Fredette ME, et al. Effects of simulation versus traditional tutorial-based training on physiologic stress levels among clinicians: a pilot study. Simul Healthcare J Soc S Healthcare. 2010;5(5):272–278.
  • Darke S. Effects of anxiety on inferential reasoning task performance. J Pers Soc Psychol. 1988;55(3):499–505.
  • Sorg BA, Whitney P. The effect of trait anxiety and situational stress on working memory capacity. J Res Pers. 1992;26(3):235–241.
  • Ashcraft MH, Kirk EP. The relationships among working memory, math anxiety, and performance. J Exp Psychol Gen. 2001;130(2):224–237.
  • Sweller J. Cognitive load during problem solving: effects on learning. Cogn Sci. 1988;12(2):257–285.
  • Fraser KL, Ayres P, Sweller J. Cognitive load theory for the design of medical simulations. Simul Healthcare J Soc S Healthcare. 2015;10(5):295–307.
  • Van Merrienboer JJ, Sweller J. Cognitive load theory in health professional education: design principles and strategies. Med Educ. 2010;44(1):85–93.
  • Sweller J, Van Merrienboer JJ, Paas FG. Cognitive architecture and instructional design. Educ Psychol Rev. 1998;10(3):251–296.
  • Bergman EM, De Bruin AB, Vorstenbosch MA, et al. Effects of learning content in context on knowledge acquisition and recall: a pretest-posttest control group design. BMC Med Educ. 2015;15(1):133.
  • Leppink J, van den Heuvel A. The evolution of cognitive load theory and its application to medical education. Perspect Med Educ. 2015;4(3):119–127.
  • Fraser KL, Meguerdichian MJ, Haws JT, et al. Cognitive Load Theory for debriefing simulations: implications for faculty development. Adv Simul (Lond). 2018;3(1):28.
  • Hadie SNH, Yusoff MSB. Assessing the validity of the cognitive load scale in a problem-based learning setting. J Taibah Univ Med Sci. 2016;11(3):194–202.
  • Leppink J, Paas F, Van der Vleuten CP, et al. Development of an instrument for measuring different types of cognitive load. Behav Res Methods. 2013;45(4):1058–1072.
  • Debue N, van de Leemput C. What does germane load mean? An empirical contribution to the cognitive load theory. Front Psychol. 2014;5:1099.
  • Pawar S, Jacques T, Deshpande K, et al. Evaluation of cognitive load and emotional states during multidisciplinary critical care simulation sessions. BMJ Simul Technol Enhanced Learn. 2018;4(2):87–91.
  • Aldekhyl S, Cavalcanti RB, Naismith LM. Cognitive load predicts point-of-care ultrasound simulator performance. Perspect Med Educ. 2018;7(1):23–32.
  • Lewis MM. Cognitive Load, Anxiety, and performance during a simulated subarachnoid block. Clin Simul Nurs. 2019;36:30–36.
  • Fraser K, Huffman J, Ma I, et al. The emotional and cognitive impact of unexpected simulated patient death: a randomized controlled trial. Chest. 2014;145(5):958–963.
  • Fraser K, Ma I, Teteris E, et al. Emotion, cognitive load and learning outcomes during simulation training. Med Educ. 2012;46(11):1055–1062.
  • Reedy GB. Using cognitive load theory to inform simulation design and practice. Clin Simul Nurs. 2015;11(8):355–360.
  • Young JQ, Sewell JL. Applying cognitive load theory to medical education: construct and measurement challenges. Perspect Med Educ. 2015;4(3):107–109.
  • Harvey A, Nathens AB, Bandiera G, et al. Threat and challenge: cognitive appraisal and stress responses in simulated trauma resuscitations. Med Educ. 2010;44(6):587–594.
  • Corvetto MA, Taekman JM. To die or not to die? A review of simulated death. Simul Healthcare J Soc S Healthcare. 2013;8(1):8–12.
  • Clarke S, Horeczko T, Cotton D, et al. Heart rate, anxiety and performance of residents during a simulated critical clinical encounter: a pilot study. BMC Med Educ. 2014;14(1):153.
  • Maran NJ, Glavin RJ. Low- to high-fidelity simulation - a continuum of medical education? Med Educ. 2003;37(Suppl 1):22–28.
  • Rehmann AJ, Mitman RD, and Reynolds MC. A handbook of flight simulation fidelity requirements for human factors research. Dayton, Ohio, USA: Crew system ergonomics information analysis center wright-patterson afb oh; 1995.
  • Rudolph JW, Simon R, Dufresne RL, et al. There’s no such thing as “nonjudgmental” debriefing: a theory and method for debriefing with good judgment. Simul Healthcare J Soc S Healthcare. 2006;1(1):49–55.
  • Spielberger C, Gorsuch R, Lushene R. STAI Manual. Palo Alto CA: Consulting Psychologist Press; 1970.
  • Spielberger C. Manual fo State-trait anxiety inventory. Palo Alto CA: Consulting Psychologists Press; 1983.
  • Knight RG, Waal-Manning HJ, Spears GF. Some norms and reliability data for the state–trait anxiety inventory and the Zung self-rating depression scale. Br J Clin Psychol. 1983;22(Pt 4):245–249.
  • Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334.
  • Evain J-N, Zoric L, Mattatia L, et al. Residual anxiety after high fidelity simulation in anaesthesiology: an observational, prospective, pilot study. Anaesth Crit Care Pain Med. 2017;36(4):205–212.
  • Savoldelli GL, Naik VN, Park J, et al. Value of debriefing during simulated crisis management: oral versus video-assisted oral feedback. Anesthesiology. 2006;105(2):279–285.