947
Views
30
CrossRef citations to date
0
Altmetric
Original Research

Peyton’s four-step approach: differential effects of single instructional steps on procedural and memory performance – a clarification study

, , , , , , & show all
Pages 399-406 | Published online: 27 May 2015

Abstract

Background

Although Peyton’s four-step approach is a widely used method for skills-lab training in undergraduate medical education and has been shown to be more effective than standard instruction, it is unclear whether its superiority can be attributed to a specific single step.

Purpose

We conducted a randomized controlled trial to investigate the differential learning outcomes of the separate steps of Peyton’s four-step approach.

Methods

Volunteer medical students were randomly assigned to four different groups. Step-1 group received Peyton’s Step 1, Step-2 group received Peyton’s Steps 1 and 2, Step-3 group received Peyton’s Steps 1, 2, and 3, and Step-3mod group received Peyton’s Steps 1 and 2, followed by a repetition of Step 2. Following the training, the first independent performance of a central venous catheter (CVC) insertion using a manikin was video-recorded and scored by independent video assessors using binary checklists. The day after the training, memory performance during delayed recall was assessed with an incidental free recall test.

Results

A total of 97 participants agreed to participate in the trial. There were no statistically significant group differences with regard to age, sex, completed education in a medical profession, completed medical clerkships, preliminary memory tests, or self-efficacy ratings. Regarding checklist ratings, Step-2 group showed a superior first independent performance of CVC placement compared to Step-1 group (P<0.001), and Step-3 group showed a superior performance to Step-2 group (P<0.009), while Step-2 group and Step-3mod group did not differ (P=0.055). The findings were similar in the incidental free recall test.

Conclusion

Our study identified Peyton’s Step 3 as being the most crucial part within Peyton’s four-step approach, contributing significantly more to learning success than the previous steps and reaching beyond the benefit of a mere repetition of skills demonstration.

Introduction

Skills-labs have become a valuable methodological teaching approach in medical education. Skills-lab training allows for sustained deliberate practiceCitation1 in a “mistake-forgiving”,Citation2 safe environment. The positive effect of skills-lab training sessions on learning outcomes and transfer of acquired skills to clinical practice have been shown in a variety of different settings.Citation3Citation9 Specific ingredients have been shown to contribute to a successful learning experience in skills-labs, such as predefined learning goals and curriculum integration, validity of the simulated scenarios,Citation4,Citation10 sustained deliberate practice,Citation1 and feedback.Citation11,Citation12 Although there is evidence that the instructional approach used to introduce novel clinical technical skills to learners also has a decisive impact on subsequent skills performance,Citation8,Citation13 little is yet known about differential effects of varying instructional methods.

In the literature, a variety of instructional approaches that include multiple steps to convey clinical technical skills to learners have been described.Citation14,Citation15 A model that is becoming increasingly prevalent in medical education is “Peyton’s four-step approach”,Citation16Citation18 which consists of four clearly defined instructional steps:

  • Step 1 – “Demonstrate”: The trainer demonstrates the skill at a normal pace and without additional comments.

  • Step 2 – “Talk the trainee through”: The trainer demonstrates the respective skill while describing each procedural substep in detail.

  • Step 3 – “Trainee talks trainer through”: The trainer performs the skill for a third time, based on the substeps described to him by the trainee.

  • Step 4 – “Trainee does”: The trainee performs the skill on his/her own.

A previously published study has shown decisive advantages of Peyton’s four-step approach in undergraduate medical education over standard instruction.Citation13 While the intervention group was instructed in gastric tube insertion by applying Peyton’s four-step approach, the control group received a standard instruction based on the instructional principle of “see one, do one”, the traditional approach in which the skill is first demonstrated and explained by the trainer and then performed by the trainee him/herself.Citation13,Citation19 The first independent performance of gastric tube insertion was videotaped and rated by independent video raters on the basis of binary checklistsCitation20 and the integrated procedural performance instrument for the assessment of procedural skills in a clinical context.Citation21,Citation22 Video analyses showed that the group instructed by Peyton’s four-step approach not only performed more single procedural steps more accurately and had a more professional and self-assured skills execution, but also performed the skill faster than the comparison group. The authors assumed that Step 3 of Peyton’s four-step approach might be of critical importance for learners’ superior skills acquisition, as it integrates mental representation and motor imagery,Citation23Citation25 which might lead to a more elaborate motor learning. However, it remains unclear whether the results can be traced back to a single specific step of Peyton’s four-step approach.

There is ample evidence of a plethora of various cognitive aspects influencing motor skills acquisition, such as the focus of attention,Citation26Citation30 visuospatial competencies,Citation31,Citation32 performance observation and motor imagery,Citation25,Citation33 working memory,Citation34 as well as declarative and procedural memory capacities.Citation35 Due to the fact that declarative memory constitutes an indispensable prerequisite for high-value skills performance,Citation36Citation38 it might be speculated that Peyton’s four-step approach also affects declarative memory for skill performance. One might assume that motor imagination, verbalization, and instructing the teacher, as conducted in Step 3 of Peyton’s four-step approach, leads to a deeper and more elaborate declarative processing of the single steps to be learned in terms of the Level of Processing Theory.Citation39 However, to our knowledge, no studies have been conducted to date on the interplay between declarative memory performance and skills performance in skills-lab training.

The presented study was designed to evaluate the hypotheses that 1) different groups of trainees show more elaborate skills performance depending on how many single steps of Peyton’s four-step approach were completed during the training; 2) the group of trainees who underwent Step 3 show superior procedural performance compared to the group of trainees who receive a repetition of Step 2 instead of Step 3; and 3) this superior performance is also reflected and can be detected in a free recall memory performance test for procedural steps 1 day after the training. Therefore, we performed a clarification study that prospectively investigated the differential learning outcome of the different steps of Peyton’s four-step approach.

Methods

Participants

Trainees were recruited via advertisement, and written consent was provided by all study participants. All 3rd-year medical students at our faculty were contacted and asked to participate in the study. Ninety-seven students were recruited (equivalent of a 40.4% participation rate) and received a book voucher as incentive for participation. Participants were assured that all data obtained would be treated anonymously. They were informed that the purpose of the study was to investigate different teaching models, but no further details were provided concerning the difference between study groups. Each study participant used a pre-prepared sheet to provide data on group characteristics (baseline data) such as age (in years), sex (female/male), previous education in a healthcare-related or medical profession other than as a paramedic or nurse (ie, physiotherapy, dental assistant, etc), and completed medical clerkships.

Materials

Participants underwent a preliminary test of working memory performance and a self-efficacy rating prior to their skills training session. The revised version of the Wechsler Memory Scales,Citation40,Citation41 (German versionCitation42) was designed to assess attention/concentration and working memory as well as logical, visual, and verbal short- and long-term memory. It comprises 13 subtests that are combined to form five primary indexes with retest reliabilities ranging from α =0.80 to α=0.88.Citation43 We employed the subtests assessing short-term and working memory. In the digit span subtest, individual digit spans are slowly read aloud to the participant and are to be repeated by the participant from memory (digit span forward). The second part of the task consists of repeating the digit span in a reversed order (digit span backward). The two task components allow conclusions to be drawn regarding short-term memory capacity (digit span forward) and working memory capacity (digit span backward). The self-efficacy ratings consisted of five items using Likert scale ratings concerning knowledge of anatomy, materials, and the different steps of and the ability to perform a central venous catheter (CVC) insertion on a manikin and on a patient. Students who had already placed a CVC were excluded from the study. Refusal to participate had no impact on later evaluations or other assessments.

The assessment of the skills-lab training was conducted through video ratings of participants’ performances. Recordings of trainees’ performances on the manikin were independently rated by two clinically experienced and trained video assessors who were blind to both the aim of the study and its design. Assessors were provided with checklists comprising 39 binary items that reflected the procedural steps of inserting a CVC.Citation44

Memory performance for the single steps of CVC was assessed by an incidental free recall testCitation45 that was conducted the day after the experiment. Free recall tests represent a measure of active memory retrieval performance.Citation46 Participants were called by telephone and asked to name as many single steps of the CVC as possible in the correct order. For scoring of the test, the same checklists were used that were provided for video assessors in order to allow for maximum comparability of the results. The number of correctly recalled steps as well as the number of steps recalled in the correct order served as dependent variables. Procedural steps were considered to be correctly recalled regardless of the exact medical terms. The free recall test lasted for approximately 10 minutes.

Study design

To implement the study, a total of 97 voluntary participants were randomly assigned to four groups, with two groups being larger due to the main interest in differential effects of Peyton’s Step 3. Each group was taught how to insert a CVC using a manikin, and the groups were instructed with a varying number of steps or a modification of Peyton’s Step 3, respectively ():

  • Step-1 group received Peyton’s Step 1 (n=20).

  • Step-2 group received Peyton’s Steps 1 and 2 (n=20).

  • Step-3 group received Peyton’s Steps 1, 2, and 3 (n=29).

  • Step-3mod group (modified) received Peyton’s Steps 1 and 2, followed by a repetition of Step 2 (n=28).

Figure 1 Study design: All four participating groups underwent skills-lab training with the topic of central venous catheterization (CVC), which was completed after different sub-steps of Peyton’s four-step approach, followed by an immediate video assessment of their first independent performance of CVC. In order to evaluate the differential effect specifically attributed to Step 3, a Step-3mod group was added, which received a mere repetition of step 2. One day after skills-lab training, participants underwent an incidental free recall test to evaluate memory performance.

Figure 1 Study design: All four participating groups underwent skills-lab training with the topic of central venous catheterization (CVC), which was completed after different sub-steps of Peyton’s four-step approach, followed by an immediate video assessment of their first independent performance of CVC. In order to evaluate the differential effect specifically attributed to Step 3, a Step-3mod group was added, which received a mere repetition of step 2. One day after skills-lab training, participants underwent an incidental free recall test to evaluate memory performance.

Each instructional procedure of individual groups was followed by a video assessment of the first independent performance of the task. CVC insertion was chosen as the learning goal as it is a routinely performed clinical skill. At the same time, it is a complex procedure with a high cognitive load for novices. Moreover, it is associated with a number of serious complications, estimated at a rate of about 5.3 per 1,000 catheter days.Citation47 Improper application can have hazardous adverse effects on patients, which are expensive to treat, including hemothorax and air emboli, and can even result in death.Citation48,Citation49

The presented study was conducted over a period of 6 weeks alongside the regular curriculum at the University of Heidelberg. In light of the above-described study design, the University of Heidelberg Ethics Committee waived requirements for an ethical approval procedure. Ethical principles were adhered to.

Skills training sessions

Skills training sessions for all groups were conducted with video instruction for Peyton’s Steps 1 and 2 in order to maximize the standardization of teaching. In the video for Peyton’s Step 1, the teacher performed the CVC insertion without further explanation, while in the video for Peyton’s Step 2, detailed instructions for all necessary action steps were provided. Step 3 (Step-3 group) was performed with a student–teacher ratio of 1:1, in accordance with approved skills training standards.Citation5,Citation50 After watching the videos for Peyton’s Steps 1 and 2, trainees were asked to instruct the teacher to perform the CVC insertion by memory once. The teacher followed these instructions, checking with the trainee if false commands were given. Step-3mod group watched the video for Peyton’s Step 2 twice. The teaching of CVC placement was performed under consideration of checklists based upon international standards.Citation44 Participants did not receive feedback after video recording to prevent biasing the results of the free recall test.

Skills-lab teachers

Step-3 group was trained by two clinically experienced consultants in internal medicine (age, 33 and 36 years), both of whom have considerable experience as certified skills-lab trainers.

Statistical analysis

Data are presented as mean ± standard deviation. Data were compared using Student’s t-tests (continuous interval data) and Mann–Whitney U tests (categorical ordinal data), respectively. The distributions of group characteristics pertaining to sex, previous education in a medical profession, and completed medical clerkships were compared using chi-square tests. A P-value <0.05 was considered to be statistically significant. Inter-rater reliability for the two video assessors was calculated using a Pearson’s correlation. The software package STATISTICA (StatSoft, Inc., Tulsa, OK, USA) was used for statistical analysis.

Results

Participants

There were no statistically significant differences between the four groups with regard to age (mean age of all participants 22.8±2.3 years), sex (57 female, 40 male), completed education in a medical profession (10/97 participants), completed medical clerkships (10/97 participants), preliminary memory tests, or self-efficacy ratings ().

Table 1 Group characteristics of different participating groups; age (mean, SD), sex (f/m), education in medical profession, completed medical clerkships, digit span forward and backward, and self-efficacy rating prior to skills training (five items using Likert scale ratings; 6= completely agree; 1= completely disagree); results of Mann–Whitney U test and chi-square tests

Effectiveness of the training

Ratings by the independent video assessors are presented in . Regarding checklist ratings, Step-2 Group (76.9%±15.0) showed a significantly superior first independent performance of CVC placement compared to Step-1 Group (58.2%±15.1) (P<0.0001), and Step-3 Group (85.4%±14.8) was superior to Step-2 Group (P<0.009), while Step-2 Group and Step-3mod Group (82.9%±14.8) did not differ (P=0.055) significantly. Step-3 Group and Step-3mod Group did not differ significantly (P=0.32). Effect sizes for mean differences between Step-2 Group and Step-3 Group (d=0.72; power =0.79) and between Step-2 Group and Step-3mod Group (d=0.57; power =0.61) show moderate to strong values.

Figure 2 Checklist ratings and memory performance for substeps of central venous catheter (CVC) placement reached by different participating groups.

Notes: (A) Results of video rating using binary checklists for first independent performance of CVC placement after training sessions. Percentage of correctly performed procedural substeps (39 items) reached by participating groups. (B) Number of correctly recalled substeps by participating groups in incidental recall test 1 day after training sessions (39 items); mean; t-test results.
Figure 2 Checklist ratings and memory performance for substeps of central venous catheter (CVC) placement reached by different participating groups.

Results of incidental free recall test

Results of the incidental free recall test 1 day after training (delayed recall) showed a similar pattern of results and even revealed a significant difference between Step-3 Group and Step-3mod Group, with a superior memory performance shown by Step-3 Group (P<0.022). Effect sizes for mean differences between Step-2 Group and Step-3 Group show strong values (d=1.07; power =0.98), small to moderate values between Step-2 Group and Step-3mod Group (d=0.41; power =0.40) and moderate to strong values between Step-3 Group and Step-3mod Group (d=0.63; power =0.76).

Inter-rater reliability for independent video raters

Standardized inter-rater reliability for independent video raters was 0.91 for binary checklist ratings.

Discussion

This study prospectively investigated the learning outcome of the different steps of Peyton’s four-step approach with a focus on the differential implications of Step 3 (“Trainee talks trainer through”), which was compared to a modified Step 3 – a repetition of Step 2 (“Talk the trainee through”). Training effectiveness was examined with respect to participants’ subsequent first performance of independent CVC insertion. Objective video ratings with binary checklists, which focused on the correct stepwise performance, showed a significant superiority of Peyton’s Step 3 over the mere repetition of Step 2. These findings were also confirmed on the level of memory performance for the single steps of CVC as assessed by an incidental free recall test (delayed recall), which additionally revealed a superior memory consolidation of the trained skill.

We assume that Peyton’s Step 3 represents the crucial instructional substep in Peyton’s four-step approach and therefore leads to a superior performance of clinical skills as compared to standard instruction. This was also demonstrated in a previous study,Citation13 in which the authors were able to show that Peyton’s four-step approach leads to a superior and faster procedural performance when students execute their very first gastric tube insertion compared to a standard instruction following a “see one, do one” approach. The current study was able to identify that this advantage of Peyton’s four-step approach can be predominantly accredited to Peyton’s Step 3: While a commented repetition of a demonstration of CVC application (Peyton’s Step 2) has been shown to lead to a superior performance compared to a first uncommented demonstration only (Peyton’s Step 1), Peyton’s Step 3 (following Step 1 and Step 2) leads to a further advantage compared to a mere (third) repetition of a CVC application demonstration (here Step 3 modified), which is reflected in checklist and memory performance results. In other words, although both skills observationCitation33 and motor imageryCitation25 support motor skills acquisition, the combination of motor imagery and skills performance as inherent in Peyton’s Step 3 seems to be superior to skills observation only.

Our study is in line with previous findings from a randomized controlled trial comparing mental vs practical training.Citation51 In that study, surgeons undergoing laparoscopic training were divided into three groups that received mental training, practical training, or no additional training, respectively. The mental training group outperformed both the practical training group and the control group and showed significantly higher task-specific checklist scores. These results support our findings of a specific importance of Peyton’s Step 3 in procedural skills acquisition. Motor imagery is a well-established training method in various sports and is used by athletes and coaches to increase performance.Citation24,Citation52 Furthermore, functional neuroimaging studies (fMRI) have demonstrated specific neural activation in the areas of the primary motor cortex and the cerebellum when subjects imagined body movements without actual muscular activity.Citation53,Citation54

Regarding memory performance for single steps of the CVC procedure as assessed by an incidental free recall test, results showed that memory performance after an instruction following Peyton’s four-step approach (including the regular Step 3) is superior to a modified version of Peyton’s four-step approach including CVC demonstrations only. These findings are in line with the theory of retrieval practice, as Step 3 can be regarded as a correlate of retrieval practice. In a variety of studies, retrieval practice has been shown to greater enhance memory than studying alone.Citation55Citation57 According to the levels of processing framework,Citation39 self-referential encoding leads to a more elaborate processing of relevant information to be learnt compared, for example, to semantic or emotional processing operations. Indeed, in a variety of clinical patient studies, researchers were able to show that information encoded with a reference to the patients themselves resulted in a “deeper” processing and therefore superior encoding.Citation58Citation60 In line with these assumptions, we expected Peyton’s Step 3, which includes motor imagery, to lead to a deeper encoding of single steps when compared to mere performance observation. This deeper encoding might have facilitated the retrieval of single procedural steps and therefore might have led to a reduced cognitive load,Citation61 meaning that more cognitive resources were available for the procedural performance itself. In a study comparing laparoscopic training with either explicit or implicit motor learning, Zhu et alCitation62 were able to show that implicit learning reduced EEG coactivation between verbal-analytic and motor planning regions, suggesting that verbal-analytic processes were less involved in laparoscopic performance. They conclude that implicit motor learning leads to the same level of technical proficiency as explicit motor learning but with greater neural efficiency. Deeper encoding of single steps, reflected in an eased recall in our study, might therefore prevent enhanced verbal-analytic processes that interfere with procedural performance. Superior declarative memory of single CVC steps as a prerequisite for CVC skills performance might also lead to a higher quality of skills execution in future procedural performances. Future research should assess whether self-referential motor imagery leads to a better skills performance than motor imagery that instructs the skills teacher. Previous research has shown that self-referential encoding leads to deeper encoding based on Levels of Processing Theory.Citation39

Several limitations of our study should be mentioned. First of all, group sizes were rather small. However, potential confounders were distributed equally across groups, and a previous study examining Peyton’s four-step approach used comparable group sizes.Citation13 We did not examine performance of CVC skills on a real patient as this would have called for the trainer to intervene during the performance if the trainee made mistakes and would have consequently led to difficulties in objectively rating the performance. We did not evaluate objective competencies in CVC placement prior to the training, as this was a predefined exclusion criterion for participants in light of our aim to evaluate participants’ very first independent performance of the skill. Furthermore, a student-to-teacher ratio of 1:1 does not reflect normal skills-lab training conditions. However, our aim was to observe emerging effects as purely and in an as isolated a manner as possible in a research setting. Group 3 was the only group that had direct contact with a teacher and this could have influenced their performance as the engagement with a more senior person could have implications for a student’s motivation to do well. On the other hand, this could as well have led to an intimidation of trainees and thus negatively influence their performance. The Step-1 group and the Step-2 group did not have the chance to inquire upon possible ambiguities as they only received video training. Furthermore, results in the delayed recall test may not correlate with actual performance of the task; hence, all conclusions must be interpreted with this in mind. Finally, we used videos for Peyton’s Steps 1 and 2, despite the fact that the original approach calls for a direct trainer-trainee interaction. We purposely decided to do so in order to ensure that the training was completely equal for all students regarding Steps 1 and 2.

In summary, our study identified Peyton’s Step 3 as being the most crucial part of Peyton’s four-step approach, contributing significantly more to learning success than previous steps and reaching beyond the benefit of a mere repetition of skills demonstration. It remains unclear whether our findings are transferable to other settings such as the workplace. In order to adapt to workplace conditions, researchers would need to assess trainees’ performance in a longitudinal way, which means that the respective skill should be evaluated in different situations with several patients. Furthermore, in order to meet concerns of time management, it may be helpful only to train substeps of a skill so that, for instance, a patient does not need to hold still for a long time while a CVC is placed. Further studies should therefore evaluate the effectiveness of this instructional approach with respect to these considerations.

Disclosure

The authors report no conflicts of interest in this work.

References

  • EricssonKAKrampeRTTeschromerCThe role of deliberate practice in the acquisition of expert performancePsychol Rev19931003363406
  • ZivABen-DavidSZivMSimulation based medical education: an opportunity to learn from errorsMed Teach200527319319916011941
  • BradleyPBlighJOne year’s experience with a clinical skills resource centreMed Educ199933211412010211261
  • IssenbergSBMcGaghieWCPetrusaERLee GordonDScaleseRJFeatures and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic reviewMed Teach2005271102816147767
  • JüngerJSchäferSRothCSchellbergDFriedman Ben-DavidMNikendeiCEffects of basic clinical skills training on objective structured clinical examination performanceMed Educ200539101015102016178828
  • LynaghMBurtonRSanson-FisherRA systematic review of medical skills laboratory training: where to from here?Med Educ200741987988717696985
  • WeyrichPSchrauthMKrausBUndergraduate technical skills training guided by student tutors – analysis of tutors’ attitudes, tutees’ acceptance and learning progress in an innovative teaching modelBMC Med Educ200881818400106
  • LundFSchultzJHMaatoukIEffectiveness of IV cannulation skills laboratory training and its transfer into clinical practice: a randomized, controlled trialPLoS One201273e3283122427895
  • CookDAHatalaRBrydgesRTechnology-enhanced simulation for health professions education: a systematic review and meta-analysisJAMA2011306997898821900138
  • NikendeiCZeuchADieckmannPRole-playing for more realistic technical skills trainingMed Teach200527212212616019330
  • RogerKFernandoBDebraNLearner-centred feedback using remote assessment of clinical proceduresMed Teach200830879580118608948
  • VeloskiJBoexJRGrasbergerMJEvansAWolfsonDBSystematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME guide no 7Med Teach200628211712816707292
  • KrautterMWeyrichPSchultzJHEffects of Peyton’s four-step approach on objective performance measures in technical skills training: a controlled trialTeach Learn Med201123324425021745059
  • AbusrewilFCameronMCampionJGriffithsSJollyBCWallaceDAdvanced trauma life support skills training: a controlled trialPaper presented at: Sixth Ottawa Conference on Medical EducationOttawa1994
  • American College of Surgeons Committee on TraumaAdvanced Trauma Life Support Program for DoctorsChicago, IL: ATLSAmerican College of Surgeons1997
  • BenjaminLSelection, teaching and training in ophthalmologyClin Experiment Ophthalmol200533552453016181283
  • LakeFRHamdorfJMTeaching on the run tips 5: teaching a skillMed J Aust2004181632732815377246
  • WalkerMPeytonJWRTeaching in the theatrePeytonJWRTeaching and Learning in Medical PracticeRickmansworthManticore Publishers Europe Ltd1998171180
  • DentJABedside teachingDentJAHardenRMA Practical Guide for Medical TeachersEdinburghElsevier Churchill Livingstone20057785
  • RegehrGMacRaeHReznickRKSzalayDComparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examinationAcad Med19987399939979759104
  • KneeboneRBelloFNestelDYadollahiFDarziATraining and assessment of procedural skills in context using an Integrated Procedural Performance Instrument (IPPI)Stud Health Technol Inform200712522923117377272
  • KneeboneRNestelDYadollahiFAssessing procedural skills in context: exploring the feasibility of an Integrated Procedural Performance Instrument (IPPI)Med Educ200640111105111417054620
  • GentiliRPapaxanthisCPozzoTImprovement and generalization of arm motor performance through motor imagery practiceNeuroscience2006137376177216338093
  • WilliamsJOdleyJCallaghanMMotor imagery boosts proprioceptive neuromuscular facilitation in the attainment and retention of range-of-motion at the hip jointJ Sports Sci Med2004316016624482593
  • MoranAGuillotAMacIntyreTColletCRe-imagining motor imagery: building bridges between cognitive neuroscience and sport psychologyBr J Psychol2012103222424722506748
  • KasperRWElliottJCGiesbrechtBMultiple measures of visual attention predict novice motor skill performance when attention is focused externallyHum Mov Sci20123151161117422516836
  • PehSYChowJYDavidsKFocus of attention and its impact on movement behaviourJ Sci Med Sport2011141707820727824
  • PorterJMAntonPMWuWFIncreasing the distance of an external focus of attention enhances standing long jump performanceJ Strength Cond Res20122692389239322067252
  • SchorerJJaitnerTWollnyRFathFBakerJInfluence of varying focus of attention conditions on dart throwing performance in experts and novicesExp Brain Res2012217228729722210117
  • ShafizadehMMcMorrisTSprouleJEffect of different external attention of focus instruction on learning of golf putting skillPercept Mot Skills2011113266267022185080
  • ReimerAMCoxRFNijhuis-Van der SandenMWBoonstraFNImprovement of fine motor skills in children with visual impairment: an explorative studyRes Dev Disabil20113251924193321531536
  • Van HerzeeleIO’DonoghueKGAggarwalRVermassenFDarziACheshireNJVisuospatial and psychomotor aptitude predicts endovascular performance of inexperienced individuals on a virtual reality simulatorJ Vasc Surg20105141035104220347702
  • HolmesPCalmelsCA neuroscientific review of imagery and observation use in sportJ Mot Behav200840543344518782718
  • Jongbloed-PereboomMJanssenAJSteenbergenBNijhuis-Van der SandenMWMotor learning and working memory in children born preterm: a systematic reviewNeurosci Biobehav Rev20123641314133022353425
  • BrownRMRobertsonEMOff-line processing: reciprocal interactions between declarative and procedural memoriesJ Neurosci20072739104681047517898218
  • JapikseKCNegashSHowardJHJrHowardDVIntermanual transfer of procedural learning after extended practice of probabilistic sequencesExp Brain Res20031481384912478395
  • WillinghamDBImplicit motor sequence learning is not purely perceptualMem Cognit1999273561572
  • WillinghamDBWellsLAFarrellJMStemwedelMEImplicit motor sequence learning is represented in response locationsMem Cognit2000283366375
  • CraikFIMTulvingEDepth of processing and the retention of words in episodic memoryJ Exp Psychol19751043268294
  • WechslerDA standardized memory scale for clinical useJ Psychol19451918795
  • WechslerDWechsler Memory Scale – Revised EditionNew YorkThe Psychological1987
  • HaertingCDeutsche Adaptation der revidierten Fassung der Wechsler Memory Scale. [German Version of the Revised Version of the Wechsler Memory Scale]Bern, SwitzerlandHans Huber2000 German
  • LienertGRaatzUTestaufbau und Testanalyse [Test Construction and Test Analysis]5WeinheimPsychologie Verlags Union1994
  • GrahamASOzmentCTegtmeyerKLaiSBranerDAVideos in clinical medicine. Central venous catheterizationN Engl J Med200735621e2117522396
  • BrandNJollesJLearning and retrieval rate of words presented auditorily and visuallyJ Gen Psychol198511222012104056765
  • BrandANJollesJGispen-de WiedCRecall and recognition memory deficits in depressionJ Affect Disord199225177861624647
  • ShojaniaKGDuncanBWMcDonaldKMWachterRMMDMarkowitzAJMaking Health Care Safer: A Critical Analysis of Patient Safety Practices. Evidence Report/Technology Assessment No 43(Prepared by the University of California at San Francisco-Stanford Evidence-based Practice Center under Contract No. 290-97-0013), AHRQ Publication No. 01-E058Rockville, MDAgency for Healthcare Research and Quality2001
  • GeXCavallazziRLiCPanSMWangYWWangFLCentral venous access sites for the prevention of venous thrombosis, stenosis and infectionCochrane Database Syst Rev20123CD00408422419292
  • PesceCMercurellaAMusiLCampobassoPNegriMFatal cardiac tamponade as a late complication of central venous catheterization: a case reportEur J Pediatr Surg19999211311510342120
  • NikendeiCKrausBSchrauthMIntegration of role-playing into technical skills training: a randomized controlled trialMed Teach200729995696018158671
  • ImmenrothMBurgerTBrennerJNagelschmidtMEberspacherHTroidlHMental training in surgical education: a randomized controlled trialAnn Surg2007245338539117435545
  • HolmesPSCollinsDJThe PETTLEP approach to motor imagery: a functional equivalence model for sport psychologistsJ Appl Sport Psychol20011316083
  • DecetyJPeraniDJeannerodMMapping motor representations with positron emission tomographyNature199437164986006027935791
  • RothMDecetyJRaybaudiMPossible involvement of primary motor cortex in mentally simulated movement: a functional magnetic resonance imaging studyNeuroreport199677128012848817549
  • KarpickeJDRoedigerHLThe critical importance of retrieval for learningScience2008319586596696818276894
  • LarsenDPButlerACLawsonALRoedigerHL3rdThe importance of seeing the patient: test-enhanced learning with standardized patients and written tests improves clinical application of knowledgeAdv Health Sci Educ Theory Pract201318340942522618856
  • RoedigerHLKarpickeJDTest-enhanced learning: taking memory tests improves long-term retentionPsychol Sci200617324925516507066
  • KuiperNADerryPADepressed and nondepressed content self-reference in mild depressivesJ Pers198250167807086630
  • LimSLKimJHCognitive processing of emotional information in depression, panic, and somatoform disorderJ Abnorm Psychol20051141506115709812
  • PincusTPearceSMcClellandAIsenbergDEndorsement and memory bias of self-referential pain stimuli in depressed pain patientsBr J Clin Psychol199534pt 22672777647718
  • van MerrienboerJJSwellerJCognitive load theory in health professional education: design principles and strategiesMed Educ2010441859320078759
  • ZhuFFPooltonJMWilsonMRHuYMaxwellJPMastersRSImplicit motor learning promotes neural efficiency during laparoscopySurg Endosc20112592950295521455805