A competency based selection procedure for Dutch postgraduate GP training: A pilot study on validity and reliability

REFERENCES

• Vermeulen MI, Kuyvenhoven MM, Zuithoff NPA, Tromp F, Graaf van der Y, Pieters HM. Selection for Dutch postgraduate GP training; time for improvement. Eur J Gen Pract. 2012;18:201–5.
   PubMed Web of Science ®Google Scholar
• Siu E, Reiter HI. Overview: What's worked and what hasn't as a guide towards predictive admissions tool development. Adv in Health Sci Educ. 2009;14:758–75.
   Google Scholar
• Patterson F, Ferguson E, Norfolk T, Lane P. A new selection system to recruit general practice registrars: Preliminary findings from a validation study. Br Med J. 2005;330:711–4.
   PubMed Web of Science ®Google Scholar
• Prideaux D, Roberts C, Eva K, Centeno A, McCrorie P, McManus C, et al. Assessment for selection for the health care professions and specialty training: Consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 2011;33:215–23.
   PubMed Web of Science ®Google Scholar
• van der Vleuten CPM, Schuwirth LW. Assessing professional competence: From methods to programmes. Med Educ. 2005; 39:309–17.
   PubMed Web of Science ®Google Scholar
• Patterson F, Ashworth V, Zibarras L, Coan P, Kerrin M, O’Neill P. Evaluations of situational judgement tests to assess non-academic attributes in selection. Med Educ. 2012;46:850–68.
   PubMed Web of Science ®Google Scholar
• Irish B, Patterson F. Selecting general practice specialty trainees: Where next? Br J Gen Pract. 2010;60:849–52.
   PubMed Web of Science ®Google Scholar
• Patterson F, Zibarras L, Carr V, Irish B, Gregory S. Evaluating candidate reactions to selection practices using organisational justice theory. Med Educ. 2011;45:289–97.
   PubMed Web of Science ®Google Scholar
• Tromp F, Vernooij-Dassen M, Grol R, Kramer A, Bottema B. Assessment of CanMEDS roles in postgraduate training: The validation of the Compass. Patient Educ Couns. 2012;89:199–204.
   Google Scholar
• Eva KW, Reiter HI, Trinh K, Wasi P, Rosenfeld J, Norman GR. Predictive validity of the multiple mini-interview for selecting medical trainees. Med Educ. 2009;43:767–75.
   PubMed Web of Science ®Google Scholar
• Schmidt FL, Hunter JE. The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychol Bull. 1998; 124:262–74.
   Web of Science ®Google Scholar
• Lievens F, Patterson F. The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection. J Appl Psychol. 2011;96:927–40.
   PubMed Web of Science ®Google Scholar
• Huffcutt AI, Conway JM, Roth PL, Stone NJ. Identification and meta-analytic assessment of psychological constructs measured in employment interviews. J Appl Psychol. 2001;86:897–913.
   PubMed Web of Science ®Google Scholar
• Altmaier EM, Smith WL, O’Halloran CM, Franken EA, Jr. The predictive utility of behavior-based interviewing compared with traditional interviewing in the selection of radiology residents. Invest Radiol. 1992;27:385–9.
   PubMedGoogle Scholar
• Brothers TE, Wetherholt S. Importance of the faculty interview during the resident application process. J Surg Educ. 2007;64: 378–85.
   PubMedGoogle Scholar
• Eva KW, Rosenfeld J, Reiter HI, Norman GR. An admissions OSCE: The multiple mini-interview. Med Educ. 2004;38:314–26.
   PubMed Web of Science ®Google Scholar
• Ram P, van der Vleuten C, Rethans JJ, Schouten B, Hobma S, Grol R. Assessment in general practice: The predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice. Med Educ. 1999;33:197–203.
   PubMed Web of Science ®Google Scholar
• Vermeulen MI, Kuyvenhoven MM, Zuithoff NPA, van der Graaf Y, Pieters HM. Attrition and poor performance in general practice training; age, competence and knowledge play a role. Ned Tijdschr Geneeskd. 2011;155:A2780.
   Google Scholar
• Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65:S63–7.
   PubMed Web of Science ®Google Scholar
• Association of Universities the Netherlands. Gedragscode voor gebruik van persoonsgegevens in wetenschappelijk onderzoek (in Dutch) 2005.
   Google Scholar
• Vermeulen MI, Kuyvenhoven MM, Zuithoff NPA, Graaf van der Y, Damoiseaux RAMJ. Dutch postgraduate GP selection procedure; reliability of interview assessments. BMC Fam Pract 2013;14:43.
   Google Scholar
• Van Leeuwen YD, Pollemans MC, Mol SSL, Eekhof JAH, Grol R, Drop MJ. Dutch knowledge test for general practice: Issues of validity. Eur J Gen Pract. 1995;1:113–7.
   Google Scholar
• Gardner MJ, Altman DG. Statistics with confidence. Confidence intervals and statistical guidelines. London: Br Med J. 1989.
   Google Scholar
• van der Heijden GJ, Donders AR, Stijnen T, Moons KG. Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariable diagnostic research: A clinical example. J of Clin Epidemiol. 2006;59:1102–9.
   PubMed Web of Science ®Google Scholar
• McGraw KO, Wong SP. Forming inferences about some intraclass correlations coefficients. Psychol methods 1996;1:30–46.
   Web of Science ®Google Scholar
• Schuwirth LWT, Vleuten van der CPM. How to design a useful test: The principles of assessment. In: Swanwick T, editor. Understanding medical education: Evidence, theory and practice. First ed. London: Wiley-Blackwell; 2010. pp. 195–207.
   Google Scholar
• Kramer AWM, Düsman H, Tan LHC, Jansen KJM, Grol RPTM, van der Vleuten CPM. Effect of extension of postgraduate training in general practice on the acquisition of knowledge of trainees. Fam Pract. 2003;20:207–12.
   Google Scholar
• Gingerich A, Regehr G, Eva KW, Rater-based assessments as social judgements: Rethinking the etiology of raters errors. Acad Med. 2011;86:S1–7.
   PubMed Web of Science ®Google Scholar