2,104
Views
46
CrossRef citations to date
0
Altmetric
Research Article

Global Rating Scale for the Assessment of Paramedic Clinical Competence

, ACP, PhD, , MD, Med, , CCP, BHSc, , ACP & , PhD
Pages 57-67 | Received 27 Apr 2012, Accepted 16 May 2012, Published online: 26 Jul 2012

References

  • Miller GE. The assessment of clinical skills/competence/ performance. Acad Med. 1990;65(9 suppl):S63–7.
  • Brennan RL. Educational Measurement. Westport, CT: Praeger Pub Text, 2006.
  • Regener H. A proposal for student assessment in paramedic education. Med Teach. 2005;27:234–41.
  • Lammers RL, Byrwa MJ, Fales WD, Hale RA. Simulation-based assessment of paramedic pediatric resuscitation skills. Prehosp Emerg Care. 2009;13:345–56.
  • Studnek JR, Fernandez AR, Shimber B, Garifo M, Correll M. The association between emergency medical services field performance assessed by high-fidelity simulation and the cognitive knowledge of practicing paramedics. Acad Emerg Med. 2011;18:1177–85.
  • Hodges B, Regehr G, McNaughton N, Toberius R, Hanson M. OSCE checklists do not capture increasing levels of expertise. Acad Med. 1999;74:1129.
  • Regehr G, MacRae H, Reznick R, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med. 1998;73:993–7.
  • von Wyl T, Zuercher M, Amsler F, Walter B, Ummenhofer W. Technical and non-technical skills can be reliably assessed during paramedic simulation training. Acta Anaesthesiol Scand. 2009;53:121–7.
  • Martin M, Hubble MW, Hollis M, Richards ME. Interevaluator reliability of a mock paramedic practical examination. Prehosp Emerg Care. 2012;16:277–83.
  • Hodges B, McIlroy JH. Analytic global OSCE ratings are sensitive to level of training. Med Educ. 2003;37:1012–6.
  • Martin J, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchinson C. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273–8.
  • Swanwick T. Understanding Medical Education. Wiley Online Library, 2010.
  • Govaerts MJB, van der Vleuten CPM, Schuwirth LWT. Optimising the reproducibility of a performance-based assessment test in midwifery education. Adv Health Sci Educ. 2002;7:133–45.
  • Han J, Kreiter CD, Park H, Ferguson KJ. An experimental comparison of rater performance on an SP-based clinical skills exam. Teach Learn Med. 2006;18:304–9.
  • Kane MT. Validation. In: Brennan RL (ed). Educational Measurement. 4th ed. Westport, CT: Praeger Publishers, 2006, pp 17–64.
  • Morgan P, Lam-McCulloch J, Herold-McIlroy J, Tarshis J. Simulation performance checklist generation using the Delphi technique. Can J Anesth. 2007;54:992–7.
  • de Villiers M, de Villiers P, Kent A. The Delphi technique in health sciences education research. Med Teach. 2005;27:639–43.
  • Graber M. Educational strategies to reduce diagnostic error: can you teach this stuff? Adv Health Sci Educ. 2009;14:63–9.
  • Ericsson K, Krampe R, Tesch-Römer C. The role of deliberate practice in the acquisition of expert performance. Psychol Rev. 1993;100:363–406.
  • Paramedic Association of Canada, National Occupational Competency Profile. Ottawa, Ontario, Canada: Paramedic Association of Canada, 2001.
  • Ontario Ministry of Health. Emergency Health Services Branch. BLS Standards of Care. Vol. 2.0. Toronto, Ontario, Canada: Publications Ontario, 2007.
  • Ontario Ministry of Health, Emergency Health Services Branch. Advanced Life Support Standards. Toronto, Ontario, Canada: Publications Ontario, 2007.
  • Ontario Ministry of Training Colleges and Universities, Paramedic Program Standards. Toronto, Ontario, Canada: Queens Printer for Ontario, 2008.
  • Cohen J. Statistical Power Analysis for the Behavioral Sciences. New York: Academic Press, 1977.
  • Kim J, Neilpovitz D, Cardinal P, Chiu M, Clinch J. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med. 2006;34:2167.
  • Streiner D, Norman G. Health Measurement Scales: A Practical Guide to Their Development and Use. Fouth ed. New York: Oxford University Press, 2008.
  • Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006; 119:166, e7–16.
  • Brennan R Generalizability theory. Educ Measure Issues Pract. 1992;11(4):27–34.
  • Wilkinson TJ, Newble DI, Frampton CM. Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing score. Med Educ. 2001;35:1043–9.
  • Humphrey-Murto S, MacFadyen JC. Standard setting: a comparison of case-author and modified borderline-group methods in a small-scale OSCE. Acad Med. 2002;77:729–32.
  • Cizek GJ. Setting Performance Standards: Concepts, Methods, and Perspectives. Mahwah, NJ: Lawrence Erlbaum Associates Inc., 2001.
  • Kirwan BE, Ainsworth LK. A Guide to Task Analysis. Philadelphia: Taylor & Francis, 1992.
  • Tavares W, Eva KW. Exploring the impact of mental workload on rater-based assessments. Adv Health Sci Educ. 2012; Apr 7 (Epub ahead of print; doi: 10.1007/s10459-012-9370-3).
  • Holmboe ES, Huot S, Chung J, Norcini J, Hawkins RE. Construct validity of the MiniClinical Evaluation Exercise (MiniCEX). Acad Med. 2003;78:826–30.
  • Goff BA, Nielsen PE, Lentz GM, Surgical skills assessment: a blinded examination of obstetrics and gynecology residents. Am J Obstet Gynecol. 2002;186:613–7.
  • Winckel CP, Reznick R, Cohen R, Taylor B. Reliability and construct validity of a structured technical skills assessment form. Am J Surg. 1994;167:423–7.
  • Lurie S, Mooney C, Lyness J. Measurement of the general competencies of the Accreditation Council for Graduate Medical Education: a systematic review. Acad Med. 2009;84:301–9.
  • Gingerich A, Regehr G, Eva KW. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 2011;86(10 suppl):S1–7.
  • Crossley J, Johnson G, Booth J, Wade W. Good questions, good answers: construct alignment improves the performance of workplace based assessment scales. Med Educ. 2011;45:560–9.
  • Crossley J, Jolly B. Making sense of work-based assessment: ask the right questions, in the right way, about the right things, of the right people. Med Educ. 2012;46(1):28–37.
  • Cizek GJ. Bunch MB. Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests. Thousand Oaks, CA: Sage Publications, 2007.
  • Downing S, Yudkowsky R. Assessment in Health Professions Education. New York: Taylor & Francis, 2009.
  • Eva K. Assessment strategies in medical education. In: Salerno-Kennedy R, O'Flynn S (eds). Medical Education: State of the Art. Halifax, Nova Scotia, Canada: Nova Scotia Publishers, Inc., 2010.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.