3,969
Views
91
CrossRef citations to date
0
Altmetric
AMEE Guide

Script concordance testing: From theory to practice: AMEE Guide No. 75

, , , &
Pages 184-193 | Published online: 29 Jan 2013
 

Abstract

The script concordance test (SCT) is used in health professions education to assess a specific facet of clinical reasoning competence: the ability to interpret medical information under conditions of uncertainty. Grounded in established theoretical models of knowledge organization and clinical reasoning, the SCT has three key design features: (1) respondents are faced with ill-defined clinical situations and must choose between several realistic options; (2) the response format reflects the way information is processed in challenging problem-solving situations; and (3) scoring takes into account the variability of responses of experts to clinical situations. SCT scores are meant to reflect how closely respondents’ ability to interpret clinical data compares with that of experienced clinicians in a given knowledge domain. A substantial body of research supports the SCT's construct validity, reliability, and feasibility across a variety of health science disciplines, and across the spectrum of health professions education from pre-clinical training to continuing professional development. In practice, its performance as an assessment tool depends on careful item development and diligent panel selection. This guide, intended as a primer for the uninitiated in SCT, will cover the basic tenets, theoretical underpinnings, and construction principles governing script concordance testing.

Notes

1. As Fournier et al. (Citation2008) point out, the zero anchor on an SCT Likert scale is not meant to be a shelter for candidates without a clear opinion, in contrast to the 0 anchor on an opinion poll that often indicates an “I don’t know” response.

2. For instance, if, for a given question, the modal answer was “+1,” then “−2” responses were removed from the answer key.

3. As a rule of thumb, test-makers should aim to generate one and a half (150%) times the amount of questions they plan to use in their final “optimized” version of the test (i.e. around 90–120 questions).

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 65.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 771.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.