3,701
Views
84
CrossRef citations to date
0
Altmetric
Research Article

Performance in assessment: Consensus statement and recommendations from the Ottawa conference

, , , , , & show all
Pages 370-383 | Published online: 25 Apr 2011

Keep up to date with the latest research on this topic with citation updates for this article.

Read on this site (19)

Katharine Boursicot, Sandra Kemp, John Norcini, Vishna Devi Nadarajah, Susan Humphrey-Murto, Elize Archer, Jen Williams, Eeva Pyörälä & Riitta Möller. (2023) Synthesis and perspectives from the Ottawa 2022 conference on the assessment of competence. Medical Teacher 45:9, pages 978-983.
Read now
Zhehan Jiang, Jinying Ouyang, Li Li, Yuting Han, Lingling Xu, Ren Liu & Junhua Sun. (2022) Cost-Effectiveness Analysis in Performance Assessments: A Case Study of the Objective Structured Clinical Examination. Medical Education Online 27:1.
Read now
Ilene Rosenberg, Listy Thomas, Gabbriel Ceccolini & Richard Feinn. (2022) ‘Early identification of struggling pre-clerkship learners using formative clinical skills OSCEs: an assessment for learning program.’. Medical Education Online 27:1.
Read now
Matt Homer & Jen Russell. (2021) Conjunctive standards in OSCEs: The why and the how of number of stations passed criteria. Medical Teacher 43:4, pages 448-455.
Read now
Katharine Boursicot, Sandra Kemp, Tim Wilkinson, Ardi Findyartini, Claire Canning, Francois Cilliers & Richard Fuller. (2021) Performance assessment: Consensus statement and recommendations from the 2020 Ottawa Conference. Medical Teacher 43:1, pages 58-67.
Read now
William B. Cutrer, Regina G. Russell, Mario Davidson & Kimberly D. Lomis. (2020) Assessing medical student performance of Entrustable Professional Activities: A mixed methods comparison of Co-Activity and Supervisory Scales. Medical Teacher 42:3, pages 325-332.
Read now
Helena C Frawley$suffix/text()$suffix/text(), Patricia Neumann$suffix/text()$suffix/text() & Clare Delany$suffix/text()$suffix/text(). (2019) An argument for competency-based training in pelvic floor physiotherapy practice. Physiotherapy Theory and Practice 35:12, pages 1117-1130.
Read now
Ronald M. Harden & Pat Lilley. (2018) Best practice for assessment. Medical Teacher 40:11, pages 1088-1090.
Read now
Kimberly D. Lomis, Regina G. Russell, Mario A. Davidson, Amy E. Fleming, Cathleen C. Pettepher, William B. Cutrer, Geoffrey M. Fleming & Bonnie M. Miller. (2017) Competency milestones for medical students: Design, implementation, and analysis at one medical school. Medical Teacher 39:5, pages 494-504.
Read now
Yoyo Suhoyo, Johanna Schönrock-Adema, Gandes Retno Rahayu, Jan B. M. Kuks & Janke Cohen-Schotanus. (2014) Meeting international standards: A cultural approach in implementing the mini-CEX effectively in Indonesian clerkships. Medical Teacher 36:10, pages 894-902.
Read now
Pam Harvey, Natalie Radomski & Dennis O’Connor. (2013) Written feedback and continuity of learning in a geographically distributed medical education program. Medical Teacher 35:12, pages 1009-1013.
Read now
Kamran Z. Khan, Sankaranarayanan Ramachandran, Kathryn Gaunt & Piyush Pushkar. (2013) The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: An historical and theoretical perspective. Medical Teacher 35:9, pages e1437-e1446.
Read now
Madalena Folque Patrício, Miguel Julião, Filipa Fareleira & António Vaz Carneiro. (2013) Is the OSCE a feasible tool to assess competencies in undergraduate medical education?. Medical Teacher 35:6, pages 503-514.
Read now
Natish Bindal, Helen Goodyear, Taruna Bindal & David Wall. (2013) DOPS assessment: A study to evaluate the experience and opinions of trainees and assessors. Medical Teacher 35:6, pages e1230-e1234.
Read now
Keh-Min Liu, Tsuen-Chiuan Tsai & Shih-Li Tsai. (2013) Clinical skills examination as part of the Taiwan National Medical Licensing Examination. Medical Teacher 35:2, pages 173-173.
Read now
DavidB. Swanson & CeesP.M. van der Vleuten. (2013) Assessment of Clinical Skills With Standardized Patients: State of the Art Revisited. Teaching and Learning in Medicine 25:sup1, pages S17-S25.
Read now
Gerard J. Gormley, Jenny Johnston, Clare Thomson & Kieran Mcglade. (2012) Awarding global grades in OSCEs: Evaluation of a novel eLearning resource for OSCE examiners. Medical Teacher 34:7, pages 587-589.
Read now

Articles from other publishers (65)

Scott Patterson, Louise Shaw, Michelle M Rank & Brett Vaughan. (2023) Assessments Used for Summative Purposes during Internal Medicine Specialist Training: A Rapid Review. Education Sciences 13:10, pages 1057.
Crossref
Aliki Thomas, Annie Rochette, Catherine George, Muhammad Zafar Iqbal, Rebecca Ataman, Christina St-Onge, Jill Boruff & Jean-Sébastien Renaud. (2023) The Definitions and Conceptualizations of the Practice Context in the Health Professions: A Scoping Review. Journal of Continuing Education in the Health Professions 43:4S, pages S18-S29.
Crossref
Lorne L. Costello, Dennis D. Cho, Ryan C. Daniel, Joana Dida, Jodie Pritchard & Kaif Pardhan. (2023) Emergency medicine resident perceptions of simulation-based training and assessment in competence by design. Canadian Journal of Emergency Medicine 25:10, pages 828-835.
Crossref
Angelina Lim, Sunanthiny Krishnan, Harjit Singh, Simon Furletti, Mahbub Sarkar, Derek Stewart & Daniel Malone. (2023) Linking assessment to real life practice – comparing work based assessments and objective structured clinical examinations using mystery shopping. Advances in Health Sciences Education.
Crossref
Aderemi O Alalade & Sindhu Sekar. (2023) Simulation-Based Education for Enhancing Obstetric Emergency Response: A Needs Impact Evaluation. Cureus.
Crossref
Chau Chain Yan & Karie Choo. (2023) Designing direct observation of procedural skills (DOPS) for core competency skills at the primary care setting. Science Talks 5, pages 100159.
Crossref
Isabelle Boulais, Kathleen Ouellet, Elise Vachon Lachiver, Mélanie Marceau, Linda Bergeron, Frédéric Bernier & Christina St-Onge. (2023) Considering the Structured Oral Examinations Beyond Its Psychometrics Properties. Medical Science Educator 33:2, pages 345-351.
Crossref
Lucie Pelland, Klodiana Kolomitro, Diana Hopkins-Rosseel & Paola Durando. (2022) The Scientific Rigor of the Objective Structured Examination for Competency Assessment in Health Sciences Education: A Systematic Review. Journal of Physical Therapy Education 36:4, pages 322-333.
Crossref
Patrick J. McGown, Celia A. Brown, Ann Sebastian, Ricardo Le, Anjali Amin, Andrew Greenland & Amir H. Sam. (2022) Is the assumption of equal distances between global assessment categories used in borderline regression valid?. BMC Medical Education 22:1.
Crossref
Eva K. Hennel, Andrea Trachsel, Ulrike Subotic, Andrea C. Lörwald, Sigrid Harendza & Sören Huwendiek. (2022) How does multisource feedback influence residency training? A qualitative case study. Medical Education 56:6, pages 660-669.
Crossref
Dipmala DasDr.Dr. & Asitava Deb RoyDr.Dr.. (2022) SWOC-ANALYSIS OF CBME IMPLEMENTATION FOR PHASE II MBBS IN ONE OF THE LARGEST PRIVATE MEDICAL COLLEGES OF EASTERN INDIA. INDIAN JOURNAL OF APPLIED RESEARCH, pages 48-49.
Crossref
Theodora Papavasiliou, Rebecca Nicholas, Lilli Cooper, Jeffrey C. Y Chan, Javier Ibanez, Charles J Bain & Lauren Uppal. (2022) Utilisation of a 3D printed ex vivo flexor tendon model to improve surgical training. Journal of Plastic, Reconstructive & Aesthetic Surgery 75:3, pages 1255-1260.
Crossref
Kelly Macauley, Stephanie Laprino & Tracy Brudvig. (2022) Perceptions of Physical Therapy Students on their Psychomotor Examinations: a Qualitative Study. Medical Science Educator 32:2, pages 349-360.
Crossref
B. Kumaravel, C. Stewart & D. Ilic. (2021) Development and evaluation of a spiral model of assessing EBM competency using OSCEs in undergraduate medical education. BMC Medical Education 21:1.
Crossref
Claire Poole & Aileen Patterson. (2021) Fostering the development of professional identity within healthcare education-interdisciplinary innovation. Journal of Medical Imaging and Radiation Sciences 52:4, pages S45-S50.
Crossref
Jonathan M. AmielDorothy A. AndrioleDiane M. BiskobingDavid R. BrownWilliam B. CutrerMatthew T. EmeryGeorge C. MejicanoMichael S. RyanJennifer L. SwailsDianne P. Wagner. (2021) Revisiting the Core Entrustable Professional Activities for Entering Residency. Academic Medicine 96:7S, pages S14-S21.
Crossref
Dixon Thomas, Sherief Khalifa, Jayadevan Sreedharan & Rucha Bond. (2021) Inter-rater Reliability of Preceptors on Clinical Pharmacy Competency Evaluation. Current Drug Therapy 16:2, pages 148-153.
Crossref
Lucy M. Alpine, Anne O'Connor, Marian McGuinness & Emer M. Barrett. (2020) Performance‐based assessment during clinical placement: Cross‐sectional investigation of a training workshop for practice educators. Nursing & Health Sciences 23:1, pages 113-122.
Crossref
Mikael Rewers & Doris Østergaard. (2021) The evolution of a national, advanced airway management simulation-based course for anaesthesia trainees. European Journal of Anaesthesiology 38:2, pages 138-145.
Crossref
Sandra Widaty, Hardyanto Soebono, Sunarto & Ova Emilia. (2021) Development of a new instrument to assess clinical performance of residents in dermatology-venereology department. The Asia Pacific Scholar 6:1, pages 70-82.
Crossref
PoojaR Mathur. (2021) Introduction of direct observation of procedural skills as workplace-based assessment tool in department of anesthesiology: Evaluation of students’ and teachers’ perceptions. Bali Journal of Anesthesiology 5:4, pages 239.
Crossref
Eva K. Hennel, Ulrike Subotic, Christoph Berendonk, Daniel Stricker, Sigrid Harendza & Sören Huwendiek. (2020) A german-language competency-based multisource feedback instrument for residents: development and validity evidence. BMC Medical Education 20:1.
Crossref
Yoyo Suhoyo, Johanna Schönrock-Adema, Ova Emilia, Jan B. M. Kuks & Janke Cohen-Schotanus. (2020) How students and specialists appreciate the mini-clinical evaluation exercise (mini-CEX) in Indonesian clerkships. BMC Medical Education 20:1.
Crossref
Adrián Martínez-González, Melchor Sánchez-Mendiola, Silvia Lizett Olivares-Olivares, Juana I. Grimaldo-Avilés, Juan Andrés Trejo-Mejía, Adrián Israel Martínez-Franco, Amílcar Alpuche-Hernández & Gali E. Furman. (2020) Colaboración de tres escuelas de medicina de México en un examen clínico objetivo estructurado (ECOE). Investigación en Educación Médica:36, pages 58-69.
Crossref
I. A. Selivanova, I. Yu. Markovina, I. R. Ilyasov, A. K. Zhevlakova & R. P. Terekhov. (2020) Test Items Validation in the Context of Education Export. Vysshee Obrazovanie v Rossii = Higher Education in Russia 29:6, pages 136-143.
Crossref
Quinten S. Paterson, Riley Hartmann, Rob Woods, Lynsey J. Martin & Brent Thoma. (2020) A transparent and defensible process for applicant selection within a Canadian emergency medicine residency program. CJEM 22:2, pages 215-223.
Crossref
Rafael Barbosa da Silva Bica & George Edward Machado Kornis. (2020) Exames de licenciamento em Medicina – uma boa ideia para a formação médica no Brasil?. Interface - Comunicação, Saúde, Educação 24.
Crossref
Kristen Weersink, Andrew K. Hall, Jessica Rich, Adam Szulewski & J. Damon Dagnone. (2019) Simulation versus real-world performance: a direct comparison of emergency medicine resident resuscitation entrustment scoring. Advances in Simulation 4:1.
Crossref
Wouter A. Keijser, Henricus J. M. Handgraaf, Liz M. Isfordink, Vincent T. Janmaat, Pieter-Paul A. Vergroesen, Julia M. J. S. Verkade, Sietse Wieringa & Celeste P. M. Wilderom. (2019) Development of a national medical leadership competency framework: the Dutch approach. BMC Medical Education 19:1.
Crossref
Stefan Müller, Ines Koch, Utz Settmacher & Uta Dahmen. (2019) How the introduction of OSCEs has affected the time students spend studying: results of a nationwide study. BMC Medical Education 19:1.
Crossref
Garry W. Kirwan, Courtney R. Clark & Megan Dalton. (2019) Rating of physiotherapy student clinical performance: is it possible to gain assessor consistency?. BMC Medical Education 19:1.
Crossref
Nicole Kester-Greene, Andrew K Hall & Catharine M Walsh. (2019) Simulation curricular content in postgraduate emergency medicine: A multicentre Delphi study. CJEM 21:5, pages 667-675.
Crossref
R. Nicholas, G. Humm, K.E. MacLeod, S. Bathla, A. Horgan, D.M. Nally, J. Glasbey, J.M. Clements, C. Fleming & H.M. Mohan. (2019) Simulation in surgical training: Prospective cohort study of access, attitudes and experiences of surgical trainees in the UK and Ireland. International Journal of Surgery 67, pages 94-100.
Crossref
Mohan Bansal. (2019) Introduction of Directly Observed Procedural Skills (DOPS) as a Part of Competency-Based Medical Education in Otorhinolaryngology. Indian Journal of Otolaryngology and Head & Neck Surgery 71:2, pages 161-166.
Crossref
Katharine A. M. Boursicot, Trudie E. Roberts & William P. Burdick. 2018. Understanding Medical Education. Understanding Medical Education 335 345 .
M. P. Escudier, M. J. Woolford & J. A. Tricio. (2018) Assessing the application of knowledge in clinical problem-solving: The structured professional reasoning exercise. European Journal of Dental Education 22:2, pages e269-e277.
Crossref
Rodney Sturt, Angela T. Burge, Paula Harding & James Sayer. (2018) Physiotherapists' perceptions of workplace competency: a mixed-methods observational study. Australian Health Review 42:4, pages 461.
Crossref
Evan Russell, Andrew Koch Hall, Carly Hagel, Andrew Petrosoniak, Jeffrey Damon Dagnone & Daniel Howes. (2017) Simulation in Canadian postgraduate emergency medicine training – a national survey. CJEM 20:1, pages 132-141.
Crossref
Yoyo Suhoyo, Elisabeth A. Van Hell, Wouter Kerdijk, Ova Emilia, Johanna Schönrock-Adema, Jan B. M. Kuks & Janke Cohen-Schotanus. (2017) Influence of feedback characteristics on perceived learning value of feedback in clerkships: does culture matter?. BMC Medical Education 17:1.
Crossref
Balakrishnan (Kichu) R Nair, Joyce MW Moonen‐van Loon, Mulavana Parvathy, Brian C Jolly & Cees PM Vleuten. (2017) Composite reliability of workplace‐based assessment of international medical graduates. Medical Journal of Australia 207:10, pages 453-453.
Crossref
Ann Sofia Skou Thomsen. (2017) Intraocular surgery – assessment and transfer of skills using a virtual‐reality simulator. Acta Ophthalmologica 95:A106, pages 1-22.
Crossref
Achim Mortsiefer, André Karger, Thomas Rotthoff, Bianca Raski & Michael Pentzek. (2017) Examiner characteristics and interrater reliability in a communication OSCE. Patient Education and Counseling 100:6, pages 1230-1234.
Crossref
Claire Palermo, Simone Jane Gibson, Janeane Dart, Kevin Whelan & Margaret Hay. (2017) Programmatic Assessment of Competence in Dietetics: A New Frontier. Journal of the Academy of Nutrition and Dietetics 117:2, pages 175-179.
Crossref
Gerard J Gormley, Brian D Hodges, Nancy McNaughton & Jennifer L Johnston. (2016) The show must go on? Patients, props and pedagogy in the theatre of the OSCE . Medical Education 50:12, pages 1237-1240.
Crossref
Claudia Kiessling, Johannes Bauer, Martin Gartmeier, Peter Iblher, Gudrun Karsten, Jan Kiesewetter, Grit E. Moeller, Anne Wiesbeck, Michaela Zupanic & Martin R. Fischer. (2016) Development and validation of a computer-based situational judgement test to assess medical students’ communication skills in the field of shared decision making. Patient Education and Counseling 99:11, pages 1858-1864.
Crossref
Imelda Reyes & Jeannie Rodriguez. (2016) Conducting Objective Structured Clinical Exams in a Pediatric Nurse Practitioner Program Using Google Tools. The Journal for Nurse Practitioners 12:8, pages 566-573.
Crossref
C. Palermo, Z. E. Davidson & M. Hay. (2016) A cross‐sectional study exploring the different roles of individual and group assessment methods in assessing public health nutrition competence. Journal of Human Nutrition and Dietetics 29:4, pages 523-528.
Crossref
Carly Margaret Hagel, Andrew Koch Hall & Jeffrey Damon Dagnone. (2015) Queen’s University Emergency Medicine Simulation OSCE: an Advance in Competency-Based Assessment. CJEM 18:3, pages 230-233.
Crossref
Luiz Ernesto de Almeida Troncon. (2016) Estruturação de Sistemas para Avaliação Programática do Estudante de Medicina. Revista Brasileira de Educação Médica 40:1, pages 30-42.
Crossref
Gerard Ingham, Jennifer Fry, Simon Morgan & Bernadette Ward. (2015) ARCADO - Adding random case analysis to direct observation in workplace-based formative assessment of general practice registrars. BMC Medical Education 15:1.
Crossref
J. Tricio, M. Woolford, M. Thomas, H. Lewis-Greene, L. Georghiou, M. Andiappan & M. Escudier. (2015) Dental students' peer assessment: a prospective pilot study. European Journal of Dental Education 19:3, pages 140-148.
Crossref
James Kwan, Nicholas Jouriles, Andrew Singer, Venkataraman Anantharaman, Gautam Bodiwala, Peter Cameron, C. James (Jim) Holliman, Cees van der Vleuten & Cherri Hobgood. (2015) Designing Assessment Programmes for the Model Curriculum for Emergency Medicine Specialists. CJEM 17:4, pages 462-467.
Crossref
Claire Palermo. (2015) Growing professional competence in nutrition and dietetics. Nutrition & Dietetics 72:2, pages 96-100.
Crossref
Indumathy Lakshminarayana, David Wall, Taruna Bindal & Helen M Goodyear. (2015) A multisource feedback tool to assess ward round leadership skills of senior paediatric trainees: (1) Development of tool. Postgraduate Medical Journal 91:1075, pages 262-267.
Crossref
Jyoti Nath Modi, Piyush Gupta & Tejinder Singh. (2015) Competency-based medical education, entrustment and assessment. Indian Pediatrics 52:5, pages 413-420.
Crossref
Andrew Koch Hall, Jeffrey Damon Dagnone, Lauren Lacroix, William Pickett & Don Albert Klinger. (2015) Queen’s Simulation Assessment Tool. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 10:2, pages 98-105.
Crossref
Sarah Huline-Dickens, Eithne Heffernan, Paul Bradley & Lee Coombes. (2018) Teaching and learning the mental state exam in an integrated medical school. Part II: Student performance. The Psychiatric Bulletin 38:5, pages 243-248.
Crossref
Cicely Roche. (2014) “Addiction Pharmacy” and the Professionalization Process: Technology-Enhanced Assessment of Reflective Practice and Teamwork. Pharmacy 2:2, pages 175-194.
Crossref
Anand Prakash Swayamprakasam, Ashvina Segaran & Lynne Allery. (2014) Work-based assessments: making the transition from participation to engagement. JRSM Open 5:3, pages 204253331351586.
Crossref
Alexander Nesbitt, Freya Baird, Benjamin Canning, Ann Griffin & Alison Sturrock. (2013) Student perception of workplace-based assessment. The Clinical Teacher 10:6, pages 399-404.
Crossref
Katharine AM Boursicot, Trudie E Roberts & William P Burdick. 2013. Understanding Medical Education. Understanding Medical Education 293 304 .
Jean Ker & Paul Bradley. 2013. Understanding Medical Education. Understanding Medical Education 175 192 .
Jennifer L Johnston, Gerard Lundy, Melissa McCullough & Gerard J Gormley. (2013) The view from over there: reframing the OSCE through the experience of standardised patient raters. Medical Education 47:9, pages 899-909.
Crossref
Mike Davis, Judy McKimm & Kirsty Forrest. 2013. How to Assess Doctors and Health Professionals. How to Assess Doctors and Health Professionals 110 125 .
Collette McCourt, Jennifer L Johnston, Stephen Cooper & Gerard J Gormley. (2012) The level playing field: the impact of assessment practice on professional development. Medical Education 46:8, pages 766-776.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.