Assessment in the Context of Licensure and Certification

REFERENCES

• Harden , R , Crosby , J and Davis , M. 1999 . An introduction to outcome-based education . Medical Teacher , 21 : 7 – 14 .
   Web of Science ®Google Scholar
• 2005 . The ACGME Outcome Project: An introduction , Accreditation Council for Graduate Medical Education .
   Google Scholar
• 2013 . General Medical Council . Good Medical Practice , Available at: http://www.gmc-uk.org/guidance/good_medical_practice.asp. Accessed July 14, 2013
   Google Scholar
• 2005 . The CanMEDS 2005 Physician Competency Framework . Available at: http://www.royalcollege.ca/portal/page/portal/rc/common/documents/canmeds/resources/publications/framework_full_e.pdf. Accessed July 14, 2013
   Google Scholar
• McGlynn , E A , Asch , S M Adams , J . 2003 . The quality of health care delivered to adults in the United States . New England Journal of Medicine , 348 : 2635 – 45 .
   PubMed Web of Science ®Google Scholar
• Choudhry , N K , Fletcher , R H and Soumerai , SB. 2005 . Systematic review: The relationship between clinical experience and quality of health care . Annals of Internal Medicine , 142 : 260 – 73 .
   PubMed Web of Science ®Google Scholar
• Eva , K W and Regehr , G. 2008 . “I’ll never play professional football” and other fallacies of self-assessment . The Journal of Continuing Education in the Health Professions , 28 : 14 – 9 .
   PubMed Web of Science ®Google Scholar
• Davis , D A , Mazmanian , P E , Fordis , M , Harrison , R V , Thorpe , K E and Perrier , L. 2006 . Accuracy of physician self-assessment compared with observed measures of competence . Journal of the American Medical Association , 296 : 1094 – 102 .
   PubMed Web of Science ®Google Scholar
• Regehr , G and Mylopoulos , M. 2008 . Maintaining competence in the field: Learning about practice, through practice, in practice . The Journal of Continuing Education in the Health Professions , 28 ( Suppl 1 ) : S19 – 23 .
   PubMed Web of Science ®Google Scholar
• Mazmanian , P E and Davis , DA. 2002 . Continuing medical education and the physician as a learner: Guide to the evidence . Journal of the American Medical Association , 288 : 1057
   PubMed Web of Science ®Google Scholar
• Brennan , T A , Horwitz , R I , Duffy , F D , Cassel , C K , Goode , L D and Lipner , RS. 2004 . The Role of Physician Specialty Board Certification Status in the Quality Movement . Journal of the American Medical Association , 292 : 1038 – 43 .
   Web of Science ®Google Scholar
• ABMS . 2011 . Certification matters: Most Americans Want their doctors to participate in lifelong learning and self-assessment. Available at: http://www.abms.org/News_and_Events/news_archive/release_2010ABMSConsumerSurvey_04142011.aspx. Accessed July 14, 2013
   Google Scholar
• ABMS . 2009 . Fact Sheet: American Board of Medical Specialties (ABMS) and ABMS Maintenance of Certification® (ABMS MOC). Available at: http://www.abms.org/News_and_Events/Media_Newsroom/pdf/ABMS_Fact_sheet.pdf. Accessed March 2010
   Google Scholar
• Chaudhry , H , Talmage , L , Alguire , P , Cain , F , Waters , S and Rhyne , J. 2012 . Maintenance of licensure: Supporting a physician's commitment to lifelong learning . Annals of Internal medicine , 158 : 220 – 1 .
   Google Scholar
• Cannataro , M , Weber dos Santos , R , Sundnes , J and Veltri , P. 2012 . Advanced computing solutions for health care and medicine . Journal of Computational Science , 3 : 250 – 3 .
   Google Scholar
• 2007 . 25 years: A technology timeline . Available at: http://gcn.com/articles/2007/12/06/25-years–a-technology-timeline.aspx. Accessed July 23, 2013
   Google Scholar
• Altman , MK. December 26, 2006 . So many advance in medicine, so many yet to come . New York Times. , Available at: http://www.nytimes.com/2006/12/26/health/26docs.html?pagewanted=all&_r=0. Accessed July 23, 2013
   Google Scholar
• Baker , FB. 2001 . The basics of item response theory , 2nd ed. , College Park , MD : ERIC Clearinghouse on Assessment and Evaluation .
   Google Scholar
• Wainer , H . 2000 . Computerized adaptive testing: A primer. , Mahwah , NJ : Erlbaum .
   Google Scholar
• Williamson , D , Mislevy , R J and Bejar , I . 2006 . Automated scoring of complex tasks in computer-based testing. , Mahwah , NJ : Erlbaum .
   Google Scholar
• Clauser , B E , Kane , M T and Swanson , DB. 2002 . Validity issues for performance-based tests scored with computer-automated scoring systems . Applied Measurement in Education , 15 : 413 – 32 .
   Web of Science ®Google Scholar
• Mislevy , R J and Haertel , GD. 2006 . Implications of evidence-centered design for educational testing . Educational Measurement: Issues & Practice , 25 : 6 – 20 .
   Google Scholar
• Yuan , MJ. How natural language processing and semantic search could revolutionize clinical decision support 2011 . Available at: http://www.ibm.com/developerworks/library/os-ind-watson./ Accessed July 21, 2013
   Google Scholar
• 2013 . The Isabel System Overview . Available at: http://www.isabelhealthcare.com/home/products. Accessed July 21, 2013
   Google Scholar
• Gierl , M J , Lai , H and Turner , SR. 2012 . Using automatic item generation to create multiple-choice test items . Medical Education , 46 : 757 – 65 .
   PubMed Web of Science ®Google Scholar
• Boulet , J R and Murray , D. 2011 . Review article: Assessment in anesthesiology education . Canadian Journal of Anesthesia , 59 : 182 – 92 .
   PubMed Web of Science ®Google Scholar
• Boulet , J. 2008 . Summative assessment in medicine: The promise of simulation for high-stakes evaluation . Academic Emergency Medicine , 15 : 1017 – 24 .
   PubMed Web of Science ®Google Scholar
• Reznick , R K , Blackmore , D , Dauphinée , W D , Rothman , A I and Smee , S. 1996 . Large-scale high-stakes testing with an OSCE: Report from the Medical Council of Canada . Academic Medicine , 71 ( 1 Suppl ) : S19 – 21 .
   Google Scholar
• Whelan , G. 1999 . Educational Commission for ForeignMedical Graduates: Clinical skills assessment prototype . Medical Teacher , 21 : 156 – 60 .
   PubMed Web of Science ®Google Scholar
• Kneebone , R. 2003 . Simulation in surgical training: Educational issues and practical implications . Medical Education , 37 : 267 – 77 .
   PubMed Web of Science ®Google Scholar
• Lipner , R S , Messenger , J C Kangilaski , R W . Can simulation technology be used to assess physicians’ technical proficiency in interventional cardiology? . Simulation in Healthcare , In press
   Google Scholar
• Maatsch , JC. 1981 . Assessment of clinical competence on the Emergency Medicine Specialty Certification Examination: The validity of examiner ratings of simulated clinical encounters . Annals of Emergency Medicine , 10 : 504 – 7 .
   PubMed Web of Science ®Google Scholar
• Norcini , J J , Blank , L L , Duffy , F D and Fortna , GS. 2003 . The Mini-CEX: A method for assessing clinical skills . Annals of Internal Medicine , 138 : 476 – 81 .
   PubMed Web of Science ®Google Scholar
• Ramsey , P G and Wenrich , MD. 1993 . Use of peer ratings to evaluate physician performance . Journal of the American Medical Association , 269 : 1655 – 60 .
   PubMed Web of Science ®Google Scholar
• Lipner , R S , Blank , L L , Leas , B F and Fortna , GS. 2002 . The value of patient and peer ratings in recertification . Academic Medicine , 77 ( 10 Suppl ) : S64 – 66 .
   Google Scholar
• Lipner , R , Hess , B J , Weng , W and Arnold , A. May 28, 2013 . Inventors; American Board of Internal Medicine, assignee. Method and System for Determining a Fair Benchmark for Physician's Quality of Patient Care .
   Google Scholar
• 2000 . “ Institute of Medicine ” . In To err is human: Building a safer health system. , Washington , DC : National Academy Press .
   Google Scholar
• Freed , G L , Dunham , K M and Gebremariam , A. 2013 . Changes in hospitals’ credentialing requirements for board certification from 2005 to 2010 . Journal of Hospital Medicine , 8 : 298 – 303 .
   PubMed Web of Science ®Google Scholar
• Drazen , J M and Weinstein , DF. 2010 . Considering recertification . New England Journal of Medicine , 362 : 946 – 7 .
   PubMed Web of Science ®Google Scholar
• 1999 . Standards for Educational and Psychological Testing. , Washington , DC : American Educational Research Association, American Psychological Association, National Council of Measurement in Education .
   Google Scholar
• Messick , S. 1995 . Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning . American Psychologist , 50 : 741 – 9 .
   Web of Science ®Google Scholar
• Kane , M. 2006 . “ Validation ” . In Educational measurement , 4th ed. , Edited by: Brennan , R. 17 – 64 . Westport , CT : American Council on Education and Praeger .
   Google Scholar
• Lipner , RS , Hess , BJ and Phillips , RL Jr . Specialty Board Certification in the United States: Issues and Evidence . The Journal of Continuing Education in the Health Professions ,
   Google Scholar
• Puffer , J C , Bazemore , A W , Jaen , C R , Xierali , I M , Phillips , R L Jr and Jones , SM. 2012 . Engagement of family physicians in maintenance of certification remains high . Journal of the American Board of Family Medicine , 25 : 761 – 2 .
   PubMed Web of Science ®Google Scholar
• Freed , G L , Dunham , K M , Clark , S J and Davis , MM. 2010 . Perspectives and preferences among the general public regarding physician selection and board certification . Journal of Pediatrics , 156 : 841 – 5 .
   PubMed Web of Science ®Google Scholar
• Fisher , D M , Brenner , C J , Cheren , M and Stange , KC. 2013 . Engagement of groups in family medicine board maintenance of certification . Journal of the American Board of Family Medicine , 26 : 149 – 58 .
   PubMed Web of Science ®Google Scholar
• Gray , B , Reschovsky , J , Holmboe , E and Lipner , R. 2013 . Do Early career indicators of clinical skill predict subsequent career outcomes and practice characteristics for general internists? . Health Services Research , 48 : 1096 – 115 .
   PubMed Web of Science ®Google Scholar
• Reed , D A , West , C P , Holmboe , E S , Halvorsen , M S , Lipner , R S Jacobs , C . 2012 . Relationship of electronic medical knowledge resource use and practice characteristics with internal medicine maintenance of certification examination scores . Journal of General Internal Medicine , 27 : 917 – 23 .
   PubMed Web of Science ®Google Scholar
• Norcini , J J , Boulet , J R , Dauphinée , W D , Opalek , A , Krantz , I D and Anderson , ST. 2010 . Evaluating the quality of care provided by graduates of international medical schools . Health Affairs , 29 : 1461 – 8 .
   PubMed Web of Science ®Google Scholar
• Holmboe , E S , Wang , Y , Meehan , T P , Tate , J P , Ho , S Y Starkey , K S . 2008 . Association between maintenance of certification examination scores and quality of care for medicare beneficiaries . Archives of Internal Medicine , 168 : 1396 – 403 .
   PubMed Web of Science ®Google Scholar