The construct and criterion validity of the multi-source feedback process to assess physician performance: a meta-analysis

References

• BrackenDWTimmreckCWChurchAHIntroduction: a multisource feedback process modelBrackenDWTimmreckCWChurchAHThe Handbook of Multisource Feedback: The Comprehensive Resource for Designing and Implementing MSF ProcessesSan Francisco, CA, USAJossey-Bass2001
   Google Scholar
• LockyerJClymanSMultisource feedback (360-degree evaluation)HolmboeESHawkinsREPractical Guide to the Evaluation of Clinical CompetencePhiladelphia, PA, USAMosby2008
   Google Scholar
• HallWViolatoCLewkoniaRAssessment of physician performance in Alberta: the Physician Achievement ReviewCMAJ1999161525710420867
   PubMed Web of Science ®Google Scholar
• FidlerHLockyerJViolatoCChanging physicians practice: the effect of individual feedbackAcad Med19997470271410386101
   PubMed Web of Science ®Google Scholar
• ViolatoCLockyerJFidlerHMultisource feedback: a method of assessing surgical practiceBMJ200332654654812623920
   PubMed Web of Science ®Google Scholar
• MillerAArcherJImpact of workplace based assessment on doctors education and performance: a systematic reviewBMJ201034116
   Web of Science ®Google Scholar
• RisucciDATortolaniAJWardRJRatings of surgical residents by self, supervisors and peersSurg Gynecol Obstet19891695195262814768
   PubMedGoogle Scholar
• ArcherJNorciniJSouthgateLHeardSDaviesHMini-PAT (Peer Assessment Tool): a valid component of a national assessment programme in the UK?Adv Health Sci Educ Theory Pract20081318119217036157
   PubMed Web of Science ®Google Scholar
• ViolatoCLockyerJFidlerHChange in performance: a 5-year longitudinal study of participants in a multi-source feedback programmeMed Educ2008421007101318823520
   PubMed Web of Science ®Google Scholar
• StroupDFBerlinJAMortonSCMeta-analysis of observational studies in epidemiology: a proposal for reportingJAMA20002382008201210789670
   PubMed Web of Science ®Google Scholar
• RosenthalRRubinDA simple general purpose display of magnitude of experimental effectJ Educ Psychol198274166169
   Web of Science ®Google Scholar
• DerSimonianRLairdNMeta-analysis in clinical trialsControl Clin Trials198671771883802833
   PubMed Web of Science ®Google Scholar
• CohenJStatistical Power Analysis for the Behavioral Sciences2nd edHillsdale, NJ, USALawrence Earlbaum Associates1988
   Google Scholar
• PollockRADonnellyMBPlymaleMAStewartDHVasconezHC360-degree evaluations of plastic surgery resident accreditation council for graduate medical education competencies: experience using a short formPlast Reconstr Surg200812263964918626387
   PubMed Web of Science ®Google Scholar
• ArcherJMcGrawMDaviesHAssuring validity of multisource feedback in a national programmePostgrad Med J20108652653120841329
   PubMed Web of Science ®Google Scholar
• ChandlerNHendersonGParkBByerleyJBrownWDSteinerMJUse of a 360-degree evaluation in the outpatient settings: the usefulness of nurse, faculty, patient/family, and resident self-evaluationJ Grad Med Educ20101043043421976094
   PubMedGoogle Scholar
• CampbellJNarayananABurfordBGrecoMValidation of a multi-source feedback tool for use in general practiceEduc Prim Care20102116517920515545
   PubMedGoogle Scholar
• WoodLWallDBullockAHassellAWhitehouseACampbellI‘Team observation’: a six-year study of the development and use of multi-source feedback (360-degree assessment) in obstetrics and gynecology training in the UKMed Teach200628e177e18417594543
   PubMedGoogle Scholar
• BrinkmanWBGeraghtySRLanpherBPEffect of multisource feedback on resident communication skills and professionalismArch Pediatr Adolesc Med2007161444917199066
   PubMedGoogle Scholar
• ArcherJCNorciniJDaviesHAUse of SPRAT for peer review of paediatricians in trainingBMJ20053301251125315883137
   PubMed Web of Science ®Google Scholar
• MassagliTLCarlineJDReliability of a 360-degree evaluation to assess resident competenceAm J Phys Med Rehabil20078684585217885319
   PubMed Web of Science ®Google Scholar
• LockyerJViolatoCFidlerHWhat multisource feedback factors influence physicians’ self-assessments? A five-year longitudinal studyAcad Med2007827780
   PubMed Web of Science ®Google Scholar
• QuBZhaoYHSunBZAssessment of resident physicians in professionalism, interpersonal and communication skills: a multisource feedbackInt J Med Sci2012922823622577337
   PubMed Web of Science ®Google Scholar
• YangYYLeeFYHsuHCAssessment of first-year post-graduate residents: usefulness of multiple toolsJ Chin Med Assoc20117453153822196467
   PubMed Web of Science ®Google Scholar
• HatalaRNormanGRIn-training evaluation during an internal medicine clerkshipAcad Med199974Suppl 10118S120S
   Web of Science ®Google Scholar
• HillFKendallKGalbraithKCrossleyJImplementing the undergraduate mini CEX: a tailored approach at Southampton UniversityMed Educ20094332633419335574
   PubMed Web of Science ®Google Scholar
• WoodJCollinsJBurnsideESPatient, faculty, and self-assessment of radiology resident performance: a 360-degree method of measuring professionalism and interpersonal/communication skillsAcad Radiol20041193193915288041
   PubMed Web of Science ®Google Scholar
• DominickPReillyRMcGourtyJThe effects of peer feedback on team member BehaviourGroup and Organization Management199722508520
   Web of Science ®Google Scholar
• EdwardsMEwenA360 Feedback: The Powerful New Model for Employee Assessment and Performance ImprovementNew York, NY, USAAmacom1996
   Google Scholar
• WaldmanDPredictors of employee preferences for multi-rater and group-based performance appraisalGroup and Organization Management199722264287
   Web of Science ®Google Scholar
• ViolatoCHeckerKHow to use structural equation modeling in medical education research: a brief guideTeach Learn Med20081936237117935466
   PubMed Web of Science ®Google Scholar
• ViolatoCLockyerJFidlerHAssessment of psychiatrists in practice through multisource feedbackCan J Psychiatry20085352553318801214
   PubMed Web of Science ®Google Scholar
• CampbellJLRichardsSHDickensAGrecoMNarayananABrearleySAssessing the professional performance of UK doctors: an evaluation of the utility of the General Medical Council patient and colleague questionnairesQual Saf Health Care20081718719318519625
   PubMedGoogle Scholar
• MengLMetroDGPatelRMEvaluating professionalism and interpersonal and communication skills: implementing a 360-degree evaluation instrument in an anesthesiology residency programJ Grad Med Educ20091021622021975981
   PubMedGoogle Scholar
• LockyerJViolatoCFidlerHAlakijaPThe assessment of pathologists/laboratory medicine physicians through a multisource feedback toolArch Pathol Lab Med20091331301130819653730
   PubMed Web of Science ®Google Scholar
• LockyerJViolatoCFidlerHThe assessment of emergency physicians by a regulatory authorityAcad Emerg Med2006131296130317099191
   PubMed Web of Science ®Google Scholar
• ArcherJMcAvoyPFactors that might undermine the validity of patient and multi-source feedbackMed Educ20114588689321848716
   PubMed Web of Science ®Google Scholar
• OvereemKWollersheimHCArahOACruijsbergJKGrolRPLombartsKMEvaluation of physicians’ professional performance: an iterative development and validation study of multisource feedback instrumentsBMC Health Serv Res20121211122214259
   PubMed Web of Science ®Google Scholar
• LockyerJViolatoCWrightBFidlerHChanRLong-term outcomes for surgeons from 3- and 4-year medical school curriculaCan J Surg20125515
   Web of Science ®Google Scholar
• DaviesHArcherJBatemanASpecialty-specific multi-source feedback: assuring validity, information trainingMed Educ2008421014102018823521
   PubMed Web of Science ®Google Scholar
• WenrichMDCarlineJDGilesLMRamseyPGRatings of the performances of practicing internists by hospital-based registered nursesAcad Med1993686806878397633
   PubMed Web of Science ®Google Scholar
• LelliottPWilliamsRMearsAQuestionnaires for 360-degree assessment of consultant psychiatrists: development and psychometric propertiesBr J Psychiatry200819315616018670003
   PubMed Web of Science ®Google Scholar
• ViolatoCMariniATowesJFeasibility and psychometric properties of using peers, consulting physicians, co-workers, and patients to assess physiciansAcad Med1997728284
   PubMed Web of Science ®Google Scholar
• ThomasPAGeboKAHellmannDBA pilot study of peer review in residency trainingJ Gen Intern Med19991455155410491244
   PubMed Web of Science ®Google Scholar
• LipnerRSBlankLLLeasBFFortnaGSThe value of patient and peer ratings in recertificationAcad Med200277Suppl 106466
   PubMed Web of Science ®Google Scholar
• JoshiRLingFWJaegerJAssessment of a 360-degree instrument to evaluate residents’ competency in interpersonal and communication skillsAcad Med20047945846315107286
   PubMed Web of Science ®Google Scholar
• LockyerJViolatoCFidlerHA multi-source feedback program for anesthesiologyCan J Anesth200653333916371607
   PubMed Web of Science ®Google Scholar
• ViolatoCLockyerJFidlerHAssessment of pediatricians by a regulatory authorityPediatrics200611779680216510660
   PubMed Web of Science ®Google Scholar
• LockyerJLBlackmoreDFidlerHA study of a multi-source feedback system for international medical graduates holding defined licencesMed Educ20064034034716573670
   PubMed Web of Science ®Google Scholar