Using consensus group methods such as Delphi and Nominal Group in medical education research^*

References

• Black N, Murphy M, Lamping D. 1999. Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy. 4:236–248.
   PubMedGoogle Scholar
• Bloor M, Sampson H, Baker S, Dahlgren K. 2015. Useful but no Oracle. Qual Res. 15:57–70.
   Web of Science ®Google Scholar
• Boers M, Kirwan J, Tugwell P, Beaton D, Bingham CO, Conaghan PG, D’Agostino MA, de Wit M, Gossec L, March L, et al. 2015. The OMERACT handbook. Omeract [cited 2016 Jan 15]. Available from: http://www.omeract.org/pdf/OMERACT_Handbook.pdf.
   Google Scholar
• Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. 2011. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS One. 6:e20476.
   PubMed Web of Science ®Google Scholar
• Brady SR. 2015. Utilizing and adapting the Delphi method for use in qualitative research. Int J Qual Methods. 14:1–6 doi:10.1177/1609406915621381.
   Web of Science ®Google Scholar
• Campbell SM, Cantrill JA, Hann M, Roland MO, Quayle JA, Shekelle PG. 2001. Consensus methods in prescribing research. J Clin Pharm Ther. 26:5–14.
   PubMed Web of Science ®Google Scholar
• Campbell SM, Hann M, Roland MO, Quayle JA, Shekelle PG. 1999. The effect of panel membership and feedback on ratings in a two-round Delphi survey: results of a randomized controlled trial. Med Care. 37:964–968.
   PubMed Web of Science ®Google Scholar
• CoBaTrICE Collaboration. 2011. International standards for programs of training in intensive care medicine in Europe. Intensive Care Med. 31:385–393.
   Web of Science ®Google Scholar
• Crisp J, Pelletier D, Duffield C, Adams A, Nagy S. 1997. The Delphi method? Nurs Res. 46:1–5.
   Web of Science ®Google Scholar
• de Loe RC, Melnychuk N, Murray D, Plummer R. 2016. Advancing the state of policy delphi practice: A systematic review evaluating methodological evolution, innovation, and opportunities. Technol Forecast Soc. 104:78–89.
   Web of Science ®Google Scholar
• De Villiers MJR. 2005. The Delphi Technique in health sciences education research. Med Teach. 27:639–643.
   PubMed Web of Science ®Google Scholar
• Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, Wales PW. 2014. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 67:401–409.
   PubMed Web of Science ®Google Scholar
• Fitch K, Bernstein SJ, Aguilar MD, Burnand B, LaCalle JR, Lazaro P, van het Loo M, McDonnell J, Vader J, Kahan JP. 2001. The RAND/UCLA appropriateness method user's manual. Santa Monica, CA: RAND Corporation.
   Google Scholar
• Fletcher AJ, Marchildon GP. 2014. Using the Delphi method for qualitative, participatory action research in health leadership. Int J Qual Methods. 13:1–18.
   Web of Science ®Google Scholar
• Goodman CM. 1987. The Delphi technique: a critique. J Adv Nurs. 12:729–734.
   PubMed Web of Science ®Google Scholar
• Guzys D. 2015. Gadamerian philosophical hermeneutics as a useful methodologic framework for the Delphi technique. Int J Qual Stud Health Well-Being. 10:26291.
   PubMed Web of Science ®Google Scholar
• Hasson F, Keeney S, McKenna H. 2000. Research guidelines for the Delphi survey technique. J Adv Nurs. 32:1008–1015.
   PubMed Web of Science ®Google Scholar
• Harvey N, Holmes CA. 2012. Nominal group technique: an effective method for obtaining group consensus. Int J Nurs Practice. 18:188–194.
   PubMed Web of Science ®Google Scholar
• Huang G, Newman LR, Schwartzstein RM, Clardy PF, Feller-Kopman D, Irish JT, Smith CC. 2009. Procedural competence in internal medicine residents: validity of a Central venous catheter insertion assessment Instrument. Acad Med. 84:1127–1134.
   PubMed Web of Science ®Google Scholar
• Humphrey-Murto S, Ufholz L, Gonsalves C, Varpio L, Lynch S, Wood TJ. 2014. The use of consensus group methods in medical education research. Paper presented at: Oral presentation, The Ottawa Conference, Ottawa, 2014 April 26–30.
   Google Scholar
• Hutchings A, Raine R. 2006. A systematic review of factors affecting the judgments produced by formal consensus development methods in health care. J Health Serv Res Policy. 11:172–179.
   PubMedGoogle Scholar
• Hutchings A, Raine R, Sanderson C, Black N. 2006. A comparison of formal consensus methods used for developing clinical guidelines. J Health Serv Res Policy. 11:218–224.
   PubMedGoogle Scholar
• Ito C, Ota K, Marsuda M. 2011. Educational content in nurse education in Japan: a Delphi study. Nurs Ethics. 18:441–454.
   PubMed Web of Science ®Google Scholar
• Jones J, Hunter D. 1995. Consensus methods for medical and health services research. BMJ. 311:376–380.
   PubMed Web of Science ®Google Scholar
• Keeney S. 2001. A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 38:195–200.
   PubMed Web of Science ®Google Scholar
• Lazarou J, Hopyanm J, Panisko D, Tai P. 2011. Neurology for internal medicine residents: working towards a national Canadian curriculum consensus. Med Teach. 33:e65–e68.
   PubMed Web of Science ®Google Scholar
• Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CFB, Askham J, et al. 1998. Consensus development methods and their use in clinical guideline development. Health Technol Assess. 2:1–88.
   Google Scholar
• Pineda C, Reginato AM, Flores V, Aliste M, Alva M, the Pan-American League of Associations for Rheumatology (PANLAR) Ultrasound Study Group, et al. 2010. Pan-American League of Associations for Rheumatology (PANLAR) recommendations and guidelines for musculoskeletal ultrasound training in the Americas for rheumatologists. J Clin Rheumatol. 16:113–118.
   PubMed Web of Science ®Google Scholar
• Sackman H. 1975. A delphi critique. Lexington, MA: Lexington Books.
   Google Scholar
• Sinha IP, Smyth RL, Williamson PR. 2011. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med. 8:e1000393.
   PubMed Web of Science ®Google Scholar
• Stewart J. 2001. Is the Delphi technique a qualitative method? Med Educ. 35:922–923.
   PubMed Web of Science ®Google Scholar
• Tammela O. 2013. Applications of consensus methods in the improvement of care of paediatric patients: a step forward from a 'good guess'. Acta Paediatr. 102:111–115.
   PubMed Web of Science ®Google Scholar
• Van der Vleuten C. 2014. Medical education research: a vibrant community of research and education practice. Med Educ. 48:761–767.
   PubMed Web of Science ®Google Scholar
• Vazquez-Ramos R, Leahy M, Hernandez NE. 2007. The Delphi method in rehabilitation counseling research. RCB. 50:111–118.
   Google Scholar
• Vernon W. 2009. The Delphi technique: a review. Int J Ther Rehabil. 16:69–76.
   Google Scholar
• Waggoner J, Carline JD, Durning SJ. 2016. Is there a consensus on consensus methodology? Descriptions and recommendations for future consensus research. Acad Med (Perspective). 91:663–668.
   PubMed Web of Science ®Google Scholar