Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM)

References

• Beckman TJ, Cook DA, Mandrekar JN. What is the validity evidence for assessments of clinical teaching?. J Gen Intern Med 2005; 20: 1159–1164
   PubMed Web of Science ®Google Scholar
• Billett S. Workplace pedagogic practices: Co-participation and learning. Br J Educ Studies 2002; 50(4)457–481
   Web of Science ®Google Scholar
• Billett S. Learning through practice. Springer, Models, traditions, orientations and approaches [Electronic resource]. Dordrecht 2010
   Google Scholar
• Bleakley A. Broadening conceptions of learning in medical education: The message from teamworking. Med Educ 2006; 40(2)150–157
   PubMed Web of Science ®Google Scholar
• Boor K, Scheele F, van der Vleuten CP, Scherpbier AJ, Teunissen PW, Sijtsma K. Psychometric properties of an instrument to measure the clinical learning environment. Med Educ 2007; 41(1)92–99
   PubMed Web of Science ®Google Scholar
• Boor K, Scheele F, van der Vleuten CP, Teunissen PW, den Breejen EM, Scherpbier AJ. How undergraduate clinical learning climates differ: A multi-method case study. Med Educ 2008; 42(10)1029–1036
   PubMed Web of Science ®Google Scholar
• Boor K, Van Der Vleuten C, Teunissen P, Scherpbier A, Scheele F. Development and analysis of D-RECT, an instrument measuring residents’ learning climate. Med Teach 2011; 33(10)820–827
   PubMed Web of Science ®Google Scholar
• Boud D, Solomon N., editors. 2001. Work-based learning: A new higher education? Phildelphia, PA: Society for Research into Higher Education, Open University Press
   Google Scholar
• Chan D. Development of an innovative tool to assess hospital learning environments. Nurse Education Today 2001; 21(8)624–631
   PubMedGoogle Scholar
• Chan D. Development of the clinical learning environment inventory: Using the theoretical framework of learning environment studies to assess nursing students’ perceptions of the hospital as a learning environment. J Nurs Educ 2002; 41(2)69–75
   PubMed Web of Science ®Google Scholar
• Clapham M, Wall D, Batchelor A. Educational environment in intensive care medicine – Use of Postgraduate Hospital Educational Environment Measure (PHEEM). Med Teach 2007; 29(6)184–191
   PubMed Web of Science ®Google Scholar
• Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: Theory and application. Am J Med 2006; 119(2)166 e167–116
   Google Scholar
• Daelmans HE, Hoogenboom RJ, Donker AJ, Scherpbier AJ, Stehouwer CD, van der Vleuten CP. Effectiveness of clinical rotations as a learning environment for achieving competences. Med Teach 2004; 26(4)305–312
   PubMed Web of Science ®Google Scholar
• Deci EL, Ryan RM. The paradox of achievement: The harder you push, the worse it gets. Improving academic achievement: Contributions of social psychology, J Aronson. Academic Press, New York 2002; 59–85
   Google Scholar
• Dewey J. Experience and education. Simon & Schuster, New York, NY 1938/1997
   Google Scholar
• Dolmans DH, Wolfhagen IH, Essed GG, Scherpbier AJ, van der Vleuten CP. The impacts of supervision, patient mix, and numbers of students on the effectiveness of clinical rotations. Acad Med 2002; 77(4)332–335
   PubMed Web of Science ®Google Scholar
• Dornan T, Boshuizen H, King N, Scherpbier A. Experience-based learning: A model linking the processes and outcomes of medical students’ workplace learning. Med Educ 2007; 41(1)84–91
   PubMed Web of Science ®Google Scholar
• Dornan T, Muijtjens A, Graham J, Scherpbier A, Boshuizen H. Manchester Clinical Placement Index (MCPI). Conditions for medical students’ learning in hospital and community placements. Adv Health Sci Educ 2012; 17(5)703–716
   PubMed Web of Science ®Google Scholar
• Eraut M. Informal learning in the workplace. Stud Cont Educ 2004; 26: 247–273
   Google Scholar
• Field A. Discovering statistics using SPSS for Windows. Sage Publications, London 2000
   Google Scholar
• Fraser BJ. Classroom environment instruments: Development, validity and applications. Learn Environ Res 1998; 1(1)7–33
   Google Scholar
• Fuller A, Unwin L. Fostering Workplace Learning: Looking through the lens of apprenticeship. Eur Educ Res J 2003; 2(1)41
   Google Scholar
• Genn JM. AMEE Medical Education Guide No. 23 (Part 1): Curriculum, environment, climate, quality and change in medical education-a unifying perspective. Med Teach 2001a; 23(4)337–344
   PubMed Web of Science ®Google Scholar
• Genn JM. AMEE Medical Education Guide No. 23 (Part 2): Curriculum, environment, climate, quality and change in medical education – A unifying perspective. Med Teach 2001b; 23(5)445–454
   PubMed Web of Science ®Google Scholar
• Gerbase MW, Germond M, Nendaz MR, Vu NV. When the evaluated becomes evaluator: What can we learn from students’ experiences during clerkships?. Acad Med 2009; 84(7)877–885
   PubMed Web of Science ®Google Scholar
• Guile D, Griffiths T. Learning through work experience. J Educ Work 2001; 14(1)113–131
   Google Scholar
• Harden RM, Crosby JR, Davis MH. AMEE Guide No. 14: Outcome-based education: Part 1 – An introduction to outcome-based education. Med Teach 1999; 21(1)7–14
   Web of Science ®Google Scholar
• Herrera C, Pacheco J, Rosso F, Cisterna C, Aichele D, Becker S. Evaluation of the undergraduate educational environment in six medical schools in Chile. Revista Medica De Chile 2010; 138(6)677–684
   PubMedGoogle Scholar
• Hobart J, Cano S. Improving the evaluation of therapeutic interventions in multiple sclerosis: The role of new psychometric methods. Health Tech Assess 2009; 13(12)1–200
   Web of Science ®Google Scholar
• Hoffman KG, Donaldson JF. Contextual tensions of the clinical environment and their influence on teaching and learning. Med Educ 2004; 38(4)448–454
   PubMed Web of Science ®Google Scholar
• Hoy WK, 1990. Organizational climate and culture: A conceptual analysis of the school workplace. J Educ Psychol Consult 1(2):149
   Google Scholar
• Hurtado S, Griffin KA, Arellano L, Cuellar M. Assessing the value of climate assessments: Progress and future directions. J Divers Higher Educ 2008; 1(4)204–221
   Web of Science ®Google Scholar
• Irby DM. Teaching and learning in ambulatory care settings: A thematic review of the literature. Acad Med 1995; 70(10)898–931
   PubMed Web of Science ®Google Scholar
• Jakobsson U, Danielsen N, Edgren G. Psychometric evaluation of the Dundee Ready Educational Environment Measure: Swedish version. Med Teach 2011; 33(5)E267–E274
   PubMed Web of Science ®Google Scholar
• James LR, Choi CC, Ko CHE, McNeil PK, Minton MK, Wright MA. Organizational and psychological climate: A review of theory and research. Eur J Work Organ Psychol 2008; 17(1)5–32
   Web of Science ®Google Scholar
• Keating S. Learning in the workplace: A literature review (Postcompulsory Education Centre). Victoria University, Melbourne 2006
   Google Scholar
• Kernan WN, Hershman W, Alper EJ, Lee MY, Viscoli CM, Perry JR. Disagreement between students and preceptors regarding the value of teaching behaviors for ambulatory care settings. Teach Learn Med 2008; 20(2)143–150
   PubMed Web of Science ®Google Scholar
• Kilminster S, Cottrell D, Grant J, Jolly B. AMEE Guide No. 27: Effective educational and clinical supervision. Med Teach 2007; 29(1)2–19
   PubMed Web of Science ®Google Scholar
• Kolb DA. Experiential learning: Experience as the source of learning and development. Prentice-Hall, Englewood Cliffs, NJ 1984
   Google Scholar
• Lave J, Wenger E. Situated learning: Legitimate peripheral participation. Cambridge University Press, Cambridge [England]; New York 2005
   Google Scholar
• Lee N, Hooley G. The evolution of “classical mythology” within marketing measure development. Eur J Market 2005; 39(3–4 SPEC. ISS.)365–385
   Google Scholar
• MacNeil AJ, Prater DL, Busch S. The effects of school culture and climate on student achievement. Int J Leader Educ 2009; 12(1)73–84
   Google Scholar
• Maslowski R. School culture and school performance. University of Twente, Enschede 2001
   Google Scholar
• Ministry of Education and Health 2003. The act concerning the ethical review of research involving humans. 2003:460. Retrieved 5 September 2013 from: http://www.riksdagen.se/sv/Dokument-Lagar/Lagar/Svenskforfattningssamling/Lag-2003460-om-etikprovning_sfs-2003-460/
   Google Scholar
• Nilsson Skyvell M, Pennbrant S, Pilhammar E, Wenestam Claes G. Pedagogical strategies used in clinical medical education: An observational study. BMC Med Educ 2010; 10: 9
   PubMedGoogle Scholar
• Nunnally JC, Bernstein IH. Psychometric theory3rd. McGraw-Hill, New York 1994
   Google Scholar
• Oliver E, Markland D, Hardy J, Petherick C. The effects of autonomy-supportive versus controlling environments on self-talk. Motiv Emot 2008; 32(3)200–212
   Web of Science ®Google Scholar
• Pololi L, Price J. Validation and use of an instrument to measure the learning environment as perceived by medical students. Teach Learn Med 2000; 12(4)201–207
   PubMed Web of Science ®Google Scholar
• QAA. 2007. Code of practice for the assurance of academic quality and standards in higher education – Section 9: Work-based and placement learning. UK. [Accessed 5 September 2013] Available from: http://www.nihpromis.org/Documents/PROMISStandards_Vers2.0_Final.pdf.
   Google Scholar
• Riquelme A, Herrera C, Aranis C, Oporto J, Padilla O. Psychometric analyses and internal consistency of the PHEEM questionnaire to measure the clinical learning environment in the clerkship of a Medical School in Chile. Med Teach 2009; 31(6)E221–E225
   PubMed Web of Science ®Google Scholar
• Roff S. Education environment: A bibliography. Med Teach 2005; 27(4)353–357
   PubMed Web of Science ®Google Scholar
• Roff S, McAleer S. What is educational climate?. Med Teach 2001; 23(4)333–334
   PubMed Web of Science ®Google Scholar
• Roff S, McAleer S, Harden RM. Development and validation of the Dundee Ready Education Environment Measure (DREEM). Med Teach 1997; 19(4)295–300
   Web of Science ®Google Scholar
• Roff S, McAleer S, Skinner A. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach 2005; 27(4)326–331
   PubMed Web of Science ®Google Scholar
• Saarikoski M, Isoaho H, Warne T, Leino-Kilpi H. The nurse teacher in clinical practice: Developing the new sub-dimension to the clinical learning environment and supervision (CLES) scale. Int J Nurs Stud 2008; 45(8)1233–1237
   PubMed Web of Science ®Google Scholar
• Saarikoski M, Leino-Kilpi H. The clinical learning environment and supervision by staff nurses: Developing the instrument. Int J Nurs Stud 2002; 39(3)259–267
   PubMedGoogle Scholar
• Schönrock-Adema J, Heijne-Penninga M, Hell EA, Cohen-Schotanus J. Necessary steps in factor analysis: Enhancing validation studies of educational instruments. The PHEEM applied to clerks as an example. Med Teach 2009; 31(6)226–32, doi: 10.1080/01421590802516756
   PubMed Web of Science ®Google Scholar
• Sfard A. On two metaphors for learning and the dangers of choosing just one. Educ Res 1998; 27(2)4–13
   Google Scholar
• Sheehan D, Wilkinson TJ, Billett S. Interns’ participation and learning in clinical environments in a New Zealand hospital. Acad Med 2005; 80(3)302–308
   PubMed Web of Science ®Google Scholar
• Soemantri D, Herrera C, Riquelme A. Measuring the educational environment in health professions studies: A systematic review. Med Teach 2010; 32(12)947–952
   PubMed Web of Science ®Google Scholar
• Stalmeijer RE, Dolmans DH, Wolfhagen IH, Muijtjens AM, Scherpbier AJ. The Maastricht Clinical Teaching Questionnaire (MCTQ) as a valid and reliable instrument for the evaluation of clinical teachers. Acad Med 2010a; 85(11)1732–1738
   PubMed Web of Science ®Google Scholar
• Stalmeijer RE, Dolmans DH, Wolfhagen IH, Peters WG, van Coppenolle L, Scherpbier AJ. Combined student ratings and self-assessment provide useful feedback for clinical teachers. Adv Health Sci Educ Theory Pract 2010b; 15(3)315–328
   PubMed Web of Science ®Google Scholar
• Stalmeijer RE, Dolmans DH, Wolfhagen IH, Scherpbier AJ. Cognitive apprenticeship in clinical practice: Can it stimulate learning in the opinion of students?. Adv Health Sci Educ Theory Pract 2009; 14(4)535–546
   PubMed Web of Science ®Google Scholar
• Stark P. Clinical learning teaching and learning in the clinical setting: A qualitative study of the perceptions of students and teachers. Med Educ 2003; 37(11)975–982
   PubMed Web of Science ®Google Scholar
• Streiner DL, Norman GR. Health measurement scales: A practical guide to their development and use, 4th ed. Oxford University Press, Oxford 2008
   Google Scholar
• Symes C, McIntyre J. Working knowledge: The new vocationalism and higher education. Society for Research into Higher Education, Ballmoor 2000
   Google Scholar
• Tavakol M, Dennick R. Making sense of Cronbach's alpha. Int J Med Educ 2011; 2: 53, . [Accessed 5 September 2013] Retrieved from Directory of Open Access Journals, Ipswich, MA
   PubMedGoogle Scholar
• Teunissen PW, Dornan T. Lifelong learning at work. BMJ 2008; 336(7645)667–669
   PubMedGoogle Scholar
• Health USDepartment of, and Human Services, National Institutes of Health. 2012. PROMIS: Instrument Development and Psychometric Evaluation Scientific Standards. Available from: http://www.nihpromis.org/measures/instrumentoverview
   Google Scholar
• Van Der Hem-Stokroos HH, Scherpbier AJ, Van Der Vleuten CP, De Vries H, Haarman HJ. How effective is a clerkship as a learning environment?. Med Teach 2001; 23(6)599–604
   PubMedGoogle Scholar
• van Hell EA, Kuks JB, Cohen-Schotanus J. Time spent on clerkship activities by students in relation to their perceptions of learning environment quality. Med Educ 2009; 43(7)674–679
   PubMed Web of Science ®Google Scholar
• Wall D, Clapham M, Riquelme A, Vieira J, Cartmill R, Aspegren K. Is PHEEM a multi-dimensional instrument? An international perspective. Med Teach 2009; 31(11)E521–E527
   PubMed Web of Science ®Google Scholar
• Wenger E. Communities of practice: Learning, meaning, and identity. Cambridge University Press, Cambridge 1998
   Google Scholar
• Wichmann-Hansen G, 2004. Praktik i laegeuddannelsen. Doctoral thesis, Aarhus Universitet, Aarhus
   Google Scholar
• Williams GC, Saizow R, Ross L, Deci EL. Motivation underlying career choice for internal medicine and surgery. Soc Sci Med 1997; 45(11)1705–1713
   PubMed Web of Science ®Google Scholar
• Wood JM, Tataryn DJ, Gorsuch RL. Effects of under- and overextraction on principal axis factor analysis with varimax rotation. Psychol Meth 1996; 1(4)354–365
   Web of Science ®Google Scholar
• Yardley S, Teunissen PW, Dornan T. Experiential learning: AMEE guide No. 63. Med Teach 2012; 34(2)E102–E115
   PubMed Web of Science ®Google Scholar