302
Views
11
CrossRef citations to date
0
Altmetric
Original Research

The Malaysia DREEM: perceptions of medical students about the learning environment in a medical school in Malaysia

, , , , , , , , , , , , , , , & show all
Pages 177-184 | Published online: 09 Jun 2014

Abstract

Background

Students’ perceptions of their learning environment, by defining its strengths and weaknesses, are important for continuous improvement of the educational environments and curriculum. Therefore, the aim of this study was to explore students’ perceptions of their learning environment, among medical students in Malaysia. Various aspects of the education environment were compared between year levels and sex.

Methods

This cross-sectional study was conducted at the Management and Science University, Shah Alam, Malaysia in 2012. A total number of 438 medical students participated in this study, and the response rate was 87.6%. Data were analyzed using SPSS. Comparisons of the mean scores of Dundee Ready Education Environment Measure (DREEM) subscales were calculated. The t-test was used to determine statistically significant differences.

Results

The majority of the study participants were female, Malay, and from year 3 (68.7%, 65.3%, and 55.7%; respectively). Analysis of each of the 50 items of the DREEM inventory showed that 47 items scored ranged between 2.00 and 3.00, and three items scored below 2.00. These were identified as problem areas in this medical school that are required to be critically addressed. The overall score showed that the medical students’ perceptions were positive. The students’ perception toward educational environment was positive for all five DREEM subscales.

Conclusion

The study found that, in general, the perceptions of the participants about the learning environment were positive. Nevertheless, the study also found there is a need for curriculum improvement in this school and identified priority areas for such improvement.

Introduction

The medical educational environment is increasingly becoming the focus of research globally.Citation1,Citation2 It is commonly understood that educational environments are an important factor for efficient learning.Citation3,Citation4 Therefore, assessment of the educational environments has been identified as a key instrument for the delivery of high quality education.Citation3,Citation4 This has been reported in a number of studies that examined educational environment among factors that are thought to be important for the success of an effective curriculum.Citation5Citation7

A number of previous studies showed that educational environments positively correlate with academic success and satisfaction with educational curriculum.Citation8,Citation9 Excellent learning has been found to positively correlate with the educators’ perceptions of the educational environments. It influences how, why, and what students learn.Citation9,Citation10

Measurements of the education environments in primary and secondary education have been commonly accepted for decades.Citation11Citation14 A number of instruments for measuring the medical education environments have also been developed.Citation15Citation20 A study by Roff et alCitation21 described the development and validation of the Dundee Ready Education Environment Measure (DREEM). This instrument is a general, multidimensional, multicultural instrument. It gives a universal score of a maximum of 200 and is capable of measuring five separate elements of the education environment: Students’ Perceptions of Learning (SPoL), Students’ Perceptions of Teachers (SPoT), Students’ Perceptions of Atmosphere (SPoA), Students’ Academic Self-Perception (SASP), and Student’s Social Self-Perceptions (SSSP).Citation21 The DREEM instrument can be used to highlight the weaknesses and strengths of any educational institution, compare the performance and success of medical schools, and make comparisons among students in different levels of study and of different sex.Citation9,Citation22 In addition, this tool can be used to help amend the curriculum, in comparing present and past programs, and for the examination and evaluation of the effectiveness of a university curriculum.Citation6Citation23 The DREEM can also be useful in helping health and medical schools to distinguish their priorities.Citation22Citation26 In addition, it enables institutions to compare their performances and productivities with their peers, which can be educationally insightful.Citation24 It is established nowadays that the value of DREEM is in providing a consistent method for global comparisons between medical schools and also, in allowing them to standardize their educational environments.Citation25 The DREEM has been successfully used in research carried out in North America, Africa, Europe, South America, the Middle East and Asia.Citation26 Previous study has been able to achieve a number of goals, including the generation of a profile of institutional/course strengths and weaknesses, and the testing and application of intra- and interinstitutional benchmarking to predict student performance.Citation26 It is well understood nowadays that monitoring the perceptions of students is necessary in order to continuously improve the educational environment, by defining its strengths and weaknesses.Citation26

Despite the obvious potential value of the application of DREEM for analysis of medical education problems, this tool is not commonly used in Malaysia. Therefore, the aim of our study was to explore students’ perceptions of their learning environment, among medical students in one of the medical schools in Malaysia. In this study, various aspects of the education environment were compared between year levels and sex.

Methods

Participants

This cross-sectional study was conducted at the Management and Science University, Malaysia, in 2012. The target population included medical students in years 1, 2, and 3 at the International Medical School, Management and Science University. The International Medical School had 610 medical students at that time, but not all of them were present at the time when the study was carried out. Thus, in our study, questionnaires were distributed randomly among 500 medical students. Sixty-two students were excluded from the study analysis as these students either failed to return the questionnaire or did not complete it. Therefore, in total, 438 questionnaires were analyzed (response rate =87.6%).

The protocol of this study was approved by the Ethics Committee of Management and Science University, Malaysia. Following precise instructions and explanation of the aim of the study, the questionnaires were distributed randomly to the students.

Measures

The perceptions of medical students in this study were assessed using the DREEM criteria. In our study, the DREEM instrument was used.Citation21 The DREEM measured the five previously described subscales: the SASP, SPoT, SPoL, SSSP, and the SPoA. This instrument contained 50 items about topics directly related to educational environments.Citation21 The students were asked to read all the statements and to answer using a five-point Likert scale ranging from “strongly agree” to “strongly disagree”. The scoring of items was as follows: 4= strongly agree, 3= agree, 2= uncertain, 1= disagree, and 0= strongly disagree. Nine items (4, 8, 9, 17, 25, 35, 39, 48, and 50) were scored in reverse. A higher score indicated a more positive evaluation – in the original version, the DREEM (50 items) has a maximum score of 200, demonstrating the perfect educational environment.Citation21 Items with mean score of 3.5 or over were classed as “real positive points”.

The DREEM was developed by the international Delphi panel, involving more than eighty health and medical profession educators from all continents all over the world.Citation24,Citation26,Citation27 The fifty items in the scale were considered to be the constituents of a good learning environment for undergraduates in the health professions.Citation6,Citation24,Citation26,Citation27 The development and validation of the DREEM has been reported.Citation27

The previous Malaysian study using the DREEM reported an “acceptable level of constancy and a high level of internal consistency of the instrument (DREEM) to be used in the local environment to measure educational environments in Malaysia”.Citation28

Data analysis

Data were analyzed using SPSS version 18 (IBM Corp, Armonk, NY, USA). Comparisons of the mean scores of males and females were included. The Student’s t-test was used to determine statistically significant differences. One-way analysis of variance (ANOVA) was carried out to analyze the difference between the mean scores of the three different years. For this study, P<0.05 was considered statistically significant.

Results

A total number of 438 medical students from the Management and Science University participated in this study. The majority were females, Malay, and from year 3 (68.7%, 65.3%, and 55.7%; respectively) ().

Table 1 Sociodemographic characteristics of the medical students from the Management and Science University, who participated in this study (n=438)

Students’ Perceptions of Learning

In the SPoL subscale, the 12 items scored between 2.00 and 3.00. These indicated the aspects of the domain that could be improved ().

Table 2 Students’ perceptions of learning, among medical students (n=438)

Students’ Perceptions of Teachers

The SPoT subscale included eleven items. Item 39, which asked whether “The teachers get angry in teaching”, and item 50, which asked whether “The students irritate the teachers”, both negative items, scored 1.99 (standard deviation [SD] 0.98) and 1.91 (SD 0.95), respectively, indicating the students’ agreement with the items. This could mean that these items indicate problem areas and should be investigated closely. The other items scored between 2.00 and 3.00, indicating the aspects of this domain that could be improved ().

Table 3 Students’ perceptions of teachers, among medical students (n=438)

Students’ Academic Self-Perception

In the analysis of individual items of the SASP subscale, which included eight items, the item scores ranged between 2.00 and 3.00, indicating areas that need to be improved ().

Table 4 Students’ academic self-perception, among medical students (n=438)

Students’ Perceptions of Atmosphere

The SPoA subscale included 12 items. The highest mean scores recorded were for the items “There are opportunities for me to develop interpersonal skills” and “I feel comfortable in the class socially”. The lowest score was for the statement “I find the experience is disappointing” ().

Table 5 Students’ perceptions of atmosphere, among medical students (n=438)

Students’ Social Self-Perception

The SSSP subscale included seven items. One item indicating a problem area was item 4 (“I am too tired to enjoy the course”), which had a mean score of 1.90. The other items scored between 2.00 and 3.00, indicating a need for further enhancement ().

Table 6 Students’ social self-perceptions, among medical students (n=438)

A total of 47 items scored between 2.00 and 3.00; this suggests that these areas could be enhanced to improve the educational environments in this university. A total of three items scored below 2.00. These could be thought to identify “real” problems in our school educational environment and thus, we believe, need urgent investigation.

shows the DREEM overall and subscale mean scores among the medical students. The overall score was 125.3/200 (SD 19.5). The overall score indicates that the medical students’ perceptions of the educational environment of the school were more positive than negative. The total mean score for the SPoL was 30.6/48 (SD 5.4), SPoT was 27.4/44 (SD 4.4), SASP was 20.6/32 (SD 3.8), SPoA was 29.7/48 (SD 5.2), and for the SSSP was 16.7/28 (SD 3.3). The students’ perceptions toward the educational environment were positive for all five DREEM subscales.

Table 7 DREEM domains for medical students (n=438)

DREEM scores by year of enrollment and sex

Significant differences were found between the year levels of enrollment for total DREEM score and the SPoT, SPoL, SASP, SPoA, and SSSP subscale scores (<0.001, <0.001, <0.001, <0.001, <0.001, and 0.043; respectively) ( and ).

Table 8 ANOVA between different years for the differing DREEM domains (n=438)

Table 9 Statistically significant differences between years (n=438)

shows that there were significant differences in the perceptions of the male and female students in six items, with higher female satisfaction with the education environment. Notably, males scored more negatively on several aspects of the educational environment than did the females.

Table 10 Statistically significant differences between male and female medical students (n=438)

Discussion

Educational environments are an important factor to determine the effectiveness and success of a medical school curriculum.Citation5 Therefore, our study aimed to evaluate the education environment as perceived by medical students at the International Medical School of the Management and Science University, Malaysia. It also aimed to determine the different perceptions among students from different year-levels and between the sexes.

According to McAleer and Roff,Citation29 a mean score between 50 and 100 indicates serious problems. The overall DREEM mean score in our study was 125.3/200, which fell well inside the range (101–150) being indicative of a “more positive than negative” perception of the environment.Citation30,Citation31 Higher overall mean scores were reported in two earlier Malaysian studies, in which the overall mean scores were 133/200 and 134/200.Citation32,Citation33 Lower overall scores (119/200, 114/200, and 107/200) were reported in repeated studies from India.Citation5,Citation9 Lower overall scores also were reported in Sri Lanka, Nigeria, and Trinidad, with overall scores of 108/200,Citation30 118/200,Citation10 and 109/200,Citation6 respectively. The lowest score, 89/200, was reported in Saudi Arabia at the College of Medicine at King Saud University,Citation34 followed by a score of 97/200 reported by a study of the Canadian Memorial Chiropractic College.Citation35 Higher overall scores were reported in Nepal and in the United Kingdom, with overall scores of 130/200Citation10 and 139/200,Citation36 respectively. An overall mean DREEM score of 125/200, similar to that obtained in our study, was reported in another Malaysian study.Citation37 A few previous studies showed higher total scores than in our study,Citation2,Citation36Citation38 which may indicate that these institutions are somewhat innovative in providing a student-centered approach to education.Citation2

All students perceived “a more positive approach” (30.6/48) for their learning; “moving in the right direction” (27.4/44) for their teachers; “feeling more on the positive side” (20.6/32) for their academic self-perception; “a more positive environment” (29.7/48) for the atmosphere; and “not too bad” (16.7/28) for their social self-perception. These results should encourage and motivate the curriculum planners in our institute to raise students’ perceptions about their educational environments to the highest level. In our study, the scores for all five subscales showed positive perceptions of the study participants. Nevertheless, there is a need for improvement in all five domains of the educational environments at the Management and Science University. This conclusion is in accordance with similar findings that were reported by Lai et al,Citation33 from a study performed in Saudi Arabia.Citation23,Citation24

There were three DREEM items that scored 2 or less. The low scores suggest these items should be examined more closely as they indicate problem areas. Two items belonged to the SPoT subscale (“The teachers get angry in class”; “The students irritate the teachers”) and another belonged to the SSSP subscale (“I am too tired to enjoy the course”). The item “I find the experience disappointing” (2.0) belonged to the SPoA subclass. These findings are indicative of the fact that these areas should be examined more closely as they relate to problem areas.

In our study, the students reported that the teaching was too teacher-centered. This finding is consistent with the findings of Mayya and Roff.Citation9 In that study, students’ perceptions about enjoying the course were found to be average, with a mean scoring of 2. In our study, the students identified two items with means of more than 2.8, and these can be regarded as strengths (“The teachers are knowledgeable” [2.9]; “I have good friends in this school” [2.9]). In a previous studyCitation39 low scores were found to be related to a good support system for students who get stressed during their study. Similarly, in a previous study,Citation39 “memorize all information needed” showed low scores, similar to the findings in the present study. In a study conducted in Saudi Arabia,Citation23,Citation24 the item “There is a good support system for students who get stressed” had a very poor score, of 0.9. A low rating of this item indicated a lack of support available for stressed students.

In our study, there were 30 items that were scored between 2.50 and 3.00. These items are aspects of the educational environment that could be enhanced.Citation29 They were items 1 (2.6), 7 (2.6), 13(2.5), 16 (2.6), 20 (2.6), 22 (2.6), 24 (2.5), and 38 (2.6) of the SPoL domain. This corresponded to student perceptions that their teachers encouraged them to participate in class, that the teachers stimulated them to participate in the teaching sessions, that the teaching was student-centered, that the teaching developed their competence and confidence, that the teaching was well focused, and that students felt clear about the learning objectives of the course. The scores of items 2 (2.9), 6 (2.7), 18 (2.7), 29 (2.7), 32 (2.5), 37 (2.7), and 40 (2.5) of the SPoT domain suggested that the students felt that their teachers were knowledgeable, well prepared for their classes, that teachers were good at communicating with them, and that teachers were good at providing feedback and criticism to students. Items 5 (2.5), 10 (2.6), 21 (2.5), 31 (2.7), and 45 (2.7) of the SASP domain corresponded to the following: “Learning strategies which worked for me before continue to work for me now”; “I am confident about my passing this year”; “I feel I am being well prepared for my profession”; “I have learned a lot about empathy in my profession”; and “Much of what I have to learn seems relevant to a career in medicine”. Items 23 (2.5), 30 (2.7), 33 (2.7), 34 (2.5), 36 (2.5), 42 (2.5), 43 (2.6), and 49 (2.6) of the SPoA domain and items 15 (2.9) and 19 (2.7) of the SSSP domain included the following statements: “The environments are relaxing during lectures”; “There are opportunities for me to develop interpersonal skills”; “I feel comfortable in class socially”; “The environments are relaxing during seminars/tutorials”; “I am able to concentrate well”; “The enjoyment outweighs the stress of studying medicine”; “The environments motivate me as a learner”; “I feel able to ask the questions I want”; “I have good friends in this school”; and “My social life is good”. Some of the problem areas identified in the study population have also been identified as problems encountered in medical schools with traditional curricula. Two studies documented that students in traditional medical curricula perceived teaching as being too teacher-centered, overemphasizing factual learning with more authoritarian teachers.Citation23,Citation24 It was also observed that the students in these environments were more likely to feel tired, less able to memorize all they needed, and were less likely to enjoy the course. A possible explanation of the fact that the students were unable to memorize may be that there was an excessive volume of material to learn and no guidance given in prioritizing learning. Previous study showed that perceptions of students were linked with a risk of superficial learning, which in the long-term is associated with less retention of knowledge.Citation40

In our study, students’ perceptions about their learning environment showed the greatest difference between males and females. Mean scores were two points higher for females than males. A possible explanation for this finding may be that females perceived factors such as curriculum, structure, focus, and goals more positively than males. This is in agreement with a previous study that reported that males and females show different learning styles.Citation41 This finding is also consistent with other earlier studies from the UK.Citation21,Citation31 However, it is essential to note here that this trend was opposite to the trend found in other studies that were carried out in the Middle East,Citation1,Citation2 the West Indies,Citation6 and Sri Lanka.Citation30

In our study there were significant differences in DREEM scores between males and females and year of study. A study by the Nepalese Health Sciences Institute showed significant sex and academic year differences.Citation29 Al-Sketty,Citation42 in his study at three institutes of nursing at the Sultanate of Oman, found variations in the DREEM score based on year of study and sex. Similar findings were reported by Al-Qahtani,Citation43 namely, that sex showed statistically significant variations in the DREEM score. Sex-specific variations in the DREEM score in a study by Al-Hazimi et alCitation23 identified that the female students were more satisfied than their male counterparts with the Dundee University Medical School (overall mean DREEM score 139/200).

Conclusion

A multicultural understanding of the environmental characteristics that influence learner growth and well-being is very important. The effectiveness of even the best pedagogy can be stymied by environmental factors that prevent learner engagement in the curriculum. Our study provides factual data about perceptions of the learning environment among medical students in Malaysia and provides some guidance on what needs to be addressed in the curriculum. Further continuous assessments of the learning environment are needed once changes are introduced, to evaluate whether these are effective.

Acknowledgments

The authors would like to thank the International Medical School, Management and Science University, Malaysia, for support.

Disclosure

The authors report no conflicts of interest in this work.

References

  • RoffSEducation, environment: a bibliographyMed Teach200527435335716024420
  • RoffSThe Dundee Ready Educational Environment Measure (DREEM) – a generic instrument for measuring students’ perceptions of undergraduate health professions curriculaMed Teach200527432232516024414
  • NewbleDCannonRA Handbook for Medical Teachers4th edDordrechtKluwer Academic Publishers2001
  • DentJHardenRMA Practical Guide for Medical Teachers3rd edAmsterdamElsevier Health Sciences2009
  • AbrahamRRamnarayanKVinodPTorkeSStudents’ perceptions of learning environment in an Indian medical schoolBMC Med Educ200882018402710
  • BassawBRoffSMcAleerSStudents’ perspectives on the educational environment, Faculty of Medical Sciences, TrinidadMed Teach200325552252614522676
  • GennJMAMEE Medical Education Guide No 23 (Part 1): Curriculum, environment, climate, quality and change in medical education – a unifying perspectiveMed Teach200123433734412098379
  • LizzioAWilsonKSimonsRUniversity students’ perceptions of the learning environment and academic outcomes: implications for theory and practiceStudies in Higher Education20022712752
  • MayyaSRoffSStudents’ perceptions of educational environment: a comparison of academic achievers and under-achievers at Kasturba Medical College, IndiaEduc Health (Abingdon)200417328029115848815
  • RoffSMcAleerSWhat is educational climate?Med Teach20012333333412098377
  • PaceCRSternGCAn approach to the measurement of the psychological characteristics of learning environmentJ Educ Psychol195849269277
  • FraserBJDevelopment of short forms of several classroom environment scalesJournal of Educational Measurement1982193221227
  • FraserBJTreagustDFValidity and use of an instrument for assessing classroom psychosocial environment in higher educationHigher Education1986153757
  • MoosRHTrickettEJClassroom Environment Scale Manual2nd edPalo Alto, CAConsulting Psychologists Press1987
  • HutchinsEBThe 1960s medical school graduate: his perceptions of his faculty, peers, and environmentJ Med Educ19613632232913717048
  • RothmanAIAyoadeFThe development of learning environment: a questionnaire for use in curriculum evaluationJ Med Educ1970457547595456533
  • LevyMMorsePKLiebeltRADallmanJJMcDonaldTFUse of the learning environment questionnaire to assess curricular changeJ Med Educ19734898408454733425
  • MarshallREMeasuring the medical school learning environmentJ Med Educ197853289104
  • FelettiGIClarkeRMReview of psychometric features of the Medical School Learning Environment SurveyMed Educ198115292967207276
  • WakefordREStudents’ perception of the medical school learning environment: a pilot study into some differences and similarities between clinical schools in the UKAssessment and Evaluation in Higher Education198163206217
  • RoffSMcAleerSHardenRMDevelopment and validation of the Dundee Ready Education Environment Measure (DREEM)Med Teach1997194295299
  • RoffSMcAleerSIfereOSBhattacharyaSA global diagnostic tool for measuring educational environment: comparing Nigeria and NepalMed Teach200123437838212098385
  • Al-HazimiAAl-HyianiARoffSPerceptions of the educational environment of the medical school in King Abdul Aziz University, Saudi ArabiaMed Teach200426657057315763838
  • Al-HazimiAZainiRAl-HyianiAEducational environment in traditional and innovative medical schools: a study in four undergraduate medical schoolsEduc Health (Abingdon)200417219220315763762
  • HammondSMO’RourkeMKellyMBennettDO’FlynnSA psychometric appraisal of the DREEMBMC Med Educ201212222240254
  • Denz-PenheyHMurdochJCA comparison between findings from the DREEM questionnaire and that from qualitative interviewsMed Teach20093110e449e45319877851
  • PimparyonPCaleerSMPembaSRoffSEducational environment, student approaches to learning and academic achievement in a Thai nursing schoolMed Teach2000224359364
  • YusoffMSBStability of DREEM in a sample of medical students: a prospective studyEducation Research International20122012509638
  • McAleerSRoffSA practical guide to using the Dundee Ready Education Environment Measure (DREEM)GennJMAMEE Medical Education Guide No 23 Curriculum, Environment, Climate, Quality and Change in Medical Education; A Unifying PerspectiveDundeeAssociation of Medical Education in Europe20012933
  • JiffryMTMcAleerSFernandoSMarasingheRBUsing the DREEM questionnaire to gather baseline information on an evolving medical school in Sri LankaMed Teach200527434835216024419
  • DunneFMcAleerSRoffSAssessment of the undergraduate medical environment in a large UK medical schoolHealth Educ J2006652149158
  • HassanIIA Study of Stressors and Coping Strategies Among First Year Nursing Students in the College of Polytech Mara, Kota Bharu, Kelantan [master’s thesis]Kota BharuUniversiti Sains Malaysia2007
  • LaiNNalliahSJuttiRCHlaYLimVKThe educational environment and self-perceived clinical competence of senior medical students in a Malaysian medical schoolEduc Health (Abingdon)200922214820029744
  • Al-AyedIHSheikSAAssessment of the educational environment at the College of Medicine of King Saud University, RiyadhEast Mediterr Health J200814495395919166179
  • AudinKDavyJBarkhamMUniversity quality of life and learning (UNIQoLL): An approach to student well-being, satisfaction and institutional changeJournal of Further and Higher Education2003274365382
  • VarmaRTiyagiEGuptaJKDetermining the quality of educational climate across multiple undergraduate teaching sites using the DREEM inventoryBMC Med Educ200551815723699
  • ZamzuriATAliANRoffSMcAleerSStudents perceptions of the educational environment at dental training collegeMalaysian Dent J2004251526
  • MilesSLeinsterSJComparing staff and student perceptions of the student experience at a new medical schoolMed Teach200931653954619811170
  • FidelmaDMcAleerSRoffSAssessment of the undergraduate medical education environment in a large UK medical schoolHealth Educ J2006652149158
  • EdgrenGHafflingACJakobssonUMcAleerSDanielsenNComparing the educational environment (as measured by DREEM) at two different stages of curriculum reformMed Teach2010326e233e23820515368
  • PhilbinMMeierEHuffmanSBoveriePA survey of gender and learning styles. Sex RolesA Journal of Research1995327–8485494
  • Al-SkettyAJSStudent Nurses’ Perceptions of the Climate of Their Learning Environment in Three Institutes of Nursing in the Sultanate of Oman [masters dissertation]DundeeUniversity of Dundee2003
  • Al-QahtaniMFMApproaches to Study and Learning Environment in Medical Schools with Special Reference to the Gulf Countries [PhD thesis]DundeeUniversity of Dundee1999