2,118
Views
2
CrossRef citations to date
0
Altmetric
Research Article

Project-based learning in biomedical sciences: using the collaborative creation of revision resources to consolidate knowledge, promote cohort identity and develop transferable skills

ORCID Icon, ORCID Icon & ORCID Icon

ABSTRACT

Project-based learning (PBL) has been found to deepen learning and develop employability skills for students through active engagement with the learning materials. Foundation, first and second year Biomedical Science students at the University of Sussex were introduced to a PBL exercise. Each class had an approximate student to staff ratio of eighty to two. Students were put into groups of four to five and asked to create a revision guide for a disease system, which was then shared among the cohort for exam preparation. Students were later surveyed on the effectiveness of this group activity. 74% indicated the activity helped them integrate knowledge from previous modules, with the majority of the students scoring the activity 4 out of 5 for consolidation of knowledge. 75% of the participants who took part before the pandemic indicated that the tasks enabled them to build a cohort identity, with 59% students feeling similarly during the pandemic. Additionally, we qualitatively assessed the development of transferrable skills, such as teamwork, effective communication and time management. The results of the questionnaire suggested that students were able to gain these skills. This paper outlines the study, discusses benefits and limitations, and provides potential solutions for the future.

Introduction

How students learn is a well-versed educational debate (Sfard Citation2016). The idea that knowledge is effectively transmitted from teacher to student through lectures is widely contested (Chickering and Gamson Citation1987); many educationalists argue that only by doing something with the teaching material do students move from a position of not knowing to a position of knowing (Louis et al. Citation2019). Research indicates that students need to interact with the knowledge and have practice using it for themselves in authentic or semi-authentic tasks (Chickering and Gamson Citation1987; Hanson and Wolfskill Citation2000; McLuckie and Topping Citation2004; Topping Citation2005; Wurdinger et al. Citation2007; Eberlein et al. Citation2008). An active learning methodology, such as project-based learning (PBL), encourages students to ‘abandon their passive attitude toward learning’ and construct a concrete artefact, forcing them to put what they know into practice (Alves et al. Citation2018). Curriculum design that uses PBL contrasts with the traditional HE curriculum, which assesses student learning through midterm and end-of-term essays and exams.

The benefits of project-based learning

The act of collaboratively constructing an output helps actively engage students with the taught material and boosts their motivation to learn (Rodríguez et al. Citation2015; Louis et al. Citation2019; Slough and Milam Citation2013). This motivation-boost became increasingly important with the move to teaching online during the COVID-19 pandemic, where students were engaging with taught content and their peers through a computer screen (Rossi et al. Citation2021). For successful online learning, which offsets student isolation from both the academic subject and their cohort, educators must facilitate interactions between both learner–content and learner–learner (Chien‐Yuan and Guo Citation2021). PBL fosters these two areas of interaction through peer collaboration, the necessity to work through a series of problems, and working towards a required output that is either formally or informally assessed.

The collaborative creation of an output requires students to consider different stages of production and follow these stages step-by-step. This process means ‘that gaps in knowledge cannot be easily overlooked or overcome’ (Helle, Tynjälä, and Olkinuora Citation2006). As students think their way through the steps of enquiry, they actively engage with material and thereby consolidate understanding (Maton Citation2009; Sanchez-Muñoz et al. Citation2020). In addition, when PBL happens in a group, discussions and potential disagreements in the appropriate stages of production occur, prompting students to negotiate and coordinate to reach an agreement. This consensus is tested and verified by the group through the various stages of production, thereby achieving ‘more diverse and in-depth social knowledge construction’ (Sheng-Yi et al. Citation2013, 78). Through active participation in project groups, PBL students feel more confident in their subject knowledge than non-PBL students (Rodríguez et al. Citation2015). The PBL production process gives students the opportunity to see their learning physically develop. Both stumbling blocks and developments in understanding are materialised, helping to demystify the learning process.

Group PBL creates connections between students by giving them a common goal and a reason to work together. Robinson et al. (Citation2007) found that group PBL encourages an environment of ‘student engagement and community building’ (Robinson et al. Citation2007). The need for community building was particularly felt during periods of online learning (Khan et al. Citation2017). For example, while studying online during the COVID-19 pandemic, HE students generally reported feelings of depression and there appeared to be a decline in student mental health (Stamatis et al. Citation2021). While a multitude of factors contributed to this decline, making it impossible to address through a singular approach, collaborative working during PBL has been reported to boost student well-being (Johnson and Johnson Citation1999; Stamatis et al. Citation2021) and therefore can be implemented to help improve psychological outlooks amongst cohorts.

Alongside building both confidence with course content and a sense of community, PBL also develops interdisciplinary thinking by allowing students to apply their learning to real-world environments, often outside of education (Vogler et al. Citation2017). These real-world skills are labelled ‘transferable’ and are valuable because of the long-term learning benefits that they give to students beyond their university life. PBL develops a range of transferable skills, such as team working, effective communication, problem solving, time management and critical thinking. In PBL, students generally work together in a non-hierarchical sense as peers, to achieve their common goal. PBL often has a flat leadership model, whereby ‘leaders are situational and collaboration is dynamic and non-coercive’ (Cain and Cocco Citation2013). Teamwork in PBL gives students the experience of solving problems together, through effectively communicating challenges and solutions, and reaching consensus within the group. Effective communication is vital for deep learning and Topping (Citation2005, p. 637) says that a ‘participant might never have truly grasped a concept until having to explain it to another, embodying and crystallising thought into language’ (Topping Citation2005) The building of effective communication skills, particularly when required to express independent viewpoints, is important for students in all disciplines, but particularly important for scientific disciplines, which at their heart require ‘the inclusion of all ideas – including ideas that are ultimately rejected, justification for ideas/designs/rejections, and attribution to experts or evidence’ (Slough and Milam Citation2013). As students work together towards their common aim, they must maintain time management skills by continually reflecting upon the project’s purpose, setting clear and realistic goals and making decisions regarding the pace, process and trajectory of learning (Kokotsaki, Menzies, and Wiggins Citation2016). Continual reflection on progress is key to the critical component of PBL, which requires students to innovate as they attempt to overcome obstacles and thereby engage with the material at a more complex level (Wurdinger and Qureshi Citation2014). The group aspect of PBL gives students the opportunity to critique their own work and the work of their peers. The fact that the outcome of these PBL projects are revision resources that benefit the entire cohort will hopefully make students constructive critics, rather than resorting to fault-finding.

Despite the many benefits of PBL, it can be difficult to assess: ‘given that PBL is necessarily more or less an adventure, […] assessment is especially difficult’ (Helle, Tynjälä, and Olkinuora Citation2006). Learning from PBL activities is demonstrated as much in the process of creation as it is in the final result. To overcome difficulties around assessing PBL, this current study utilises PBL’s focus on process by using it in the student’s preparation for assessment, rather than the assessment itself. Students worked in designated groups to collaboratively create revision resources on disease settings. The construction of these resources dealt with the dearth of revision material for students within this subject area. To promote motivation, students were reminded that these resources could be used throughout their degree programme and thereby positively affect their final grade. This research paper evaluates the impact of the collaborative creation of revision resources on student learning by asking whether such a project helped students consolidate knowledge, build a sense of community, and develop transferable skills.

Methods

This is in part an action research project (Somekh Citation1995) as one of the authors is the module convenor and designed the PBL teaching activity, in part a quantitative study and in part a qualitative study. The questionnaire to students was designed by the tutor and an educationalist. The teaching method employed a PBL approach, whereby students were divided into designated groups by randomisation and tasked with creating revision resources focused on a disease setting. The project’s main objective was to encourage students to utilise their study time collaboratively and consolidate their knowledge, as they brought together learning materials from various modules, which they shared with their group through peer-tutoring, discussion and reflective learning. The final product was to create a condensed but informative digital revision resource that was interactive, accessible, and easily understood. Groups were able to decide on their resource format, from video, PowerPoint, mind map, or Word document. The three aims of this study were to monitor the effectiveness of the formative task in:

  1. Consolidating and integrating knowledge, from other modules, into a disease setting

  2. Encouraging students to collaborate, and to build a sense of community through the cohort

  3. Developing transferable skills, such as effective communication, problem-solving, time management and team building.

In semester 1 of 19/20 the project ran as a pilot in one first-year module. In semester 2 of 19/20, and both semesters 1 and 2 of 20/21 and 21/22, the study was extended to three modules: foundation year, first year and second year Biomedical Science. In academic year 19/20 the project was run before the pandemic started. In all modules, the student output was assessed formatively. Formative assessments often pose challenges regarding uptake. However, the direct link to the summative assessment, through the creation of revision material and the development of transferable skills, bolstered student motivation. The formative assessment fed into the summative, even when exams moved from closed to open-book during the pandemic. The open-book questions tested the students’ application of knowledge, rather than simply their knowledge recall, mirroring requirements of the PBL task as students applied their knowledge to a disease setting. The questionnaire was given to the student after the modules had ended in the winter of 2021/2022.

Ethical Approval

The study was approved by the University of Sussex Research Ethics Committee (Reference: ER/PAOLO/1) before distribution of the questionnaire to the participants.

Rationale

The rationale behind this project was for the surface knowledge acquired in lectures and seminars to gain depth through the construction of revision resources. This process developed understanding, requiring students to make sense of what they had learned, ‘create meaning and make ideas their own’ (Hattie and Donoghue Citation2016). If we think of this project in relation to the cycle of knowledge construction, the ‘learner observes a moderately complicated situation, makes connections, and builds up relationships to produce more sophisticated conceptions’ (Pegg and Tall Citation2010). Having brought their knowledge together, students build upon their ability to evaluate, as they organise and filter material in order to produce digestible and accessible materials. As students make their thinking visible, they are given the opportunity to ‘explicitly monitor their own learning, which encourages reflection and more accurately models the scientific process’ (Slough and Milam Citation2013).

In addition to consolidating and evaluating their knowledge, the process of co-creation builds a sense of community and a cohort identity. Although students work in teams in core laboratory group work, the duration of these tasks are limited and the instructions are pre-written, lacking the need for open peer–peer dialogue (Poort, Jansen, and Hofman Citation2020). Another key difference to laboratory group work is that this task is undertaken outside of university contact hours, prompting students to manage their own time, organise meetings outside of the classroom without an academic facilitator, and therefore take ownership of their learning. It must be noted that the opportunity for collaboration via laboratory group work was removed by online teaching during COVID-19, making the collaborative benefits afforded by PBL even more important for the cohort of students affected by the pandemic.

The PBL task was aimed at foundation, first and second years and can be considered a “transition pedagogy’ that builds upon the abilities and knowledge that students have when entering university and, through the students’ construction of the resource, directs their development to the specific needs of HE assessment (Mouton Citation2019). These communal resources benefit all students, but particularly those who lack skills in creating concise revision materials by themselves. This task therefore promotes an ethos of collegiality, which is particularly pertinent to science subjects, whereby it is difficult to solve complex problems in isolation. As Bing et al. (Citation2020) highlights, PBL introduces students to the benefits of collaboration early in their scientific careers (Bing et al. Citation2020).

Student activity

Students were given 3 weeks to complete the task. They were divided into random groups of three or four via University’s virtual learning environment. During the first 3 weeks, students were encouraged to meet at least four times, for 30 minutes to an hour for each meeting. Groups were encouraged to carry out some research on the topic, enabling them to engage with the subject area outside of given teaching materials. Students with learning differences were allowed to work on their own or choose a group member. This allowed for an inclusive experience.

In the beginning of the term (week one), students received one lecture introducing the module learning outcomes and the activity, which explained the benefits and challenges of the task, as well as providing evidence (students’ feedback) from previous courses where the task positively impacted students’ learning experience. Students were instructed to constructively align the learning outcomes from their lecture slides and weekly learning materials to the revision material.

An example of the activity completed by students in year 1:

Task: Produce a revision guide that describes what happens when Staphylococcus aureus bacterial antigen in staph infection is detected by our innate immune system. The guide should include the following details:

“bacterial cell structure, bacterial metabolism, assessment of the presence of bacteria in patients’ samples, the immune system, available antibiotics”

Students attended five lectures on microbiology between week 1 and 3 which covered all the aforementioned contents. In groups, students worked collaboratively and extracted key information from these lectures and applied to an infection, e.g. staph infection. This application of knowledge fed into their summative assessments such as lab practical report write up and final exam. Please see the flowchart below ().

Figure 1. A flowchart describing the timeline and events during the PBL task.

Figure 1. A flowchart describing the timeline and events during the PBL task.

Each group had a randomly pre-designated student chair, responsible for delegating tasks, communication and ensuring completion of the task. If a student chair declared that they were not confident enough to lead group meetings and activities, the tutor asked an alternative student to chair. On receiving the information in the first lecture, the designated chairing student organised weekly meetings. Students were provided with the following guidance for each meeting:

Meeting 1: Initial discussion to decide the type of revision material (e.g. slides, text document, mind map, or video), delegation of tasks and setting up a deadline.

Meeting 2: Feedback on content of revision material, consolidating knowledge, seeking clarity on difficult topics and raising any matters e.g. time commitments.

Meeting 3: Students share material produced with their peers prior to the meeting. In the meeting, they provide feedback to each other, identify missing links and gaps in knowledge and collaboratively contribute to completing the task.

Meeting 4: During the final meeting, students present their final product to each other, discuss any potential room for improvements, and then submit it for assessment.

These meeting lasted between 30 minutes and an hour and were carried out over 3 weeks. Students met with one another during face-to-face teaching and the COVID19 pandemic. For consistency, all information and activities remained the same in both learning environments, except that during the pandemic students had to organise their meetings online using a platform, such as Zoom.

Assessment and feedback

The group task was assessed formatively by two members of faculty. Students were provided with the non-contributory marking assessment criteria, which was based on the following:

  • The clarity of presentation – information presented clearly with relevant figures and diagrams, labels and figure legends

  • The detail and quality of content that sufficiently covers the key learning outcomes

  • The creativity of the revision material, e.g. interactivity.

Students received constructive feedback in the sandwich method, whereby areas for improvement are situated between two pieces of positive feedback. This method has been shown to improve students’ performances as they are able to follow through and act on both positive and corrective feedback (Prochazka, Ovcari, and Durinik Citation2020). The task, outcomes and skills gained were discussed in a large group session in week 7 to reflect on the benefits and demonstrate an association with the upcoming summative assessments (see ).

Comparison of the overall module grades

Student results were compared in the two assessed modules before the task was introduced and after the task was introduced. A comparison was performed between the results obtained in those modules in academic year 2018/19 (before the task was introduced even as a pilot) and when the task ran in 2020/21 and 2021/22. Student results from these 3 years were collected through a school office database, anonymised and then compared to see whether students achieved higher module grades after the task was introduced. The results are presented as mean ± (standard deviation). It is important to note that the summative assessment methods changed from closed-book to open-book due to the COVID19 pandemic.

Questionnaire design

The student experience of the PBL task was assessed using a questionnaire, which allowed for both quantitative and qualitative data capture and analysis, was cost-effective and less time-consuming than a focus group or interviews (Adams and Cox Citation2008). The lack of in-depth, reflective answers, which is a disadvantage of questionnaire-style surveys, was overcome by open-ended questions (Mirzaei, Aliah Phang, and Kashefi Citation2014). The questionnaire provided free-text boxes, allowing participants to further comment on their chosen answers. These open-ended answers were utilised for qualitative analysis and used to complement quantitative data.

The quantitative element consisted of close-ended questions with ‘nominal scale’ (Choi and Pak Citation2005). Additionally, we used Likert-rating scale to quantitatively analyse students’ satisfaction, e.g. ‘How useful was this activity in consolidating your knowledge (0 being not useful and 5 being most useful)?’.

A literature review and a consultation amongst the authors of this paper and with colleagues informed the initial design of the questionnaire. This was followed by a pilot questionnaire among five students belonging to two different year groups within the Biomedical Science degree. The pilot questionnaire was conducted to assess whether students understood the questions and to evaluate the questions for their relevance and adequacy. Students were encouraged to provide feedback on the quality of the questionnaire, which was considered for further amendments.

Data generation and analysis

The questionnaire was administered to 304 students in years one and two who participated in the activity at least once. The sample size calculation with 95% confidence level (8% margin of error). This study received 103 responses (at a 34% rate). The wider margin of error was considered due to a lack of engagement observed during the pandemic. The questionnaire was set up on Qualtrics and circulated in the form of an email letter to all eligible participants. Students were provided with clear objectives of, and rationales for, the questionnaire to avoid ambiguity and differential understanding among the students. Students were given 1 month to complete the questionnaire with two reminders within the period.

Questionnaire data were collated from Qualtrics and transferred onto a spreadsheet. The data were reviewed and the PBL task evaluated in terms of its effectiveness in the following areas:

  1. Consolidation and integration of knowledge

  2. Community building

  3. Development of transferable skills

The analyses were carried out both quantitatively and qualitatively. Cronbach’s alpha test confirmed the reliability of the data collected. The questions with nominal-scale answers such as ‘yes’, ‘not sure’ and ‘no’ were each assigned a score of 3, 2 and 1, respectively, for statistical analysis purposes. To measure consolidation of knowledge, we used the Likert scale (ranging from 1 to 5). For representation purposes, the data was normalised against the total number of participants per group. For instance, our collected data was further sorted into pre-COVID 19 and during COVID 19 to assess the impact of the task both in person and online, on consolidation and integration of learning and building a sense of community among students.

Students’ comments as open texts were reviewed, counted, and sorted for transferable skills. Based on these comments, the top six transferable skills were selected for further evaluation and discussion. The assessment of transferable/employability skills in the questionnaire was based on employability skills developed by STEMnet (STEMnet Citation2016).

The quantitative data was analysed using Mann Whitney U-test (non-parametric) using GraphPad Prism 8.0.1 (California, USA) and Microsoft Excel 2013 and a p value of less than 0.05 was considered statistically significant. Next, we analysed the size of the observed effects using the Cohen method (Lenhard and Lenhard Citation2016; Cohen Citation1988). Briefly, according to Cohen, the magnitude of size effects can be interpreted by ‘no effect’, ‘small effect’, ‘intermediate effect’ and ‘large effect’ (). Cohen’s d is determined by calculating the difference between the mean of two groups, and then dividing the result by the pooled standard deviation. Additionally, Kendall’s Tau correlation analysis (non-parametric) was conducted to assess associations between ‘sense of community’ and ‘knowledge integration’ and ‘consolidation of learning’. This analysis was performed using SPSS.

Table 1. Interpretation of different effect sizes.

Results and discussion

In this section, we discuss the student assessment results and their responses to the questionnaire.

Assessment of overall grades of the modules

There is evidence that the overall grade of students in their final exams was positively impacted by the revision resource activity. In the first-year module, the students’ mean mark in their final examination increased from 67 (±14) in 2018/19 to 74 (±12) in 2020/21 and this mean mark was maintained in 2021/22 at 75 (±10). In the second-year module, a similar increase was observed: 68 (±14) from 2018/19 to 77 (±6) in 2020/21. This mean mark was also maintained in 2021/22 at 74 (±21). However, we are tentative in claims that the significant increase in student grades is correlated solely to the revision resource activity. There may have been other factors influencing this rise in marks including the general-grade inflation in response to the lockdown conditions. The researchers did not measure whether students achieved higher assessment grades on the topics covered by the PBL task as the aim was for students to collaboratively build application skills in microbiology, rather than develop their knowledge of the specific topic. The ability to apply knowledge will have benefited all topics covered by the assessment.

Questionnaire responses

Despite not directly contributing to the student grades, all groups submitted a revision guide and almost all students engaged in the activity or gave reasonable excuses for not doing so, such as illness. Of this, 34% responded to the questionnaire.

The questionnaire responses provided rich evidence that the PBL task improved knowledge integration from previous modules and experience and the consolidation of knowledge for deeper understanding. It provided evidence that it also created a sense of community between the students and provided them with transferable skills. The questionnaire also provided data on how learning was only marginally affected by the move online during COVID-19.

Knowledge integration and the consolidation of knowledge

The questionnaire results indicated that PBL can facilitate cumulative learning (Mouton Citation2019). The mean score from the question ‘Q16 – One aim for this activity was for you to consolidate and integrate your knowledge. How useful was this activity in consolidating your knowledge (0 being not useful and 5 being very useful)?’ was 4.1+-0.8, with most students scoring it 4 and 5 out of 5. Fifteen participants said that the exercise helped them contextualise their understanding. One student said:

By writing the answers to the questions in a style more suited for revision, it meant that I had to condense what I had learned in lectures with prior knowledge [from A-level] into a short and concise answer.

This comment describes progressive problem-solving, whereby the student is required to rethink what they already know in order to condense and prioritise information for revision purposes. The need to prioritise adds another level of complexity to the students’ knowledge acquisition and promotes academic development through enhancing critical thinking skills (Helle, Tynjälä, and Olkinuora Citation2006). Students appreciated the opportunity to integrate information with knowledge gained from outside the module. This response corroborates the research, which suggests that the integration of topics, whereby students develop a more holistic understanding of their subject, holds students’ interest to a greater degree than when topics are studied in isolation of one another (Elkhamisy, Hassan Zidan, and Fathelbab Fathelbab Citation2022). Seventy-four percent of students indicated their participation in the activity helped them integrate knowledge from previous modules and experiences. One said:

It really helped me understand the information and was really useful for my exams. Not only that it helped me integrate information from other modules to formulate a really useful document.

The application of knowledge requires students to consolidate knowledge and then create something from it. In the free-text comments, 14 participants said that the exercise allowed them to apply their knowledge. One student said:

We all applied our knowledge, taught each other in areas we felt confident in and shared ideas and understanding of the module.

Other students indicated that it was the group element of PBL that encouraged them to evaluate and consolidate their knowledge:

Explaining concepts is a really good way to ensure that you understand them properly, which helped to consolidate our knowledge.

Another explained:

We were able to discuss concepts raised in lectures that we did not fully understand and learn from each other, further reinforcing our knowledge on the topics.

Students were undergoing ‘semantic waves’ where they start with an abstract concept or questioning followed by a descending wave of unpacking knowledge and information (Mouton Citation2019). This results in students making sense of the complex concepts and then using technical language to explain these concepts to each other in a way that is meaningful to them and in more detail. Next, in the ascending wave, students repack knowledge and link back to the abstract concept. Through peer–peer teaching and listening, students learn considerably more compared to the didactic formal lecturing (Mouton Citation2019).

It appears that the consolidation and integration of learning and knowledge were not affected by the pandemic (). For instance, 55% of participants during COVID 19 scored this activity 4 out of 5, with a mean of 4 ± 0.8 (SD) which was slightly higher than the score received for the pre-COVID 19 activity. This may have been because students were able to study and prepare materials at their own pace, confined in their home environment, with limited social contacts due to government-led lockdowns (Gonzalez et al. Citation2020).

Sense of community

Sixty-six percent of the student participants felt that the PBL tasks enabled them to build a cohort identity, with 23% and 11% answered ‘unsure’ and ‘no’, respectively. One participant said in free-text comments that it was ‘a way to get to know other people that are in my course’. Another stated: ‘it enabled me to talk to people I wouldn’t have normally spoken to’.

In addition to the immediate benefits to community, the PBL task resulted in long-term positive impacts. A year after completing the task, one student said: ‘we got to know each other a little better and even today I am in contact with some of them’. Another wrote: ‘Our group is still active, we share our concerns and struggles, although we never met one another’, indicating that through this virtual group activity students maintained a sense of community throughout their academic year.

There were 16 free-text comments indicating that the exercise encouraged the students to communicate with each other about the topic. The student responses suggested that communicating with peers had a positive influence on their understanding. One student said:

It was nice working with peers that I haven’t talked to before and getting to know them and knowing we could help each other out.

Collaboration is a vital skill for the sciences, particularly when working as team in a laboratory, where problem-solving often happens via collaboration and peer–peer learning.

Collaboration highlights the importance of using a comprehensive common language, which encourages students to recognise gaps in their knowledge. One student reflected:

Producing content to learn from forces individuals to write/produce work in a way that they understand, using terminology that they are familiar with and learning new terms.

In PBL, students identify gaps in knowledge by actively engaging with materials from multiple perspectives, enhancing a deep, and often more nuanced, understanding of the content (Millis Citation2014).

We assessed whether the student’s sense of community was impacted by COVID 19. Seventy-five percent of the student participants who took part before the pandemic felt that the tasks enabled them to build a cohort identity, with 19% and 6% answering ‘unsure’ and ‘no’, respectively. This was slightly affected during the pandemic with 59% felt that they were able to build a sense of community, with 26% and 15% answered ‘not sure’ and ‘no’, respectively. In our effect size analysis, we found that building a sense of community was slightly affected (d = 0.302) (). This seemed unavoidable as for many students, physical presence is a significant factor that contributes to creating a cohort identity (Drouin and Rae Vartanian Citation2010). Although community was slightly affected, knowledge consolidation and integration were not impacted by the move online during the pandemic ().

Table 2. A comparative effect size for three parameters between ‘during’ and ‘pre-COVID 19’.

We also investigated whether a sense of community had any association with how students scored on knowledge integration and consolidation of knowledge. Results indicated that collaborative and peer-to-peer learning can deepen learning (Han et al. Citation2021), as demonstrated by the Kendall Tau correlation values that revealed a positive association between the parameters and were closer to 1 during pre-COVID 19 activity (). This indicates that working together as a team helps students integrate knowledge and consolidate learning both during COVID 19 and pre-COVID 19.

Table 3. Kendall Tau Correlations to investigate associations between ‘Sense of community’ and ‘knowledge integration’ and ‘Consolidation of knowledge’.

Transferable skills

The term transferable skills has been used to describe the skills that students practice that are relevant to their studies but are also relevant to other contexts (Barnes Citation2020). In this PBL task, the aim was for students to create a revision resource for one another. To do so, they not only needed to understand the topic but also needed to use a host of other skills, including communication, problem solving, time management and teamwork. It should be noted that the acquisition of these transferable skills was not objectively assessed but self-reported by the students via the survey, and therefore subject to misconception.

In pre-lockdown teaching, the practicing of transferable skills sometimes happened organically through peer communication after class or in social situations. During lockdown, this was less likely as students were often studying in isolation from their peers. The results indicate that PBL provided opportunities for students to practice transferable skills even during lockdown conditions.

The following sub-headings are transferable skills that students, via the questionnaire, recognised as being developed from the PBL task and as important graduate attributes.

Communication skills

The PBL task required the students to regularly meet with their group to communicate their ideas and concerns with regards to the project. In addition, amongst the group students presented their product upon its completion, and at various stages of creation. One student stated that communication was a key skill they had developed through the activity:

It helped me communicate my findings with others and the public in a clear and concise manner.

While some scholars have noted that students may not see the relevance of communication skills (Mello and Wattret Citation2021), the questionnaire provided evidence that the students were fully aware of the importance of this skill. Sixty-seven percent of respondents cited communication as an important skill to acquire for graduate employment, with one student stating:

Scientists need to be able to effectively communicate the results of any research conducted for future reference.

Throughout the questionnaire, there was significant acknowledgement that communication skills improved through the PBL task, with the majority of students citing it as the most important skill they got out of the exercise.

Problem solving and critical thinking

The students were presented with a problem that they needed to solve through critical thinking: how could they combine and condense what they had learnt into a revision resource and how would the information be selected and presented? Students had to work like active research professionals (Boyle and Trevitt Citation2006) to complete the task. One student stated:

As a scientist you need to be able to assess information from different sources.

In order to create digestible and engaging revision resources, students had to be creative in their approach to presenting scientific information, relying heavily on the visualisation of facts. The questionnaire suggested that students enjoyed this challenge as it helped them realise that ‘imagination and science are not antonymous’. As students ‘think outside the box’ and embrace the creative challenges that come with PBL, they develop an open mindset deemed essential for future scientists (Rossi et al. Citation2021).

Time management

Requiring students to work together on a project is time-consuming, making time management an important skill for PBL (Affandi and Sukyadi Citation2016). Many respondents to the questionnaire stated that the task required the ability to be organised. One student said:

[Time management and organisation] are really key skills I enriched through this project, which will help me succeed as a science graduate and will always have to manage my time well in order to meet deadlines and be organised in doing so.

Another commented:

The ability to meet deadlines is also essential as in an academic [or] work setting is vital [in order] to be organized and to present your work in the appropriate way and on time.

Several students reflected that PBL would benefit them in a STEM graduate job market, with one student stating:

As a science graduate … meeting deadlines can be important to achieve long-term targets in industry

There are several reasons why time management is challenging for some students, for example certain neurodiverse students and students with caring responsibilities. In an attempt to offset these challenges, the module tutor should help students break down the task into smaller steps and monitor progress (Soares and Vannest Citation2013). Student feedback reflected this need, as students recommended that going forward, the tutor should create ‘clear deadlines’, while another suggested that student progress should be ‘monitored individually’ in order to ensure that some students do not get left behind.

Teamwork and leadership

When students are required to produce something collaboratively in a PBL task, they must engage effectively with their group (Bing et al. Citation2020). By establishing healthy relationships with others, the student creates the conditions for knowledge sharing and growth. The task helped develop teamwork and communication skills. One student said:

Leadership, communication and teamwork are very important for a science graduate because there is a lot of collaborative work in science e.g., peer review. Nearly every job requires good communication so activities like this help us prep for the ‘real world’.

The task encouraged students to reflect upon the importance of teamwork, with one student commenting:

Science is most easily approached when many ideas come together, working together towards one goal, teamwork is therefore essential.

Another said:

Teamwork is vital because sharing ideas with your peers can help in any projects as combining different points of views for looking at a problem helps to achieve a better solution.

Although teamwork is important, it is not always easy to achieve. One potential reason is differences in status that could lead to domination by members with more authoritative behaviour (Brooks Citation1994). In creating this revision material, which was largely a self-directed and off-the-classroom task, it was challenging for a tutor to ensure that less-vocal students are able to participate as equally as dominating students. Although this was partially addressed in the beginning of the project, by informing the chair of each group to ensure equal participation and delegation, supervision was still necessary to ensure students’ interaction, greater exchange of ideas and thus learning (O’Donnell Citation2006). Since a tutor-led supervision was not possible, students who did not feel part of a team were able to switch groups or create their own groups. In addition to this flexibility, one student recommended that there should be a consequence for any group members who choose not to do any work, as it has a negative impact on those who are trying to work together.

One way to provide a consequence for this lack of engagement is to convert the activity into a summative assessment and introduce peer marking. Graded assessments provide students with the incentive to put more effort into completing their assignments. Additionally, peer marking has been shown to improve individual member’s contributions. Going forward, peer marking may introduce with holistic rubrics that identify ‘very good’ and ‘very weak’ contributions with adjustable calculations of an individual’s contribution to maximise the correlation between actual group scores and true levels of a student’s contribution (Chang, Brickman, and Tanner Citation2018).

Another potential difficulty with teamwork is that group members can experience a cognitive overload when facing unstructured tasks (Dreu, Carsten, and Weingart Citation2003). Thus, a leadership role is encouraged in facilitating team learning behaviour (Koeslag-Kreunen et al. Citation2018) which can influence peers, both individually and collectively, to understand and agree about task goal and required activities to accomplish shared objectives (Yukl Citation2010) p. 8). The questionnaire provided evidence that students recognised the importance of leadership. One student said:

having a leader of a group helps members stay organised, not slack on their work, and make sure everything is done on time.

A leadership role could also contribute to building social relationships and a sense of community, overcoming barriers such as feeling insecure in expressing opposing views and opinions (Wong, Tjosvold, and Jiafang Citation2010). Leadership is an important skill for students to practice, particularly within the sciences, which will often require collaborative work (Somech Citation2006).

Limitations of the study and potential solutions

The study had several limitations. As discussed in the section above, this activity was labelled as a formative assessment and therefore a handful of second-year students participating for the first time did not engage with it at the expected level. This is probably because students at level 5 were aware of the grades they want to achieve and so mainly focussed on summative assessments. One student said:

I think this is an incredibly useful tool, however, I think if it were graded work, it would mean students engage better.

Engagement barriers may have also been due to a lack of coordination and collaboration between students. For instance, one student said

We actually don’t contact as the way I expected. I always messaged and they usually just didn’t reply.

Self-directed group activities benefit from continuous engagement across modules (Kyungbin, Liu, and Johnson Citation2014; Isohätälä, Järvenoja, and Järvelä Citation2017). This was observed among some of those students who participated twice in the task. These students were more engaged the second time and understood the benefit of this activity in their learning better than students that only did it once, as reflected in students’ comments:

Having completed this task before the previous year, I understood what was expected of these resources e.g., getting in all the key points. Also, I managed to tailor it more so to my revision by including additional concepts from other parts of the module.

This resonates with a study by Strauß and Rummel (Citation2021), where early collaboration and interaction in group activities resulted in more even participation and greater satisfaction (Strauß and Rummel Citation2021)

Another limitation of the study was the inability to certify its positive impact on student grades due to the fact that the UK HE sector saw a general increase in grades of around 7% to 8% for students who completed their modules during lockdown, due to differences in assessment practices and the introduction of the ‘no detriment’ policy (Hale Citation2021). This sector-wide grade inflation made it impossible to directly compare outcomes for students before and after they undertook the task.

Conclusion

The authors of this paper were pleasantly surprised at the amount of positive feedback the task received from students. The research indicated that the task did everything it set out to do in terms of contributing the students’ learning: it helped students consolidate their knowledge from previous learning, build a sense of community and develop transferable skills. The authors postulate that the effectiveness of the task was on account of the fact that it did not contribute to the final grade and hence was not resisted by students who feel the pressure of extra assessments but was clearly aligned to the summative assessments and students could clearly see how doing it would benefit their final grade.

This study also supports research by Haque et al. (Citation2020), which indicated the effectiveness of project work was similar pre and post lockdown, suggesting that the success of a PBL task is not affected by whether it is done in-person or online, so long as there are clear tasks and the capability for students to meet synchronously online (Haque et al. Citation2020). We suggest the difficulties in organising group work under lockdown conditions was counterbalanced by the increase in perceived need for group work felt by students.

Examination grades were seen to increase from a 2:1 to a first degree in the years that the revision resource task was set. Although this activity was not the only factor that was changed in the module, there may be a positive correlation between assessment grades and student engagement in this formative activity. In order to be conclusive in this claim, further research is needed outside of lockdown conditions.

One potential contributor to the rise in grades could be that PBL encouraged students to integrate discipline knowledge that they had developed both during, and outside of, the module. The questionnaire results indicated that the task facilitated cumulative learning, while also teaching students to be selective when deciding what information was relevant for the revision resource and what could be omitted, requiring students to approach material critically behave like active research professionals (Boyle and Trevitt Citation2006).

The group work element was deeply valued by students for its development of transferable skills. The fact the task was not summatively assessed may have helped avoid group tensions because the assessment was perceived as relatively low-stakes (Chang, Brickman, and Tanner Citation2018). However, the lack of a summative grade had a negative impact on engagement for some second-year students, who were more focused on direct contributions towards their final grades. Going forward, the task may be changed from formative to summative in an attempt to boost student motivation.

Acknowledgments

This paper is dedicated to the memory of our dear friend Dr Stephen Hare for their contribution in the project-based learning task.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

The authors did not receive support from any organization for the submitted work.

References

  • Adams, A., and A. L. Cox. 2008. “Questionnaires, in-depth Interviews and Focus Groups.” In Research Methods for Human Computer Interaction, edited by P. Cairns and A. L. Cox, 17–34. Cambridge, UK: Cambridge University Press.
  • Affandi, A., and D. Sukyadi. 2016. “Project-Based Learning and Problem-Based Learning for EFL Students’ Writing Achievement at the Tertiary Level.” In Rangsit Journal of Educational Studies 3 (1): 23–40. doi: 10.14456/RJES.2016.2.
  • Alves, A. C., C. P. Leão, F. Moreira, and S. Teixeira. 2018. “Project-Based Learning and Its Effects on Freshmen Social Skills in an Engineering Program.” Human Capital and Competences in Project Management 10.
  • Barnes, R. L. 2020. “A Protein Purification Card Game Develops Subject Knowledge and Transferable Skills.” Journal of Biological Education 1–11. doi:10.1080/00219266.2020.1799844.
  • Bing, L., X. Jia, Y. Chi, X. Liu, and B. Jia. 2020. “Project-based Learning in a Collaborative Group Can Enhance Student Skill and Ability in the Biochemical Laboratory: A Case Study.” Journal of Biological Education 54 (4): 404–418. doi:10.1080/00219266.2019.1600570.
  • Boyle, P., and C. Trevitt. 2006. “Enhancing the Quality of Student Learning through the Use of Subject Learning Plans.” Higher Education Research & Development 16 (3): 293–308. doi:10.1080/0729436970160304.
  • Brooks, A. K. 1994. “Power and the Production of Knowledge: Collective Team Learning in Work Organizations.” Human Resource Development Quarterly 5 (3): 213–235. doi:10.1002/hrdq.3920050303.
  • Cain, K., and S. Cocco. 2013. ”Leadership Development through Project Based Learning.” Proceedings of the Canadian Engineering Education Association (CEEA), Montréal, Canada. doi: 10.24908/pceea.v0i0.4869.
  • Chang, Y., P. Brickman, and K. Tanner. 2018. “When Group Work Doesn’t Work: Insights from Students.” CBE—Life Sciences Education 17 (3). doi:10.1187/cbe.17-09-0199.
  • Chickering, A. W., and Z. F. Gamson. 1987. “Seven Principles for Good Practice in Undergraduate Education.” American Association for Higher Education Bulletin 3: 7.
  • Chien‐Yuan, S., and Y. Guo. 2021. “Factors Impacting University Students’ Online Learning Experiences during the COVID ‐19 Epidemic.” Journal of Computer Assisted Learning 37 (6): 1578–1590. doi:10.1111/jcal.12555.
  • Choi, B. C., and A. W. Pak. 2005. “A Catalog of Biases in Questionnaires.” Prev Chronic Dis 2 (1): A13.
  • Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. New York: Routledge. doi:10.4324/9780203771587.
  • Dreu, D., K. W. Carsten, and L. R. Weingart. 2003. “Task versus Relationship Conflict, Team Performance, and Team Member Satisfaction: A meta-analysis.” Journal of Applied Psychology 88 (4): 741–749. doi:10.1037/0021-9010.88.4.741.
  • Drouin, M., and L. Rae Vartanian. 2010. “Students’ Feelings of and Desire for Sense of Community in Face-to-Face and Online Courses.” Quarterly Review of Distance Education 11 (3): 147–159.
  • Eberlein, T., J. Kampmeier, V. Minderhout, R. S. Moog, T. Platt, P. Varma-Nelson, and H. B. White. 2008. “Pedagogies of Engagement in Science: A Comparison of PBL, POGIL, and PLTL*.” Biochem Mol Biol Educ 36 (4): 262–273. doi:10.1002/bmb.20204.
  • Elkhamisy, F. A. A., A. Hassan Zidan, and M. Fathelbab Fathelbab. 2022. “Using project-based Learning to Enhance Curricular Integration and Relevance of Basic Medical Sciences in pre-clerkship Years.” Alexandria Journal of Medicine 58 (1): 1–7. doi:10.1080/20905068.2021.2009652.
  • Gonzalez, T., M. A. de la Rubia, K. P. Hincz, M. Comas-Lopez, L. Subirats, S. Fort, and G. M. Sacha. 2020. “Influence of COVID-19 Confinement on Students’ Performance in Higher Education.” PLoS One 15 (10): e0239490. doi:10.1371/journal.pone.0239490.
  • Hale, C. 2021. ”Degree Classification, Grade Inflation and COVID: Lessons from 2019–20.” https://www.hepi.ac.uk/2021/04/16/degree-classification-grade-inflation-and-covid-lessons-from-2019-20/
  • Han, J., Y. Jiang, N. Mentzer, and T. Kelley. 2021. “The Role of Sense of Community and Motivation in the Collaborative Learning: An Examination of the first-year Design Course.” International Journal of Technology and Design Education. doi:10.1007/s10798-021-09658-6.
  • Hanson, D., and T. Wolfskill. 2000. “Process Workshops - A New Model for Instruction.” Journal of Chemical Education 77 (1): 120. doi:10.1021/ed077p120.
  • Haque, A., S. Mumtaz, O. Khattak, R. Mumtaz, and A. Ahmed. 2020. “Comparing the Preventive Behavior of Medical Students and Physicians in the Era of COVID −19: Novel Medical Problems Demand Novel Curricular Interventions.” Biochemistry and Molecular Biology Education 48 (5): 473–481. doi:10.1002/bmb.21406.
  • Hattie, J. A. C., and G. M. Donoghue. 2016. “Learning Strategies: A Synthesis and Conceptual Model.” Npj Science of Learning 1 (1). doi:10.1038/npjscilearn.2016.13.
  • Helle, L., P. Tynjälä, and E. Olkinuora. 2006. “Project-Based Learning in Post-Secondary Education: Theory, Practice and Rubber Sling Shots.” Higher Education 51 (2): 287–314. doi:10.1007/s10734-004-6386-5.
  • Isohätälä, J., H. Järvenoja, and S. Järvelä. 2017. “Socially Shared Regulation of Learning and Participation in Social Interaction in Collaborative Learning.” International Journal of Educational Research 81: 11–24. doi:10.1016/j.ijer.2016.10.006.
  • Johnson, D. W., and R. T. Johnson. 1999. “Making Cooperative Learning Work.” Theory Into Practice 38 (2): 67–73. doi:10.1080/00405849909543834.
  • Khan, A., O. Egbue, B. Palkie, and J. Madden. 2017. “Active Learning: Engaging Students To Maximize Learning In An Online Course: EJEL.” Electronic Journal of E-Learning 15 (2): 107–115.
  • Koeslag-Kreunen, M., P. Van den Bossche, M. Hoven, M. Van der Klink, and W. Gijselaers. 2018. “When Leadership Powers Team Learning: A Meta-Analysis.” Small Group Research 49 (4): 475–513. doi:10.1177/1046496418764824.
  • Kokotsaki, D., V. Menzies, and A. Wiggins. 2016. “Project-based Learning: A Review of the Literature.” Improving Schools 19 (3): 267–277. doi:10.1177/1365480216659733.
  • Kyungbin, K., Y.-H. Liu, and L. P. Johnson. 2014. “Group Regulation and social-emotional Interactions Observed in Computer Supported Collaborative Learning: Comparison between Good Vs. Poor Collaborators.” Computers & Education 78: 185–200. doi:10.1016/j.compedu.2014.06.004.
  • Lenhard, W., and A. Lenhard. 2016. “Computation of Effect Sizes.” Psychometrica.
  • Louis, D., L. S. McCarty, K. Miller, K. Callaghan, and G. Kestin. 2019. “Measuring Actual Learning versus Feeling of Learning in Response to Being Actively Engaged in the Classroom.” Proceedings of the National Academy of Sciences 116 (39): 19251–19257. doi:10.1073/pnas.1821936116.
  • Maton, K. 2009. “Cumulative and Segmented Learning: Exploring the Role of Curriculum Structures in Knowledge‐building.” British Journal of Sociology of Education 30 (1): 43–57. doi:10.1080/01425690802514342.
  • McLuckie, J., and K. J. Topping. 2004. “Transferable Skills for Online Peer Learning.” Assessment & Evaluation in Higher Education 29 (5): 563–584. doi:10.1080/02602930410001689144.
  • Mello, L. V., and G. Wattret. 2021. “Developing Transferable Skills through Embedding Reflection in the Science Curriculum.” Biophysical Reviews 13 (6): 897–903. doi:10.1007/s12551-021-00852-3.
  • Millis, B. J. 2014. “Using Cooperative Structures to Promote Deep Learning.” Journal on Excellence in College Teaching 25 (3&4): 139–148.
  • Mirzaei, F., F. A. Aliah Phang, and H. Kashefi. 2014. “Measuring Teachers Reflective Thinking Skills.” Procedia - Social and Behavioral Sciences 141: 640–647. doi:10.1016/j.sbspro.2014.05.112.
  • Mouton, M. 2019. “A Case for Project Based Learning to Enact Semantic Waves: Towards Cumulative Knowledge Building.” Journal of Biological Education 54 (4): 363–380. doi:10.1080/00219266.2019.1585379.
  • O’Donnell, A. M. 2006. “The Role of Peers and Group Learning.“ In Handbook of Educational Psychology, edited by P. A. Alexander & P. H. Winne, 781–802. Mahwah, NJ, US: Erlbaum.
  • Pegg, J., and D. Tall. 2010. “The Fundamental Cycle of Concept Construction Underlying Various Theoretical Frameworks.” In Theories of Mathematics Education: Seeking New Frontiers, edited by B. Sriraman and L. English, 173–192. Berlin, Heidelberg: Springer Berlin Heidelberg.
  • Poort, I., E. Jansen, and A. Hofman. 2020. “Does the Group Matter? Effects of Trust, Cultural Diversity, and Group Formation on Engagement in Group Work in Higher Education.” Higher Education Research & Development 41 (2): 511–526. doi:10.1080/07294360.2020.1839024.
  • Prochazka, J., M. Ovcari, and M. Durinik. 2020. “Sandwich Feedback: The Empirical Evidence of Its Effectiveness.” Learning and Motivation 71. doi:10.1016/j.lmot.2020.101649.
  • Robinson, F. E., B. Wuetherick, N. Wolanski, and S. Greenwood. 2007. “Building Core Animal Science Knowledge through Project-Based Study: Name that Tool.” NACTA Journal 51 (1): 33–36.
  • Rodríguez, J., A. Laverón-Simavilla, J. M. Del Cura, J. M. Ezquerro, V. Lapuerta, and M. Cordero-Gracia. 2015. “Project Based Learning Experiences in the Space Engineering Education at Technical University of Madrid.” Advances in Space Research 56 (7): 1319–1330. doi:10.1016/j.asr.2015.07.003.
  • Rossi, I. V., J. Dinorá Lima, B. Sabatke, M. Alice Ferreira Nunes, G. Evans Ramirez, and M. Ivan Ramirez. 2021. “Active Learning Tools Improve the Learning Outcomes, Scientific Attitude, and Critical Thinking in Higher Education: Experiences in an Online Course during theCOVID ‐19 Pandemic.” Biochemistry and Molecular Biology Education 49 (6): 888–903. doi:10.1002/bmb.21574.
  • Sanchez-Muñoz, R., M. Carrió, G. Rodríguez, N. Pérez, and E. Moyano. 2020. “A Hybrid Strategy to Develop real-life Competences Combining Flipped Classroom, Jigsaw Method and project-based Learning.” Journal of Biological Education 1–12. doi:10.1080/00219266.2020.1858928.
  • Sfard, A. 2016. “On Two Metaphors for Learning and the Dangers of Choosing Just One.” Educational Researcher 27 (2): 4–13. doi:10.3102/0013189x027002004.
  • Sheng-Yi, W., H.-T. Hou, W.-Y. Hwang, and E. Zhi-Feng Liu. 2013. “Analysis of Learning Behavior in Problem-Solving-Based and Project-Based Discussion Activities within the Seamless Online Learning Integrated Discussion (SOLID) System.” Journal of Educational Computing Research 49 (1): 61–82. doi:10.2190/EC.49.1.c.
  • Slough, S. W., and J. O. Milam. 2013. “Theoretical Framework for the Design of STEM Project-Based Learning.” In STEM Project-Based Learning: An Integrated Science, Technology, Engineering, and Mathematics (STEM) Approach, edited by R. M. Capraro, M. M. Capraro, and J. R. Morgan, 15–27. Rotterdam: SensePublishers.
  • Soares, D. A., and K. J. Vannest. 2013. “STEM Project-Based Learning and Teaching for Exceptional Learners.” In STEM Project-Based Learning: An Integrated Science, Technology, Engineering, and Mathematics (STEM) Approach, edited by R. M. Capraro, M. M. Capraro, and J. R. Morgan, 85–98. Rotterdam: SensePublishers.
  • Somech, A. 2006. “The Effects of Leadership Style and Team Process on Performance and Innovation in Functionally Heterogeneous Teams.” Journal of Management 32 (1): 132–157. doi:10.1177/0149206305277799.
  • Somekh, B. 1995. “The Contribution of Action Research to Development in Social Endeavours: A Position Paper on Action Research Methodology.” British Educational Research Journal 21 (3): 339–355. doi:10.1080/0141192950210307.
  • Stamatis, C. A., H. C. Broos, S. E. Hudiburgh, S. K. Dale, and K. R. Timpano. 2021. “A Longitudinal Investigation of COVID‐19 Pandemic Experiences and Mental Health among University Students.” British Journal of Clinical Psychology 61 (2): 385–404. doi:10.1111/bjc.12351.
  • STEMnet. 2016. “Top 10 Employability Skills.”
  • Strauß, S., and N. Rummel. 2021. “Promoting Regulation of Equal Participation in Online Collaboration by Combining a Group Awareness Tool and Adaptive Prompts. But Does It Even Matter?” International Journal of Computer-Supported Collaborative Learning 16 (1): 67–104. doi:10.1007/s11412-021-09340-y.
  • Topping, K. J. 2005. “Trends in Peer Learning.” Educational Psychology 25 (6): 631–645. doi:10.1080/01443410500345172.
  • Vogler, J. S., P. Thompson, D. W. Davis, B. E. Mayfield, P. M. Finley, and D. Yasseri. 2017. “The Hard Work of Soft Skills: Augmenting the project-based Learning Experience with Interdisciplinary Teamwork.” Instructional Science 46 (3): 457–488. doi:10.1007/s11251-017-9438-9.
  • Wong, A., D. Tjosvold, and L. Jiafang. 2010. “Leadership Values and Learning in China: The Mediating Role of Psychological Safety.” Asia Pacific Journal of Human Resources 48 (1): 86–107. doi:10.1177/1038411109355374.
  • Wurdinger, S., J. Haar, R. Hugg, and J. Bezon. 2007. “A Qualitative Study Using project-based Learning in A Mainstream Middle School.” Improving Schools 10 (2): 150–161. doi:10.1177/1365480207078048.
  • Wurdinger, S., and M. Qureshi. 2014. “Enhancing College Students’ Life Skills through Project Based Learning.” Innovative Higher Education 40 (3): 279–286. doi:10.1007/s10755-014-9314-3.
  • Yukl, G. 2010. Leadership in Organizations. 7th ed. Upper Saddle River, NJ: Pearson.