7,685
Views
9
CrossRef citations to date
0
Altmetric
Research-in-Practice

Challenges of Recruitment and Retention of University Students as Research Participants: Lessons Learned from a Pilot Study

ABSTRACT

Recruitment of participants into research studies is a great challenge, in particular among higher education students who frequently receive invitations to participate in research projects led by faculty members or fellow students. Researchers need to be mindful of students’ motivations and take into account the contributing factors in recruiting students before formulating a recruitment strategy. The primary focus of this paper is to explore the factors which can have an influence on students’ decision to participate in research studies as well as effective strategies for facilitating and improving student recruitment. Moreover, the author provides reflection upon a recruitment process of a pilot study discussing the challenges and barriers she encountered during data collection. The main contribution of this paper is to increase awareness and understanding of the multiple facets of students’ recruitment, challenges to recruitment efforts and the solutions developed to address them among researchers who might experience similar problems. It is in particular noteworthy as research papers would rarely provide information on the outcome of recruitment experience and reasons behind the low-response rate and failure in participants’ retention.

Introduction

Recruitment of participants into research studies is widely considered to be the most challenging and critical aspect of a study. Recruitment is defined as the process of identifying potential participants, providing them with information about the research, obtaining consent and allocating them to the study (Berger, Begun, & Otto‐Salaj, Citation2009; Patel, Doku, & Tennakoon, Citation2003). Retention of participants is recognised as an important aspect of recruitment and it refers to developing and maintaining the relationship with participants to encourage and persuade them to be committed and continue their participation (Patel et al., Citation2003) which is vitally important for longitudinal studies. Recruitment challenges matter most to inexperienced researchers who usually tend to overestimate the number of potentially avid, easily accessible and perfectly suitable volunteers to participate in their research (Gul & Ali, Citation2010). In addition, recruitment efforts have not been well documented and commonly discussed in the literature as Archibald and Munce (Citation2015) claim that recruitment failures and innovative strategies to overcome the barriers have received less attention in research articles as well as research methodology textbooks. Gul and Ali (Citation2010) also assert that research studies usually provide details about the number of volunteers who participate and those who refuse; however, they fail to give clear and detailed explanation for inadequate number of participants. So, the researchers cannot learn from previous research and most importantly novice investigators underestimate the time and resources required for successful recruitment (Cyr, Childs, & Elgie, Citation2013; Joseph, Keller, & Ainsworth, Citation2016).

It is extremely important to remember that failure in recruitment can pose serious threats to feasibility, validity and quality of a research study (Brown, Long, Gould, Weitz, & Milliken, Citation2000; Gul & Ali, Citation2010; Massie, Smith, & Tolfrey, Citation2015; Patel et al., Citation2003) and it can lead to an ‘under-powered study’ (Treweek et al., Citation2010, p. 2). Therefore, the common challenges of recruitment and related strategies should be identified during the planning phase of the study as unsuccessful recruitment and poor retention of participants would increase the project costs (Patel et al., Citation2003). In this regard, recruiting university students as research subjects has been very common and widespread among researchers as they are the most convenient target population specifically due to their potential benefits such as adequate sample sizes and diversity (Aycock & Currie, Citation2013). However, it should not be assumed an easy task as there are occasions when students are not motivated and interested in the topic of the study, when they drop out before study completion and when those who participate do not sufficiently represent the population (Cyr et al., Citation2013).

Singer and Bossarte (Citation2006) suggest three main motives behind students’ willingness to participate in research studies. They contend that it can be entirely altruistic as some people believe in helping others without expecting any advantages. They also mention the project-related reasons such as interest in the topic or the researcher as well as the self-centred reasons such as incentives. For instance, male participants are more likely to participate in research for monetary incentives; while, women want to be helpful (Gerstein, Wilkeson, & Anderson, Citation2004; Goldenberg, Owens Jr, & Pickar, 2007). On the other hand, Zhang (Citation1996) describes in his paper that students are usually hesitant to participate in research studies due to lack of interest/knowledge in the topic, school work, family commitments and their major concern is additional time requirement. Thus, there is still a need for researchers to consider students’ motivations and take into account the factors which can have an impact on their decision to participate in research studies and develop effective strategies to improve and facilitate students’ recruitment.

This paper aims to highlight the importance of recruitment and retention of research participants, particularly in academic environment. It will also discuss the influential factors and the most commons recruitment strategies.

Theoretical Approaches

What makes university students to take part in research studies? If we can gain a better understanding of the answer to this question, we might be able to formulate and employ innovative recruitment strategies. There has been some effort to develop theories and provide explanations of why some people participate in research while others do not with two dominant approaches in the literature.

Porter and Umbach (Citation2006) refer to social exchange theory developed by Blau (Citation1964) explaining that people make decision and choose to do something by using a subjective cost–benefit analysis and the comparison of the alternatives. As such, students will consider the advantages of participating in research projects and they should reach to this conclusion that benefits outweigh the costs. This means that students must have sufficient information about the research topic to assess the relative merits of participating in a study and adequate time to decide (Aycock & Currie, Citation2013). This theory is in particular of use to understand how certain aspects of research design and administration can have an impact on response rate.

The self-determination theory (Deci & Ryan, Citation1985) which is widely discussed in the field of motivation has also been mentioned in Cartmell’s (Citation2016) work as its theoretical framework to provide a better explanation of why higher education students decide to participate in research studies. Self-determination theory makes an important distinction between two different types of motivations and the consequences of them. These two forms are termed intrinsic and extrinsic motivation: ‘why versus what for’ (Leal, Miranda, & Carmo, Citation2013, p. 164). According to this theory, intrinsic motivation involves students participating in research when they find it interesting and feel spontaneous contentment in carrying it out. On the other hand, they will become externally motivated to take part in research studies when the satisfaction does not come from the activity itself but rather from the extrinsic consequences of participation such as tangible rewards (e.g. course credit).

These two approaches have been used to describe and explore different types of factors which can have influential impact on university students to take part in research studies with regard to costs and benefits of participation, intrinsic value or external coercion.

Factors Influencing Students’ Decisions to Participate in Research Studies

Promoting the Benefits of Participation

Researchers should not assume that participants are interested in their topic of research as much as they are. Students conduct a cost–benefit analysis when they are asked to participate in a research study; therefore, attention to details and information which inform their decisions can improve recruitment (Lindenberg, Solorzano, Vilaro, & Westbrook, Citation2001). In this regard, highlighting the potential benefits of research and how their contribution can improve education or enhance the students’ experience can be effective in generating their interest. For instance, research studies about students’ health improvement can potentially exert positive influence on students’ lifestyle (Aycock & Currie, Citation2013), so stressing that how students’ participation can play vital role in increasing awareness and management of risky behaviours among university students can be highly influential in attracting their interest to contribute and participate in the research.

Investigators can also emphasise the educational gain from research participation and stimulate students’ interest. Prescott (Citation2002) believes that research projects are not intrinsically designed to be advantageous for participants, but students may benefit by gaining valuable and first-hand experience and learning about research principals. Healey and Jenkins (Citation2009) also support this claim as they believe that students have this opportunity to learn more about the latest trends in the discipline and acquiring research skills. The findings of a qualitative study undertaken by Roberts and Allen (Citation2012) also confirmed the above statements as students assert that by participating in other’s research, their knowledge about the research process specifically conducting research in their own discipline has been enhanced. However, this is a controversial matter as the findings of some research studies demonstrate that students do not prefer research participation to classroom lectures as they cannot gain any extra advantage (Elliott, Rice, Trafimow, Madson, & Hipshur, Citation2010). This point of view is also fiercely criticised by Leentjens and Levenson (Citation2013) as they argue that if researchers can prove and validate the pedagogical value of taking part in research studies, it cannot be a justification for students’ requirement to participate in research.

In general, researchers who intend to recruit students should inform them of the potential benefits of participation even non-academic ones such as self-discovery and networking opportunities (Brewer & Robinson, Citation2017) to be able to make them interested in their topic of research.

Incentives

Researchers often provide incentives in appreciation of the participants’ time and effort as well as increasing students’ engagement (Aycock & Currie, Citation2013; Archibald & Munce, Citation2015; Yancey, Ortega, & Kumanyika, Citation2006). However, it cannot be a motivational factor for everyone to volunteer and there is no standard procedure advising when and how to compensate volunteers for their participation. Some methods have been mentioned in the literature but the most frequent and common ones in academia are monetary incentives and course credit (Aycock & Currie, Citation2013; Cyr et al., Citation2013; Leentjens & Levenson, Citation2013).

Monetary Incentives

Determining the amount of financial incentives to encourage participants’ cooperation and also preventing their attrition is difficult. It is noted in the literature that higher monetary incentives might have undue influence on students and can cause those ones who do not satisfy the study entry criteria, hide the information which excludes them from participation (Cyr et al., Citation2013). On the other hand, providing a modest amount of money as an incentive considering students’ other responsibilities including schoolwork, full-time or part-time job and family commitments is not satisfactory and students will not invest their time to participate in research. Hence, it is advised that the compensation ‘should be sufficiently high so as to encourage participation but not so high as to be coercive’ (Gross & Fogg, Citation2001, p. 532).

Although financial compensation can be attractive, it is worthwhile noting that poor attendance and dropping-off before study completion are the distinctive characteristics of those participants whose main reason to participate is money (Green et al., Citation2000). The findings of a study conducted by Kaba and Beran (Citation2014) demonstrate that the majority of students participated in their research due to the positive feedback shared by other students who had participated, their curiosity about the topic and wanting to be involved in the research. Gul and Ali (Citation2010) also maintain that financial incentives can be stimulating; however, participants’ active engagement can be determined by the perception of benefits and relevance of research to their life.

Course Credit

Providing a course credit incentive is another option for researches who recruit students. It might be of interest from departmental point of view as it does not add extra costs and can be easily incorporated into the teaching program (Leentjens & Levenson, Citation2013); however, it is not feasible for all studies specifically those conducted campus-wide (Coker, Huang, & Kashubeck‐West, Citation2009). Moreover, the majority of scholars are also of the opinion that offering extra credit is a controversial matter as providing equitable alternatives for those who choose not to participate is not a straightforward task (Bartholomay & Sifers, Citation2016). Research suggests that writing a short essay or book report can be comparable to participating in research; while, students believe that the alternatives are not interesting and quite likely to take more time and effort than taking part in research projects (Leentjens & Levenson, Citation2013). Aycock and Currie (Citation2013) assert that course credit will put students choosing not to participate in an unfavourable position as they might be influenced by concerns about repercussions of non-participation such as receiving lower grades or fewer learning opportunities. Besides, those opposing this incentive argue that grades should be a reflection of students’ learning, not an irrelevant activity that aims to advance researchers’ careers (Grant & Sugarman, Citation2004).

Overall, researchers need to give careful consideration to choosing the most effective incentive for their target population as different incentives may stimulate different subsets of population to take part in the study and causing participation bias (Hsieh & Kocielnik, Citation2016). Furthermore, students who are motivated solely by extrinsic incentives might not take part in a study with sincerity which can affect their responses and consequently lead to invalid research data (Aycock & Currie, Citation2013).

Researcher/Recruiter Characteristics and Interpersonal Skills

Researchers should possess certain and essential attributes to be able to convey positive impression on potential participants (Patel et al., Citation2003). They should be respectful, tolerant and tactful and also communicate the research details and expectations from participants in a positive, honest and clear manner (Massie et al., Citation2015). As such, they can establish and maintain a trustworthy relationship with prospective participants which can play a critical role in enhancing recruitment and reducing attrition (Archibald & Munce, Citation2015; Gul & Ali, Citation2010). Being reasonably well informed about the aim and process of a research project is of great importance as they should provide detailed information about the research, respond to participants’ inquiries and address their concerns (Gul & Ali, Citation2010). It is also noteworthy to mention that participants’ questions should be answered in a prompt and courteous manner. Quickly responding to participants’ questions proves clearly that researchers are thoughtful and considerate towards fulfilling participant’ needs and it could be a unique opportunity to make a positive impression on potential participants (Joseph et al., Citation2016). Several studies have also revealed that communicating the research in an enthusiastic way can have profound impact on prospective participants (e.g. Archibald & Munce, Citation2015; Massie et al., Citation2015; Patel et al., Citation2003). Kaba and Beran (Citation2014) claim that when students feel the researchers’ strong passion about their study, it makes them more interested in participation and they see value in their role. Researchers should also be diligent and tenacious during the recruitment process as the initial recruitment results might be disappointing. This issue mostly can have an impact on junior investigators who underestimate the workload of recruitment and their motivation and enthusiasm could easily fade by the challenges they might face.

Researchers need to be determined to conquer a sense of failure and frustration and be persistent by following up with the participants who did not respond initially and give them another opportunity to participate in the research (Kaba & Beran, Citation2014). However, investigators should act in a way not considered as pushy and overbearing (Yancu, Lee, Witherspoon, & McRae, Citation2012) which can have detrimental effect on students’ motivation.

Presentation of Content

Communicating the goals of the research in a clear and honest way is considered as another influential factor on encouraging students to participate in a study. Students should be fully aware of what the research expectations are to be able to make informed decision. It is imperative to be clear from the start about the research potential benefits, level of commitment, time estimates, incentives as well as ethical matters to generate interest and build trust in prospective participants. If the research details and expectations from participants are communicated poorly, it might lead to reduced retention and dropping out of the study before its completion. This matter is identified as a frequent complaint of students from researches who do not explain the research process clearly (Cyr et al., Citation2013).

Researchers should also avoid using unnecessary and scientific language as their choice of words and phrases play a significant role in attracting students’ interest or raising fear. For instance, the finding of a study conducted by Massie et al. (Citation2015) demonstrates that students’ interpretation of using the words exercise and sport are widely varied as some see these two words the same, some prefer the word sport as their assumption about exercise was working hard and some believe that the word sport reminds them of competition which seems stressful. Archibald and Munce (Citation2015) also put an emphasis on choosing the right words and attention to terminology when describing the research projects and contend that using specialised and technical counterparts of words can result in hesitation among students to participate.

Logistical Factors

It is mentioned in the literature that investigators should give serious consideration to participants’ other commitments to encourage their participation. Conflicting schedules, lack of time and transport are identified frequently as participation obstacles which can cause inconvenience for students and might hinder their participation (Gul & Ali, Citation2010; Kaba & Beran, Citation2014; Massie et al., Citation2015). These problems specifically matter to researchers conducting qualitative research who need to schedule different interview sessions. Students from different faculties usually study on different campuses and it would be more convenient for them to attend interview sessions on their own campus to avoid wasting time and also money on transport. Thus, researchers should be able to organise research sessions at places in close proximity of where students study and have flexible hours for participation to enhance recruitment and prevent drop-off (Fook et al., Citation2013). Timing of contact with potential participants is another critical factor and it is vital for researchers to consider the students’ workload and do not start recruitment efforts during peak academic times. Students might be interested in taking part in research; however, if they receive the request at bad timing considering their busy life, they will decline the invitation (Cyr et al., Citation2013).

Researchers must carefully assess recruitment strategies before commencing the study, identify the logistical barriers and discuss the effective solutions to reduce them. They should be mindful of contacting students at a good time, avoiding the exam period while they are busy with their schoolwork as well as considering their schedules and place of running research sessions to increase their willingness to participate.

Recruitment Strategies

As previously stated, recruitment and retention of participants is a challenging aspect of conducting research; therefore, acquiring knowledge about the most common strategies and analysing others’ successes and failures in recruiting a similar sample is of vital importance to learn effective strategies and avoid ineffective ones. In regard to student recruitment, scholars are of the idea that researchers need to use a combination of active and passive forms of recruitment to effectively enhance the student participation. Passive recruitment can broadly be defined as a process which investigators promote awareness in the target population about a research project relying on participants to approach them; while, active recruitment strategies encompass identifying specific individuals or groups and recruiting from them (Lee et al., Citation1997).

Hanging posters, distributing flyers, sending targeted or mass email, as well as making an announcement using online course management systems are some of the most frequently passive strategies cited in the literature which used to increase study awareness simultaneously across various faculties (Cyr et al., Citation2013; Kaba & Beran, Citation2014; Roschelle et al., Citation2014). However, Goldenberg, Owens, and Pickar (Citation2007) are convinced that direct approach is highly effective in engaging students’ attention as they used collective number of strategies to recruit students but class presentation and setting up information kiosks yielded better results comparing to indirect methods. Other researchers also support this claim (Gul & Ali, Citation2010; Yancu et al., Citation2012) and maintain that it would be easier for students to consent and approve to participate in research while they are amongst their friends and there is an increased likelihood of encouraging and inviting other students to take part in the study (Ivaz et al., Citation2006).

In spite of the advantages of active method, some researchers have strong reservation about it and emphasise the ethical implications of applying this method. Leentjens and Levenson (Citation2013) highlight the privacy issue and assert that this method violates the students’ privacy as their decision about taking part in research would reveal to their friends, other fellow students and even their lecturer. They also argue that group recruitment increases peer pressure and students might consent to participate due to their friends’ encouragement. Teacher’s authority is recognised as another complication of active recruitment. The results of a study conducted by Bartholomay and Sifers (Citation2016) which investigates students’ perception of pressure in research done by faculty indicate that students felt intense pressure when they are asked to participate in a study by their own instructor and they feel obliged to participate due to perception of repercussions for non-participation. Hence, research suggests faculty members to avoid direct contact and use of students whom they teach to limit the perception of coercion among students (Aycock & Currie, Citation2013; Miller & Kreiner, Citation2008).

Retention Strategies

Along with exploring the most effective strategies to enhance recruitment efforts, an investigation into identifying retention strategies has also been increased over recent years (Robinson et al., Citation2015). Researchers believe that high study demands may result in higher rates of attrition. The amount of contact between the researcher and participants, the extra and inconvenient procedures and long study duration are amongst the most cited factors which play a role in poor retention (Cyr et al., Citation2013; Zweben, Fucito, & O’Malley, Citation2009). In this regard, scholars are of the opinion that careful selection is an important element which investigators should take it into serious consideration. Hadidi, Lindquist, Treat-Jacobson, and Swanson (Citation2013) contend that researchers usually recruit participants who expressed their interest and meet the research criteria in a very short time due to recruitment challenges; while, assessing the general interest and motivation of volunteers are of great significance. There are several factors such as personal issues, work requirements, study pressures and logistical obstacles which might have an impact on participants’ commitment; hence, it is important not only to explain the research process and expectations to participants but also to assess whether the volunteers are good candidates for the study.

Exploring the literature also shows that researchers should place considerable emphasis on staying in contact with participants and sending regular reminders (Foss, Druin, & Guha, Citation2013; Gul & Ali, Citation2010). The significant role of sending out email reminders using names of participants in email subject lines has been highlighted as it can be a way to ensure that an email is going to be read and response rates are likely to be improved. Sending update emails and providing participants with their personal results at different stages of research can also be influential in marinating their interest in the study as it will help to build a trustworthy relationship between the research team and participants.

In summary, we can reach to this conclusion that to help keep participants engaged throughout the study’s period, building, developing and maintaining a strong relationship plays a significant role. It can be achieved by clarifying the participation requirements, assessing and understanding their main motivation of volunteering before signing the consent form and staying in contact.

Lessons Learned from a Pilot Study

Pilot study plays an important role in helping researchers identifying the difficulties and problems regarding their research design, research instruments and also recruitment and retention of participants. The findings of a pilot study can provide a valid assumption about response rate and the likely success of proposed recruitment strategies. Pilot studies can be very informative, not only to the researchers conducting them in terms of helping to guide planning the main study but also to others who undertake similar work. Researchers believe that every attempt should be taken to publish the results of pilot studies specifically when the focus is on feasibility goals not statistical significance as these studies typically do not show statistically significant results. Hence, providing such information can help research community to save resources for performing studies which may not be feasible and most importantly avoid duplication of efforts (Thabane et al., Citation2010).

In this section, the author provides reflection on recruitment efforts of a pilot study undertaken as part of a PhD research project to explore the impact of cohesion on university students’ collaborative information behaviour over the duration of group tasks and discusses the major obstacles she faced during the process.

Overview of Research Project

The main aim of the research is to explore and gain a comprehensive understanding of the role that group cohesion can play in the way students seek, find, evaluate and use information collaboratively to accomplish a group task. In this regard, mixed research methodology combining both quantitative and qualitative methods of data collection was proposed to conduct this study. Hence, research participation involved filling out pre-survey and post-survey, completing a digital diary at three points during the group assignment as well as being interviewed at the end of the assignment. The surveys and digital diaries would take about 15–20 min and 10–15 min to complete, respectively.

Pre-survey and post-survey were employed in order to measure cohesion as a group construct as well as students’ information behaviour in the group context. The first questionnaire includes items measuring cohesion from a multidimensional perspective encompassing task cohesion, interpersonal cohesion and perceived cohesion within groups. The second questionnaire encompasses questions probing students’ information behaviour activities which include sensemaking and identifying information need, seeking information and using information during the course of their group assignment to find out to some extent these activities have been performed individually or collaboratively. It should be noted that evaluating cohesion at multiple points across a team’s lifespan matters for group cohesion; thus, the same items measuring different aspects of cohesion were included in post-survey as well to perceive the changes in this group construct. The semi-structured digital diary was also employed to be completed at three points over the duration of group task by each participant to reflect changes of their behaviour over time. Open-ended questions and partially open-ended questions were included to probe for further information regarding their experience of seeking, evaluating and using information in a group and their interaction with other group members. It would record the participants’ activities, individual views and information behaviour practices in a collaborative environment.

The data collection would end by conducting semi-structured interviews with the aim of seeking elaboration, enhancement and clarification of the results of two previous data collection instruments. Thus, the interview questions would be largely driven by data obtained from surveys and diaries.

Recruitment Procedure

The researcher made a decision to implement an active recruitment strategy due to its benefits and higher rate of participation. Having analysed publicly available information contained in the university handbook, the researcher identified four teaching units as having a component of group work assessment (more than 20% of final grade). The units also had a high rate of enrolment which could provide bigger population of students. The researcher obtained permission from course coordinators to present information about the study and distribute informed consent forms in classrooms. The recruitment process started during the third week of semester when students had just started forming their groups and working on their group assignment.

The researcher developed a script that highlighted the value of student participation and the potential benefits of this study as well as details about the research process and expectations from participants. The researcher made five classroom visits with approximately 40 students presented at each class during seven days and gave presentation for about five to eight minutes depending on students’ questions. She clarified the research aims and how the results could benefit the student community and future students if not themselves directly. Confidentiality and participants’ rights were also emphasised and the presentation ended with information about the incentives in appreciation of students’ time and effort for their contribution.

The researcher offered students a monetary incentive (entering into a draw for four $50 gift vouchers); she also emphasised the educational gain from participating in this research by offering students a summary of the data they would provide as their personal reflection on their contributions to the group assignment so as to increase their willingness to participate. After presentation, the researcher distributed the information letter and consent forms and informed students that she would collect them after the lecture.

Recruitment and Retention Challenges

The use of an active recruitment strategy resulted in 52 participants from roughly 200 students which was a successful outcome for a pilot study. However, the serious problem arose when students dropped out before study completion, just 17% of participants (9 participants form 52 students who were recruited) completed all the phases of project; while, it was assumed that at least half of participants would remain till the end of study. The researcher diligently followed up with participants and sent them regular reminders (no more than three times) to encourage them keep up commitment which was not successful. In this regard, retention of participants was a major issue due to high non-response rate and students’ withdrawal before finishing the study. As mentioned earlier, retention is considered as an important aspect of recruitment; therefore, the researcher revised the recruitment process so as to find the most likely explanations which hindered her efforts.

Using an active recruitment strategy without considering its associated issues could be one reason of high non-response rate. As discussed earlier, the pressure from peers might be higher in group recruitment; so some students might feel obliged to sign the consent form because of their friends’ encouragement and other fellow students. The lecturers of those teaching units also supported the research and encouraged students to participate. That could be another explanation which also mentioned by Leentjens and Levenson (Citation2013) that students usually consent to participate in these circumstances in order not to disappoint their ‘liked professor’ (p. 396). We can conclude that ethical implications of active recruitment strategies emphasised by scholars can cause students to agree to participate under feeling of coercion which consequently leads to their withdrawal. Hence, investigators need to be acquainted with ethical implications of active recruitment strategies and do not rely on only one strategy. Using a combination of active and passive recruitment methods can play significant role in enhancing recruitment and retention.

Providing improper incentive considering the study design could be another contributing factor in high non-response rate. Completing online surveys and digital diaries were assumed quite simple and straightforward considering the use of user-friendly platforms (e.g. Qualtrics); however, the monetary incentives of four $50 gift voucher prizes were too modest for students to give their time to take part in this multi-stage research. Reviewing the literature also demonstrates that researchers should ‘start big’ for longitudinal studies and they need to recruit as many initial participants as resources allow due to the probability of high attrition in these studies (Foss et al., Citation2013). In this research, the investigator stopped recruiting when the number of participants reached about 50 without considering the possibility of poor retention.

As stated previously, students should have enough time after providing with detailed information about the research to be able to analyse the potential benefits of the study and arrive at a decision whether they wish to participate. In this regard, Comer (Citation2009) suggests that students should be allowed at least one day as it can be highly beneficial for decreasing perceived coercion. They need to be strongly motivated to participate in a study that continues over a period of time. The researcher asked students to return consent forms after the class, which might exert intense pressure on them and led them into making a snap and hasty decision to partake in research.

Difficulties and discomforts come with research design and data collection methods can also have an impact on participant recruitment and retention (Gul & Ali, Citation2010) specifically among students who are recognised as over-surveyed population (Van Mol, Citation2017). Cyr et al. (Citation2013) believe that time commitment is a deciding factor for students to participate or withdraw from a study. They state that ‘less is more: as level of commitment increases, so does attrition’ (p. 12). Patel et al. (Citation2003) also mention that the number of research instruments should be reduced to lighten the extra participant burden. In the current study, students were asked to complete two surveys and three digital diaries while they were working on their group assignment as well as attending an interview session. Given the demands of research and the amount of time that participants should have remained committed, poor retention could be predictable.

New Research Design and Recruitment Strategy

With regard to the study’s low-response rate, the researcher decided to amend the recruitment strategy as well as research design. Analysing the data collected from nine participants who completed all the stages of study resulted in lack of enough meaningful data. The participants’ responses to open-ended questions within the digital diaries which were designed to encourage students to elaborate on their collaborative behaviour while working on their group assignments did not provide rich data to enhance the researcher’s understanding of their information behaviour in group settings. This issue also confirmed the need to make a revision to research design. Thus, the researcher with the assistance of a supervisory team took a new approach for collecting data. Accordingly, focus group research has been employed as it is particularly suited for obtaining several perspectives about the same topic and gaining deeper insights (Gibbs, Citation1997). Focus groups provide an opportunity for the researchers to engage with participants and probe when responses need more explanation (Barbour, Citation2008). In addition, social interaction between participants provides the insight and data that cannot be obtained via other methods as it enables participants to ask questions of each other, and re-evaluate their own understandings of their specific experiences (Gibbs, Citation1997). Students who were about to complete and submit their group assignments or have done so in the last 12 months were eligible to take part in focus group sessions and the guided questions are based upon previously designed instruments. However, there would be some follow-up questions to obtain additional detail and to further explore the insights, experiences and rich description.

The investigator also used a new recruitment strategy. Despite presenting research to some specific classes across faculties, the invitation to participate in research was published on university website (Student Intranet – News) to increase awareness among target population. In addition to brief and vivid description of research, a short video was also prepared and uploaded which provided more details about the study. The usefulness of developing a short video about the research procedure is mentioned in prior work and scholars assert that it can have a positive role in attracting participants’ interest (Roschelle et al., Citation2014; Yancu et al., Citation2012). The incentive scheme was also amended and participants were compensated individually ($40 gift voucher for each participant) in appreciation of their time and their contribution to research.

Making the above amendments to recruitment strategy and research design yielded much better results. Of 35 students who contacted the researcher and expressed their interest in participation, 23 took part in research and attended focus group sessions. Participants were accepted in the order of receiving emails from students; however, their eligibility to take part in research was confirmed before sending an invitation to attend a focus group session. Moving to a focus group approach (reduced set of instruments) and using wider recruitment medium lead to collecting more meaningful and rich data through very active participation.

Conclusion

Recruiting students to participate in research is not simple. Students analyse the costs and benefits of participation and if their participation was not truly voluntary they would easily withdraw from research. Researchers need to be mindful that how their research design and activities expected from students can have an impact on the response rate. Research suggests that investigators should highlight the intrinsic motivations and non-monetary extrinsic ones to participants; however, it heavily depends on the sample and study design. Hence, researchers should review all the relevant literature, be acquainted with others’ successes and failures and consider all the critical factors which could enhance student recruitment to be able to formulate the best possible recruitment strategy.

Acknowledgments

The author would like to thank Associate Professor Justin Brown for his inspiration and helpful comments. She is also grateful to the anonymous reviewers for their useful suggestions.

Disclosure statement

No potential conflict of interest was reported by the author.

Additional information

Notes on contributors

Parisa Khatamian Far

Parisa Khatamian Far is a PhD candidate in Library and Information Science at Edith Cowan University. She previously worked as a research librarian for about nine years providing research services to higher education students. Parisa’s research interest is exploring students’ information behaviour in the context of group work and identifying the factors which drive them to engage in collaborative information behaviour activities.

References

  • Archibald, M. M., & Munce, S. E. P. (2015). Challenges and strategies in the recruitment of participants for qualitative research. University of Alberta Health Sciences Journal, 11(1), 34–37.
  • Aycock, D. M., & Currie, E. R. (2013). Minimizing risks for nursing students recruited for health and educational research. Nurse Educator, 38(2), 56–60.
  • Barbour, R. (2008). Doing focus groups. Thousands Oaks, CA: Sage.
  • Bartholomay, E. M., & Sifers, S. K. (2016). Student perception of pressure in faculty-led research. Learning and Individual Differences, 50, 302–307.
  • Berger, L. K., Begun, A. L., & Otto‐Salaj, L. L. (2009). Participant recruitment in intervention research: Scientific integrity and cost-effective strategies. International Journal of Social Research Methodology, 12(1), 79–92.
  • Blau, P. (1964). Exchange and power in social life. New York: Wiley.
  • Brewer, G., & Robinson, S. (2017). ‘I like being a lab rat’: Student experiences of research participation. Journal of Further and Higher Education, 1–12.
  • Brown, B. A., Long, H. L., Gould, H., Weitz, T., & Milliken, N. (2000). A conceptual model for the recruitment of diverse women into research studies. Journal of Women’s Health & Gender-Based Medicine, 9(6), 625–632.
  • Cartmell, A. (2016). Students as research participants: A study of their experiences (Doctoral dissertation). Capella University, Minnesota. Retrieved from Proquest Dissertation and Theses Database
  • Coker, A. D., Huang, H. H., & Kashubeck‐West, S. (2009). Research with African Americans: Lessons learned about recruiting African American women. Journal of Multicultural Counseling and Development, 37(3), 153–165.
  • Comer, S. K. (2009). The ethics of conducting educational research on your own students. Journal of Nursing Law, 13(4), 100–105.
  • Cyr, D., Childs, R., & Elgie, S. (2013). Recruiting students for research in postsecondary education: A guide. Toronto: Higher Education Quality Council of Ontario.
  • Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behaviour. New York: Plenum Press.
  • Elliott, L. J., Rice, S., Trafimow, D., Madson, L., & Hipshur, M. F. (2010). Research participation versus classroom lecture: A comparison of student learning. Teaching of Psychology, 37(2), 129–131.
  • Fook, J., d’Avray, L., Norrie, C., Psoinos, M., Lamb, B., & Ross, F. (2013). Taking the long view: Exploring the development of interprofessional education. Journal of Interprofessional Care, 27(4), 286–291.
  • Foss, E., Druin, A., & Guha, M. L. (2013). Recruiting and retaining young participants: Strategies from five years of field research. Paper presented at the Proceedings of the 12th International Conference on Interaction Design and Children.
  • Gerstein, L. H., Wilkeson, D. A., & Anderson, H. (2004). Differences in motivations of paid versus nonpaid volunteers. Psychological Reports, 94(1), 163–175.
  • Gibbs, A. (1997). Focus groups. Social research update (19). Retrieved from http://sru.soc.surrey.ac.uk/SRU19.html
  • Goldenberg, L. R., Owens, E. F., Jr, & Pickar, J. G. (2007). Recruitment of research volunteers: Methods, interest, and incentives. Journal of Chiropractic Education, 21(1), 28–31.
  • Grant, R. W., & Sugarman, J. (2004). Ethics in human subjects research: Do incentives matter? Journal of Medicine and Philosophy, 29(6), 717–738.
  • Green, B. L., Partridge, E. E., Fouad, M. N., Kohler, C., Crayton, E. F., & Alexander, L. (2000). African-American attitudes regarding cancer clinical trials and research studies: Results from focus group methodology. Ethnicity & Disease, 10(1), 76–86.
  • Gross, D., & Fogg, L. (2001). Clinical trials in the 21st century: The case for participant-centered research. Research in Nursing & Health, 24(6), 530–539.
  • Gul, R. B., & Ali, P. A. (2010). Clinical trials: The challenge of recruitment and retention of participants. Journal of Clinical Nursing, 19(1–2), 227–233.
  • Hadidi, N., Lindquist, R., Treat-Jacobson, D., & Swanson, P. (2013). Participant withdrawal: Challenges and practical solutions for recruitment and retention in clinical trials. Creative Nursing, 19(1), 37–41.
  • Healey, M., & Jenkins, A. (2009). Developing undergraduate research and inquiry. York: Higher Education Academy.
  • Hsieh, G., & Kocielnik, R. (2016). You get who you pay for: The impact of incentives on participation bias. Paper presented at the Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing.
  • Ivaz, S., Brennan, S., Dean, S., Hay, S., Hay, P., Kerry, S., & Oakeshott, P. (2006). Lessons learned from recruiting young female students to a randomised controlled trial of chlamydia screening. Family Practice, 23(2), 188–191.
  • Joseph, R. P., Keller, C., & Ainsworth, B. E. (2016). Recruiting participants into pilot trials: Techniques for researchers with shoestring budgets. Californian Journal of Health Promotion, 14(2), 81.
  • Kaba, A., & Beran, T. (2014). Twelve tips to guide effective participant recruitment for interprofessional education research. Medical Teacher, 36(7), 578–584.
  • Leal, E. A., Miranda, G. J., & Carmo, C. R. S. (2013). Self-determination theory: An analysis of student motivation in an accounting degree program. Revista Contabilidade & Finanças, 24(62), 162–173.
  • Lee, R. E., McGinnis, K. A., Sallis, J. F., Castro, C. M., Chen, A. H., & Hickmann, S. A. (1997). Active vs. passive methods of recruiting ethnic minority women to a health promotion program. Annals of Behavioral Medicine, 19(4), 378–384.
  • Leentjens, A. F., & Levenson, J. L. (2013). Ethical issues concerning the recruitment of university students as research subjects. Journal of Psychosomatic Research, 75(4), 394–398.
  • Lindenberg, C. S., Solorzano, R. M., Vilaro, F. M., & Westbrook, L. O. (2001). Challenges and strategies for conducting intervention research with culturally diverse populations. Journal of Transcultural Nursing, 12(2), 132–139.
  • Massie, R., Smith, B., & Tolfrey, K. (2015). Recommendations for recruiting and retaining adolescent girls in chronic exercise (training) research studies. Sports, 3(3), 219–235.
  • Miller, W. E., & Kreiner, D. S. (2008). Student perception of coercion to participate in psychological research. North American Journal of Psychology, 10(1), 53–64.
  • Patel, M. X., Doku, V., & Tennakoon, L. (2003). Challenges in recruitment of research participants. Advances in Psychiatric Treatment, 9(3), 229–238.
  • Porter, S. R., & Umbach, P. D. (2006). Student survey response rates across institutions: Why do they vary? Research in Higher Education, 47(2), 229–247.
  • Prescott, H. M. (2002). Using the student body: College and university students as research subjects in the United States during the twentieth century. Journal of the History of Medicine and Allied Sciences, 57(1), 3–38.
  • Roberts, L., & Allen, P. (2012). Student perspectives on the value of research participation. In S. McCarthy, K. L. Dickson, J. Cranney, A. Trapp, & V. Karandashev (Eds.), Teaching psychology around the world (Vol. 3, pp. 198–211). Newcastle upon Tyne, UK: Cambridge Scholars Publishing.
  • Robinson, K. A., Dinglas, V. D., Sukrithan, V., Yalamanchilli, R., Mendez-Tellez, P. A., Dennison-Himmelfarb, C., & Needham, D. M. (2015). Updated systematic review identifies substantial number of retention strategies: Using more strategies retains more study participants. Journal of Clinical Epidemiology, 68(12), 1481–1487.
  • Roschelle, J., Feng, M., Gallagher, H. A., Murphy, R., Harris, C., Kamdar, D., & Trinidad, G. (2014). Recruiting participants for large-scale random assignment experiments in school settings. Grantee Submission.
  • Singer, E., & Bossarte, R. M. (2006). Incentives for survey participation: When are they ‘coercive’? American Journal of Preventative Medicine, 31(5), 411–418.
  • Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., … Goldsmith, C. H. (2010). A tutorial on pilot studies: The what, why and how. BMC Medical Research Methodology, 10(1), 1.
  • Treweek, S., Mitchell, E., Pitkethly, M., Cook, J., Kjeldstrøm, M., Johansen, M., … Jackson, C. (2010). Strategies to improve recruitment to randomised controlled trials. Cochrane Database of Systematic Reviews (Online), 4(4).
  • van Mol, C. (2017). Improving web survey efficiency: The impact of an extra reminder and reminder content on web survey response. International Journal of Social Research Methodology, 20(4), 317–327.
  • Yancey, A. K., Ortega, A. N., & Kumanyika, S. K. (2006). Effective recruitment and retention of minority research participants. Annual Reviews Public Health, 27, 1–28.
  • Yancu, C. N., Lee, A. K., Witherspoon, D. D., & McRae, C. D. (2012). Participant recruitment of African American college students at an historically black college and university (HBCU): Challenges and strategies for health-related research. Journal of Health Disparities Research and Practice, 5(1), 5.
  • Zhang, J. Q. (1996). Research attitudes among chiropractic college students. Journal of Manipulative and Physiological Therapeutics, 19(7), 446–453.
  • Zweben, A., Fucito, L. M., & O’Malley, S. S. (2009). Effective strategies for maintaining research participation in clinical trials. Drug Information Journal, 43(4), 459–467.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.