786
Views
1
CrossRef citations to date
0
Altmetric
Original Articles

Building Research Capacity of Medical Students and Health Professionals in Rural Communities: Leveraging a Rural Clinical School's Resources to Conduct Research Skills Workshops

&
Pages 135-150 | Published online: 06 Sep 2013

Abstract

The paper reports on a project where the objective was for the Rural Clinical School, The University of Queensland, Australia, to design an acceptable model of research skills workshops for medical students and rural health professionals. Eight, interactive research skills workshops focused on skill development were conducted in rural Queensland, and attended by 62 undergraduate medical students and rural health professionals. The workshop learning objectives were to: provide an understanding of research methods and practise some basic research skills; and develop a greater understanding of the research process. Of the 53 participants who provided evaluations, more than two-thirds agreed that the learning objectives were met, and although health professionals evaluated the workshops most highly, two-thirds of the medical students also agreed. Consistent with the positive quantitative evaluations, participants reported valuing the knowledge acquired in the workshops, combined with the teaching methods. The study demonstrated that an interactive, skills-based workshop was an acceptable model for the medical students and rural health professionals who participated, and that better health outcomes for rural Australians could ultimately result from leveraging a Rural Clinical School's resources to increase research capacity through this approach.

Introduction

The health of rural Australians is generally poorer than that of city dwellers. The causes are complex; however, overall, they experience higher health risk factors and inferior access to health care services (Australian Government Department of Health and Ageing Citation2008; Australian Institute of Health and Welfare Citation2012; Health Workforce Australia Citation2012). Governments at all levels have developed policies and funded initiatives to address this issue with varying degrees of success (Alston Citation2007; Dunbar et al. Citation2007; Humphreys Citation2009; Humphreys, Wakerman, and Wells Citation2006; Humphreys et al. Citation2008; Wakerman, Curry, and McEldowney Citation2012). Studies have criticised ‘one size fits all’ approaches (Fraser et al. Citation2002) and highlighted the integral role of communities in forging local solutions (Humphreys Citation2009; O'Meara et al. Citation2012; Peake and Judd Citation2007; Stagg and Rosenthal Citation2012; Sutton, Maybery, and Moore Citation2011; Wakerman and Humphreys Citation2011).

Many health professionals understand the importance of conducting meaningful research into local issues; however, the barriers to their participation are well documented. These include a lack of time (Barnett et al. Citation2005), funding (Gunn, McCallum, and Sanci Citation2008; Yallop et al. Citation2006), research skills and confidence (Ried, Farmer, and Weston Citation2007), technological issues (Barnett et al. Citation2005; Liaw and Humphreys Citation2006) and limited access to research networks and infrastructure (Dunbar Citation2010). Despite these barriers, there are examples of successful research projects by rural primary health care professionals developed from the ground up which have investigated topics of local interest and value (Veitch, Heal, and Preston Citation2008). Funding and access to university researchers with the appropriate infrastructure and skills have assisted in overcoming barriers (Perkins et al. Citation2011).

The Australian Commonwealth government has funded programmes such as Primary Health Care Research, Evaluation and Development (PHCRED), Rural Clinical Schools (RCSs) and University Departments of Rural Health (UDRHs) to develop the rural health workforce and improve rural health. The Commonwealth expected a high level of engagement between these groups and local health professionals to increase rural research (Australian Department of Health and Ageing Citation2010; National Health and Hospitals Reform Commission, and Australian Department of Health and Ageing Citation2009). Recently the Commonwealth reinforced the importance of the translation of research to practice, and the role of research in workforce development (Australian Department of Health and Ageing Citation2011). The 2012 consultation paper summary of the Strategic Review of Health and Medical Research in Australia identified a general lack of research capacity amongst health professionals, recommended strategies for improvement and named rural and remote research as a priority area (Commonwealth Department of Health and Ageing Citation2012).

The RCS and UDRH programmes have a research role; however, it is more explicitly expressed in the objectives set by the Commonwealth for the UDRHs than those of the RCSs. There is an expectation of research productivity from the UDRHs: publications, grants and consultancies. The 2008 evaluation of the programmes, commissioned by the Department of Health and Ageing, recommended that the UDRHs build upon their achievements in facilitating research by rural health professionals (Department of Health and Ageing, and Urbis Citation2008). To date, measurement of the effectiveness of RCSs has focused on their success at attracting medical students and retaining them as health professionals (Eley et al. Citation2012). The evaluation found that RCS infrastructure such as library services enabled local clinicians with particular interests to undertake research and to contribute to the development of a research culture (Department of Health and Ageing, and Urbis Citation2008). The message for the RCSs was to turn their attention to research capacity building once the teaching programmes were established.

Despite the Commonwealth's view that research is critical to improved health outcomes, as well as evidence of some signs of improvement in rural research capacity, further advances will largely depend on the engagement of future health professionals. This is problematic, given the barriers to research participation outlined earlier, and a deficit of medical school graduates' research skills highlighted in the 2008 synthesis report of the Department of Education, Employment and Workplace Relations Review of Undergraduate Medical Education in Australia (Department of Education, Science and Training, and Urbis Citation2008). Junior doctors self-reported a lack of preparedness in research methodologies required for speciality training, a weakness also observed by specialists. Medical programmes in Australia are assessed according to the standards set by the Australian Medical Council which expect schools to have an active research programme, to emphasise the importance of research for the advancement of knowledge and to encourage student engagement with research (Australian Medical Council Limited Citation2010). This emphasis and encouragement is not producing graduates with strong research skills.

A review of the literature found that researchers have investigated this issue, not unique to Australia, asking questions related to medical students' perceptions of research and their skills and productivity. In addition, there are reports of strategies employed to improve education and engagement in this area. Investigations have been undertaken in the context of a worldwide shortage of clinical scientists or physician investigators, not limited to rural areas (Lander et al. Citation2010), and increasing difficulty for clinicians to find time for teaching and research (Commonwealth Department of Health and Ageing Citation2012; Joyce, Piterman, and Wesselingh Citation2009). Surveys of students in Australia, Canada, New Zealand, the United Kingdom and the United States of America have found that while they valued research and could see benefits, both personally and for the betterment of medicine, there were barriers to their involvement at medical school and beyond (Burgoyne, O'Flynn, and Boylan Citation2010; Chakraborti et al. Citation2012; Galletly et al. Citation2009; Hyde Citation2007; Murdoch-Eaton et al. Citation2010; Park, McGhee, and Sherwin Citation2010; Siemens et al. Citation2010). One Australian survey of students revealed that just over one half predicted they would have some involvement in research during their working life (Galletly et al. Citation2009), and in another, 40% of the respondents had not ruled out a research career, motivated to advance medicine (Hyde Citation2007). Overall, the medical students' interest in research was qualified. A common perception was that research was removed from clinical practice and patient contact, making it less attractive (Burgoyne, O'Flynn, and Boylan Citation2010; Hyde Citation2007). New Zealand medical students articulated plans to participate in related activities while at university and during their careers; however, their clinical role took precedence (Park, McGhee, and Sherwin Citation2010). For this group and others, debt incurred during studies and a desire to earn money was a reported barrier to students making a long-term research commitment (Park, McGhee, and Sherwin Citation2010; Vanasse et al. Citation2011). A lack of awareness of flexible pathways, of combining research with practice, was also reported (Hyde Citation2007).

In addition to research training within the standard curricula of some undergraduate programmes, strategies to inculcate knowledge, skills and interest have included dedicated project courses (Laidlaw, Guild, and Struthers Citation2009; Laskowitz et al. Citation2010), fellowships or summer scholarships (Cleland et al. Citation2010; Smith et al. Citation2009; Zorzi et al. Citation2005), pathways or ‘tracks’ (Hunskaar et al. Citation2009), mentoring (Zier and Coplit Citation2009), and learning activities such as workshops and lectures (Vujaklija et al. Citation2010). Disciplines aiming to bolster research numbers within their ranks have introduced programmes (Allen et al. Citation2009; Back et al. Citation2011; Smith et al. Citation2009). These studies reported the success of their strategies against measures such as students' participation, completion and satisfaction rates (Cleland et al. Citation2010; Dehaven et al. Citation2011; van Eyk et al. Citation2010; Zier and Coplit Citation2009), self-reported positive perception of research (Vujaklija et al. Citation2010), speciality selection (Allen et al. Citation2009), funding success, reported value to their studies, and long-term engagement and research productivity (Daniel, Michael Brooks, and Waterbor Citation2011; Hunskaar et al. Citation2009; Smith et al. Citation2009).

Despite these initiatives, the survey findings suggest that engagement with research while at medical school has been limited by students' perceptions and experiences. Although the UK cohorts were interested in gaining research skills, they required a more realistic understanding of the research process (Murdoch-Eaton et al. Citation2010) and the broader application of research in the clinical context (Burgoyne, O'Flynn, and Boylan Citation2010). Students at three medical schools in Canada reported low levels of engagement with research despite acknowledgement that it could facilitate selection into speciality training programmes, citing a lack of time, inadequate research training, insufficient mentors and concern their contribution would be downplayed (Siemens et al. Citation2010). Few students in the New Zealand study sought an intense research experience, such as an intercalated research degree, or thought research methods should be compulsory (Park, McGhee, and Sherwin Citation2010). American students highlighted the value of a research office to coordinate information and resources. Research training combined with awareness of local research activity and mentors increased chances of successful research (Chakraborti et al. Citation2012). The nature of the research training or exposure influenced students' attitudes to research, as expressed by the Australian students. It could encourage or deter future involvement (Galletly et al. Citation2009; Hyde Citation2007). Students who undertook research projects did not benefit when the project descriptions were vague and the skills they could develop were not made explicit (Murdoch-Eaton et al. Citation2010), or mentoring was considered inadequate and failed to deliver on-going role models (Galletly et al. Citation2009).

There are few studies which have investigated the research skills development of medical students undertaking their training in rural locations. One study reported positive outcomes from a summer research placement programme in rural communities in Canada (Zorzi et al. Citation2005). A comparison of research engagement of rural and urban origin medical students in Croatia found that students of rural background performed less well against the study outcome measures, including research involvement (Polasek and Kolcic Citation2006). Given that these students were more likely to return to practise in rural areas, and contribute to improving rural health indicators, a support programme was recommended.

The literature review revealed that trends in Australia reflected those in countries with comparable medical education systems. Informed by these studies and aware of the government priorities in relation to research and health workforce strategy, Research Skills Workshops were trialled by a librarian and postdoctoral research fellow at The University of Queensland, Rural Clinical School, commencing in 2010. Local drivers were also in play that led to student demand: anecdotal evidence of medical students' awareness of research experience as a competitive advantage for places on specialty training programmes. Demand existed locally for research training from health professionals who had particular studies they were involved with or wished to conduct.

The workshops complemented the existing research capacity building work undertaken by the postdoctoral research fellow and Rural Clinical School library staff at all locations who offered advice and assistance predominantly to students, but also to university staff and local health professionals. The library service was established with funding from the Commonwealth in 2002 to enhance access to information and related services for medical students and their clinical teachers in traditionally underserved areas (Lasserre and Lamb Citation2010).

When the workshop content and offering were developed the strengths and challenges of previous models of similar training were taken into account, and addressed where the RCS curriculum and structure permitted. The key challenges identified in the literature that were targeted, were creating a positive perception of research through demonstrating its application to clinical work and the clear identification of research skills, through naming and practising them. The workshops were scheduled to fit in with free time in the students' programme and as the students of interest were known to highly value interactive learning, this style of workshop approach was selected.

The theoretical framework that underpins the workshop design is problem-based learning, where the student learns by actively working through realistic problems (Yew and Schmidt Citation2012) hence the cycle of research was used, with participants using their own examples to work through the exercises in small groups. The students drew on prior knowledge, searched for new information and invested intellectually to construct solutions collaboratively with peers (Yew and Schmidt Citation2012). This model was selected primarily due to the students' familiarity with this approach, but also because it integrates adult learning theory (Onyon Citation2012) which promotes self-directed learning, an essential skill for independent research. Problem-based learning has been used successfully for research skills development training within medical education. Reports highlight the positive benefits to participants of a problem-based learning approach: active, collaborative, motivational and productive (Davis III et al. Citation2006). Due to much information being new to participants and time constraints, this approach was balanced with some lecture format sessions.

The workshop content and design was jointly developed by the author librarian and the postdoctoral research fellow author drawing on their respective skills and knowledge. The librarian brought expertise in literature searching and reference management, and experience in delivering training, undertaking research and publishing. To complement this, the postdoctoral research fellow's strengths were her skills and knowledge of research methodology, and experience running workshops, but she too had experience in conducting research projects, and reporting/publishing. Both had a grounded understanding, from experience, of the benefits of multi-disciplinary collaboration.

While transdisciplinary collaboration has the benefit of integrating diverse disciplinary approaches (Gehlert Citation2013), the strength of the collaboration for the workshop was that the librarian and postdoctoral research fellow brought complementary knowledge. It was their capacity to maintain their disciplinary lenses and so work within a multi-disciplinary framework that resulted in the breadth of the set of skills covered in the workshop. In Sullivan's (Citation1998) continuum of collaborative interactive education models, the multi-disciplinary approach is most similar to the uni-disciplinary approach where activities and interactions are collaborative but maintain a strong disciplinary focus (Hoeman Citation2002). By comparison interdisciplinary and transdisciplinary approaches seek a level of integration of the disciplines. The multi-disciplinary approach has been characterised as doing one's own work but sharing results, being cost and time efficient but promoting limited discussion about differences and similarities, having no real sharing, just an exchange of information and no presumption of change or enrichment (MacRae and Dyer Citation2005). However, the multi-disciplinary approach is collaborative and consistent with Whitehouse (Citation1951), where a team approach was advocated for education.

This collaboration was expanded to conduct the first four workshops (at Toowoomba, Hervey Bay, Bundaberg and Rockhampton), in accordance with the RCS sites where the librarians were based. A further two librarians were involved as co-presenters, with the postdoctoral research fellow and each librarian making minor adaptations to the Bundaberg and Rockhampton workshops to accommodate local requirements. While all three librarians already had working relationships, these were new collaborations for the postdoctoral research fellow. Following these workshops, using the principles of reflective practice (Kolb Citation1984; Schön Citation1983) the process and content of the workshops were reviewed by all presenters, by teleconference.

At later workshops the collaboration was expanded again. At the second Hervey Bay workshop a University of Southern Queensland librarian who provided librarian services to RCS students co-presented. At this workshop and at the final Toowoomba workshop a RCS research assistant also co-presented. In total there were four librarians involved (three from the RCS) and two research staff. The author librarian presented in five of the seven workshops offered at RCS sites and the one pre-conference workshop. The other author presented at all workshops. The remaining four workshops were reviewed by those who presented, on the completion of each workshop, in person.

This paper reports on the evaluation of the level of acceptability of a model of research skills workshops designed to provide an understanding of research methods and of the research process, to health professionals, and students undertaking undergraduate medical education in a rural setting.

Methods

Over a 2-year period 62 people participated in a total of eight research skills workshops that were conducted in five locations across Queensland. The workshops were conducted at each of The University of Queensland, Rural Clinical School sites – Toowoomba, Rockhampton, Hervey Bay and Bundaberg, and as a pre-conference workshop at the 2011 Rural Doctors Association of Queensland conference, Cairns. The learning objectives of the workshop were to:

1.

Provide an understanding of research methods and practise some basic research skills

2.

Develop a greater understanding of the research process

This four-hour interactive workshop focused on developing four skills, based on the cycle of research:

1.

Turning a research idea into a research question

2.

Searching the academic literature online

3.

Using EndNote with literature searches and when writing assignments/reports

4.

Critiquing a research article

At every workshop the postdoctoral research fellow led the presentation of skills 1 and 4, and the librarian with responsibility for each RCS site (Toowoomba, Hervey Bay, Bundaberg, Rockhampton) typically led the presentation of skills 2 and 3. While the target audience was the University of Queensland, Rural Clinical School, Year 3 and Year 4 medical students, most workshops were open to and attended by health professionals in the local community. Workshops were scheduled at times that were optimal for student attendance, with the exception of the workshop offered prior to the conference. Attendance was compulsory for students at one site.

This model of research skills workshops was evaluated using two approaches – by the participants and by the presenters. The workshops were evaluated by participants at the end of each workshop. Of the 62 people who attended the workshops 53 completed a one-page pen and paper evaluation. Participants identified their occupation/employer (e.g. student/ Queensland Health) from a list of options. The key question, ‘the workshop met the learning objectives’ was rated on a Likert-like scale (1 = Strongly disagree; 5 = Strongly agree). These data were analysed using IBM SPSS Statistics Version 19. The remaining questions were open-ended, asking participants to list the ‘best aspects’ of the workshop, the ‘worst aspects’ of the workshop, and ‘how the workshop could be improved’. These qualitative data were then thematically analysed.

Ethical clearance for this project was provided by the University of Queensland, Behavioural and Social Sciences Ethical Review Committee.

Results

Of the 62 who attended the workshops, the mean score for those 53 participants who evaluated the workshops was 3.65. In order to meet other learning commitments several participants did not complete the workshop. The five response categories were collapsed into three for analysis, with Strongly agreed and Agreed combined, and Strongly disagreed and Disagreed combined. Sixty-seven percent of participants (n = 34) Strongly agreed/Agreed that the learning objectives were met, 20% (n = 10) were Undecided and the remainder Strongly disagreed/Disagreed (13.7%; n = 7) that the learning objectives were met. When the types of participants were examined by collapsing into students, Queensland Health staff, Rural Clinical School/University of Queensland staff, and preceptors (medical practitioners who supervise medical students while doing clinical practice), a more refined analysis was possible.

The majority of participants who evaluated the workshop were students (71.7%; n = 38). Queensland Health staff were the next largest group (11.3%; n = 6) followed by Rural Clinical School/University of Queensland staff who were predominantly Rural Clinical staff (9.4%; n = 5), and finally preceptors (7.5%; n = 4). Of all participants, 17.7% (n = 9) had no Rural Clinical School affiliation. Thirty-four people completed evaluations in 2010 and 19 in 2011.

The mean score for the students was 3.44, with almost two-thirds (61.1%; n = 22) who Strongly agreed/Agreed that their learning objectives were met, almost a quarter (22.2%; n = 8) were Undecided and 16.7% (n = 6) Strongly disagreed/Disagreed that their learning objectives were met (Table ). The Queensland Health staff had a mean of 4.17, with more than three-quarters (83.3%; n = 5) who Strongly agreed/Agreed that their learning objectives were met and the remainder (16.7%; n = 1) who Strongly disagreed/Disagreed that their learning objectives had been met. The Rural Clinical School/University of Queensland staff evaluated the workshop most positively, with a mean of 4.2. In this group more than three-quarters (80.0%; n = 4) Strongly agreed/Agreed that their learning objectives were met with one participant being Undecided. The preceptors' mean was 4.00. Three-quarters (75%; n = 3) Strongly agreed/Agreed that their learning objectives had been met and one was Undecided.

Table 1 Responses to the question ‘The workshop met the above learning objectives for me?’ on a scale of 1 to 5 (1 = Strongly agree; 5 = Strongly disagree), by type of participant (* = not students).

When the learning objectives were analysed by RCS site it emerged that Toowoomba students were significantly more likely than Hervey Bay students or participants who were not students at RCS site workshops (health professionals) to Strongly agree /Agree that the workshop objectives were met, and Hervey Bay students were significantly more likely than those who were not students, or Toowoomba students to Strongly disagree/Disagree that the workshop objectives were met (χ2 df 3, n = 51, p = 002). The highest mean score for workshops where there were predominantly student participants was in Toowoomba (4.24) (Table ). The librarian author was based here and had daily contact with the student population; and the workshop was conducted at this location on three occasions. At this site, Toowoomba, almost all (94.1%; n = 16) participants Strongly agreed/Agreed that their learning objectives were met, with only one being Undecided. The site where the workshop was compulsory for students and only attended by students (Hervey Bay) is where the lowest mean was reported for a student group – 2.83. At Hervey Bay, while more than a third of participants (36.8%; n = 7) Strongly agreed/Agreed that their learning needs were met, almost the same proportion (31.6%; n = 6) Strongly disagreed/Disagreed that their learning needs were met, with a slightly smaller proportion (26.3%; n = 5) being Undecided. The workshop was conducted twice at Hervey Bay. The one workshop conducted at Rockhampton had the greatest diversity of participants (students; Queensland Health staff; preceptors) and had a mean of 3.88. Almost two-thirds (62.5%; n = 5) Strongly agreed/Agreed that their learning objectives were met and the remaining third (33.3%; n = 3) were Undecided.

Table 2 Responses to the question ‘The workshop met the above learning objectives for me?’ on a scale of 1 to 5 (1 = Strongly agree; 5 = Strongly disagree), by site of workshop, for all participants, students and those who were not students.

The two remaining workshops were attended predominantly by health professionals. At the pre-conference workshop in Cairns, the highest mean score by location, of 4.80 was reported. All participants indicated that they Strongly agreed/Agreed that their learning objectives had been met (n = 5). By contrast Bundaberg participants reported the lowest mean score of all the workshops for location with 2.67. Of the three participants, one Strongly agreed/Agreed that his learning objectives were met, one was Undecided and the last Strongly disagreed/Disagreed that his learning objectives were met.

The qualitative comments indicated that it was the content of the workshops in general, learning how to use referencing software, the small sized groups and the interactive nature of the workshop which were considered the best aspects. Examples of quotes highlighting each of these are: ‘Comprehensive overview of basic research skills’; ‘… a basic understanding of EndNote and how to export citations in to EndNote’; ‘Small group – more personal and able to ask questions freely’; ‘Interactive and flexible’. Participants reported that the worst aspects were having inadequate time and inaccurate targeting of participants' level of expertise. Quotes providing examples of these are: ‘Lack of time and a lot of information to digest’; ‘Too simplistic for people with advanced research skills’; ‘Probably a bit over my head – needed something more basic’. When asked how the workshop could be improved there were a range of suggestions, but most indicated that lack of time was an issue. Examples are: ‘Give the articles to peruse before the workshop for more time for discussion’; ‘Perhaps a little more time on conducting an online search and storing the data’.

Based on the participant evaluations and on the presenters' reflection on their practice, changes were made to the model of workshop delivery, both with the process of delivery and the content. The most significant change was doubling the time from an initial two-hour workshop, to four hours over a five-hour period. While this was well received by those who attended later workshops, a common issue in participant evaluations was inadequate time. The presenters determined that any future workshops while retaining the same length of four hours, would be best offered over two days either early in the morning or late afternoon. This would provide students with greater opportunity to re-organise their timetable and health professionals, particularly those in private practice who would potentially lose income through attending during usual working hours, easier access. A second change in the process dimension of the workshops was to increase the number of ‘change of state’ activities to maintain the energy levels and interest of participants. Changes here were made following most workshops with one example being the introduction of competitions which involved physical movement, and another where participants were required to conduct activities while standing instead of sitting. The third process change was to represent more closely the cycle of research by having the participants use their research topic of interest throughout the workshop, from developing the research question, in the online search practice and use of EndNote, then later in the mock research design component.

While the four skills remained the focus of all workshops, some content was changed. Two significant additions were the expansion of the section on literature reviews and a pre-workshop questionnaire to establish the skill base for literature searching and use of EndNote so the appropriate skill level could be targeted. While modifications were made, the model remained an interactive, skills-based workshop that engaged participants.

When the temporal dimension was considered, the mean score at the final workshop was higher than the first workshop, but there were decreases and increases within that period (Table ). However when the linear trend was examined for responses categorised as Disagree, Undecided and Agree, the slope for those who Agreed was positive (Figure ).

Table 3 The mean scores of each workshop, by location and the date the workshop was conducted.

Figure 1 Percentages of workshop participants who Strongly agreed/Agreed, were Undecided and who Strongly disagreed/Disagreed that the workshop met the learning objectives, in chronological order of the workshops being conducted.

Figure 1 Percentages of workshop participants who Strongly agreed/Agreed, were Undecided and who Strongly disagreed/Disagreed that the workshop met the learning objectives, in chronological order of the workshops being conducted.

Discussion

The study demonstrated that an interactive, skills-based workshop was an acceptable model for these participants – medical students and rural health professionals. This novel approach to increasing research capacity for students through running research skills workshops, but also making them available to locally based health professionals, met a need in each of the student cohorts and communities where it was offered. The results demonstrate clearly that the health professionals (Queensland Health staff, Rural Clinical School/University of Queensland staff and preceptors) received more benefit from the workshop than the medical students, as reflected by the mean scores. This is shown with each of the health professional participant groups having a mean score of four or above, out of a possible five, and medical students lowering the overall mean, with a score of 3.44. It should be noted, however, that more than one-third (37.7%) of all participants were students who were not given a choice about attending and it is hypothesised that the involuntary nature of attendance may be reflected in their evaluation. The high mean scores from the health professional participants may reflect a high value being placed on a scarce resource as indicated by previously reported barriers of a lack of research networks and infrastructure (Dunbar Citation2010) and contribute to addressing low levels of research skills and confidence (Ried, Farmer, and Weston Citation2007), and if so it would highlight the importance of this approach to enhancing research skills acquisition in rural communities.

Importantly almost two-thirds of the medical students reported the learning objectives were met, which shows substantial support for this model of delivery of research skills training. Amongst the predominantly student participant workshops it was participants at the location where the librarian author was based who gave the highest ratings with means of four or above. This may reflect the RCS quality assurance data which showed consistently that students at this site highly valued this librarian's contribution to their learning. The greatest difference by site, between highest and the lowest mean scores, is where only health professionals attended. These were substantially different groups, with the Bundaberg participants each having a research project they were about to undertake or had commenced (one a clinical trial) and the hope that this workshop would provide much needed knowledge and skill. The Cairns participants on the other hand were at the location to attend a conference and chose to attend this workshop and others, prior to the conference.

Consistent with the positive evaluations of learning needs being met, the open-ended comments indicate that it was both the knowledge acquired in the workshops that participants valued, combined with the teaching methods and activities used in the workshops. The evaluations endorsed the choice of the problem-based learning design. Participants appreciated learning about the process of conducting research, and in particular learning how to use referencing software (Endnote). They enjoyed the interactive, small group format.

Having reflective practice built into the workshop model assisted presenters to continually monitor and modify components, in concert with the participant feedback. There is some support indicated for the presenters' ability to use the feedback and their insights to effectively modify the workshops, demonstrated by the upward trajectory of the mean scores for those who Agreed that the learning needs were met, from the first to last workshop.

These results confirm earlier findings where medical students recognise the value of gaining research skills (Burgoyne, O'Flynn, and Boylan Citation2010; Galletly et al. Citation2009; Hyde Citation2007; Murdoch-Eaton et al. Citation2010; Park, McGhee, and Sherwin Citation2010; Siemens et al. Citation2010), with a mean of 3.44, even though the health professionals scored higher. Given these students are seen as potential rural health professionals, predominantly in primary care, their research capacity is important in facilitating the provision of evidence-based health care and improved rural health outcomes. This model, through using the cycle of the research process, with a skills focus, potentially contributes to students having a clear understanding of what fundamental research skills are, and a more realistic perception of the conduct of research, and so addressed these key short comings noted previously (Murdoch-Eaton et al. Citation2010). While specific research methods were not taught in the workshops, participants were exposed to the theory underlying methods which provides an introduction, so to a degree addresses another barrier found (Siemens et al. Citation2010). Including local health professionals in the workshops, provided the students with the opportunity to learn about local research projects and gain insights into the way research can be combined with practice, potentially preventing negative perceptions found earlier (Burgoyne, O'Flynn, and Boylan Citation2010; Hyde Citation2007). For health professionals interested in conducting their own research, or participating in research it contributed to addressing the lack of skills issue (Yallop et al. Citation2006), to some extent technological issues (Gunn, McCallum, and Sanci Citation2008; O'Meara et al. Citation2012) and access to research networks and infrastructure (Ried, Farmer, and Weston Citation2007).

While this model of research skills workshops was found acceptable by participants, there are some limitations. First, to effectively measure the impact of the workshop on research capacity building it would be necessary to enhance the evaluation process with additional surveying. Self-assessment of research knowledge and skills, as well as attitudes to research, pre- and post-workshop would provide more insights. Participants' stronger engagement could be measured by enrolment in research-based study, project initiation, publications, grants and increased use of research services such as the library or research advice. Second, apart from a pre-workshop questionnaire on database and EndNote experience, the baseline research knowledge and skills of the participants was not assessed. The research design would be strengthened by a pre- and post-test evaluation of knowledge and skills to provide a more objective measure than the self-report by the participants, in addition a longitudinal study would have the capacity to report on individual changes, over time and therefore the longer term impact. Finally, the small sample size only allows descriptive analysis and the non-probability sampling limits generalisation beyond this study.

The multi-disciplinary collaboration between the authors in developing the workshop, then expanding this to include other librarians and a research assistant in presenting the workshops, appears to have been effective. The challenges of multi-disciplinary teamwork such as competition for resources, discipline-specific turf issues, workloads and perceptions of power and control (Dyer Citation2003) were not apparent. While the impact of this team approach on the students' learning outcomes was not measured, some of Pounder's (Citation1999) potential areas for enhanced work experience were realised. The on-going review of the workshops provided opportunities for colleagues to give feedback about work effort, which was invariably constructive. There was an increased level of work coordination between this group, on matters outside the workshops. Presenters attended each other's sections of the workshops and typically this resulted in increased skills, knowledge and instructional strategies. For the research staff who had the least student contact, their knowledge of the students and their total educational experience increased as a result of the workshops. At reviews of the workshops, a sense of satisfaction and professional commitment was often reported, even though the focus was always on how to improve.

Leveraging local resources, in particular, the combined skills sets of the librarians, postdoctoral research fellow, and research assistant, was effective. They lived in or knew the communities where the workshops were conducted, through their day-to-day work. This local knowledge gave an advantage over an external provider flying in for the day. However the challenge of institutionalising activities such as this with high staff turnover in rural communities (Australian Government Department of Health and Ageing Citation2008) is highlighted by a half of the presenters, which includes both authors, now living elsewhere.

Conclusion

An outcome of this project was that the majority of participating students and health professionals concluded that the learning objectives were met. So they developed a greater understanding of the research process, were provided with an understanding of research methods and practised some basic research skills. The research skills workshops therefore moved participants a step closer to being able to operate as independent researchers.

Therefore this study demonstrates that a small multi-disciplinary team can respond to interest in research and assist in scaling the barriers for primary health care providers in conducting research. While research skills are not part of all undergraduate medical curricula and not core business for rural clinical schools, this approach is an alternative for students and health professionals to commence the development of research skills. The optimal format of the workshop would be voluntary, and sufficiently long to spend more time on each skill. It was difficult for participants to commit a half day to the workshop, so it would be preferable to hold it over two days or evenings.

This unique approach, to offer an interactive, skills-based workshop to future and current rural health professionals through the leveraging of a multi-disciplinary local collaboration presents an effective model that addresses numerous previously identified barriers to current and future health professionals in rural communities conducting research. While the barriers to health professionals undertaking research are well documented, the potential positive benefits to rural health care and communities are considerable. This model of research skills workshops could potentially be replicated in other rural communities where Rural Clinical Schools operate.

Acknowledgements

The authors would like to thank Sarah Thorning, Margaret Lamb and Brenda Strachan, librarians who participated in the development and delivery of the workshops, and also Donna Rouse who assisted in the delivery of workshops.

References

  • Allen , J. G. , Weiss , E. S. , Patel , N. D. , Alejo , D. E. , Fitton , T. P. , Williams , J. A. Barreiro , C. J. 2009 . Inspiring Medical Students to Pursue Surgical Careers: Outcomes from Our Cardiothoracic Surgery Research Program . The Annals of Thoracic Surgery , 87 ( 6 ) : 1816 – 1819 . doi:10.1016/j.athoracsur.2009.03.007
  • Alston , M. 2007 . Globalisation, Rural Restructuring and Health Service Delivery in Australia: Policy Failure and the Role of Social Work? . Health & Social Care in the Community , 15 ( 3 ) : 195 – 202 . doi:10.1111/j.1365-2524.2007.00696.x
  • Australian Department of Health and Ageing. A National Health and Hospitals Network for Australia's Future: Delivering Better Health and Better Hospitals for All Australians, Commonwealth of Australia 2010. Accessed August 6, 2012. http://www.yourhealth.gov.au/internet/yourhealth/publishing.nsf/Content/nhhn-report-toc
  • Australian Department of Health and Ageing. National Health Reform: Progress and Delivery, Department of Health and Ageing 2011. Accessed June 18, 2012. http://www.yourhealth.gov.au/internet/yourhealth/publishing.nsf/Content/nhr-progress-delivery/
  • Australian Government Department of Health and Ageing. Report on the Audit of Health Workforce in Rural and Regional Australia, April 2008 [Internet]. Australian Government Department of Health and Ageing 2008. Accessed October 8, 2012. www.health.gov.au/internet/main/publishing.nsf/Content/4F3A981914316A11CA257434008189EC/$File/ruraud.pdf
  • Australian Institute of Health and Welfare. Australia's Health 2012 the Thirteenth Biennial Health Report of the Australian Institute of Health and Welfare [Internet]. Australian Institute of Health and Welfare 2012. Accessed September 7, 2012. http://www.aihw.gov.au/publication-detail/?id = 10737422172
  • Australian Medical Council Limited. Assessment and Accreditation of Medical Schools: Standards and Procedures, Australian Medical Council Limited 2010. Accessed June 18, 2012. http://www.amc.org.au/images/Medschool/standards.pdf
  • Back , S. E. , Book , S. W. , Santos , A. B. and Brady , K. T. 2011 . Training Physician-Scientists: A Model for Integrating Research into Psychiatric Residency . Academic Psychiatry , 35 ( 1 ) : 40 – 45 . doi:10.1176/appi.ap.35.1.40
  • Barnett , L. , Holden , L. , Donoghue , D. , Passey , M. and Birden , H. 2005 . What's Needed to Increase Research Capacity in Rural Primary Health Care? . Australian Journal of Primary Health , 11 ( 3 ) : 45 – 53 . doi:10.1071/PY05042
  • Burgoyne , L. N. , O'Flynn , S. and Boylan , G. B. 2010 . Undergraduate Medical Research: The Student Perspective . Medical Education Online , 15 : 5212 doi:10.3402/meo.v15i0.5212
  • Chakraborti , Chayan , Bourgeois , D. J. III , Gleeson , Elizabeth and Gunderson , William . 2012 . Identifying Barriers to Successful Research During Medical School . Medical Education Development , 2 ( 1 ) : e2 doi:10.4081/med.2012.e2
  • Cleland , J. , Engel , N. , Dunlop , R. and Kay , C. 2010 . Innovation in Medical Education: Summer Studentships . The Clinical Teacher , 7 ( 1 ) : 47 – 52 . doi:10.1111/j.1743-498X.2009.00335.x
  • Commonwealth Department of Health and Ageing. Strategic Review of Health and Medical Research in Australia – Consultation Paper Summary, 2012. Accessed October 8, 2012. http://www.mckeonreview.org.au/downloads/SRHMRA_Consultation_Paper_Summary_031012%20.pdf
  • Daniel , C. L. , Michael Brooks , C. and Waterbor , J. W. 2011 . Approaches for Longitudinally Tracking Graduates of NCI-Funded Short-Term Cancer Research Training Programs . Journal of Cancer Education , 26 ( 1 ) : 58 – 63 . doi:10.1007/s13187-010-0190-y
  • Davis III , T. H. , Wagner , G. S. , Gleim , G. , Andolsek , K. M. , Arheden , H. , Austin , R. Courtney-Eighmy , A. 2006 . Problem-Based Learning of Research Skills . Journal of Electrocardiology , 39 ( 1 ) : 120 – 128 .
  • Dehaven , M. J. , Gimpel , N. E. , Dallo , F. J. and Billmeier , T. M. 2011 . Reaching the Underserved through Community-Based Participatory Research and Service Learning: Description and Evaluation of a Unique Medical Student Training Program . Journal of Public Health Management and Practice , 17 ( 4 ) : 363 – 368 . doi:10.1097/PHH.0b013e3182214707
  • Department of Education, Science and Training, and Urbis. What Makes for Success in Medical Education? Synthesis Report, Department of Education, Science and Training 2008. Accessed August 6, 2012. http://www.innovation.gov.au/HigherEducation/ResourcesAndPublications/Docuents/HEReports/SynthesisReport.pdf
  • Department of Health and Ageing, and Urbis. Evaluation of the University Departments of Rural Health Program and the Rural Clinical Schools Program November 2008, Department of Health and Ageing 2008. Accessed June 18, 2012. http://www.health.gov.au/internet/main/publishing.nsf/Content/F113F29BD0A03FB8CA2575DE00227803/$File/udrheval.pdf
  • Dunbar , J. A. 2010 . Building Capacity for Rural and Remote Research . Australian Journal of Rural Health , 18 ( 4 ) : 133 – 133 . doi:10.1111/j.1440-1584.2010.01146.x
  • Dunbar , J. A. , Hickie , I. B. , Wakerman , J. and Reddy , P. 2007 . New Money for Mental Health: Will it Make Things Better for Rural and Remote Australia? . Medical Journal of Australia , 186 ( 11 ) : 587 – 589 .
  • Dyer , Jean . 2003 . Multidisciplinary, Interdisciplinary, and Transdiscriplinary Education Models and Nursing Educaiton . Nursing Education Perspectives , 24 ( 4 ) : 186 – 188 .
  • Eley , D. S. , Synnott , R. , Baker , P. G. and Chater , A. B. 2012 . A Decade of Australian Rural Clinical School Graduates–Where Are They and Why? . Rural Remote Health , 12 : 1937
  • Fraser , C. , Judd , F. , Jackson , H. , Murray , G. , Humphreys , J. and Hodgins , G. A. 2002 . Does One Size Really Fit All? Why the Mental Health of Rural Australians Requires Further Research . Australian Journal of Rural Health , 10 ( 6 ) : 288 – 295 . doi:10.1046/j.1440-1584.2002.00463.x
  • Galletly , C. , Chur-Hansen , A. , Air , T. and Chapman , I. 2009 . Academics of the Future? A Survey of Final Year Medical Students . Australasian Psychiatry , 17 ( 6 ) : 502 – 505 . doi:10.1080/10398560903284935
  • Gehlert , Sarah . 2013 . Turning Disciplinary Knowledge into Solutions . Journal of Adolescent Health , 52 ( 5, Supplement ) : S98 – S102 . doi:http://dx.doi.org/10.1016/j.jadohealth.2013.02.015.
  • Gunn , J. , McCallum , Z. and Sanci , L. 2008 . What Do GPs Get Out of Participating in Research? Experience of the LEAP Trial . Australian Family Physician , 37 ( 5 ) : 372 – 375 .
  • Health Workforce Australia. Health Workforce Australia Annual Report 2011–2012 Internet]. Health Workforce Australia 2012. Accessed October 8, 2012. www.hwa.gov.au/sites/uploads/HWA-Annual-Report-2011–2012_0.pdf
  • Hoeman , S. 2002 . Rehabilitation Nursing: Process and Application , St. Louis, MO : WB Saunders .
  • Humphreys , J. S. 2009 . Key Considerations in Delivering Appropriate and Accessible Health Care for Rural and Remote Populations: Discussant Overview . Australian Journal of Rural Health , 17 ( 1 ) : 34 – 38 . doi:10.1111/j.1440-1584.2008.01034.x
  • Humphreys , J. S. , Wakerman , J. and Wells , R. 2006 . What Do We Mean by Sustainable Rural Health Services? Implications for Rural Health Research . Australian Journal of Rural Health , 14 ( 1 ) : 33 – 35 . doi:10.1111/j.1440-1584.2006.00750.x
  • Humphreys , J. S. , Wakerman , J. , Wells , R. , Kuipers , P. , Jones , J. A. and Entwistle , P. 2008 . Beyond Workforce: A Systemic Solution for Health Service Provision in Small Rural and Remote Communities . Medical Journal of Australia , 188 ( 8 Suppl ) : S77 – S80 .
  • Hunskaar , S. , Breivik , J. , Siebke , M. , Tømmerås , K. , Figenschau , K. and Hansen , J. B. 2009 . Evaluation of the Medical Student Research Programme in Norwegian Medical Schools. A Survey of Students and Supervisors . BMC Medical Education , 9 ( 1 ) : 43 doi:10.1186/1472-6920-9-43
  • Hyde , Sarah . 2007 . Australian Medical Students' Interest in Research as a Career . Focus on Health Professional Education , 9 ( 2 ) : 27 – 38 .
  • Joyce , C. M. , Piterman , L. and Wesselingh , S. L. 2009 . The Widening Gap between Clinical, Teaching and Research Work . Medical Journal of Australia , 191 ( 3 ) : 169 – 172 .
  • Kolb , David A. 1984 . Experiential Learning: Experience as the Source of Learning and Development , Englewood Cliffs, NJ : Prentice-Hall .
  • Laidlaw , A. , Guild , S. and Struthers , J. 2009 . Graduate Attributes in the Disciplines of Medicine, Dentistry and Veterinary Medicine: A Survey of Expert Opinions . BMC Medical Education , 9 ( 1 ) : 28 doi:10.1186/1472-6920-9-28
  • Lander , B. , Hanley , G. E. and Atkinson-Grosjean , J. 2010 . Clinician-Scientists in Canada: Barriers to Career Entry and Progress . Plos One , 5 ( 10 ) : e13168 doi:10.1371/journal.pone.0013168
  • Laskowitz , D. T. , Drucker , R. P. , Parsonnet , J. , Cross , P. C. and Gesundheit , N. 2010 . Engaging Students in Dedicated Research and Scholarship During Medical School: The Long-Term Experiences at Duke and Stanford . Academic Medicine , 85 ( 3 ) : 419 – 428 . doi:10.1097/ACM.0b013e3181ccc77a
  • Lasserre , Kaye and Lamb , Margaret . 2010 . “ Levelling the Playing Field: The University of Queensland Rural Clinical School Library Enabling Participation in Research in Rural and Remote Medicine ” . In Rural Medicine Australia 2010, 6th scientific forum on rural and remote medicine , Hobart, Australia : Australian College of Rural and Remote Medicine .
  • Liaw , S. T. and Humphreys , J. S. 2006 . Rural eHealth Paradox: It's Not Just Geography! . Australian Journal of Rural Health , 14 ( 3 ) : 95 – 98 . doi:10.1111/j.1440-1584.2006.00786.x
  • MacRae , Nancy and Dyer , Jean . 2005 . Collaborative Teaching Models for Health Professionals . Occupational Therapy in Health Care , 19 ( 3 ) : 93 – 103 . doi:doi:10.1080/J003v19n03_07
  • Murdoch-Eaton , D. , Drewery , S. , Elton , S. , Emmerson , C. , Marshall , M. , Smith , J. A. , Stark , P. and Whittle , S. 2010 . What Do Medical Students Understand by Research and Research Skills? Identifying Research Opportunities within Undergraduate Projects . Medical Teacher , 32 ( 3 ) : e152 – e160 . doi:10.3109/01421591003657493
  • National Health and Hospitals Reform Commission, and Australian Department of Health and Ageing. A Healthier Future for all Australians – Final Report of the National Health and Hospitals Reform Commission – June 2009, Department of Health and Ageing 2009. Accessed August 6, 2012. http://www.yourhealth.gov.au/internet/yourhealth/publishing.nsf/Content/nhhrc-report-toc#.UFgaEq7Oicc
  • O'Meara , P. F. , Tourle , V. , Stirling , C. , Walker , J. and Pedler , D. 2012 . Extending the Paramedic Role in Rural Australia: A Story of Flexibility and Innovation . Rural Remote Health , 12 ( 2 ) : 1978
  • Onyon , C. 2012 . Problem-Based Learning: A Review of the Educational and Psychological Theory . The Clinical Teacher , 9 ( 1 ) : 22 – 26 .
  • Park , S. J. , McGhee , C. N. and Sherwin , T. 2010 . Medical Students' Attitudes Towards Research and a Career in Research: An Auckland, New Zealand Study . New Zealand Medical Journal , 123 ( 1323 ) : 34 – 42 .
  • Peake , S. L. and Judd , N. 2007 . Supporting Rural Community-Based Critical Care . Current Opinion in Critical Care , 13 ( 6 ) : 720 – 724 .
  • Perkins , D. A. , Barclay , L. , Browne , K. M. , Blunden , L. A. , Fragar , L. J. , Kelly , B. J. Lower , T. 2011 . The Australian Rural Health Research Collaboration: Building Collaborative Population Health Research in Rural and Remote NSW . New South Wales Public Health Bulletin , 22 ( 1–2 ) : 23 – 26 . doi:10.1071/nb10067
  • Polasek , O. and Kolcic , I. 2006 . Academic Performance and Scientific Involvement of Final Year Medical Students Coming from Urban and Rural Backgrounds . Rural Remote Health , 6 ( 2 ) : 530
  • Pounder , D. 1999 . Teacher Teams: Exploring Job Characteristics and Work-Related Outcomes of Work Group Enhancement . Educational Administration Quarterly , 35 : 317 – 348 .
  • Ried , K. , Farmer , E. A. and Weston , K. M. 2007 . Bursaries, Writing Grants and Fellowships: A Strategy to Develop Research Capacity in Primary Health Care . BMC Family Practice , 8 ( 1 ) : 19 doi:10.1186/1471-2296-8-19
  • Schön , Donald A. 1983 . The Reflective Practitioner: How Professionals Think in Action , New York, NY : Basic Books .
  • Siemens , D. R. , Punnen , S. , Wong , J. and Kanji , N. 2010 . A Survey on the Attitudes towards Research in Medical School . BMC Medical Education , 10 ( 1 ) : 4 doi:10.1186/1472-6920-10-4
  • Smith , W. H. , Rogers , J. G. , Hansen , T. N. and Smith , C. V. 2009 . Early Career Development in Academic Pediatrics of Participants in the APS-SPR Medical Student Research Program . Pediatric Research , 65 ( 4 ) : 474 – 477 . doi:10.1203/PDR.0b013e3181975f85
  • Stagg , P. and Rosenthal , D. R. 2012 . Why Community Members Want to Participate in the Selection of Students into Medical School . Rural Remote Health , 12 ( 3 ) : 1954
  • Sullivan , T. 1998 . Collaboration: A Health Care Imperative , St. Louis, MO : McGraw-Hill Companies .
  • Sutton , K. P. , Maybery , D. and Moore , T. 2011 . Creating a Sustainable and Effective Mental Health Workforce for Gippsland, Victoria: Solutions and Directions for Strategic Planning . Rural Remote Health , 11 ( 1 ) : 1585
  • van Eyk , H. J. , Hooiveld , M. H. W. , Van Leeuwen , T. N. , Van der Wurff , B. L. J. , De Craen , A. J. M. and Dekker , F. W. 2010 . Scientific Output of Dutch Medical Students . Medical Teacher , 32 ( 3 ) : 231 – 235 . doi:10.3109/01421591003596592
  • Vanasse , A. , Orzanco , M. G. , Courteau , J. and Scott , S. 2011 . Attractiveness of Family Medicine for Medical Students: Influence of Research and Debt . Canadian Family Physician , 57 ( 6 ) : e216 – e227 .
  • Veitch , C. , Heal , C. F. and Preston , R. 2008 . Practice Based Research: Lessons from the Field . Australian Family Physician , 37 ( 5 ) : 381 – 384 .
  • Vujaklija , A. , Hren , D. , Sambunjak , D. , Vodopivec , I. , Ivanis , A. , Marusic , A. and Marusic , M. 2010 . Can Teaching Research Methodology Influence Students' Attitude toward Science? Cohort Study and Nonrandomized Trial in a Single Medical School . Journal of Investigative Medicine , 58 ( 2 ) : 282 – 286 . doi:10.231/JIM.0b013e3181cb42d9
  • Wakerman , J. , Curry , R. and McEldowney , R. 2012 . Fly in/Fly out Health Services: The Panacea or the Problem? . Rural Remote Health , 12 ( 2 ) : 2268
  • Wakerman , J. and Humphreys , J. S. 2011 . Sustainable Primary Health Care Services in Rural and Remote Areas: Innovation and Evidence . Australian Journal of Rural Health , 19 ( 3 ) : 118 – 124 . doi:10.1111/j.1440-1584.2010.01180.x
  • Whitehouse , F. 1951 . Teamwork: An Approach to a Higher Professional Level . Exceptional Children , 18 : 75 – 82 .
  • Yallop , J. J. , McAvoy , B. R. , Croucher , J. L. , Tonkin , A. , Piterman , L. and Study Group , C. H. 2006 . Primary Health Care Research-Essential but Disadvantaged . Medical Journal of Australia , 185 ( 2 ) : 118 – 120 .
  • Yew , E. H. J. and Schmidt , H. G. 2012 . What Students Learn in Problem-Based Learning: A Process Analysis . Instructional Science , 40 ( 2 ) : 371 – 395 .
  • Zier , K. and Coplit , L. D. 2009 . Introducing INSPIRE, a Scholarly Component in Undergraduate Medical Education . Mount Sinai Journal of Medicine: A Journal of Translational Personalized Medicine , 76 ( 4 ) : 387 – 391 . doi:10.1002/msj.20121
  • Zorzi , A. , Rourke , J. , Kennard , M. , Peterson , M. and Miller , K. 2005 . Combined Research and Clinical Learning Make Rural Summer Studentship Program a Successful Model . Rural Remote Health , 5 ( 4 ) : 401

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.