Abstract
Background
Knowledge translation involves the dissemination and application of scientific research findings into clinical practice. In the health care arena, uptake of evidence-based assessment and intervention strategies is aimed at reducing inefficiencies and ultimately improving patient outcomes. However, numerous studies have purported gaps in knowledge translation in the health care professions. The objective of this study was to classify the traits of undergraduate paramedic students from Monash Univeristy, Australia, using the practice style inventory (PSI).
Methods
A cross-sectional study of students across all undergraduate years from Emergency Health and Emergency Health/Nursing was completed. Student knowledge translation levels were measured using the 17-item paper-based PSI.
Results
A total of 266 students participated in the study, of which 68.4% were females. The majority of participants were <26 years of age (n=228) and just over half enrolled in second year studies (n=134). Two subscales produced statistically significant differences: evidence versus experience (extent to which scientific evidence rather than authority is perceived as the best source of knowledge) and nonconformity (degree of comfort with clinical practices that are out of step with recommendations of leaders). There was a statistically significant difference between sex on the evidence versus experience subscale (P<0.0001, d =0.51), and between year levels on the nonconformity subscale (P<0.007, d =0.63).
Conclusion
This study identified several differences in knowledge translation subscales in the undergraduate paramedic cohorts. Further investigation is warranted in order to better understand barriers and facilitate improved uptake of evidence-based research into clinical practice and, ultimately, improve patient outcomes. Future research using a longitudinal study design to capture changing attitudes to knowledge translation in the postgraduate population may also prove valuable in curricula renewal.
Introduction
Health care systems globally are enduring the demanding challenge of improving the quality of care and reducing the risk of adverse events.Citation1 Evidence drives improvements in patient care,Citation2 and efficient transference of evidence between universities and the clinical interface is vital to give the best possible care to patients. Unfortunately, providing evidence in the form of scientific journals, while necessary, is not all that is required for delivering best practice care to patients as health care systems often fail to use evidence optimally, resulting in inefficient practice and quality of life for patients.Citation3–Citation6 McGlynn et alCitation5 found that adults in the US were treated with less than 55% of optimal recent evidence-based practice (EBP). Many expressions have been used to describe the process of putting health knowledge into practice;Citation7 however, knowledge translation (KT) has become the commonly accepted term within the literature.Citation8 KT is the science of reducing the gaps present between knowledge and practice; the science of transferring information to where it is needed.Citation9 KT research is essential if the benefits of medical and health research are to be translated in clinical practice. It is necessary to improve health and quality of life of patients, and to enhance the productivity of the health care system.Citation9,Citation10
The Canadian Institutes of Health Research defines KT as:
a dynamic and iterative process that includes the synthesis, dissemination, exchange and ethically sound application of knowledge to improve health, provide more effective health services and products and strengthen the health care system.Citation11
KT may be thought of as the transfer of knowledge from research into clinical practice, and it is ultimately about capturing and disseminating information and innovation to ensure its application.Citation9,Citation10 Since its inception, this definition has been accepted by some and adapted by other organizations around the globe including the World Health Organization and the US National Center for Dissemination of Disability Research.Citation8,Citation12
Efficiency in the uptake of evidence-based research is paramount in paramedic practice, as it is with other health care professions. It is important that evidence-based research is efficiently translated into paramedic practice as such strategies serve to improve patient outcomes and reduce system inefficiencies, thereby strengthening out-of-hospital care and the broader continuum of health care. This will also help to achieve equity in health care delivery, thus improving access to the best possible standards in clinical care.Citation9,Citation10
In a bid to close the gaps in health care Wyszewianski and GreenCitation13 pioneered original research with a group of family physicians and general practitioners. They postulated that the gap in KT may be, at least in part, explained by observed differences between clinicians in what they consider to be credible sources of information, in their degree of comfort with stepping outside traditional practice, and in the weight they assigned to purely practical concerns. As such, Wyszewianski and Green proposed the use of the practice style inventory (PSI) to classify physicians against three traits. These are: the individual’s belief in scientific evidence versus clinical experience and authority as the best source of knowledge about good practice; their willingness to diverge from common or previous practice, or the recommendations of leaders; and the importance attached to pragmatic concerns. Wyszewianski and Green, and Green et al held the view that the classification of clinicians using these three traits was highly important, as an individual physician’s reasons for choosing or not choosing to implement various assessments and intervention strategies was ultimately a function of these three underlying factors.Citation13,Citation14 Others have since replicated this study in numerous other fields including nursing, occupational therapy, and physical therapy, among others.Citation15,Citation16 To our knowledge, there have been no studies conducted using an Australian undergraduate or graduate paramedic cohort.
In the paramedic discipline, understanding EBP by paramedics is as important as undertaking emergency-medical-services-related clinical trials.Citation17 If clinicians do not understand EBP, they will never be accepting of, or assist in the translation of such evidence into practice. The primary objective of this study was to classify the traits of undergraduate paramedic students from Monash University, Australia, using the PSI. Addressing this objective will provide new knowledge in assessing the attitudes and acceptance of KT in a bid to gauge whether the undergraduate cohort, representative of the next generation of paramedics, are indeed agents of change.
Methods
Design
A cross-sectional study was carried out using a convenience sample of undergraduate paramedic students at Monash University, Australia, during semester 1, 2012.
Participants
Students were eligible to be enrolled in this study if they were enrolled in either the Bachelor of Emergency Health or the Bachelor of Emergency Health/Bachelor of Nursing double degree at Monash University. Monash University is one of five universities in Victoria, Australia that offers entry-level paramedic degree programs.
Instrumentation
Participants were asked to respond to a 17-item paper-based survey, the PSI, which uses a five-point Likert scale (where 1 =Strongly Disagree and 5 =Strongly Agree). The 17 items contained in the PSI are designed to score an individual’s tendency towards three main underlying traits. Six of these items, items 1, 3, 9, 12, 16, and 17, are aimed at identifying a clinician’s attitudes towards evidence versus experience (minimum score 6 – maximum score 30). Six questions, items 2, 5, 7, 11, 13, and 15, gauge attitudes towards nonconformity (minimum score 6 – maximum score 30). Finally, there are five questions, items 4, 6, 8, 10, and 14, that assess an individual’s focus on pragmatic concerns (minimum score 6 – maximum score 25).
Procedures
At the conclusion of lectures for each of the undergraduate programs, students were invited to participate on a voluntary basis in this study. Students were provided with an explanatory statement and were informed that participation was voluntary and anonymous. The questionnaires took students approximately 15 minutes to complete and consent was implied by its completion and submission. No follow-ups were undertaken. Ethics approval was obtained from the Monash University Human Research Ethics Committee.
Data analysis
The SPSS program (Statistical Package for the Social Sciences Version 20.0; IBM Corporation, Armonk, NY, USA) was used for data storage, tabulation, and the generation of descriptive and inferential statistics. Descriptive statistics including means and standard deviations (SDs) were used to summarize the demographic data. Inferential statistics, t-tests, and one-way analysis of variance, including post hoc tests, were used to compare the differences between age groups, sex, and year level. The effect sizes were used to evaluate the magnitude of the findings. Results were considered statistically significant if the P-value was <0.05; effect sizes (effect sizes [d] were also calculated for quantifying the differences between mean scores) were also calculated for quantifying the differences between mean scores.
Results
A total of 266 students took part in the study out of a total eligible student population of 420 (63% response rate), the majority of whom were female (n=179; 67.3%). Representation between double degree and single degree students was fairly even, with 51.1% enrolled in a double degree (n=136) compared with 48.9% enrolled in the single degree program (n=130). Half of the participants were in their second year of study (n=134; 50.4%). Most participants were either less than 21 years of age (n=119; 44.7%) or aged from 21 to 25 years (n=109; 41.0%). There were fewer participants aged 26 years or older, accounting for just 14.3% of the sample. The full demographic profile is outlined in .
Table 1 Demographic distributions
The mean score for the six-item evidence versus experience subscale was 13.3 (SD ±2.32), the six-item nonconformity subscale mean score was 16.8 (SD ±2.04), and the mean score for the five-item pragmatic concerns subscale was 15.3 (SD ±2.07). The mean values for each item are provided in .
Table 2 Practice style inventory mean item results
These data suggest that there was a statistically significant difference and large effect size between sexes on the evidence versus experience subscale (P<0.0001, d =0.51) with female mean scores at 13.7 versus males at 12.5. There was also an observed significant difference and large effect size between year levels on the nonconformity subscale (P<0.007, d =0.63), with degree of comfort with nonconformity generally trending upwards as the study progressed and also trending upwards with increased age.
Discussion
To our knowledge, this is the first time a PSI has been conducted identifying the traits of an undergraduate paramedic cohort. The results, however, are consistent with the work conducted by Green et al and their multiple studies involving family physicians, interns, and other specialist groups, as well as the work of Korner-Bitenski et al on occupational therapists and physical therapist traits.Citation13–Citation16
Regarding the evidence versus experience subscale, the literature suggests that a subtotal score of greater than 22 indicates that the individual relies heavily on evidence.Citation14 With a mean score of only 13.3 (SD ±2.32), paramedic students in this cohort are far more inclined to rely on experience rather than evidence. Item 3 produced a low mean (1.67) despite the scores for negatively worded item 17 heading towards the agreement end of the spectrum, highlighting some confusion over the benefit of EBP. Students express that EBP does not make much sense to them and they are unsure if it is very practical in patient care. This provides an opportunity for universities to impart knowledge of the importance and relevance of EBP. This may have a downstream positive impact on the acceptance and attitude towards KT.
The literature proposes that a subtotal score of 18 or above in the nonconformity subscale indicates that an individual is willing to go against the trends set by those around them.Citation14 Though higher, the nonconformity mean score 16.8 (SD±2.04) does not suggest a strong degree of confidence in practicing out of step with group norms, with students leaning slightly more towards conformist attitudes. However, interestingly, the question scoring the highest on average in this sub-scale was item 13 – “My colleagues consider me to be someone who marches to my own drummer” – (mean=3.51, SD±0.86) while results for most of the other items were either roughly neutral or leaning more towards disagreement. This is surprising given that students are novices and should be more comfortable working within set guidelines considering their lack of experience. Perhaps this question, in the university context, plays on the personality or ego of some students, encouraging them to rank it more highly, which would require further investigation.
Students in the practicality subscale produced a mean score of 15.3 (SD±2.07) where a subtotal score of greater than 14 indicates that the individual is concerned with pragmatic considerations.Citation14 There was some agreement on items 4 – “I do not have the time to read up on every practice decision” – and 6 – “I follow practice guidelines if they are not too much hassle”. Paramedic students in this study appear to have an appreciation of purely practical affairs, which includes time management and possibly the management of limited resources.
Recently, Snooks et alCitation18 found that there were 96 evidence gaps related to current out-of-hospital policy, management, clinical practice, and service delivery in the United Kingdom. Some authors suggest that the time lag between the availability of research evidence and its use in clinical practice can be anywhere from 8 to 30 years.Citation5,Citation19–Citation22 The curriculum provided at Monash University’s Paramedic Department includes, as part of its coursework and curriculum, an evidence-based approach to clinical practice. Given this, it would be reasonable to expect the results to reflect a greater level of confidence in students’ use of scientific evidence; however, this was not the case based on these self-reported results. Perhaps our study results, as with previous studies involving various health care groups, may be at least partially explained by the general admission of a lack of understanding of evidence-based practice. The lack of confidence in understanding, interpreting research findings, or confidence in translating evidence into practice may result in a preference for relying on direction from senior clinicians and “experts”. Future research utilizing a mixed methods approach would be useful in examining these views in more detail.
The statistically significant difference between sexes on the evidence versus experience subscale suggests that females have an increased tendency towards belief in scientific evidence over experience as the best source of knowledge. In truth, it is not known to what the observed difference between sexes on the weighting given to scientific evidence can be attributed, but it is perhaps worthy of further exploration. The same is true of the increasing degree of comfort with nonconformity in line with progression through study and increasing age. Perhaps this may be linked to accumulation of life experience or previous work roles, and this is also worthy of further investigation.
Study limitations
The use of convenience samples of students from one university may not be representative of the student population as a whole or generalizable to other universities. Future studies would do well to involve larger sample sizes, so as to permit a more thorough estimation of attitudes amongst the paramedic profession, including practicing paramedics. Additionally, respondents who did volunteer to participate in the survey may be more academically inclined or may be proactive learners, which may also introduce bias into the sample.
Future implications
A larger sample size across multiple institutions including qualitative data, and a study design to capture changing attitudes over time, will prove more insightful. The observed difference between sexes on the weighting given to scientific evidence, and the increasing degree of comfort with nonconformity in line with progression through study and increasing age, is worthy of further exploration.
The application of a psychometric instrument such as the PSI to help identify barriers to KT amongst paramedics has important implications during review of the methods being used to teach undergraduate paramedic students. It can also be used to promote improved practice change and timely implementation of guidelines in the postgraduate population.
Conclusion
This study found that paramedic students are far more inclined to rely on experience rather than evidence as the best source of information showing that, despite being trained in EBP, students still do not appear to have much faith in it. This indicates that there is opportunity to improve the way that EBP is taught to students and its coherence throughout the curriculum. Since improved KT facilitates the expedient uptake of innovation and research into clinical practice, it is an issue that cannot be ignored. Improved understanding of the distribution of different practice style traits among the paramedic profession as a whole is an important step in helping to bridge KT gaps. Only when paramedics understand EBP will they accept and participate in KT. Further investigation is warranted in order to better understand barriers and facilitate improved uptake of evidence-based research into clinical practice and, ultimately, improve patient outcomes. The next generations of paramedics are in as good a position as any to be agents in effecting such a change.
Acknowledgments
We would like to thank the students for participating and completing the questionnaires.
The authors alone are responsible for the content and writing of this article.
Disclosure
The authors report no conflicts of interest in this work.
References
- KohnLCorriganJDonaldsonMTo Err is Human: Building a Safer Health SystemWashington (DC)National Academy Press2002
- Fineout-OverholtEMelnykBMSchultzATransforming health care from the inside out: advancing evidence-based practice in the 21st centuryJ Prof Nurs200521633534416311228
- DavisDEvansMJadadAThe case for knowledge translation: shortening the journey from evidence to effectBMJ20033277405333512842955
- MadonTHofmanKJKupferLGlassRIPublic health. Implementation scienceScience20073181728172918079386
- McGlynnEAAschSMAdamsJThe quality of health care delivered to adults in the United StatesN Engl J Med2003348262635264512826639
- MajumdarSRMcAlisterFAFurbergCDFrom knowledge to practice in chronic cardiovascular disease: a long and winding roadJ Am Coll Cardiol200443101738174215145092
- GrahamIDLoganJHarrisonMBLost in knowledge translation: time for a map?J Contin Educ Health Prof2006261132416557505
- SudsawadPKnowledge Translation: Introduction to Models, Strategies and MeasuresAustinSouthwest Educational Development Laboratory, National Center for the Dissemination of Disability Research2007 Available from: http://www.ktdrr.org/ktlibrary/articles_pubs/ktmodels/index.htmlAccessed April 11, 2012
- StrausSETetroeJMGrahamIDKnowledge translation is the use of knowledge in health care decision makingJ Clin Epidemiol201164161019926445
- StrausSETetroeJGrahamIDefining knowledge translationCMAJ20091813–416516819620273
- About knowledge translation and commercialization [webpage on the internet]OttawaCanadian Institutes of Health Research updated5152013 Available from: http://www.cihr-irsc.gc.ca/e/29418.htmlAccessed February 16, 2013
- World Health OrganizationKnowledge Translation on Aging and Health: A framework for policy and development2012http://www.who.int/ageing/publications/knowledge_translation_en.pdfAccessed April 14, 2013
- WyszewianskiLGreenLAStrategies for changing clinicians’ practice patterns: a new perspectiveJ Fam Pract200049546146410836780
- GreenLAGorenfloDWWyszewianskiLMichigan Consortium for Family Practice ResearchValidating an instrument for selecting interventions to change physician practice patternsJ Fam Pract2002511193894212485547
- HadoudaSLarouiHRLemayAPractice style traits of student occupational therapists and physical therapistsCan J Occup Ther20097629810619456088
- Korner-BitenskyNMenon-NairAThomasABoutinEArafahAMPractice style traits: do they help explain practice behaviours of stroke rehabilitation professionals?J Rehabil Med200739968569217999005
- BallLSetting the scene for the paramedic in primary care: a review of the literatureEmerg Med J2005221289690016299210
- SnooksHEvansAWellsBWhat are the highest priorities for research in emergency prehospital care?Emerge Med J2009268549550
- BighamBLAufderheideTPDavisDPKnowledge translation in emergency medical services: a qualitative survey of barriers to guideline implementationResuscitation201081783684020398994
- BighamBLDaintyKNScalesDCMorrisonLJBrooksSCPredictors of adopting therapeutic hypothermia for post-cardiac arrest patients among Canadian emergency and critical care physiciansResuscitation2010811202419913981
- KennedyJGreenRSStenstromRCAEP Critical Care CommitteeThe use of induced hypothermia after cardiac arrest: a survey of Canadian emergency physiciansCJEM200810212513018371250
- LaRosaJCHeJVupputuriSEffect of statins on risk of coronary diseaseJAMA1999282242340234610612322