Beyond synthesis: augmenting systematic review procedures with practical principles to optimise impact and uptake in educational policy and practice

References

• Arksey, H., and L. O'Malley. 2005. “Scoping Studies: Towards a Methodological Framework.” International Journal of Social Research Methodology 8 (1): 19–32. doi:10.1080/1364557032000119616.
   Google Scholar
• Armijo-Olivo, S., C. R. Stiles, N. A. Hagen, P. D. Biondo, and G. G. Cummings. 2012. “Assessment of Study Quality for Systematic Reviews: A Comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: Methodological Research.” Journal of Evaluation in Clinical Practice 18 (1): 12–18. doi:10.1111/j.1365-2753.2010.01516.x.
   PubMed Web of Science ®Google Scholar
• Azer, S. A. 2015. “The Top-cited Articles in Medical Education: A Bibliometric Analysis.” Academic Medicine 90 (8). Advance online publication. doi:0.1097/ACM.0000000000000780.
   PubMed Web of Science ®Google Scholar
• Bartunek, J. M., and S. L. Rynes. 2014. “Academics and Practitioners Are Alike and Unalike: The Paradoxes of Academic-Practitioner Relationships.” Journal of Management 40 (5): 1181–1201. doi: 10.1177/0149206314529160
   Web of Science ®Google Scholar
• Bastow, Simon, Patrick Dunleavy, and Jane Tinkler. 2014. The Impact of the Social Sciences: How Academics and Their Research Make a Difference. London: Sage.
   Google Scholar
• Biesta, G. J. J. 2010. “Why ‘What Works’ Still Won't Work: From Evidence-Based Education to Value-Based Education.” Studies in Philosophy and Education 29: 491–503. doi:10.1007/s11217-010-9191-x.
   Web of Science ®Google Scholar
• Cabinet Office. 2014. What Works? Evidence for Decision Makers. London: Cabinet Office. Accessed June 3. https://www.gov.uk/government/publications/what-works-evidence-for-decision-makers.
   Google Scholar
• Cochrane Collaboration. 2015. Our Vision, Mission and Principles. Accessed June 23. http://www.cochrane.org/about-us/our-vision-mission-and-principles.
   Google Scholar
• Cook, D. A. 2012. “If you Teach Them, They Will Learn: Why Medical Education Needs Comparative Effectiveness Research.” Advances in Health Sciences Education 17: 305–310. doi:10.1007/s10459-012-9381-0.
   PubMed Web of Science ®Google Scholar
• Cook, D. A., A. J. Levinson, S. Garside, D. M. Dupras, P. J. Erwin, and V. M. Montori. 2008. “Internet-based Learning in the Health Professions: A Meta-analysis.” Journal of the American Medical Association 300: 1181–1196. doi:10.1001/jama.300.10.1181.
   PubMed Web of Science ®Google Scholar
• Cottrell, E., E. Whitlock, E. Kato, S. Uhl, S. Belinson, C. Chang, and T. Hoomans et al. 2014. Defining the Benefits of Stakeholder Engagement in Systematic Reviews. AHRQ Publication No. 14-EHC006-EF.: Agency for Healthcare Research and Quality. Accessed June 23. www.effectivehealthcare.ahrq.gov/reports/final.cfm.
   Google Scholar
• David, M. E. 2008. “Research Quality Assessment and the Metrication of the Social Sciences.” European Political Science 7: 52–63. doi:10.1057/palgrave.eps.2210176.
   Web of Science ®Google Scholar
• Davies, H., S. Nutley, and I. Walter. 2005. Assessing the Impact of Social Science Research:Conceptual, Methodological and Practical Issues. ESRC Symposium on Assessing Non-Academic Impact of Research. London: ESRC.
   Google Scholar
• Engeström, Y., and A. Sannino. 2010. “Studies of Expansive Learning: Foundations, Findings and Future Challenges.” Educational Research Review 5 (1): 1–24. doi:10.1016/j.edurev.2009.12.002.
   Web of Science ®Google Scholar
• Gabbay, J., and A. Le May. 2011. Practice-based Evidence for Healthcare: Clinical Mindlines. Abingdon: Routledge.
   Google Scholar
• Giluk, T. L., and S. L. Rynes. 2012. “Research Findings Practitioners Resist: Lessons for Management Academics from Evidence-based Medicine.” In The Oxford Handbook of Evidence-Based Management, edited by Denise Rousseau, 130–164. Oxford: Oxford University Press.
   Google Scholar
• Gordon, M., and T. Gibbs. 2014. “Stories Statement: Publication Standards for Healthcare Education Evidence Synthesis.” BMC Medicine 12 (143). doi:10.1186/s12916-014-0143-0.
   Web of Science ®Google Scholar
• Grimshaw, J. M., M. P. Eccles, J. N. Lavis, S. J. Hill, and J. E. Squires. 2012. “Knowledge Translation of Research Findings.” Implementation Science 7: 50. doi:10.1186/1748-5908-7-50.
   PubMed Web of Science ®Google Scholar
• Hammersley, M. 2005. “The myth of research-based practice: The critical case of educational inquiry.” International Journal of Social Research Methodology 8 (4): 317–330. doi:10.1080/1364557042000232844.
   Google Scholar
• Hammersley, M. 2013. The Myth of Research-based Policy and Practice. London: Sage.
   Google Scholar
• Harden, R. M., J. Grant, G. Buckley, and I. R. Hart. 1999. “BEME Guide No 1: Best Evidence Medical Education.” Medical Teacher 21 (6): 597–598. doi: 10.1080/01421599979059
   PubMedGoogle Scholar
• Hattie, J. 2015. What Doesn't Work in Education: The Politics of Distraction. London: Pearson.
   Google Scholar
• Issenberg, S. B., W. C. Mcgaghie, E. R. Petrusa, D. L. Gordon, and R. J. Scalese. 2005. “Features and Uses of High-fidelity Medical Simulations that Lead to Effective Learning: A BEME Systematic Review.” Medical Teacher 27 (1): 10–28. doi:10.1080/01421590500046924.
   PubMed Web of Science ®Google Scholar
• Kastner, M., A. C. Tricco, C. Soobiah, E. Lillie, L. Perrier, T. Horsley, V. Welch, E. Cogo, J. Antony, and S. E. Straus. 2012. “What is the Most Appropriate Knowledge Synthesis Method to Conduct a Review? Protocol for a Scoping Review.” BMC Medical Research Methodology 12 (114). doi:10.1186/1471-2288-12-114.
   PubMed Web of Science ®Google Scholar
• Kirkpatrick, D. 2007. The Four Levels of Evaluation: Measurement and Evaluation. Alexandria, VA: American Society for Training and Development.
   Google Scholar
• Kolb, D. 1984. Experiential Learning: Experience as the Source of Learning and Development. Englewood Cliffs, NJ: Prentice Hall.
   Google Scholar
• Liberati, A., D. G. Altman, J. Tetzlaff, C. Mulrow, P. C. Gøtzsche, J. P. Ioannidis, M. Clarke, P. J. Devereaux, J. Kleijnen, and D. Moher. 2009. “The PRISMA Statement for Reporting Systematic Reviews and Meta-analyses of Studies that Evaluate Healthcare Interventions: Explanation and Elaboration.” British Medical Journal 339: b2700. doi:10.1136/bmj.b2700.
   PubMed Web of Science ®Google Scholar
• Maclure, M. 2005. “Clarity Bordering on Stupidity: Where's the Quality in Systematic Review?” Journal of Education Policy 20 (4): 393–416. doi:10.1080/02680930500131801.
   Web of Science ®Google Scholar
• Martin, B. R. 2011. “The Research Excellence Framework and the ‘Impact Agenda’: Are we Creating a Frankenstein Monster?” Research Evaluation 20 (3): 247–254. doi: 10.3152/095820211X13118583635693
   Web of Science ®Google Scholar
• McCormack, B. 2011. “Engaged Scholarship and Research Impact: Integrating the Doing and Using of Research in Practice.” Journal of Research in Nursing 16 (2): 111–127. doi:10.1177/1744987110393419.
   Google Scholar
• McGaghie, W. C., S. B. Issenberg, E. R. Cohen, J. H. Barsuk, and D. B. Wayne. 2011. “Does Simulation-based Medical Education with Deliberate Practice Yield Better Results than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence.” Academic Medicine 86 (6): 706–711. doi:10.1097/ACM.0b013e318217e119.
   PubMed Web of Science ®Google Scholar
• Micieli, A. M. M. I., J. R. Frank, and A. Jalali. 2015. “A Medical Educator's Guide to #MedEd.” Academic Medicine 90 (8). doi:10.1097/ACM.0000000000000776.
   PubMedGoogle Scholar
• Milat, A. J., A. E. Bauman, and S. Redman. 2015. “A Narrative Review of Research Impact Assessment Models and Methods.” Health Research Policy and Systems 13: 646. doi:10.1186/s12961-015-0003-1.
   Web of Science ®Google Scholar
• Passi, V., S. Johnson, E. Peile, S. Wright, F. Hafferty, and N. Johnson. 2013. “Doctor Role Modelling in Medical Education: BEME Guide No.27.” Medical Teacher 35 (9): e1422–e1436. doi:10.3109/0142159X.2013.806982.
   PubMed Web of Science ®Google Scholar
• Pawson, R. 2006. Evidence-based Policy: A Realist Perspective. London: Sage.
   Google Scholar
• Pelletier, S. G. 2015. Use of Simulation Expands in Medical Education. Association of American Medical Colleges Reporter – February 2015. Accessed June 23. https://www.aamc.org/newsroom/reporter/february2015/426092/simulation.html.
   Google Scholar
• Petticrew, M. 2003. “Why Certain Systematic Reviews Reach Uncertain Conclusion.” British Medical Journal 326: 756–758. doi:10.1136/bmj.326.7392.756.
   PubMed Web of Science ®Google Scholar
• Research Councils UK. 2014. Pathways to Impact. Accessed June 19. http://www.rcuk.ac.uk/innovation/impacts/.
   Google Scholar
• Research Excellence Framework. 2011. Assessment Framework and Guidance on Submissions. Accessed July 12. http://www.ref.ac.uk/media/ref/content/pub/assessmentframeworkandguidanceonsubmissions/GOS%20including%20addendum.pdf.
   Google Scholar
• Research Excellence Framework. 2012. Panel Criteria and Working Methods. Accessed July 12. http://www.ref.ac.uk/media/ref/content/pub/panelcriteriaandworkingmethods/01_12.pdf.
   Google Scholar
• Rubin, A., and J. Bellamy. 2012. Practitioner's Guide to Using Research for Evidence-based Practice. Hoboken, NJ: Wiley.
   Google Scholar
• Sayer, D. 2015. Why the £246m Tab for the REF is Over Three Times as Much as the RAE (it's not Just Because of Impact). Maximising the Impact of Academic Research – the Impact Blog. LSE. Accessed October 9. http://blogs.lse.ac.uk/impactofsocialsciences/2015/08/03/why-did-the-2014-ref-cost-three-times-as-much-as-the-2008-rae-hint-its-not-just-because-of-impact/#author
   Google Scholar
• Schön, D. 1983. The Reflective Practitioner: How Professionals Think in Action. London: Temple Smith.
   Google Scholar
• Schwandt, T. A. 2014. “On the Mutually Informing Relationship Between Practice and Theory in Evaluation.” American Journal of Evaluation 35 (2): 231–236. doi:10.1177/1098214013503703.
   Web of Science ®Google Scholar
• Stevens, M., K. Liabo, S. Witherspoon, and H. Roberts. 2009. “What do Practitioners Want from Research, What Do Funders Fund and What Needs to be Done to Know More About What Works in the New World of Children's Services?” Evidence and Policy 5 (3): 281–294. doi:10.1332/174426409X463820.
   Google Scholar
• Thistlethwaite, J. E., E. Bartle, A. A. L. Chong, M.-L. Dick, D. King, S. Mahoney, T. Papinczak, and G. Tucker. 2013. “A Review of Longitudinal Community and Hospital Placements in Medical Education: BEME Guide No.26.” Medical Teacher 35 (8): e1340–e1364. doi:10.3109/0142159X.2013.806981.
   PubMed Web of Science ®Google Scholar
• Tong, A., K. Flemming, E. McInnes, S. Oliver, and J. Craig. 2012. “Enhancing Transparency in Reporting the Synthesis of Qualitative Research: ENTREQ.” BMC Medical Research Methodology 12 (181). doi:10.1186/1471-2288-12-181.
   PubMed Web of Science ®Google Scholar
• van de Ven, A. 2007. Engaged Scholarship: A Guide for Organizational and Social Research. Oxford: Oxford University Press.
   Google Scholar
• Wells, P. 2007. “New Labour and Evidence-based Policy-making: 1997–2007.” People, Place and Policy Online 1 (1): 22–29. doi:10.3351/ppp.0001.0001.0004.
   Google Scholar
• Wong, G., T. Greenhalgh, and R. Pawson. 2010. “Internet-based Medical Education: A Realist Review of what Works, for Whom and in What Circumstances.” BMC Medical Education 10 (12). doi:10.1186/1472-6920-10-12.
   Web of Science ®Google Scholar
• Wong, G., T. Greenhalgh, G. Westhorp, J. Buckingham, and R. Pawson. 2013a. “RAMESES Publication Standards: Realist Syntheses.” BMC Medicine 11 (21). doi:10.1186/1741-7015-11-21.
   Web of Science ®Google Scholar
• Wong, G., T. Greenhalgh, G. Westhorp, J. Buckingham and R. Pawson. 2013b. “RAMASES Publication Standards: Meta-narrative Reviews.” BMC Medicine 11 (20). doi:10.1186/1741-7015-11-20.
   Web of Science ®Google Scholar
• Woolf, K., H. W. W. Potts, and I. C. McManus. 2011. “Ethnicity and Academic Performance in UK Trained Doctors and Medical Students: Systematic Review and Meta-analysis.” British Medical Journal 342 (7803): d901. doi:https://doi.org/10.1136/bmj.d901.
   PubMedGoogle Scholar