Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices

References

• Antes, A. L., S. T. Murphy, E. P. Waples, M. D. Mumford, R. P. Brown, S. Connelly, and L. D. Devenport. 2009. A meta-analysis of ethics instruction effectiveness in the sciences. Ethics & Behavior 19:379–402. doi:10.1080/10508420903035380.
   PubMed Web of Science ®Google Scholar
• Antes, A. L., X. Wang, M. D. Mumford, R. P. Brown, S. Connelly, and L. D. Devenport. 2010. Evaluating the effects that existing instruction on responsible conduct of research has on ethical decision making. Academic Medicine 85:519–26. doi:10.1097/ACM.0b013e3181cd1cc5.
   PubMed Web of Science ®Google Scholar
• *Balakrishnan, B., P. H. Er, and P. Visvanathan. 2013. Socio-ethical education in nanotechnology engineering programmes: A case study in Malaysia. Science and Engineering Ethics 19:1341–55. doi:10.1007/s11948-012-9418-z.
   PubMed Web of Science ®Google Scholar
• Brock, M. E., A. Vert, V. Kligyte, E. P. Waples, S. T. Sevier, and M. D. Mumford. 2008. Mental models: An alternative evaluation of a sensemaking approach to ethics instruction. Science and Engineering Ethics 14:449–72. doi:10.1007/s11948-008-9076-3.
   PubMed Web of Science ®Google Scholar
• *Brummel, B. J., C. K. Gunsalus, K. L. Anderson, and M. C. Loui. 2010. Development of role-play scenarios for teaching responsible conduct of research. Science and Engineering Ethics 16:573–89. doi:10.1007/s11948-010-9221-7.
   PubMed Web of Science ®Google Scholar
• *Buff, C. L., and V. Yonkers. 2005. Using student generated codes of conduct in the classroom to reinforce business ethics education. Journal of Business Ethics 61:101–10. doi:10.1007/s10551-005-0273-6.
   Web of Science ®Google Scholar
• *Canary, H. E., J. L. Taylor, J. R. Herkert, K. Ellison, J. M. Wetmore, and C. A. Tarin. 2014. Engaging students in integrated ethics education: A communication in the disciplines study of pedagogy and students’ roles in society. Communication Education 63:83–104. doi:10.1080/03634523.2014.888457.
   Web of Science ®Google Scholar
• Chikudate, N. 2000. A phenomenological approach to inquiring into an ethically bankrupted organization: A case study of a Japanese company. Journal of Business Ethics 28:59–72. doi:10.1023/A:1006266623545.
   Web of Science ®Google Scholar
• Cohen, J. 1960. A coefficient of agreement for nominal scales. Educational Psychological Measurement 20:37–46. doi:10.1177/001316446002000104.
   Web of Science ®Google Scholar
• Creswell, J. W., W. E. Hanson, V. L. C. Plano, and A. Morales. 2007. Qualitative research designs selection and implementation. The Counseling Psychologist 35:236–64. doi:10.1177/0011000006287390.
   Web of Science ®Google Scholar
• *Cummings, M. L., and J. Lo. 2004. Globalizing engineering ethics education through web-based instruction. In Technology and Society, 2004. ISTAS’04. International Symposium on, pp. 92–95. IEEE, June, Worcester, Massachusetts.
   Google Scholar
• *Donaldson, T. M., E. Fistein, and M. Dunn. 2010. Case-based seminars in medical ethics education: How medical students define and discuss moral problems. Journal of Medical Ethics 36:816–20. doi:10.1136/jme.2010.036574.
   PubMed Web of Science ®Google Scholar
• *Eisen, A., and K. P. Parker. 2004. A model for teaching research ethics. Science and Engineering Ethics 10:693–704. doi:10.1007/s11948-004-0047-z.
   PubMed Web of Science ®Google Scholar
• Erlandson, D., E. L. Harris, B. L. Skipper, and D. S. Allen. 1993. Quality criteria for a naturalistic study: Doing naturalistic inquiry. Newbury Park, CA: Sage.
   Google Scholar
• *Fleischmann, K. R., R. W. Robbins, and W. A. Wallace. 2011. Information ethics education for a multicultural world. Journal of Information Systems Education 22:191–201.
   Google Scholar
• *Fryer-Edwards, K., R. M. Arnold, W. Baile, J. A. Tulsky, F. Petracca, and A. Back. 2006. Reflective teaching practices: An approach to teaching communication skills in a small-group setting. Academic Medicine 81:638–44. doi:10.1097/01.ACM.0000232414.43142.45.
   PubMed Web of Science ®Google Scholar
• Golafshani, N. 2003. Understanding reliability and validity in qualitative research. The Qualitative Report 8:597–606.
   Google Scholar
• *Goldie, J., L. Schwartz, and J. Morrison. 2000. A process evaluation of medical ethics education in the first year of a new medical curriculum. Medical Education 34:468–73. doi:10.1046/j.1365-2923.2000.00496.x.
   PubMed Web of Science ®Google Scholar
• *Han, H., and C. Jeong. 2014. Improving epistemological beliefs and moral judgment through an STS-based science ethics education program. Science and Engineering Ethics 20:197–220. doi:10.1007/s11948-013-9429-4.
   PubMed Web of Science ®Google Scholar
• *Hashemian, G., and M. C. Loui. 2010. Can instruction in engineering ethics change students’ feelings about professional responsibility? Science and Engineering Ethics 16:201–15. doi:10.1007/s11948-010-9195-5.
   PubMed Web of Science ®Google Scholar
• *Kerridge, J., G. Kyle, and D. Marks-Maran. 2009. Evaluation of the use of team teaching for delivering sensitive content: A pilot study. Journal of Further and Higher Education 33:93–103. doi:10.1080/03098770902856637.
   Google Scholar
• *Kligyte, V., R. T. Marcy, S. T. Sevier, E. S. Godfrey, and M. D. Mumford. 2008. A qualitative approach to responsible conduct of research (RCR) training development: Identification of metacognitive strategies. Science and Engineering Ethics 14:3–31. doi:10.1007/s11948-007-9035-4.
   PubMed Web of Science ®Google Scholar
• *Kyle, G. 2008. Using anonymized reflection to teach ethics: A pilot study. Nursing Ethics 15:6–16. doi:10.1177/0969733007083931.
   PubMed Web of Science ®Google Scholar
• *Lau, A. 2004. Teaching engineering ethics to first-year college students. Science and Engineering Ethics 10:359–68. doi:10.1007/s11948-004-0032-6.
   PubMed Web of Science ®Google Scholar
• *Malek, J. I., G. Geller, and J. Sugarman. 2000. Talking about cases in bioethics: The effect of an intensive course on health care professionals. Journal of Medical Ethics 26:131–36. doi:10.1136/jme.26.2.131.
   PubMed Web of Science ®Google Scholar
• Mecca, J. T., C. Gibson, V. Giorgini, K. E. Medeiros, M. D. Mumford, and S. Connelly. 2015. Researcher perspectives on conflicts of interest: A qualitative analysis of views from academia. Science and Engineering Ethics 21:843–55. doi:10.1007/s11948-014-9580-6.
   PubMed Web of Science ®Google Scholar
• Medeiros, K., L. L. Watts, T. J. Mulhearn, L. M. Steele, S. Connelly, and M. D. Mumford. 2016. A meta-analytic review of business ethics education from 1988 to 2015. Manuscript submitted for publication.
   Google Scholar
• Mulhearn, T. J., L. M. Steele, L. L. Watts, K. E. Medeiros, M. D. Mumford, and S. Connelly. 2016. Review of instructional approaches in ethics education. Science and Engineering Ethics. doi:10.1007/s11948-016-9803-0.
   PubMed Web of Science ®Google Scholar
• Mumford, M. D., S. Connelly, R. P. Brown, S. T. Murphy, J. H. Hill, A. L. Antes, … L. D. Devenport. 2008. A sensemaking approach to ethics training for scientists: Preliminary evidence of training effectiveness. Ethics & Behavior 18:315–39. doi:10.1080/10508420802487815.
   PubMed Web of Science ®Google Scholar
• Mumford, M. D., L. Steele, and L. L. Watts. 2015. Evaluating ethics education programs: A multilevel approach. Ethics & Behavior 25:37–60. doi:10.1080/10508422.2014.917417.
   Web of Science ®Google Scholar
• Parry, K., M. D. Mumford, I. Bower, and L. L. Watts. 2014. Qualitative and historiometric methods in leadership research: A review of the first 25 years of The Leadership Quarterly. The Leadership Quarterly 25:132–51. doi:10.1016/j.leaqua.2013.11.006.
   Web of Science ®Google Scholar
• *Resnik, D. B. 2005. Using electronic discussion boards to teach responsible conduct of research. Science and Engineering Ethics 11:617–30. doi:10.1007/s11948-005-0029-9.
   PubMed Web of Science ®Google Scholar
• *Roff, S., and P. Preece. 2004. Helping medical students to find their moral compasses: Ethics teaching for second and third year undergraduates. Journal of Medical Ethics 30:487–89. doi:10.1136/jme.2003.003483.
   PubMed Web of Science ®Google Scholar
• *Seiler, S., A. Fischer, and S. A. Voegtli. 2011. Developing moral decision-making competence: A quasi-experimental intervention study in the Swiss armed forces. Ethics & Behavior 21:452–70. doi:10.1080/10508422.2011.622177.
   Web of Science ®Google Scholar
• Shadish, W. R., T. D. Cook, and D. T. Campbell. 2002. Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin and Company.
   Google Scholar
• *Shaw, M. H. (2011). Coaching as a form of instruction and a component of medical ethics education. Dissertation, University of Rochester, Rochester, NY.
   Google Scholar
• Sonenshein, S. 2007. The role of construction, intuition, and justification in responding to ethical issues at work: The sensemaking-intuition model. Academy of Management Review 32:1022–40. doi:10.5465/AMR.2007.26585677.
   Web of Science ®Google Scholar
• Spencer, L., J. Ritchie, J. Lewis, and L. Dillon. 2003. Quality in qualitative evaluation: A framework for assessing research evidence. London, UK: Government Chief Social Researcher’s Office.
   Google Scholar
• Stemler, S. 2001. An overview of content analysis. Practical Assessment, Research & Evaluation 7:137–46.
   Google Scholar
• Strauss, A., and J. Corbin. 1998. Basics of qualitative research, 2nd ed. Newbury Park, CA: Sage.
   Google Scholar
• Taylor, S. J., R. Bogdan, and M. DeVault. 2015. Introduction to qualitative research methods: A guidebook and resource. New York, NY: John Wiley & Sons.
   Google Scholar
• Thiel, C. E., Z. Bagdasarov, L. Harkrider, J. F. Johnson, and M. D. Mumford. 2012. Leader ethical decision-making in organizations: Strategies for sensemaking. Journal of Business Ethics 107:49–64. doi:10.1007/s10551-012-1299-1.
   Web of Science ®Google Scholar
• Thomas, D. R. 2006. A general inductive approach for analyzing qualitative evaluation data. American Journal of Evaluation 27:237–46. doi:10.1177/1098214005283748.
   Web of Science ®Google Scholar
• Tracy, S. J. 2010. Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qualitative Inquiry 16:837–51. doi:10.1177/1077800410383121.
   Web of Science ®Google Scholar
• Tsang, E. W., and K. M. Kwan. 1999. Replication and theory development in organizational science: A critical realist perspective. Academy of Management Review 24:759–80.
   Web of Science ®Google Scholar
• *Van Slyke, J. M. (2007). Police ethics training: Preferred modes of teaching in higher education law enforcement. Dissertation, University of Texas at Austin, Austin, TX.
   Google Scholar
• *Vanlaere, L., M. Timmermann, M. Stevens, and C. Gastmans. 2012. An explorative study of experiences of healthcare providers posing as simulated care receivers in a ‘care-ethical’ lab. Nursing Ethics 19:68–79. doi:10.1177/0969733011412103.
   PubMed Web of Science ®Google Scholar
• *Venglar, M., and M. Theall. 2007. Case-based ethics education in physical therapy. The Journal of Scholarship of Teaching and Learning 7:64–76.
   Google Scholar
• Waples, E. P., A. L. Antes, S. T. Murphy, S. Connelly, and M. D. Mumford. 2009. A meta-analytic investigation of business ethics instruction. Journal of Business Ethics 87:133–51. doi:10.1007/s10551-008-9875-0.
   Web of Science ®Google Scholar
• Watts, L. L., and M. R. Buckley. 2015. A dual-processing model of moral whistleblowing in organizations. Journal of Business Ethics. doi:10.1007/s10551-015-2913-9.
   PubMedGoogle Scholar
• Watts, L. L., K. E. Medeiros, T. J. Mulhearn, L. M. Steele, S. Connelly, and M. D. Mumford. 2016. Are ethics training programs improving? A meta-analytic review of past and present ethics instruction in the sciences. Ethics & Behavior 1–34. doi:10.1080/10508422.2016.1182025.
   Web of Science ®Google Scholar
• Watts, L. L., T. J. Mulhearn, K. E. Medeiros, L. M. Steele, S. Connelly, and M. D. Mumford. In press. Modeling the instructional effectiveness of responsible conduct of research education: A meta-analytic path-analysis. Ethics & Behavior.
   Google Scholar
• Weick, K. E. 1995. Sensemaking in organizations, vol. 3. Newbury Park, CA: Sage.
   Google Scholar