Evaluating a novel faculty development program in teaching at a research-intensive university

References

• AAAS (American Association for the Advancement of Science). 2011. Vision and Change in Undergraduate Biology Education: A Call to Action, Final Report. Washington, DC: American Association for the Advancement of Science.
   Google Scholar
• Aguirre, Jr., A. 2000. Women and Minority Faculty in the Academic Workplace: Recruitment, Retention, and Academic Culture. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Ambrose, S. A., M. W. Bridges, M.DiPietro, M. C. Lovett, and M. K. Norman. 2010. How Learning Works: 7 Research-Based Principles for Smart Teaching. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Amundsen, C., and M. Wilson. 2012. “Are We Asking the Right Questions? A Conceptual Review of the Educational Development Literature in Higher Education.” Review of Educational Research 82 (1): 90–126. doi:10.3102/0034654312438409.
   Web of Science ®Google Scholar
• Anderson, L. W., and D. R. Krathwohl. 2001. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. New York: Longman.
   Google Scholar
• Arnold, N. W., E. R. Crawford, and M. Khalifa. 2016. “Psychological Heuristics and Faculty of Color: Racial Battle Fatigue and Tenure/Promotion.” Journal of Higher Education 87 (6): 890–919. doi:10.1353/jhe.2016.0033.
   Web of Science ®Google Scholar
• Arum, R., J. Roska, and A. Cook. 2016. Improving Quality in American Higher Education: Learning Outcomes and Assessments for the 21st Century. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Austin, A. E. 2002. “Preparing the Next Generation of Faculty: Graduate School as Socialization to the Academic Career.” The Journal of Higher Education 73 (1): 94–122. doi:10.1353/jhe.2002.0001.
   Web of Science ®Google Scholar
• Austin, A. E., and R. E. Rice. 1998. “Making Tenure Viable Listening to Early Career Faculty.” American Behavioral Scientist 41 (5): 736–754. doi:10.1177/0002764298041005009.
   Web of Science ®Google Scholar
• Bach, D. J., P. Weiß, K. Inkelas, and K. Riewerts. 2016. “Introducing and Assessing Learning-Focused Course Design at the University of Virginia, USA and at Bielefeld University, Germany.” Die Hochschullehre 2 (November).
   Google Scholar
• Bandura, A. 1997. Self-Efficacy: The Exercise of Control. New York: W.H. Freeman.
   Google Scholar
• Barr, R. B., and J. Tagg. 1995. “From Teaching to Learning – A New Paradigm for Undergraduate Education.” Change: The Magazine of Higher Learning 27 (6): 12–26. doi:10.1080/00091383.1995.10544672.
   Google Scholar
• Bates, D., M. Mächler, B. Bolker, and S. Walker. 2015. “Fitting Linear Mixed-Effects Models Using Lme4.” Journal of Statistical Software 67 (1): 1–48. doi:10.18637/jss.v067.i01.
   Web of Science ®Google Scholar
• Blumberg, P. 2009. Developing Learner-Centered Teaching: A Practical Guide for Faculty. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Blumberg, P. 2015. “How Critical Reflection Benefits Faculty as They Implement Learner-Centered Teaching.” New Directions for Teaching and Learning 2015 (144): 87–97. doi:10.1002/tl.20165.
   Google Scholar
• Boice, R. 1992. “Lessons Learned About Mentoring.” New Directions for Teaching and Learning 1992 (50): 51–61. doi:10.1002/tl.37219925007.
   Google Scholar
• Boice, R. 2000. Advice for New Faculty Members: Nihil Nimus. Needham Heights, MA: Allyn & Bacon.
   Google Scholar
• Bok, D. 2013. Higher Education in America. Princeton, NJ: Princeton University Press.
   Google Scholar
• Brookfield, S. 2017. Becoming a Critically Reflective Teacher. 2nd ed. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Brownell, S. E., and K. D. Tanner. 2012. “Barriers to Faculty Pedagogical Change: Lack of Training, Time, Incentives, and…Tensions with Professional Identity?” CBE–Life Sciences Education 11 (4): 339–346. doi:10.1187/cbe.12-09-0163.
   PubMed Web of Science ®Google Scholar
• Budd, D. A., K. J. van der Hoeven Kraft, D. A. McConnell, and T. Vislova. 2013. “Characterizing Teaching in Introductory Geology Courses: Measuring Classroom Practices.” Journal of Geoscience Education 61 (4): 461–475. doi:10.5408/12-381.1.
   Google Scholar
• Chism, N. 2004. “Using a Framework to Engage Faculty in Instructional Technologies.” Educause Quarterly 2: 39–45.
   Google Scholar
• Chism, N., M. Holley, and C. J. Harris. 2012. “9: Researching the Impact of Educational Development.” To Improve the Academy 31 (1): 129–145. doi:10.1002/j.2334-4822.2012.tb00678.x.
   Google Scholar
• Condon, W., E. R. Iverson, C. A. Manduca, C. Rutz, and G. Willett. 2016. Faculty Development and Student Learning: Assessing the Connections. Bloomington, IN: Indiana University Press.
   Google Scholar
• Connolly, M. R., J. N. Savoy, Y.-G. Lee, and L. B. Hill. 2016. Building a Better Future STEM Faculty: How Doctoral Teaching Programs Can Improve Undergraduate Education. Madison, WI: Wisconsin Center for Education Research, University of Wisconsin–Madison.
   Google Scholar
• Connolly, M. R., and S. B. Millar. 2006. “Using Workshops to Improve Instruction in STEM Courses.” Metropolitan Universities 17 (4): 53–65. https://journals.iupui.edu/index.php/muj/article/view/20288
   Google Scholar
• Cox, M. D. 1995. “The Development of New and Junior Faculty.” In Teaching Improvement Practices: Successful Strategies for Higher Education, edited by W. A. Wright, 283–310. Bolton, MA: Anker.
   Google Scholar
• Cox, M. D. 2004. “Introduction to Faculty Learning Communities.” New Directions for Teaching and Learning 2004 (97): 5–23. doi:10.1002/tl.129.
   Google Scholar
• Derting, T. L., D. Ebert-May, T. P. Henkel, J. Middlemis Maher, B. Arnold, and H. A. Passmore. 2016. “Assessing Faculty Professional Development in STEM Higher Education: Sustainability of Outcomes.” Science Advances 2 (3): 1–10. doi:10.1126/sciadv.1501422.
   Web of Science ®Google Scholar
• Dolinsky, R., and H. McCambly. 2014. “Civic-Minded Practices for LGBTQ Student Success.” Diversity and Democracy 17 (4). https://www.aacu.org/diversitydemocracy/2014/fall/dolinsky-mccambly
   Google Scholar
• Dunlosky, J., K. A. Rawson, E. J. Marsh, M. J. Nathan, and D. T. Willingham. 2013. “Improving Students’ Learning with Effective Learning Techniques: Promising Directions from Cognitive and Educational Psychology.” Psychological Science in the Public Interest 14 (1): 4–58. doi:10.1177/1529100612453266.
   PubMed Web of Science ®Google Scholar
• Dunning, D. 2011. “The Dunning–Kruger Effect.” In Advances in Experimental Social Psychology. Advances in Experimental Social Psychology, Vol. 44, edited by J. M. Olson and M. P. Zanna, 247–296. Cambridge, MA: Academic Press. doi:10.1016/B978-0-12-385522-0.00005-6.
   Google Scholar
• Ebert-May, D., T. L. Derting, J. Hodder, J. L. Momsen, T. M. Long, and S. E. Jardeleza. 2011. “What We Say Is Not What We Do: Effective Evaluation of Faculty Professional Development Programs.” BioScience 61 (7): 550–558. doi:10.1525/bio.2011.61.7.9.
   Web of Science ®Google Scholar
• Eddy, P. L., and J. L. Gaston-Gayles. 2008. “New Faculty on the Block: Issues of Stress and Support.” Journal of Human Behavior in the Social Environment 17 (1/2): 89–106. doi:10.1080/10911350802168878.
   Google Scholar
• Fink, L. D. 2013. Creating Significant Learning Experiences: An Integrated Approach to Designing College Courses. 2nd ed. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Fisher, M., and F. C. Keil. 2016. “The Curse of Expertise: When More Knowledge Leads to Miscalibrated Explanatory Insight.” Cognitive Science 40 (5): 1251–1269. doi:10.1111/cogs.12280.
   PubMed Web of Science ®Google Scholar
• Gibbs, G., and M. Coffey. 2004. “The Impact of Training of University Teachers on Their Teaching Skills, Their Approach to Teaching and the Approach to Learning of Their Students.” Active Learning in Higher Education 5 (1): 87–100. doi:10.1177/1469787404040463.
   Google Scholar
• Good, J. J., J. W. Keeley, S. Leder, S. E. Afful, and J. J. Stiegler-Balfour. 2013. “Supporting Our Junior Faculty: Assessing the Concerns and Needs of Early Career Psychologists.” Teaching of Psychology 40 (4): 340–345. doi:10.1177/0098628313501048.
   Web of Science ®Google Scholar
• Halekoh, U., and S. Højsgaard. 2014. “A Kenward-Roger Approximation and Parametric Bootstrap Methods for Tests in Linear Mixed Models: The R Package Pbkrtest.” Journal of Statistical Software 59 (1): 1–32. doi:10.18637/jss.v059.i09.
   PubMedGoogle Scholar
• Henderson, C., and M. H. Dancy. 2007. “Barriers to the Use of Research-Based Instructional Strategies: The Influence of Both Individual and Situational Characteristics.” Physical Review Special Topics – Physics Education Research 3 (2). doi:10.1103/PhysRevSTPER.3.020102.
   Google Scholar
• Hines, S. R. 2009. “Investigating Faculty Development Program Assessment Practices: What’s Being Done and How Can It Be Improved?” Journal of Faculty Development 23 (3): 5–19.
   Google Scholar
• Hines, S. R. 2011. “How Mature Teaching and Learning Centers Evaluate Their Services.” To Improve the Academy 30 (1): 277–289. doi:10.1002/j.2334-4822.2011.tb00663.x.
   Google Scholar
• Hines, S. R. 2015. “Setting the Groundwork for Quality Faculty Development Evaluation: A Five-Step Approach.” Journal of Faculty Development 29 (1): 5–12. doi:10.1002/j.2334-4822.2011.tb00647.x.
   Google Scholar
• Jones, A. 2008. “Preparing New Faculty Members for Their Teaching Role.” New Directions for Higher Education 2008 (143): 93–100. doi:10.1002/he.317.
   Google Scholar
• Kolomitro, K., and L. M. Anstey. 2017. “A Survey on Evaluation Practices in Teaching and Learning Centres.” International Journal for Academic Development 22 (3): 186–198. doi:10.1080/1360144X.2017.1313162.
   Web of Science ®Google Scholar
• Kreber, C., and P. Brook. 2001. “Impact Evaluation of Educational Development Programmes.” International Journal for Academic Development 6 (2): 96–108. doi:10.1080/13601440110090749.
   Google Scholar
• Kruger, J., and D. Dunning. 1999. “Unskilled and Unaware of It: How Difficulties in Recognizing One’s Own Incompetence Lead to Inflated Self-Assessments.” Journal of Personality and Social Psychology 77 (6): 1121–1134. doi:10.1037/0022-3514.77.6.1121.
   PubMed Web of Science ®Google Scholar
• Levinson-Rose, J., and R. J. Menges. 1981. “Improving College Teaching: A Critical Review of Research.” Review of Educational Research 51 (3): 403–434. doi:10.3102/00346543051003403.
   Web of Science ®Google Scholar
• Lund, T. J., M. Pilarz, J. B. Velasco, D. Chakraverty, K. Rosploch, M. Undersander, and M. Stains. 2015. “The Best of Both Worlds: Building on the COPUS and RTOP Observation Protocols to Easily and Reliably Measure Various Levels of Reformed Instructional Practice.” CBE–Life Sciences Education 14 (2): 1–12. doi:10.1187/cbe.14-10-0168.
   Web of Science ®Google Scholar
• Mathison, S. 2008. “What Is the Difference between Evaluation and Research – And Why Do We Care?” In Fundamental Issues in Evaluation, edited by N. L. Smith and P. R. Brandon, 183–196. New York: Guilford Press.
   Google Scholar
• McBride, L. G., and J. DeCarrico Voegele. 2011. “Reflecting Together about Tenure and Promotion: A Faculty Learning Community Approach.” To Improve the Academy 30 (1): 43–53. doi:10.1002/j.2334-4822.2011.tb00647.x.
   Google Scholar
• Olsen, D., and M. D. Sorcinelli. 1992. “The Pretenure Years: A Longitudinal Perspective.” New Directions for Teaching and Learning 1992 (50): 15–25. doi:10.1002/tl.37219925004.
   Google Scholar
• Palmer, M. S., D. J. Bach, and A. C. Streifer. 2014. “Measuring the Promise: A Learning-Focused Syllabus Rubric.” To Improve the Academy 33 (1): 14–36. doi:10.1002/tia2.20004.
   Google Scholar
• Palmer, M. S., A. C. Streifer, and S. Williams-Duncan. 2016. “Systematic Assessment of a High-Impact Course Design Institute.” To Improve the Academy 35 (2): 339–361. doi:10.1002/tia2.20041.
   Google Scholar
• Paulsen, M. B., and K. A. Feldman. 1995. Taking Teaching Seriously: Meeting the Challenge of Instructional Improvement. ASHE-ERIC Higher Education Report 2, 1995. Washington, DC: Graduate School of Education and Human Development, George Washington University.
   Google Scholar
• R Core Team. 2018. R: A Language and Environment for Statistical Computing. Vienna: Foundation for Statistical Computing.
   Google Scholar
• Rice, R. E., M. D. Sorcinelli, and A. E. Austin. 2000. Heeding New Voices: Academic Careers for a New Generation. New Pathways Working Paper Series. Washington, DC: American Association for Higher Education. http://files.eric.ed.gov/fulltext/ED451740.pdf
   Google Scholar
• Rice, R. E., and M. D. Sorcinelli. 2009. “Can the Tenure Process Be Improved?” In The Questions of Tenure, edited by R. P. Chait, 101–124. Cambridge, MA: Harvard University Press.
   Google Scholar
• Sawada, D., and M. Piburn. 2000. Reformed Teaching Observation Protocol (RTOP): Reference Manual. ACEPT Technical Report IN00-3. Arizona Collaborative for Excellence in the Preparation of Teachers.
   Google Scholar
• Sawada, D., M. D. Piburn, E. Judson, J. Turley, K. Falconer, R. Benford, and I. Bloom. 2002. “Measuring Reform Practices in Science and Mathematics Classrooms: The Reformed Teaching Observation Protocol.” School Science and Mathematics 102 (6): 245–253. doi:10.1111/j.1949-8594.2002.tb17883.x.
   Google Scholar
• Schein, E. H. 1992. Organizational Culture and Leadership. 2nd ed. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Sheldon, O. J., D. Dunning, and D. R. Ames. 2014. “Emotionally Unskilled, Unaware, and Uninterested in Learning More: Reactions to Feedback about Deficits in Emotional Intelligence.” Journal of Applied Psychology 99 (1): 125–137. doi:10.1037/a0034138.
   PubMed Web of Science ®Google Scholar
• Shulman, L. S. 1993. “Forum: Teaching as Community Property.” Change: The Magazine of Higher Learning 25 (6): 6–7. doi:10.1080/00091383.1993.9938465.
   Google Scholar
• Shulman, L. S. 2004. Teaching as Community Property: Essays on Higher Education. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Smith, M. K., F. H. M. Jones, S. L. Gilbert, and C. E. Wieman. 2013. “The Classroom Observation Protocol for Undergraduate STEM (COPUS): A New Instrument to Characterize University STEM Classroom Practices.” CBE–Life Sciences Education 12 (4): 618–627. doi:10.1187/cbe.13-08-0154.
   PubMed Web of Science ®Google Scholar
• Solem, M. N., and K. E. Foote. 2006. “Concerns, Attitudes, and Abilities of Early-Career Geography Faculty.” Journal of Geography in Higher Education 30 (2): 199–234. doi:10.1080/03098260600717299.
   Web of Science ®Google Scholar
• Sorcinelli, M. D. 1994. “Effective Approaches to New Faculty Development.” Journal of Counseling and Development 1992 (50): 474–479. doi:10.1002/j.1556-6676.1994.tb00976.x.
   Google Scholar
• Stains, M., J. Harshman, M. K. Barker, S. V. Chasteen, R. Cole, S. E. DeChenne-Peters, M. K. Eagan, et al. 2018. “Anatomy of STEM Teaching in North American Universities.” Science 359 (6383): 1468–1470. doi:10.1126/science.aap8892.
   PubMed Web of Science ®Google Scholar
• Stes, A., M. Min-Leliveld, D. Gijbels, and P. Van Petegem. 2010. “The Impact of Instructional Development in Higher Education: The State-of-the-Art of the Research.” Educational Research Review 5 (1): 25–49. doi:10.1016/j.edurev.2009.07.001.
   Web of Science ®Google Scholar
• Suskie, L. 2009. Assessing Student Learning: A Common Sense Guide. 2nd ed. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Upcraft, M. L., and J. H. Schuh. 2002. “Assessment vs. Research: Why We Should Care about the Difference.” About Campus 7 (1): 16–20. doi:10.1177/108648220200700104.
   Google Scholar
• Usher, E. L., and F. Pajares. 2008. “Sources of Self-Efficacy in School: Critical Review of the Literature and Future Directions.” Review of Educational Research 78 (4): 751–796. doi:10.3102/0034654308321456.
   Web of Science ®Google Scholar
• Weimer, M. 2013. Learner-Centered Teaching: Five Key Changes to Practice. 2nd ed. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Wenger, E. 1998. Communities of Practice: Learning, Meaning, and Identity. Cambridge: Cambridge University Press.
   Google Scholar
• Wickham, H. 2009. ggplot2: Elegant Graphics for Data Analysis. New York: Springer.
   Google Scholar
• Wiggins, G., and J. McTighe. 2005. Understanding by Design. 2nd ed. Alexandria, VA: Pearson.
   Google Scholar
• Wright, M., C. V. Horii, P. Felten, M. D. Sorcinelli, and M. Kaplan. 2018. “Faculty Development Improves Teaching and Learning.” POD Speaks 2: 1–5. https://podnetwork.org/content/uploads/POD-Speaks-Issue-2_Jan2018-1.pdf
   Google Scholar
• Zull, J. E. 2002. The Art of Changing the Brain: Enriching the Practice of Teaching by Exploring the Biology of Learning. Sterling, VA: Stylus.
   Google Scholar