Instructional improvement and student engagement in post-secondary engineering courses: the complexity underlying small effect sizes

References

• Astin, A. W. (1993). What matters in college? Four critical years revisited. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Berliner, D. C. (2006). Educational psychology: Searching for essence throughout a century of influence. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (2nd ed., pp. 3–27). Mahwah, NJ: Erlbaum.
   Google Scholar
• Blumenfeld, P. C., Kempler, T. M., & Krajcik, J. S. (2004). Motivation and cognitive engagement in learning environments. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 475–488). New York, NY: Cambridge University Press.
   Google Scholar
• Boos, D. D. (2003). Introduction to the bootstrap world. Statistical Science, 18, 168–174.10.1214/ss/1063994971
   Web of Science ®Google Scholar
• Borrego, M., Culter, S., Prince, M., Henderson, C., & Froyd, J. E. (2013). Fidelity of implementation of research-based instructional strategies (RBIS) in engineering science courses. Journal of Engineering Education, 102, 294–425.
   Web of Science ®Google Scholar
• Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.). (1999). How people learn: Brain, mind, experience, and school. Washington, DC: National Academy Press.
   Google Scholar
• Bruun, J., & Brewe, E. (2013). Talking and learning physics: Predicting future grades from network measures and force concept inventory pretest scores. Physical Review Special Topics – Physics Education Research, 9(2), 1–13.
   Google Scholar
• Budd, D. A., van der Hoeven Kraft, K. J., Knight, C., Wirth, K. R., McConnell, D., Bykerk-Kauffman, A., & Stempien, J. A. (2010, November). How much non-traditional teaching does it take to dramatically improve learning gains in introductory physical geology? Geological Society of America Abstracts with Programs, 42, 584.
   Google Scholar
• Budd, D. A., van der Hoeven Kraft, K. J., McConnell, D. A., & Vislova, T. (2013). Characterizing teaching in introductory geology courses: A direct measure of classroom practices. Journal of Geoscience Education, 61, 461–475.
   Google Scholar
• Caldwell, J. E. (2007). Clickers in the large classroom: Current research and best-practice tips. Cell Biology Education, 6, 9–20.10.1187/cbe.06-12-0205
   Google Scholar
• Carini, R. M., Kuh, G. D., & Klein, S. P. (2006). Student engagement and student learning: Testing the linkages. Research in Higher Education, 47(1), 1–32.10.1007/s11162-005-8150-9
   Web of Science ®Google Scholar
• Chi, M. T. H. (2009). Active-constructive-interactive: A conceptual framework for differentiating learning activities. Topics in Cognitive Science, 1, 73–105.10.1111/tops.2009.1.issue-1
   PubMed Web of Science ®Google Scholar
• Chinn, C. A. (2006). The microgenetic method: Current work and extensions to classrooms. In J. L. Green, G. Camilli, & P. B. Elmore (Eds.), Handbook of complementary methods in education research (pp. 439–456). Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Corbin, J., & Strauss, A. (2008). Basics of qualitative research. Thousand Oaks, CA: Sage.
   Google Scholar
• Corno, L., & Mandinach, E. B. (2004). What we have learned about student engagement in the past twenty years. Big Theories Revisited, 4, 299–328.
   Google Scholar
• Eddy, S. L., & Hogan, K. A. (2014). Getting under the hood: How and for whom does increasing course structure work? CBE-Life Sciences Education, 13, 453–468.
   PubMed Web of Science ®Google Scholar
• Evans, Jonathan St. B. T. (2008). Dual-processing accounts of reasoning, judgment, and social cognition. Annual Review of Psychology, 59, 255–278.10.1146/annurev.psych.59.103006.093629
   PubMed Web of Science ®Google Scholar
• Felder, R. M., & Brent, R. (2009). Active learning: An introduction. ASQ Higher Education Brief, 2(4), 1–5.
   Google Scholar
• Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74, 59–109.10.3102/00346543074001059
   Web of Science ®Google Scholar
• Fredricks, J., McColskey, W., Meli, J., Mordica, J., Montrosse, B., & Mooney, K. (2011). Measuring student engagement in upper elementary through high school: A description of 21 instruments. Issues & Answers ( REL 2011-No. 098). Regional Educational Laboratory Southeast.
   Google Scholar
• Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111, 8410–8415.10.1073/pnas.1319030111
   PubMed Web of Science ®Google Scholar
• Gagné, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of instructional design (4th ed.). Forth Worth, TX: Harcourt Brace Jovanovich College.
   Google Scholar
• Gasiewski, J. A., Eagan, M. K., Garcia, G. A., Hurtado, S., & Chang, M. J. (2012). From gatekeeping to engagement: A multicontextual, mixed method study of student academic engagement in introductory stem courses. Research in Higher Education, 53, 229–261.10.1007/s11162-011-9247-y
   PubMed Web of Science ®Google Scholar
• Gibbs, G. R. (2007). Analyzing qualitative data. Thousand Oaks, CA: Sage.10.4135/9781849208574
   Google Scholar
• Gravetter, F. J., & Wallnau, L. B. (2009). Statistics for the behavioral sciences. Belmont, CA: Cengage Learning.
   Google Scholar
• Greene, B. A. (2015). Measuring cognitive engagement with self-report scales: Reflections from over 20 years of research. Educational Psychologist, 50, 14–30.10.1080/00461520.2014.989230
   Web of Science ®Google Scholar
• Grunspan, D. Z., Wiggins, B. L., & Goodreau, S. M. (2014). Understanding classrooms through social network analysis: A primer for social network analysis in education research. CBE-Life Science Education, 13, 167–178.
   PubMed Web of Science ®Google Scholar
• Henderson, C., Beach, A., & Finkelstein, N. (2011). Facilitating change in undergraduate STEM instructional practices: An analytic review of the literature. Journal of Research in Science Teaching, 48, 952–984.10.1002/tea.v48.8
   Web of Science ®Google Scholar
• Henderson, C., Finkelstein, N., & Beach, A. (2010). Beyond dissemination in college science teaching: An introduction to four core change strategies. Journal of College Science Teaching, 39, 18–25.
   Google Scholar
• Hilpert, J. C., Husman, J., Stump, G. S., Kim, W., Chung, W. T., & Duggan, M. A. (2012). Examining students’ future time perspective: Pathways to knowledge building1. Japanese Psychological Research, 54, 229–240.
   Web of Science ®Google Scholar
• Hilpert, J., & Holliday, R. (2015, June). Using Havel-Hakimi to graph classroom networks. Proceedings of the American Society of Engineering Educators, Vol. 26, Seattle, WA, 1666.1–1666.7
   Google Scholar
• Hilpert J., & Husman, J. (2015). A group-level framework for emergent properties of interactive learning. Proceedings of the American Society of Engineering Educators, Vol. 26, Seattle, WA, 50.1–50.14.
   Google Scholar
• Johnson, D., Johnson, R., & Smith, K. (1998). Cooperative learning returns to college what evidence is there that it works? Change: The Magazine of Higher Learning, 30, 26–35.10.1080/00091389809602629
   Google Scholar
• Knight, J. K., & Wood, W. B. (2005). Teaching more by lecturing less. Cell Biology Education, 4, 298–310.10.1187/05-06-0082
   PubMedGoogle Scholar
• Kuh, G. D. (2001). The national survey of student engagement: Conceptual framework and overview of psychometric properties (pp. 1–26). Bloomington: Indiana University Center for Postsecondary Research, .
   Google Scholar
• Kuh, G. D., Nelson Laird, T. F., & Umbach, P. D. (2004). Aligning faculty activities and student behavior: Realizing the promise of greater expectations. Liberal Education, 40, 24–31.
   Google Scholar
• Kuh, G. D., Pace, C. R., & Vesper, N. (1997). The development of process indicators to estimate student gains associated with good practices in undergraduate education. Research in Higher Education, 38, 435–454.10.1023/A:1024962526492
   Web of Science ®Google Scholar
• Lawson, A., Benford, R., Bloom, I., Carlson, M., Falconer, K., Hestenes, D., & Wyckoff, S. (2002). Evaluating college science and mathematics instruction. Journal of College Science Teaching, 31, 388–393.
   Google Scholar
• Lawson, M. A., & Lawson, H. A. (2013). New conceptual frameworks for student engagement research, policy, and practice. Review of Educational Research, 83, 432–479.10.3102/0034654313480891
   Web of Science ®Google Scholar
• MacKinnon, J. G. (2009). Bootstrap hypothesis testing. In D. Belsley & E. Kontoghiorghes (Eds.), Handbook of computational econometrics (pp. 183–213). Chichester: Wiley.10.1002/9780470748916
   Google Scholar
• Marchand, G. C., & Gutierrez, A. P. (2016). Processes involving perceived instructional support, task value, and engagement in graduate education. The Journal of Experimental Education, 1–20.10.1080/00220973.2015.1107522
   Web of Science ®Google Scholar
• Marchand, G. C., & Sanders, K. (2012). Being the new kid: Implications of within-year academic transitions for motivational development in school. Transitions Across Schools and Cultures, 17, 109–145.10.1108/ama
   Google Scholar
• Marchand, G. C., & Skinner, E. (2007). Motivational dynamics of children's academic help-seeking and concealment. Journal of Educational Psychology, 99, 65–82.10.1037/0022-0663.99.1.65
   Web of Science ®Google Scholar
• Mayer, R. E. (2004). Should there be a three-strikes rule against pure discovery learning?. American Psychologist, 59, 14–19.10.1037/0003-066X.59.1.14
   PubMed Web of Science ®Google Scholar
• McKeachie, W., & Svinicki, M. (2010). Teaching tips: Strategies, research, and theory for college and university teachers (13th ed.). Belmont, CA: Wadsworth, Cengage Learning.
   Google Scholar
• McKeachie, W., & Svinicki, M. (2014). Teaching tips: Strategies, research, and theory for college and university teachers (14th ed.). Belmont, CA: Wadsworth, Cengage Learning.
   Google Scholar
• National Survey of Student Engagement. (2007). Experiences that matter: Enhancing student learning and success ( Annual Report). Indiana University, Center for Postsecondary Research. Retrieved from http://nsse.iub.edu/NSSE_2007_Annual_Report/docs/withhold/NSSE_2007_Annual_Report.pdf
   Google Scholar
• Nelson, K., Shell, D., Husman, J., Fishman, E., & Soh, L. K. (2015). Motivational and self-regulated learning profiles of students taking a foundational engineering course. Journal of Engineering Education, 104, 74–100.10.1002/jee.20066
   Web of Science ®Google Scholar
• Ohland, M. W., Sheppard, S. D., Lichtenstein, G., Ozgur, E., Chachra, D., & Layton, R. A. (2008). Persistence, engagement, and migration in engineering programs. Journal of Engineering Education, 97, 259–278.10.1002/jee.2008.97.issue-3
   Web of Science ®Google Scholar
• Pascarella, E. T., Seifert, T. A., & Blaich, C. (2010). How effective are the NSSE benchmarks in predicting important educational outcomes? Change: The Magazine of Higher Learning, 42, 16–22.10.1080/00091380903449060
   Google Scholar
• Pentland, A. (2014). Social physics: How good ideas spread – the lessons from a new science. New York, NY: The Penguin Press.
   Google Scholar
• Piburn, M., Sawada, D., Falconer, K., Turley, J. Benford, R., & Bloom, I. (2000). Reformed Teaching Observation Protocol (RTOP). ( ACEPT IN-003). Retrieved from http://modeling.asu.edu/R&E/RTOP_ref_man_IN003.pdf
   Google Scholar
• Prince, M. (2004). Does active learning work? A review of the research. Journal of Engineering Education, 93, 223–231.10.1002/jee.2004.93.issue-3
   Web of Science ®Google Scholar
• Raudenbush, S. W. (1993). Hierarchical linear models as generalizations of certain common experimental design models. In L. Edwards (Ed.), Applied analysis of variance in behavioral science (pp. 459–496). New York, NY: Marcell Decker.
   Google Scholar
• Ryu, S., & Lombardi, D. (2015). Coding classroom interactions for collective and individual engagement. Educational Psychologist, 50, 70–83.10.1080/00461520.2014.1001891
   Web of Science ®Google Scholar
• Sawada, D., Piburn, M., Judson, E., Turley, J., & Falconer, K. (2002). Measuring reform practices in science and mathematics classrooms: The reformed teaching observation protocol. School Science and Mathematics, 102, 245–253.10.1111/ssm.2002.102.issue-6
   Google Scholar
• Sawyer, R. K. (2004a). Improvised lessons: Collaborative discussion in the constructivist classroom. Teaching Education, 15, 189–201.10.1080/1047621042000213610
   Google Scholar
• Sawyer, R. K. (2004b). Creative teaching: Collaborative discussion as disciplined improvisation. Educational Researcher, 33, 12–20.10.3102/0013189X033002012
   Google Scholar
• Seidel, S., & Tanner, K. (2013). What if students revolt? Considering student resistance: Origins, options, and opportunities for investigation. CBE-Life Sciences Education, 12, 586–595.
   PubMed Web of Science ®Google Scholar
• Seymour, E., & Hewitt, N. M. (1997). Talking about leaving: Why undergraduates leave the sciences. Boulder, CO: Westview Press.
   Google Scholar
• Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. New York, NY: Houghton Mifflin Company.
   Google Scholar
• Springer, L., Stanne, M., & Donovan, S. (1999). Effects of small-group learning on undergraduates in science, mathematics, engineering, and technology: A meta-analysis. Review of Educational Research, 69, 21–51.10.3102/00346543069001021
   Web of Science ®Google Scholar
• Stes, A., De Maeyer, S., Gijbels, D., & Van Petegem, P. (2012). Instructional development for teachers in higher education: Effects on students’ perceptions of the teaching–learning environment. British Journal of Educational Psychology, 82, 398–419.10.1111/bjep.2012.82.issue-3
   PubMed Web of Science ®Google Scholar
• Thelen, E., & Smith, L. B. (2006). Dynamic systems theories. In R. M. Lerner & W. Damon (Eds.), Handbook of child psychology: Vol. 1. Theoretical models of human development (pp. 258–312). Hoboken, NJ: Wiley.
   Google Scholar
• Turner, J. C., & Patrick, H. (2008). How does motivation develop and why does it change? Reframing motivation research. Educational Psychologist, 43, 119–131.10.1080/00461520802178441
   Web of Science ®Google Scholar
• Zeilik, M., & Morris, V. J. (2004). The impact of cooperative quizzes in a large introductory astronomy course for non-science majors. Astronomy Education Review, 3, 51–61.10.3847/AER2004006
   Google Scholar