Does student enthusiasm equal learning? The mismatch between observed and self-reported student engagement and environmental literacy outcomes in a residential setting

References

• Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument. Journal of School Psychology, 44(5), 427–445. doi:10.1016/j.jsp.2006.04.002
   Web of Science ®Google Scholar
• Appleton, J. J., & Lawrenz, F. (2011). Student and teacher perspectives across mathematics and science classrooms: The importance of engaging contexts. School Science and Mathematics, 111(4), 143–155. doi:10.1111/j.1949-8594.2011.00072.x
   Google Scholar
• Ardoin, N. M., DiGiano, M., Bundy, J., Chang, S., Holthuis, N., & O’Connor, K. (2014). Using digital photography and journaling in evaluation of field-based environmental education programs. Studies in Educational Evaluation, 41, 68–76. doi:10.1016/j.stueduc.2013.09.009
   Web of Science ®Google Scholar
• Ballantyne, R., Fien, J., & Packer, J. (2001a). Program effectiveness in facilitating intergenerational influence in environmental education: Lessons from the field. The Journal of Environmental Education, 32(4), 8–15. doi:10.1080/00958960109598657
   Google Scholar
• Ballantyne, R., Fien, J., & Packer, J. (2001b). School environmental education programme impacts upon student and family learning: A case study analysis. Environmental Education Research, 7(1), 23–37. doi:10.1080/13504620124123
   Google Scholar
• Ballantyne, R., & Packer, J. (2009). Introducing a fifth pedagogy: Experience based strategies for facilitating learning in natural environments. Environmental Education Research, 15(2), 243–262. doi:10.1080/13504620802711282
   Web of Science ®Google Scholar
• Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein and S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 349–381). San Francisco, CA: Jossey-Bass.
   Google Scholar
• Blumenfeld, P., Modell, J., Bartko, W. T., Secada, W. G., Fredricks, J. A., Friedel, J., & Paris, A. (2005). School engagement of inner-city students during middle childhood. In C. R. Cooper, C. T. G. Coll, W. T. Bartko, H. Davis, and C. Chatman (Eds.), Developmental pathways through middle childhood: Rethinking contexts and diversity as resources (pp. 145–170). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
   Google Scholar
• Boekarts, M., Pintrich, P. R., & Zeidner, M. (Eds.). (2000). Handbook of self-regulation: Theory, research and applications. San Diego, CA: Academic Press.
   Google Scholar
• Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: SAGE.
   Google Scholar
• Carter, P. L. (2006). Straddling boundaries: Identity, culture, and school. Sociology of Education, 79(4), 304–328. doi:10.1177/003804070607900402
   Web of Science ®Google Scholar
• Christenson, S. L., Reschly, A. L., Appleton, J. J., Berman, S., Spanjers, D., & Varro, P. (2008). Best practices in fostering student engagement. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology (5th ed.). Bethesda, MD: National Association of School Psychologists.
   Google Scholar
• Connell, J. P., & Wellborn, J. G. (1991). Competence, autonomy, and relatedness: A motivational analysis of self-system processes. In M. R. Gunnar & L. A. Sroufe (Eds.), Self processes and development (Vol. 23, pp. 43–77). Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar
• Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. doi:10.1037/h0040957
   PubMed Web of Science ®Google Scholar
• DeVellis, R. F. (2003). Scale development: Theory and applications applied social research methods (2nd ed.). Thousand Oaks, CA: SAGE Publishing.
   Google Scholar
• Emmons, K. M. (1997). Perceptions of the environment while exploring the outdoors: A case study in Belize. Environmental Education Research, 3(3), 327–344. doi:10.1080/1350462970030306
   Google Scholar
• Fenichel, M., & Schweingruber, H. A. (2010). Surrounded by science: Learning science in informal environments. Board on Science Education, Center for Education, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.
   Google Scholar
• Flowers, A. A., Carroll, J. P., Green, G. T., & Larson, L. R. (2015). Using art to assess environmental education outcomes. Environmental Education Research, 21(6), 846–864. doi:10.1080/13504622.2014.959473
   Web of Science ®Google Scholar
• Field, A. (2013). Discovering statistics using IBM SPSSs statistics: And sex and drugs and rock ‘n’ roll (4th ed.). Los Angeles: SAGE.
   Google Scholar
• Finn, J. D. (1989). Withdrawing from school. Review of Educational Research, 59(2), 117–142.
   Web of Science ®Google Scholar
• Finn, J. D., & Rock, D. A. (1997). Academic success among students at risk for school failure. Journal of Applied Psychology, 82(2), 221–234.
   PubMed Web of Science ®Google Scholar
• Finn, J. D., & Zimmer, K. S. (2012). Student engagement: What is it? Why does it matter? In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), The handbook of research on student engagement (pp. 97–130). New York, NY: Springer.
   Google Scholar
• Frensley, B. T. (2018). Investigating the links between lesson characteristics, student engagement, and outcomes at a residential environmental education program (PhD Dissertation). Virginia Tech.
   Google Scholar
• Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. doi:10.3102/00346543074001059
   Web of Science ®Google Scholar
• Fredricks, J. A., & McColskey, W. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 763–781). New York, NY: Springer.
   Google Scholar
• Furlong, M. J., & Christenson, S. L. (2008). Engaging students at school with learning: A relevant construct for all students. Psychology in the Schools, 45(5), 365–368. doi:10.1002/pits.20302
   Web of Science ®Google Scholar
• Goldspink, C., & Foster, M. (2013). A conceptual model and set of instruments for measuring student engagement in learning. Cambridge Journal of Education, 43(3), 291–311. doi:10.1080/0305764X.2013.776513
   Web of Science ®Google Scholar
• Grodzinska-Jurczak, M., Bartosiewicz, A., Twardowska, A., & Ballantyne, R. (2003). Evaluating the impact of a school waste education programme upon students’, parents’ and teachers’ environmental knowledge, attitudes and behaviour. International Research in Geographical and Environmental Education, 12(2), 106–122. doi:10.1080/10382040308667521
   Google Scholar
• Heddy, B. C., & Sinatra, G. M. (2013). Transforming misconceptions: Using transformative experience to promote positive affect and conceptual change in students learning about biological evolution. Science Education, 97(5), 723–744.
   Web of Science ®Google Scholar
• Helme, S., & Clarke, D. (2001). Identifying cognitive engagement in the mathematics classroom. Mathematics Education Research Journal, 13(2), 133–153.
   Google Scholar
• Hollweg, K. S., Taylor, J. R., Bybee, R. W., Marcinkowski, T. J., McBeth, W. C., & Zoido, P. (2011). Developing a framework for assessing environmental literacy. Washington, DC: North American Association for Environmental Education.
   Google Scholar
• Hungerford, H. R., Volk, T., Ramsey, J. M., Litherland, R. A., & Peyton, R. B. (2003). Investigating and evaluating environmental issues and actions. Champaign, IL: Stipes Publishing, LLC.
   Google Scholar
• Johnson, M., & Sinatra, G. M. (2012). Use of task-value instructional inductions for facilitating engagement and conceptual change. Contemporary Educational Psychology, 30, 51–63.
   Google Scholar
• Jolliffe, I. T. (1987). Rotation of principal components: some comments. International Journal of Climatology, 7(5), 507–510.
   Google Scholar
• Klem, A. M., & Connell, J. P. (2004). Relationships matter: Linking teacher support to student engagement and achievement. Journal of School Health, 74(7), 262–273. doi:10.1111/j.1746-1561.2004.tb08283.x
   PubMed Web of Science ®Google Scholar
• Kreft, I., & De Leeuw, J. (1998). Introducing multilevel modeling. London: SAGE Ltd.
   Google Scholar
• Lawson, M. A., & Lawson, H. A. (2013). New conceptual frameworks for student engagement research, policy, and practice. Review of Educational Research, 83(3), 432–479. doi:10.3102/0034654313480891
   Web of Science ®Google Scholar
• Lee, O., & Brophy, J. (1996). Motivational patterns observed in sixth-grade science classrooms. Journal of Research in Science Teaching, 33(3), 303–318.
   Web of Science ®Google Scholar
• MacCallum, R. C., Widaman, K. F., Zhang, S. B., & Hong, S. H. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99. doi:10.1037/1082-989X.4.1.84
   Web of Science ®Google Scholar
• McBeth, B., Hungerford, H., Volk, T., & Cifranick, K. (2011). National environmental literacy assessment, phase two: Measuring the effectiveness of North American environmental education programs with respect to the parameters of environmental literacy.
   Google Scholar
• McBride, B. B., Brewer, C. A., Berkowitz, A. R., & Borrie, W. T. (2013). Environmental literacy, ecological literacy, ecoliteracy: What do we mean and how did we get here?Ecosphere, 4(5), art67. doi:10.1890/ES13-00075.1
   Web of Science ®Google Scholar
• National Center for Education Statistics. (2017). Search for public schools. Retrieved from https://nces.ed.gov/ccd/schoolsearch/
   Google Scholar
• National Research Council. (2004). Engaging schools: Fostering high school students’ motivation to learn. Washington, DC: National Academies Press.
   Google Scholar
• National Science Foundation (NSF). (2008). Framework for evaluating impacts of informal science education projects. Retrieved from http://www.informalscience.org/documents/Eval_Framework.pdf
   Google Scholar
• Ogbu, J. U. (1995). Cultural problems in minority education: Their interpretations and consequences—Part one: Theoretical background. The Urban Review, 27(3), 189–205.
   Google Scholar
• Peterson, P. L., Swing, S. R., Stark, K. D., & Waas, G. A. (1984). Students’ cognitions and time on task during mathematics instruction. American Educational Research Journal, 21(3), 487–515.
   Web of Science ®Google Scholar
• Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. doi:10.1037/0021-9010.88.5.879
   PubMed Web of Science ®Google Scholar
• Roehrig, A. D., & Christesen, E. (2010). Development and use of a tool for evaluating teacher effectiveness in grades K-12. In V. J. Shute & B. J. Becker (Eds.), Innovative assessment for the 21st century. New York, NY: Springer
   Google Scholar
• Schumacker, R. E., & Lomax, R. G. (2004). A beginner’s guide to structural equation modeling. New Jersey: Lawrence Erlbaum Associates.
   Google Scholar
• Shapiro, E. S. (n.d.). Conducting systematic behavioral observations in schools: Using the behavioral observation of students in schools (BOSS) app for iphone and android [PowerPoint slides]. Retrieved from http://images.pearsonclinical.com/images/Assets/BOSS/BOSS-Webinar-Handout-10-2013.pdf
   Google Scholar
• Shernoff, D. J., Csikszentmihalyi, M., Schneider, B., & Shernoff, E. S. (2003). Student engagement in high school classrooms from the perspective of flow theory. School Psychology Quarterly, 18(2), 158–176. doi:10.1521/scpq.18.2.158.21860
   Web of Science ®Google Scholar
• Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015). The challenges of defining and measuring student engagement in science. Educational Psychologist, 50(1), 1–13.
   Web of Science ®Google Scholar
• Skibins, J. C., Powell, R. B., & Stern, M. J. (2012). Exploring empirical support for interpretations best practices. Journal of Interpretation Research, 17(1), 25–44.
   Google Scholar
• Skinner, E. A., & Belmont, M. J. (1993). Motivation in the classroom: Reciprocal effect of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85(4), 571–581. doi:10.1037/0022-0663.85.4.571
   Web of Science ®Google Scholar
• Skinner, E. A., Furrer, C., Marchand, G., & Kindermann, T. (2008). Engagement and disaffection in the classroom: Part of a larger motivational dynamic?. Journal of Educational Psychology, 100(4), 765–781. doi:10.1037/a0012840
   Web of Science ®Google Scholar
• Skinner, E. A., Kindermann, T. A., Connell, J. P., & Wellborn, J. G. (2009). Engagement and disaffection as organizational constructs in the dynamics of motivational development. In K. R. Wentzel & A. Wigfield (Eds.), Handbook of motivation at school (pp. 223–245). New York & London: Routledge.
   Google Scholar
• Stern, M. J., & Powell, R. B. (2013). What leads to better visitor outcomes in live interpretation?Journal of Interpretation Research, 18(2), 9–44.
   Google Scholar
• Stern, M. J., Powell, R. B., & Ardoin, N. M. (2010). Evaluating a constructivist and culturally responsive approach to environmental education for diverse audiences. The Journal of Environmental Education, 42(2), 109–122. doi:10.1080/00958961003796849
   Web of Science ®Google Scholar
• Stoddart, T., Abrams, R., Gasper, E., & Canaday, D. (2000). Concept maps as assessment in science inquiry learning-a report of methodology. International Journal of Science Education, 22(12), 1221–1246. doi:10.1080/095006900750036235
   Web of Science ®Google Scholar
• Szczytko, R., Stevenson, K., Peterson, M. N., Nietfeld, J., & Strnad, R. L. (2019). Development and validation of the environmental literacy instrument for adolescents. Environmental Education Research, 25(2), 193–210.
   Web of Science ®Google Scholar
• Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Needham Heights, MA: Allyn & Bacon.
   Google Scholar
• Turner, J. C. (1995). The influence of classroom contexts on young children’s motivation for literacy. Reading Research Quarterly, 30(3), 410–441. doi:10.2307/747624
   Web of Science ®Google Scholar
• Turner, J. C., & Meyer, D. K. (2000). Studying and understanding the instructional context of classroom: Using our past to forge our future. Educational Psychologist, 35(2), 69–85. doi:10.1207/S15326985EP3502_2
   Web of Science ®Google Scholar
• Trowler, V. (2010). Student engagement literature review. Retrieved from https://www.heacademy.ac.uk/sites/default/files/studentengagementliteraturereview_1.pdf
   Google Scholar
• Tyler, R., & Osborne, J. (2012). Student attitudes and aspirations towards science. In B. J. Fraser, K. Tobin, & C. J. McRobbie (Eds.), Second international handbook of science education (pp. 597–625). New York, NY: Springer International.
   Google Scholar
• Wong, H. K., & Wong, R. T. (2005). The first days of school: How to be an effective teacher. Mountain View, CA: H. K. Wong Publications.
   Google Scholar
• Wurdinger, S. D. (2005). Using experiential learning in the classroom. Lanham: Scarecrow Education.
   Google Scholar