Identifying areas and approaches for improving evaluation processes in environmental education in the United States of America

References

• Aceves-Bueno, E., Adeleye, A. S., Bradley, D., Tyler Brandt, W., Callery, P., Feraud, M., Garner, K. L., Gentry, R., Huang, Y., McCullough, I., Pearlman, I., Sutherland, S. A., Wilkinson, W., Yang, Y., Zink, T., Anderson, S. E., & Tague, C. (2015). Citizen science as an approach for overcoming insufficient monitoring and inadequate stakeholder buy-in in adaptive management: criteria and evidence. Ecosystems, 18(3), 493–506. https://doi.org/10.1007/s10021-015-9842-4
   Web of Science ®Google Scholar
• Acree, J., & Chouinard, J. A. (2020). Exploring use and influence in culturally responsive approaches to evaluation: A review of the empirical literature. American Journal of Evaluation, 41(2), 201–215. https://doi.org/10.1177/1098214019879505
   Web of Science ®Google Scholar
• Anderson, K. C., Stern, M. J., Powell, R. B., Dayer, A. A., & Archibald, T. G. (2022). A culturally responsive evaluation framework and its application in environmental education. Evaluation and Program Planning, 92, 102073.
   PubMed Web of Science ®Google Scholar
• Ardoin, N. M., Bowers, A. W., Roth, N. W., & Holthuis, N. (2018). Environmental education and K-12 student outcomes: A review and analysis of research. The Journal of Environmental Education, 49(1), 1–17. https://doi.org/10.1080/00958964.2017.1366155
   Web of Science ®Google Scholar
• Askew, K., Beverly, M. G., & Jay, M. L. (2012). Aligning collaborative and culturally responsive evaluation approaches. Evaluation and Program Planning, 35(4), 552–557.
   PubMed Web of Science ®Google Scholar
• Ballantyne, R., & Packer, J. (2009). Introducing a fifth pedagogy: Experience‐based strategies for facilitating learning in natural environments. Environmental Education Research, 15(2), 243–262. https://doi.org/10.1080/13504620802711282
   Web of Science ®Google Scholar
• Boyce, A. S., & Chouinard, J. A. (2017). Moving beyond the buzzword: A framework for teaching culturally responsive approaches to evaluation. Canadian Journal of Program Evaluation, 32(2), 266–279. https://doi.org/10.3138/10.3138/cjpe.31132
   Web of Science ®Google Scholar
• Braun, T., Cottrell, R., & Dierkes, P. (2018). Fostering changes in attitude, knowledge and behavior: Demographic variation in environmental education effects. Environmental Education Research, 24(6), 899–920. https://doi.org/10.1080/13504622.2017.1343279
   Web of Science ®Google Scholar
• Capwell, E. M., Butterfoss, F., & Francisco, V. T. (2000). Why evaluate? Health Promotion Practice, 1(1), 15–20. https://doi.org/10.1177/152483990000100103
   Google Scholar
• Carleton-Hug, A., & Hug, J. W. (2010). Challenges and opportunities for evaluating environmental education programs. Evaluation and Program Planning, 33(2), 159–164.
   PubMed Web of Science ®Google Scholar
• Cordie, A. M. (2009). The development, implementation, evaluation, and revision of an online course entitled making environmental education relevant for culturally diverse audiences (Doctoral dissertation). University of Wisconsin-Stevens Point.
   Google Scholar
• Dale, R., Powell, R. B., Stern, M. J., & Garst, B. (2020). Influence of the natural setting on environmental education outcomes. Environmental Education Research, 26(5), 613–631. https://doi.org/10.1080/13504622.2020.1738346
   Web of Science ®Google Scholar
• Davidson, E. J. (2005). Evaluation methodology basics: The nuts and bolts of sound evaluation. Sage.
   Google Scholar
• Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, phone, mail, and mixed-mode surveys: the tailored design method. John Wiley & Sons.
   Google Scholar
• Dismuke, C., & Lindrooth, R. (2006). Ordinary least squares. Methods and Designs for Outcomes Research, 93, 93–104.
   Google Scholar
• Fien, J., Scott, W., & Tilbury, D. (2001). Education and conservation: Lessons from an evaluation. Environmental Education Research, 7(4), 379–395. https://doi.org/10.1080/13504620120081269
   Google Scholar
• Finney, C. (2014). Black faces, white spaces: Reimagining the relationship of African Americans to the great outdoors. The University of North Carolina Press.
   Google Scholar
• Frensley, B. T., Stern, M. J., Powell, R. B., & Sorice, M. G. (2022). Investigating the relationships among students basic psychological needs, engagement, and environmental literacy at a residential environmental education center. The Journal of Environmental Education, 53(4), 186–198. https://doi.org/10.1080/00958964.2022.2081654
   Web of Science ®Google Scholar
• Frensley, T. B., Stern, M. J., & Powell, R. B. (2020). Does student enthusiasm equal learning? The mismatch between observed and self-reported student engagement and environmental literacy outcomes in a residential setting. The Journal of Environmental Education, 51(6), 449–461. https://doi.org/10.1080/00958964.2020.1727404
   Web of Science ®Google Scholar
• Giese, J. L., & Cote, J. A. (2000). Defining consumer satisfaction. Academy of Marketing Science Review, 1(1), 1–22.
   Google Scholar
• Greene, J. C. (2006). Evaluation, democracy, and social change. In I.F. Shaw, J.C. Greene, & M. Mark (Eds.), The Sage handbook of evaluation (pp. 118–140). Sage.
   Google Scholar
• Ham, S. H. (2013). Interpretation: A guide to making a difference on purpose. Fulcrum Publishing.
   Google Scholar
• Heimlich, J. E. (2010). Environmental education evaluation: Reinterpreting education as a strategy for meeting mission. Evaluation and Program Planning, 33(2), 180–185. https://doi.org/10.1016/j.evalprogplan.2009.07.009
   PubMed Web of Science ®Google Scholar
• Keene, M., & Blumstein, D. T. (2010). Environmental education: A time of change, a time for change. Evaluation and Program Planning, 33(2), 201–204. https://doi.org/10.1016/j.evalprogplan.2009.07.014
   PubMed Web of Science ®Google Scholar
• Lee, H., Stern, M. J., & Powell, R. B. (2020). Do pre-visit preparation and post-visit activities improve student outcomes on field trips? Environmental Education Research, 26(7), 989–1007. https://doi.org/10.1080/13504622.2020.1765991
   Web of Science ®Google Scholar
• Linnan, L., & Steckler, A. (2002). Process evaluation for public health interventions and research. Jossey-Bass.
   Google Scholar
• Martilla, J. A., & James, J. C. (1977). Importance-performance analysis. Journal of Marketing, 41(1), 77–79. https://doi.org/10.1177/002224297704100112
   Web of Science ®Google Scholar
• McDuff, M. (2002). Needs assessment for participatory evaluation of environmental education programs. Applied Environmental Education & Communication, 1(1), 25–36. https://doi.org/10.1080/15330150213990
   Google Scholar
• McLean, S. (2013). The whiteness of green: Racialization and environmental education. The Canadian Geographer / Le Géographe Canadien, 57(3), 354–362. https://doi.org/10.1111/cag.12025
   Web of Science ®Google Scholar
• Mertens, D. M., & Wilson, A. T. (2018). Program evaluation theory and practice. Guilford Publications.
   Google Scholar
• Morghan, K. J. R., Sheley, R. L., & Svejcar, T. J. (2006). Successful adaptive management—The integration of research and management. Rangeland Ecology & Management, 59(2), 216–219. https://doi.org/10.2111/05-079R1.1
   Web of Science ®Google Scholar
• Neilson, A. L. (2008). Disrupting privilege, identity, and meaning: A reflective dance of environmental education. Sense Publishers.
   Google Scholar
• Newcomer, K. E., Hatry, H. P., & Wholey, J. S. (2015). Handbook of practical program evaluation (4th ed.). Jossey Bass.
   Google Scholar
• O’Hare, A., Powell, R. B., Stern, M. J., & Bowers, E. P. (2020). Influence of educators’ emotional support behaviors on environmental education student outcomes. Environmental Education Research, 26(11), 1556–1577. https://doi.org/10.1080/13504622.2020.1800593
   Web of Science ®Google Scholar
• Powell, R. B., Stern, M. J., & Ardoin, N. (2006). A sustainable evaluation framework and its application. Applied Environmental Education & Communication, 5(4), 231–241. https://doi.org/10.1080/15330150601059290
   Google Scholar
• SenGupta, S., Hopson, R., & Thompson‐Robinson, M. (2004). Cultural competence in evaluation: An overview. New Directions for Evaluation, 2004(102), 5–19. https://doi.org/10.1002/ev.112
   Google Scholar
• Stern, M. J. (2018). Social science theory for environmental sustainability: A practical guide. Oxford University Press.
   Google Scholar
• Stern, M. J., Powell, R. B., & Ardoin, N. M. (2010). Evaluating a constructivist and culturally responsive approach to environmental education for diverse audiences. The Journal of Environmental Education, 42(2), 109–122. https://doi.org/10.1080/00958961003796849
   Web of Science ®Google Scholar
• Stern, M. J., Powell, R. B., & Hill, D. (2014). Environmental education program evaluation in the new millennium: What do we measure and what have we learned? Environmental Education Research, 20(5), 581–611. https://doi.org/10.1080/13504622.2013.838749
   Web of Science ®Google Scholar
• Stern, M. J., Powell, R. B., & Frensley, B. T. (2022a). Environmental education, age, race, and socioeconomic class: An exploration of differential impacts of field trips on adolescent youth in the United States. Environmental Education Research, 28(2), 197–215. https://doi.org/10.1080/13504622.2021.1990865
   Web of Science ®Google Scholar
• Stern, M. J., Powell, R. B., & Frensley, B. T. (2022b). Interpretation and environmental education research on public lands: Lessons learned and new directions. Journal of Park and Recreation Administration, 40(1), 228–237. https://doi.org/10.18666/JPRA-2021-11003
   Web of Science ®Google Scholar
• Stufflebeam, D. L., & Shinkfield, A. J. (2012). Systematic evaluation: A self-instructional guide to theory and practice. Springer.
   Google Scholar
• West, S., Schultz, L., & Bekessy, S. (2016). Rethinking social barriers to effective adaptive management. Environmental Management, 58(3), 399–416.
   PubMed Web of Science ®Google Scholar