Enhancing environmental educators' evaluation competencies: insights from an examination of the effectiveness of the My Environmental Education Evaluation Resource Assistant (MEERA) website

References

• Arnold , M.E. 2006 . Developing evaluation capacity in extension 4‐H field faculty . American Journal of Evaluation , 27 ( 2 ) : 257 – 69 .
   Web of Science ®Google Scholar
• Bennett , D.B. 1984 . Evaluating environmental education in schools , Paris : Division of Science, Technical and Environmental Education, UNESCO‐UNEP International Environmental Education Programme .
   Google Scholar
• Bennett , C. and Rockwell , K. 1995 . “ Targeting outcomes of programs (TOP): An integrated approach to planning and evaluation ” . Lincoln, NE : University of Nebraska . Unpublished manuscript
   Google Scholar
• Birnbaum , M. 2010 . Interview with Brett Jenks, president and CEO of Rare . Journal of Evaluation and Program Planning , 33 ( 2 ) : 191 – 3 .
   PubMed Web of Science ®Google Scholar
• Brandon , P.R. and Higa , R.A.F. 2004 . An empirical study of building the evaluation capacity of K‐12 site‐managed project personnel . Canadian Journal of Program Evaluation , 19 ( 1 ) : 125 – 42 .
   Google Scholar
• Chelimsky , E. 1997 . “ The coming transformation in evaluation ” . In Evaluation for the 21st century , Edited by: Chelimsky , E. and Shadish , W.R. 1 – 26 . Thousand Oaks, CA : Sage .
   Google Scholar
• Clavijo , K. , Fleming , M.L. , Hoermann , E.F , Toal , S.A. and Johnson , K. 2005 . Evaluation use in nonformal education settings . New Directions for Evaluation , 108 : 47 – 55 .
   Google Scholar
• Compton , D.W. , Glover‐Kudon , R. , Smith , I.E. and Avery , M.E. 2002 . Ongoing capacity building in the American Cancer Society (ACS) 1995–2002 . New Directions for Evaluation , 93 : 47 – 61 .
   Google Scholar
• Cousins , J.B. and Earl , L.M. , eds. 1995 . Participatory evaluation in education: Studies in evaluation use and organizational learning , Washington, DC : Falmer Press .
   Google Scholar
• Cousins , J.B. , Goh , S.C. , Clark , S. and Lee , L.E. 2004 . Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge base . Canadian Journal of Program Evaluation , 19 ( 2 ) : 99 – 141 .
   Google Scholar
• Creswell , J.W. 2009 . Research design: Qualitative, quantitative, and mixed methods approaches. , 3rd ed. , Los Angeles : Sage .
   Google Scholar
• Department of Environment and Conservation . 2004 . Does your project make a difference? A guide to evaluating environmental education projects and programs , Sydney : Department of Environment and Conservation .
   Google Scholar
• Dillard , J. 2006 . “ The evaluation and revision of an online course entitled ‘Applied environmental education program evaluation,’ ” . University of Wisconsin‐Stevens Point . Master's thesis
   Google Scholar
• Ernst , J. , Monroe , M. and Simmons , B. 2009 . Evaluating your environmental education program: A workbook for practitioners , Washington, DC : North American Association for Environmental Education .
   Google Scholar
• Fetterman , D.M. , Kaftarian , S.J. and Wandersman , A. , eds. 1996 . Empowerment evaluation: Knowledge and tools for self‐assessment and accountability , Thousand Oaks, CA : Sage .
   Google Scholar
• Fleming , L. 2009 . Environmental education: Professional development needs and priorities study , Stevens Point, WI : Environmental Education Training Partnership, University of Wisconsin‐Stevens Point .
   Google Scholar
• Fleming , L. and Easton , J. 2010 . Building environmental educators' evaluation capacity through distance education . Evaluation and Program Planning , 33 ( 2 ) : 172 – 7 .
   PubMed Web of Science ®Google Scholar
• Fournier , D.M. 2005 . “ Evaluation ” . In Encyclopedia of evaluation , Edited by: Mathison , S. 139 – 40 . Thousand Oaks, CA : Sage .
   Google Scholar
• Ghere , G. , King , J.A. , Stevhan , L. and Minnema , J. 2006 . A professional development unit for reflecting on program evaluator competencies . American Journal of Evaluation , 27 ( 1 ) : 108 – 23 .
   Web of Science ®Google Scholar
• Hill , L.G. and Betz , D.L. 2005 . Revisiting the retrospective pretest . American Journal of Evaluation , 26 ( 4 ) : 501 – 17 .
   Web of Science ®Google Scholar
• Jacobson , S.K. and McDuff , M.D. 1997 . Success factors and evaluation in conservation education programmes . International Research in Geographical and Environmental Education , 6 ( 3 ) : 204 – 21 .
   Google Scholar
• Jenks , B. , Vaughan , P.W. and Butler , P. 2010 . The evolution of Rare Pride: Using evaluation to drive adaptive management in a biodiversity conservation organization . Journal of Evaluation and Program Planning , 33 ( 2 ) : 186 – 90 .
   PubMed Web of Science ®Google Scholar
• Joint Committee on Standards for Educational Evaluation . 1994 . The program evaluation standards , Thousand Oaks, CA : Sage .
   Google Scholar
• Kiernan , N.E. and Alter , T.R. 2004 . Can a website be used as a vehicle for organizational learning about evaluation? . Journal of Higher Education Outreach and Engagement , 10 ( 1 ) : 121 – 34 .
   Google Scholar
• King , J.A. , Morris , L.L. and Fitz‐Gibbon , C.T. 1987 . How to assess program implementation , Newbury Park, CA : Sage .
   Google Scholar
• Kreis , R. 2007 . “ The impact of an online course on environmental education program evaluation ” . University of Wisconsin‐Stevens Point . Master's thesis
   Google Scholar
• Labin , S.N. 2008 . “ Research synthesis: Toward broad‐based evidence ” . In Fundamental issues in evaluation , Edited by: Smith , L. and Brandon , P.R. 89 – 110 . New York : The Guildford Press .
   Google Scholar
• Lam , T.C.M. and Bengo , P. 2003 . A comparison of three retrospective self‐reporting methods of measuring change in instructional practice . American Journal of Evaluation , 24 ( 1 ) : 65 – 80 .
   Web of Science ®Google Scholar
• Mackay , R. , Horton , D. , Dupleich , L. and Andersen , A. 2002 . Evaluating organizational capacity development . Canadian Journal of Program Evaluation , 17 ( 2 ) : 121 – 50 .
   Google Scholar
• Mandler , G. 1975 . “ Memory storage and retrieval: Some limits on the research of attention and consciousness ” . In Attention and performance , Edited by: Rabbitt , P.M. and Dornic , S. 499 – 516 . London : Academic Publishers .
   Google Scholar
• Mathison , S. 2008 . “ What is the difference between evaluation and research, and why do we care? ” . In Fundamental issues in evaluation , Edited by: Smith , L. and Brandon , P.R. 183 – 96 . New York : Guildford Press .
   Google Scholar
• McDuff , M. 2001 . Building the capacity of grassroots conservation organizations to conduct participatory evaluation . Environmental Management , 27 ( 5 ) : 715 – 27 .
   PubMed Web of Science ®Google Scholar
• McDuff , M. 2002 . Needs assessment for participatory evaluation of environmental education programs . Applied Environmental Education & Communication , 1 ( 1 ) : 25 – 36 .
   Google Scholar
• Miron , G. 2004 . Evaluation report checklist , Kalamazoo, MI : Evaluation Center, Western Michigan University .
   Google Scholar
• Monroe , M.C. , Fleming , M.L. , Bowman , R.A. , Zimmer , J.F. , Marcinkowski , T. , Washburn , J. and Mitchell , N.J. 2005 . Evaluators as educators: Articulating program theory and building evaluation capacity . New Directions for Evaluation , 105 : 57 – 71 .
   Google Scholar
• Norris , K.S. and Jacobson , S.K. 1998 . Content analysis of tropical conservation education programs: Elements of success . Journal of Environmental Education , 30 ( 1 ) : 38 – 44 .
   Google Scholar
• Patton , M.Q. 1997 . Toward distinguishing empowerment evaluation and placing it in a larger context . American Journal of Evaluation , 18 ( 1 ) : 147 – 63 .
   Google Scholar
• Patton , M.Q. 2008 . Utilization‐focused evaluation. , 4th ed. , Los Angeles : Sage .
   Google Scholar
• Powell , R.B. , Stern , M.J. and Ardoin , N. 2006 . A sustainable evaluation framework and its application . Applied Environmental Education & Communication , 5 ( 4 ) : 231 – 41 .
   Google Scholar
• Pratt , C.C. , McGuigan , W.M. and Katzev , A.R. 2000 . Measuring program outcomes: Using retrospective methodology . American Journal of Evaluation , 21 ( 3 ) : 341 – 9 .
   Web of Science ®Google Scholar
• Preskill , H. and Boyle , S. 2008 . A multidisciplinary model of evaluation capacity building . American Journal of Evaluation , 29 ( 4 ) : 443 – 59 .
   Web of Science ®Google Scholar
• Recreational Boating and Fishing Foundation . 2006 . Best practices guide to program evaluation for aquatic educators , Alexandria, VA : Recreational Boating and Fishing Foundation .
   Google Scholar
• Robottom , I. 1985 . Evaluation in environmental education: Time for a change in perspective? . Journal of Environmental Education , 17 ( 1 ) : 31 – 6 .
   Google Scholar
• Rossi , P.H. , Lipsey , M.W. and Freeman , H.E. 2004 . Evaluation: A systematic approach. , 7th ed. , Thousand Oaks, CA : Sage .
   Google Scholar
• Russ‐Eft , D. , Bober , M.J. , De La Teja , I. , Foxon , M. and Koszalka , T.A. 2008 . Evaluator competencies: Standards for the practice of evaluation in organizations , San Francisco, CA : Jossey‐Bass .
   Google Scholar
• Simmons , B. 2004 . Designing evaluation for education projects , Washington, DC : Office of Education and Sustainable Development, National Oceanic and Atmospheric Administration .
   Google Scholar
• Smith , N. 1982 . Communication strategies in evaluation , Thousand Oaks, CA : Sage .
   Google Scholar
• Somers , C. 2005 . Evaluation of the wonders in nature‐wonders in neighborhoods conservation education program: Stakeholders gone wild! . New Directions for Evaluation , 108 : 29 – 46 .
   Google Scholar
• Stevahn , L. , King , J. , Ghere , G. and Minnema , J. 2005 . Establishing essential competencies for program evaluators . American Journal of Evaluation , 26 ( 1 ) : 43 – 59 .
   Web of Science ®Google Scholar
• Stokking , K. , Van Aaert , L. , Meijberg , W. and Kaskens , A. 1999 . Evaluating environmental education , Gland : International Union for Conservation of Nature .
   Google Scholar
• Stufflebeam , D.L. , Madaus , G.F. and Kellaghan , T. 2000 . Evaluation models: Viewpoints on educational and human services evaluation , Boston, MA : Kluwer .
   Google Scholar
• Torres , R. , Preskill , H. and Piontek , M.E. 2005 . Evaluation strategies for communicating and reporting: Enhancing learning in organizations. , 2nd ed. , Thousand Oaks, CA : Sage .
   Google Scholar
• Towne , L. and Shavelson , R.J. 2002 . Scientific research in education , Washington, DC : National Academies Press .
   Google Scholar
• Trevisan , M.S. 2002 . Evaluation capacity in K‐12 counseling programs . American Journal of Evaluation , 23 ( 3 ) : 291 – 305 .
   Web of Science ®Google Scholar
• Yin , R. 2009 . Case study research. , 4th ed. , Thousand Oaks, CA : Sage .
   Google Scholar
• Zint , M. 2010 . An Introduction to My Environmental Education Evaluation Resource Assistant (MEERA), a web‐based resource for self‐directed learning about environmental education program evaluation . Evaluation and Program Planning , 33 ( 2 ) : 178 – 9 .
   PubMed Web of Science ®Google Scholar
• Zint , M. Forthcoming . “ Advancing environmental education program evaluation: Insights from a review of behavioral outcome evaluations ” . In International handbook of research in environmental education , Edited by: Brody , M. , Dillon , J. , Stevenson , B. and Wals , A. Washington, DC : American Education Research Association .
   Google Scholar
• Zint , M. , Covitt , B. and Dowd , P.F. Forthcoming . Insights from an evaluability assessment of the U.S. Forest Service More Kids in the Woods initiative . Journal of Environmental Education ,
   Web of Science ®Google Scholar