Building face, construct, and content validity through use of a modified Delphi: adapting grounded theory to build an environmental field days observation tool

References

• Anderson , D. , Kisiel , J. and Storksdieck , M. 2006 . Understanding teachers’ perspectives on field trips: Discovering common ground in three countries . Curator , 49 ( 3 ) : 365 – 86 .
   Google Scholar
• Andrews , E. and Team , C.E. 1992 . Educating young people about water: A guide to goals and resources with an emphasis on nonformal and school enrichment settings , Madison : University of Wisconsin Extension, Environmental Resources Center .
   Google Scholar
• Ausubel , D.P. 1960 . The acquisition and retiontion of knowledge: A cognitive view , New York : Springer .
   Google Scholar
• Ballantyne , R. , Connell , S. and Fien , J. 2006 . Students as catalysts of environmental change: A framework for researching intergenerational influence through environmental education . Environmental Education Research , 12 ( 3 ) : 413 – 27 .
   Google Scholar
• Ballantyne , R. and Uzzell , D.L. 1994 . A checklist for the critical evaluation of informal enviromental learning experiences . International Journal of Environmental Education and Information , 13 ( 2 ) : 111 – 24 .
   Google Scholar
• Bilotta , J. 2001 . 2001 Children’s Water Festival education impact , St. Paul : University of Minnesota Extension Service .
   Google Scholar
• Bitgood , S. 1989 . School field trips: An overview . Visitor Behavior , 4 ( 2 ) : 3 – 6 .
   Google Scholar
• Bogner , F.X. 1998 . The influence of short‐term outdoor ecology education on long‐term variables of environmental persective . Journal of Environmental Education , 29 ( 4 ) : 17 – 29 .
   Google Scholar
• Brooks , K.W. 1979 . Delphi technique: Expanding applications . North Central Association Quarterly , 53 ( 3 ) : 377 – 85 .
   Google Scholar
• Carlson , S.P. 2008 . Environmental field days: Recommendations for success . Journal of Applied Environmental Education and Communications , 7 ( 3 ) : 94 – 105 .
   Google Scholar
• Carlson , S.P. , Heimlich , J.E. and Storksdieck , M. Under review . Validating an enviromental education field day observation tool . International Electronic Journal of Environmental Education ,
   Google Scholar
• Carlson , S. and Maxa , S. 1998 . Learning by doing and the youth‐driven model – The center , St. Paul : Center for Youth Development, University of Minnesota Extension Service .
   Google Scholar
• Carlson , S.P. and Peters , J. 2001 . Environmental field days: Do they make a difference? , St. Paul : University of Minnesota Extension Service .
   Google Scholar
• Clark , H. and Anderson , A.A. Theories of change and logic models: Telling them apart . Paper presented at the American Evaluation Association . November , Atlanta, GA.
   Google Scholar
• Colburn , A. 2000 . An inquiry primer . Science Scope , 23 ( 6 ) : 42 – 4 .
   Google Scholar
• Culen , G.R. 1998 . “ The status of environmental education with respect to the goal of responsible citizenship behavior ” . In Essential readings in environmental education , Edited by: Hungerford , H.R. , Bluhm , W.J. , Volk , T.L. and Ramsey , J.M. 37 – 46 . Champaign, IL : Stipes Publishing Company .
   Google Scholar
• Dalkey , N.C. and Helmer , O. 1951 . The use of experts for the estimation of bombing requirements – A Project‐Delphi experiment , Santa Monica, CA : Rand Corporation .
   Google Scholar
• Delbeque , A.L. , Van De Ven , A.H. and Gustafson , D.H. 1975 . Group techniques for program planning: A guide to nominal group and Delphi process , Glenview, IL : Scott, Foresman .
   Google Scholar
• Falk , J.H. 1983 . Field trips: A look at environmental effects of learning . Journal of Biological Education , 17 : 137 – 42 .
   Web of Science ®Google Scholar
• Falk , J.H. and Balling , J.D. 1980 . The school field trip: Where you go makes a difference . Science and Children , 17 ( 6 ) : 6 – 8 .
   Google Scholar
• Farmer , J. , Knapp , D. and Benton , G. 2007 . An elementary school environmental education field trip: Long‐term effects on ecological and environmental knowledge and attitude development . Journal of Environmental Education , 38 ( 3 ) : 33 – 42 .
   Google Scholar
• Farmer , A.J. and Wott , J.A. 1995 . Field trips and follow‐up activities: Fourth graders in a public garden . Journal of Environmental Education , 27 ( 1 ) : 33 – 5 .
   Google Scholar
• Fedler , A.J. 2001 . “ Fishing, boating and aquatic stewardship education: Framework and best practices recommendations ” . In Defining best practices in boating, fishing and stewardship education , Edited by: Fedler , A.J. 1 – 15 . Alexandria, VA : Recreational Boating and Fishing Foundation .
   Google Scholar
• Flexer , B.K. and Borun , M. 1984 . The impact of a class visit to a participatory science museum exhibit and a classroom science lesson . Journal of Research in Science Teaching , 21 ( 9 ) : 863 – 73 .
   Web of Science ®Google Scholar
• Fortner , R.W. 2001 . “ The right tools for the right job: How can aquatic resource education succeed in the classroom ” . In Defining best practices in boating, fishing and stewardship education , Edited by: Fedler , A.J. 49 – 60 . Alexandria, VA : Recreational Boating and Fishing Foundation .
   Google Scholar
• Gardner , H. 1993 . Multiple intelligences: The theory in practice – A reader , New York : Basic Books .
   Google Scholar
• Gennaro , E.D. 1981 . The effectiveness of using previsit instructional materials on learning for a museum field trip experience . Journal of Research in Science Teaching , 18 ( 3 ) : 275 – 9 .
   Google Scholar
• Griffin , J. and Symington , D. 1997 . Moving from task‐oriented to learning‐oriented strategies on school excursions to museums . Science Education , 81 ( 6 ) : 763 – 79 .
   Web of Science ®Google Scholar
• Gross , M.P. and Pizzini , E.L. 1979 . The effects of combined advance organizers and field experience on enviornmental orientations of elementary school children . Journal of Research in Science Teaching , 16 ( 4 ) : 325 – 31 .
   Google Scholar
• Ham , S. 1992 . Environmental interpretation: A practical guide for people with big ideas , Golden, CO : Fulcrum .
   Google Scholar
• Hartly , J. and Davies , I.K. 1976 . Preinstructional Strategies: The role of pretests, behavioral objectives, overviews and advance organizers . Review of Educational Research , 46 ( 2 ) : 239 – 65 .
   Web of Science ®Google Scholar
• Hasson , F. , Keeney , S. and McKenna , H. 2000 . Research guidelines for the Delphi survey technique . Journal of Advanced Nursing , 32 ( 4 ) : 1008 – 15 .
   PubMed Web of Science ®Google Scholar
• Hatcher , T. and Coulter , S. 2006 . Using the internet to imrpove HRD research: The use of the web‐based Delphi research technique to achieve content‐validity of an HRD‐oriented measurement . Journal of European Industrial Training , 31 ( 7 ) : 570 – 87 .
   Google Scholar
• Hyerle , D. 1996 . Thinking maps: Seeing is understanding . Educational Leadership , 53 ( 4 ) : 85 – 9 .
   Web of Science ®Google Scholar
• Ignatiuk , G.T. 1978 . Influence of the amount of time spent in field trip activities on student attitude twoard science and the enviornment , Regina : Saskatchewan School Turstees Association, The Research Centre .
   Google Scholar
• Kisiel , J.F. 2003 . Teachers, museums and worksheets: A closer look at a learning experience . Journal of Science Teacher Education , 14 ( 1 ) : 3 – 21 .
   Google Scholar
• Knapp , D. Evaluating the impact of environmental interpretation: A review of three research studies . Coalition for education in the outdoors: 3rd research symposium proceedings . Edited by: McAvoy , L.H. , Stringer , L.A. , Bialeschki , M.D. and Young , A.B. pp. 127 – 35 . Bradford Woods, IN : The Coalition for Education in the Outdoors .
   Google Scholar
• Knapp , D. 2000 . Memorable experiences of a science field trip . School Science and Mathematics , 100 ( 2 ) : 65 – 72 .
   Google Scholar
• Knapp , D. 2007 . A longitudinal analysis of an out‐of‐school science experience . School Science and Mathematics , 107 ( 2 ) : 44 – 51 .
   Google Scholar
• Knapp , D. and Barrie , E. 2001 . Content evaluation of an environmental science field trip . Journal of Science Education and Technology , 10 ( 4 ) : 351 – 7 .
   Google Scholar
• Knowlton , L.W. and Phillips , C.C. 2009 . The logic model guidebook: Better strategies for great results , Los Angeles, CA : Sage .
   Google Scholar
• Kolb , D. 1984 . Experiential learning , Englewood Cliffs, NJ : Prentice‐Hall .
   Google Scholar
• Koran , J.J. and Baker , S.D. 1979 . “ Evaluating the effectiveness of field experiences ” . In What research says to the science teacher, , 2nd ed. , Edited by: Rowe , M.B. 50 – 64 . Washington, DC : National Science Teachers Association .
   Google Scholar
• Koran , J.J. , Koran , M.L. and Ellis , J. 1989 . Evaluating the effectiveness of field experiences: 1939–1989 . Visitor Behavior , 4 ( 2 ) : 7 – 13 .
   Google Scholar
• Kubota , C. and Olstad , R. 1991 . Effects of novelty‐reducing preparations on exploratory behavior and cognitive learning in a science museum setting . Journal of Research in Science Teaching , 28 : 225 – 34 .
   Web of Science ®Google Scholar
• Lazear , D. 1991 . Seven ways of teaching: The artistry of teaching with multiple intelligences , Palatine, IL : IRI/Skylight .
   Google Scholar
• Linstone , H.A. and Turoff , M. , eds. 1975 . Delphi method: Techniques and applications , Reading, MA : Addison‐Wesley .
   Google Scholar
• Lisowski , M. and Disinger , J.F. 1988 . Environmental education research news . Envionrmentalist , 8 ( 1 ) : 3 – 6 .
   Web of Science ®Google Scholar
• Lockett , D.W. The relationship of classifactory behavior in fourth grade students to performance in a science education program at a museum (ERIC Document Reproduction Service No. ED236871) . Paper presented at the meeting of the American Educational Research Association . New York. Washington, DC : Creative Associates Inc .
   Google Scholar
• Martin , W.W. , Falk , J.H. and Balling , J.D. 1981 . Environmental effects on learning: The outdoor field trip . Science Education , 65 ( 3 ) : 301 – 9 .
   Google Scholar
• Martinez , M.E. and Haertel , E. 1991 . Components of interesting science experiments . Science Education , 75 ( 4 ) : 471 – 9 .
   Web of Science ®Google Scholar
• Mason , J.L. 1980 . Field work in earth science classrooms . School Science and Mathematics , 80 ( 4 ) : 317 – 22 .
   Google Scholar
• McDonnell , J. 2001 . “ Best practices in marine and coastal science education: Lessons learned from a National Estuarine Research Reserve ” . In Defining best practices in boating, fishing, and stewardship education , Edited by: Fedler , A.J. 173 – 82 . Arlington, VA : Recreational Boating and Fishing Foundation .
   Google Scholar
• Meyer , N.J. , Blair , R.B. , Carlson , S.P. , Bilotta , J.P. , Montgomery , K.L. , Ostlie , K.M. , Prax , V.J. and Rager , A.R.B. 2005 . Best practices for field days: A program planning guidebook for organizers, presenters, teachers and volunteers , St. Paul : University of Minnesota Extension Service .
   Google Scholar
• Miller , G.A. 1956 . The magical number seven, plus or minus two: Some limits on our capacity for processing information . The Psychological Review , 63 ( 2 ) : 81 – 97 .
   PubMed Web of Science ®Google Scholar
• Okoli , C. and Pawlowski , S.D. 2004 . The Delphi method as a research tool: An example, design considerations and applications . Information & Management , 42 : 15 – >29 .
   Web of Science ®Google Scholar
• Oldfather , P. , Thomas , S. , Eckert , L. , Garcia , F. , Grannis , N. , Kilgore , J. , Newman‐Gonchar , A. , Petersen , B. , Rodriguez , P. and Tjioe , M. 1999 . The nature and outcomes of students’ longitudinal participatory research on literacy motivations and schooling . Research in the Teaching of English , 34 : 281 – 320 .
   Web of Science ®Google Scholar
• Orion , N. and Hofstein , A. 1994 . Factors that influence learning during a sceintific field trip in a natural environment . Journal of Research in Science Teaching , 31 ( 10 ) : 1097 – 119 .
   Web of Science ®Google Scholar
• Paul , R. , Binker , A.J. , Jensen , K. and Kreklau , H. 1990 . Critical thinking handbook: 4th–6th grades – A guide for remodelling lesson plans in language arts, social studies, and science , Rohnert Park, CA : Foundation for Critical Thinking, Sonoma State University .
   Google Scholar
• Poudel , D.D. , Vincent , L.M. , Anzalone , C. , Huner , J. , Wollard , D. , Clement , T. , DeRamus , A. and Blakewood , G. 2005 . Hands‐on activities and challenge tests in agricultural and environmental education . Journal of Environmental Education , 36 ( 4 ) : 10 – 22 .
   Google Scholar
• Price , S. and Hein , G.E. 1991 . More than a field trip: Science programmes for elementary school groups at museums . International Journal of Science Education , 13 ( 5 ) : 505 – 20 .
   Web of Science ®Google Scholar
• Ramey‐Gassert , L. and Walberg , H. J. 1994 . Reexamining connections: Museums as science learning . Science Education , 78 ( 4 ) : 345 – 63 .
   Web of Science ®Google Scholar
• Rickinson , M. 2001 . Learners and learning in environmental education: A critical review of the evidence . Environmental Education Research , 7 ( 3 ) : 207 – 320 .
   Google Scholar
• Roberts , N.S. and Rodriguez , D.A. 1999 . Multicultural issues in outdoor education (Eric Digest ED438151) , Charleston, WV : ERIC/CRESS .
   Google Scholar
• Rudman , C.L. 1994 . A review of the use and implementation of science field trips . School Science and Mathematics , 94 : 138 – 41 .
   Google Scholar
• Schmidt , R.C. 1997 . Managing Delphi surveys using nonparametric statistical techniques . Decision Sciences , 28 ( 3 ) : 763 – 74 .
   Web of Science ®Google Scholar
• Seacrest , S.S. and Herpel , R. 1997 . Developing a results‐oriented approach for water education programs . Journal of the American Water Resources Association , 33 ( 2 ) : 262 – 70 .
   Web of Science ®Google Scholar
• Siemer , W.F. 2001 . “ Best practices for curriculum, teaching and evaluation: Components of aquatic stewardship education ” . In Defining best practices in boating, fishing and stewardship education , Edited by: Fedler , A.J. 18 – 36 . Alexandria, VA : Recreational Boating and Fishing Foundation .
   Google Scholar
• Spector , B.S. and Gibson , C.W. 1991 . A qualitative study of middle school students’ perceptions of factors facilitating the learning of science: Grounded theory and existing theory . Journal of Research in Science Teaching , 28 ( 6 ) : 467 – 84 .
   Web of Science ®Google Scholar
• Stevens , M. and Andrews , E. , eds. 2006 . Outreach that makes a difference: Target audiences for water education – A research meta‐analysis (A study conducted for the National Extension Water Outreach Project) , Madison : University of Wisconsin .
   Google Scholar
• Storksdieck , M. 2006 . Field trips in environmental education , Berlin : Berliner Wissenschafts‐Verlag .
   Google Scholar
• Strauss , A. and Corbin , J. 1990 . Basics of qualitative research: Techniques and procedures for developing grounded theory. , 2nd ed. , Newbury Park, CA : Sage .
   Google Scholar
• Stronck , D.R. 1983 . The comparative effects of different museum tours on children’s attitudes and learning . Journal of Research in Science Teaching , 20 ( 4 ) : 283 – 90 .
   Web of Science ®Google Scholar
• Vogt , W.P. 1993 . Dictionary of statistics and methodology , Newbury Park, CA : Sage .
   Google Scholar
• Volk , T.L. and McBeth , B. 1997 . Environmental literacy in the United States , Washington, DC : US Environmental Protection Agency and North American Association for Environmental Education .
   Google Scholar
• Wendling , R.C. and Wuensch , K.L. 1985 . A fifth‐grade outdoor education program: Expectations and effects . Journal of Interpretation , 10 : 11 – 20 .
   Google Scholar