References
- Adisso, E. L., Borde, V., Saint-Hilaire, M.-È., Robitaille, H., Archambault, P., Blais, J., Cameron, C., Cauchon, M., Fleet, R., Létourneau, J.-S., Labrecque, M., Quinty, J., Samson, I., Boucher, A., Zomahoun, H. T. V., & Légaré, F. (2018). Can patients be trained to expect shared decision making in clinical consultations? Feasibility study of a public library program to raise patient awareness. PLoS One, 13(12), e0208449. https://doi.org/https://doi.org/10.1371/journal.pone.0208449
- Aiken, L. S., & West, S. G. (1990). Invalidity of true experiments: Self-report pretest biases. Evaluation Review, 14(4), 374–390. https://doi.org/https://doi.org/10.1177/0193841X9001400403
- Angell, D. L. (2008). Food demonstration and taste testing format: Ohio extension program proves effective. Journal of Family and Consumer Sciences, 100(1), 38.
- Arbogast, D., Smaldone, D., & Balcarczyk, K. (2015). Evaluating the West Virginia interpretive guide heritage steward program. Journal of Interpretation Research, 20(2), 33–40. https://www.interpnet.com/NAI/docs/Publications/JIR-v20n2.pdf https://doi.org/https://doi.org/10.1177/109258721502000204
- Bjorklund, D. F. (1987). How age changes in knowledge base contribute to the development of children’s memory: An interpretive review. Developmental Review, 7(2), 93–130. https://doi.org/https://doi.org/10.1016/0273-2297(87)90007-4
- Blue Scarf Consulting. (2012). “Next level” student retrospective report of findings, 2012. In InformalScience.org. http://informalscience.org/sites/default/files/2013-06-07_MN_Zoo_Next_Level_Retrospective_Report_of_Findings.pdf
- Brook, J., Akin, B. A., Lloyd, M., Bhattarai, J., & McDonald, T. P. (2016). The Use of prospective versus retrospective pretests within child-welfare involved families. Journal of Child and Family Studies, 25(9), 2740–2752. https://doi.org/https://doi.org/10.1007/s10826-016-0446-1
- Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Rand McNally College Publishing Company.
- Clary, C. D., & Ferrari, T. M. (2015). Communication, coping, and connections: Campers’ and parents’ perspectives of self-efficacy and benefits of participation in deployment support camps. Journal of Youth Development, 10(2), 31–54. https://doi.org/https://doi.org/10.5195/JYD.2015.407
- Cohen, E. H. (2016). Self-assessing the benefits of educational tours. Journal of Travel Research, 55(3), 353–361. https://doi.org/https://doi.org/10.1177/0047287514550098
- Collins, R., Sibthorp, J., Gookin, J., & Schumann, S. (2012). The role and importance of program quality in outdoor adventure programs for youth: Examining program quality indicators as predictors of outcome achievement among NOLS participants. Research in Outdoor Education, 11(1), 28–46. https://doi.org/https://doi.org/10.1353/roe.2012.0004
- Falk, J. H., & Gillespie, K. L. (2009). Investigating the role of emotion in science center visitor learning. Visitor Studies, 12(2), 112–132. https://doi.org/https://doi.org/10.1080/10645570903203414
- Fraser, J., Yoco, V. (2011). GSCA 2010 conference attendees awareness and attitudes towards DIGSS. In InformalScience.org. http://informalscience.org/sites/default/files/GSCA_Conference_Report_2011_01_04_copy.pdf
- Galvan, A. R., & LaRocque, L. (2010). Evaluation and analyses of cultural diversity training with environmental educators. Applied Environmental Education & Communication, 9(4), 262–275. https://doi.org/https://doi.org/10.1080/1533015X.2010.530894
- Garst, B. A., Baughman, S., Franz, N. K., & Seidel, R. W. (2013). Strengthening families: Exploring the impacts of family camp experiences on family functioning and parenting. Journal of Experiential Education, 36(1), 65–77. https://doi.org/https://doi.org/10.1177/1053825916689267
- Gress, S., & Hall, T. (2017). Diversity in the outdoors: National outdoor leadership school students’ attitudes about wilderness. Journal of Experiential Education, 40(2), 114–134. https://doi.org/https://doi.org/10.1177/1053825916689267
- Hake, R. (1998). Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64–74. https://doi.org/https://doi.org/10.1119/1.18809
- Harada, V. H. (2016). A practice-centered approach to professional development: Teacher-librarian collaboration in capstone projects. [Online]. School Library Research, 19. http://www.ala.org/aasl/slr/volume19/harada
- Heimlich, J., Wasserman, D., Hayde, D. (2014). Human plus: Real lives + real engineering: Summative evaluation. In InformalScience.org. https://www.informalscience.org/sites/default/files/2014-06-25_Human_Plus_Summative_Report_FINAL.pdf
- Hill, L. G. (2020). Back to the future: Considerations in use and reporting of the retrospective pretest. International Journal of Behavioral Development, 44(2), 184–191. https://doi.org/https://doi.org/10.1177/0165025419870245
- Hill, L. G., & Betz, D. L. (2005). Revisiting the retrospective pretest. American Journal of Evaluation, 26(4), 501–517. https://doi.org/https://doi.org/10.1177/1098214005281356
- Howard, G. S., Ralph, K. M., Gulanick, N. A., Maxwell, S. E., Nance, D. W., & Gerber, S. K. (1979). Internal invalidity in pretest-posttest self-report evaluations and a re-evaluation of retrospective pretests. Applied Psychological Measurement, 3(1), 1–23. https://doi.org/https://doi.org/10.1177/014662167900300101
- Iacovelli, S., Beyer, M., Kunz Kollmann, E. (2012). Dimensions of public engagement with science: Summative evaluation. In InformalScience.org. http://informalscience.org/sites/default/files/2012_Dimensions_of_Public_Engagement_with_Science_Summative_Evaluation.pdf
- Kelly, L. (2019). Children’s opinion of retrospective pre-post ‘then-test’ survey validity. Journal of MultiDisciplinary Evaluation, 15(33), 54–65.
- Kemmerly, J. D., & Macfarlane, V. (2009). The elements of a consumer-based initiative in contributing to positive environmental change: Monterey Bay Aquarium’s Seafood Watch program. Zoo Biology, 28(5), 398–411. https://doi.org/https://doi.org/10.1002/zoo.20193
- Kuyumjian, T. A. (2016). Summative evaluation report: Farm to science initiative. Oregon Museum of Science and Industry. https://omsi.edu/sites/default/files/ODA%20Summative%20Evaluation%20Report_With%20Supplement_Proofed_FINAL_0.pdf
- Lam, T. C. M., & Bengo, P. A. (2003). Comparison of three retrospective self-reporting methods of measuring change in instructional practice. American Journal of Evaluation, 24(1), 65–80. https://doi.org/https://doi.org/10.1177/109821400302400106
- Little, T. D., Chang, R., Gorrall, B. K., Waggenspack, L., Fukuda, E., Allen, P. J., & Noam, G. G. (2019). The retrospective pretest-posttest design redux: On its validity as an alternative to traditional pretest-posttest measurement. International Journal of Behavioral Development, 44(2), 175–183. https://doi.org/https://doi.org/10.1177/0165025419877973
- Luke, J. J., Ancelet, J. E., Figueiredo, C. (2010). Leap into science: Year 3 evaluation report. In InformalScience.org. http :// infor mals cien ce.org / sit es/ def ault /fil es/ Year3.Final Report.V3.doc
- Miller, E. R., Snider, R. J. (2013). Design affects short-term knowledge and attitude outcomes in sea lion show audiences. In Soundings, 1. http: // soun dings .imata. org/ artic le/ Desig n_Aff ects_ Short- Term_ Knowle dge_And_ Attitude _Outcom es_ In_ Sea_ Lion_ Show_ Audi ences / 1316 037 /1467 44/ arti cle.html
- Nimon, K., Zigarmi, D., & Allen, J. (2011). Measures of program effectiveness based on retrospective pretest data: Are all created equal? American Journal of Evaluation, 32(1), 8–28. https://doi.org/https://doi.org/10.1177/1098214010378354
- Ocobock, C., & Hawley, P. (2020). Science on tap: Effective public engagement or preaching to the choir? Journal of Science Communication, 19(01), A04. https://doi.org/https://doi.org/10.22323/2.19010204
- Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000). Measuring program outcomes: Using retrospective pretest methodology. American Journal of Evaluation, 21(3), 341– 349. https://doi.org/https://doi.org/10.1016/S1098-2140(00)00089-8
- Schneider, W., & Ornstein, P. A. (2015). The development of children’s memory. Child Development Perspectives, 9(3), 190–195. https://doi.org/https://doi.org/10.1111/cdep.12129
- Shanahan, M. M. (2007). Evaluation of the Bishop Museum’s Science on a Sphere. Retrieved from https://www.noaa.gov/sites/default/files/atoms/files/Bishop_PREL_Evaluation.pdf
- Shaver, J. P. (1993). What statistical significance testing is, and what it is not. The Journal Of Experimental Education, 6(4), 293–316.
- Sibthorp, J., Paisley, K., & Gookin, J. (2007). Exploring participant development through adventure-based programming: A model from the National Outdoor Leadership School. Leisure Sciences, 29(1), 1–18. https://doi.org/https://doi.org/10.1080/01490400600851346
- Stern, M. J., Powell, R. B. (2019). Stern and Powell EE21. Virginia Tech. Retrieved from https://frec.vt.edu/people/Stern/stern_docs.html
- Taylor, P. J., Russ-Eft, D. F., & Taylor, H. (2009). Gilding the outcome by tarnishing the past: Inflationary biases in retrospective pretests. American Journal of Evaluation, 30(1), 31–43. https://doi.org/https://doi.org/10.1177/1098214008328517
- Tisdal, C. E. (2019). Mission: Mars. Bridging Earth and Mars (BEAM): Summative evaluation. In InformalScience.org. https://www.informalscience.org/sites/default/files/BEAM%20Summative%20Report%20-%20Final.pdf
- Wagner, K., Chessler, M., York, P., & Rayno, J. (2009). Development and implementation of an evaluation strategy for measuring conservation outcomes. Zoo Biology, 28(5), 473–487. https://doi.org/https://doi.org/10.1002/zoo.20270
- Wang, Y., & Davidson, M. C. (2010). Pre-and post-trip perceptions: An insight into Chinese package holiday market to Australia. Journal of Vacation Marketing, 16(2), 111–123. https://doi.org/https://doi.org/10.1177/1356766709357488
- Wasserstein, R. L., & Lazar, N. A. (2016). The ASA statement on p-values: Context, process, and purpose. The American Statistician, 70(2), 129–133. https://doi.org/https://doi.org/10.1080/00031305.2016.1154108