Assessing science inquiry skills of citizen science volunteers: a snapshot of the field

References

• Becker-Klein, R, Peterman, K, & Stylinski, C. (2016). Embedded Assessment as an Essential Method for Understanding Public Engagement in Citizen Science. Citizen Science: Theory and Practice, 1(1), 8. http://doi.org/10.5334/cstp.15
   Google Scholar
• Bonney, R., Shirk, J. L., Phillips, T. B., Wiggins, A., Ballard, H. L., Miller-Rushing, A. J., & Parrish, J. K. (2014). Next steps for citizen science. Science, 343(6178), 1436–1437. doi: 10.1126/science.1251554
   PubMed Web of Science ®Google Scholar
• Bonter, D. N., & Cooper, C. B. (2012). Data validation in citizen science: A case study from project FeederWatch. Frontiers in Ecology and the Environment, 10(6), 305–307. doi: 10.1890/110273
   Web of Science ®Google Scholar
• Burgess, H., DeBey, L., Froehlich, H., Schmidt, N., Theobald, E., Ettinger, A., … Parrish, J. (2017). The science of citizen science: Exploring barriers to use as a primary research tool. Biological Conservation, 208, 113–120. doi: 10.1016/j.biocon.2016.05.014
   Web of Science ®Google Scholar
• Crall, A. W., Newman, G. J., Stohlgren, T. J., Holfelder, K. A., Graham, J., & Waller, D. M. (2011). Assessing citizen science data quality: An invasive species case study. Conservation Letters, 4, 433–442. doi: 10.1111/j.1755-263X.2011.00196.x
   Web of Science ®Google Scholar
• Doran, R. L., Boorman, J., Chan, F., & Hejaily, N. (1993). Alternative assessment of high school laboratory skills. Journal of Research in Science Teaching, 30(9), 1121–1131. doi: 10.1002/tea.3660300909
   Web of Science ®Google Scholar
• Dori, Y. J., Zohar, A., Fischer-Shachor, D., Kohan-Mass, J., & Carmi, M. (2018). Gender-fair assessment of young gifted students’ scientific thinking skills. International Journal of Science Education, 40(6), 595–620. doi: 10.1080/09500693.2018.1431419
   Web of Science ®Google Scholar
• Fuccillo, K. K., Crimmins, T. M., de Rivera, C. E., & Elder, T. S. (2015). Assessing accuracy in citizen science-based plant phenology monitoring. International Journal of Biometeorology, 59(7), 917–926. doi: 10.1007/s00484-014-0892-7
   PubMed Web of Science ®Google Scholar
• Golumbic, Y. N., Orr, D., Baram-Tsabari, A., & Fishbain, B. (2017). Between vision and reality: A study of scientists’ views on citizen science. Citizen Science: Theory and Practice, 2(1), 6.
   Google Scholar
• Gray, S., Jordan, R., Crall, A., Newman, G., Hmelo-Silver, C., Huang, J., … Prysby, M. (2017). Combining participatory modelling and citizen science to support volunteer conservation action. Biological Conservation, 208, 76–86. doi: 10.1016/j.biocon.2016.07.037
   Web of Science ®Google Scholar
• Haywood, B. K. (2016). Beyond data points and research contributions: The personal meaning and value associated with public participation in scientific research. International Journal of Science Education, Part B, 6(3), 239–262. doi: 10.1080/21548455.2015.1043659
   Web of Science ®Google Scholar
• Haywood, B. K., & Besley, J. C. (2014). Education, outreach, and inclusive engagement: Towards integrated indicators of successful program outcomes in participatory science. Public Understanding of Science, 23(1), 92–106. doi: 10.1177/0963662513494560
   PubMed Web of Science ®Google Scholar
• Ivankova, N. V., Creswell, J. W., & Stick, S. L. (2006). Using mixed-methods sequential explanatory design: From theory to practice. Field Methods, 18(1), 3–20. doi: 10.1177/1525822X05282260
   Web of Science ®Google Scholar
• Jordan, R. C., Ballard, H. L., & Phillips, T. B. (2012). Key issues and new approaches for evaluating citizen-science learning outcomes. Frontiers in Ecology and the Environment, 10(6), 307–309. doi: 10.1890/110280
   Google Scholar
• Kieslinger, B., Schäfer, T., Heigl, F., Dörler, D., Richter, A., & Bonn, A. (2017). The challenge of evaluation: An open framework for evaluating citizen science activities. Retrieved from https://www.researchgate.net/profile/Florian_Heigl/publication/319980567_The_Challenge_of_Evaluation_An_Open_Framework_for_Evaluating_Citizen_Science_Activities/links/59c4ddf8458515548f287b76/The-Challenge-of-Evaluation-An-Open-Framework-for-Evaluating-Citizen-Science-Activities.pdf
   Google Scholar
• Lewandowski, E., & Specht, H. (2015). Influence of volunteer and project characteristics on data quality of biological surveys. Conservation Biology, 29, 713–723. doi: 10.1111/cobi.12481
   PubMed Web of Science ®Google Scholar
• Lou, Y., Blanchard, P., & Kennedy, E. (2015). Development and validation of a science inquiry skills assessment. Journal of Geoscience Education, 63(1), 73–85. doi: 10.5408/14-028.1
   Google Scholar
• MacKenzie, C. M., Murray, G., Primack, R., & Weihrauch, D. (2017). Lessons from citizen science: Assessing volunteer-collected plant phenology data with mountain watch. Biological Conservation, 208, 121–126. doi: 10.1016/j.biocon.2016.07.027
   Web of Science ®Google Scholar
• McKinley, D. C., Miller-Rushing, A. J., Ballard, H. L., Bonney, R., Brown, H., Cook-Patton, S. C., … Phillips, T. B. (2017). Citizen science can improve conservation science, natural resource management, and environmental protection. Biological Conservation, 208, 15–28. doi: 10.1016/j.biocon.2016.05.015
   Web of Science ®Google Scholar
• Mislevy, R. J., Sternberg, L. S., Almond, R. G., Haertel, G. D., & Penuel, E. R. (2003). Improving educational assessment. In B. Means, & G. D. Haertel (Eds.), Evaluating education technology: Effective research design for improvement learning (pp. 149–180). New York, NY: Teacher College Press.
   Google Scholar
• National Academies of Sciences, Engineering, & Medicine (NASEM). (2016). Science literacy: Concepts, contexts, and consequences. Washington, DC: The National Academies Press. doi: 10.17226/23595
   Google Scholar
• National Academies of Sciences, Engineering, & Medicine (NASEM). (2018). Learning through citizen science: Enhancing opportunities by design. Washington, DC: The National Academies Press. doi: 10.17226/25183
   Google Scholar
• National Research Council (NRC). (2001). Knowing what students know: The science and design of educational assessment. Washington, DC: The National Academies Press. doi: 10.17226/10019
   Google Scholar
• National Research Council (NRC). (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. The National Academies Press. doi: 10.17226/13165
   Google Scholar
• Parsons, J., Lukyanenko, R., & Wiersma, Y. (2011). Easier citizen science is better. Nature, 471, 37. doi: 10.1038/471037a
   PubMed Web of Science ®Google Scholar
• Patton, M. Q. (1999). Enhancing the quality and credibility of qualitative analysis. HSR: Health Services Research Part II, 34(5), 1189–1208. Retrieved from https://jcom.sissa.it/sites/default/files/documents/JCOM1203(2013)A03.pdf
   PubMed Web of Science ®Google Scholar
• Peterman, K., Cranston, K. A., Pryor, M., & Kermish-Allen, R. (2015). Measuring primary students’ graph interpretation skills via a performance assessment: A case study in instrument development. International Journal of Science Education, 37(17), 2787–2808. doi: 10.1080/09500693.2015.1105399
   Web of Science ®Google Scholar
• Phillips, T. B., Ballard, H. L., Lewenstein, B. V., & Bonney, R. (2019). Engagement in science through citizen science: Moving beyond data collection. Science Education, 103(3), 665–690. doi: 10.1002/sce.21501
   Web of Science ®Google Scholar
• Phillips, T., Bonney, R., & Shirk, J. (2012). What is our impact: Towards a unified framework for evaluating outcomes of citizen science participation. In J. L. Dickinson, & R. Bonney (Eds.), Citizen science: Public participation in environmental research (pp. 82–95). Ithaca, NY: Cornell University Press.
   Google Scholar
• Phillips, T., Porticella, N., Constas, M., & Bonney, R. (2018). A framework for articulating and measuring individual learning outcomes from participation in citizen science. Citizen Science: Theory and Practice, 3(2), 3. doi: 10.5334/cstp.126
   Google Scholar
• Prudic, K. L., McFarland, K. P., Oliver, J. C., Hutchinson, R. A., Long, E. C., Kerr, J. T., & Larrivée, M. (2017). Ebutterfly: Leveraging massive online citizen science for butterfly conservation. Insects, 8(2), 53. doi: 10.3390/insects8020053
   Web of Science ®Google Scholar
• Shirk, J. L., Ballard, H. L., Wilderman, C. C., Phillips, T., Wiggins, A., Jordan, R., … Krasny, M. E. (2012). Public participation in scientific research: A framework for deliberate design. Ecology and Society, 17, 29. Retrieved from https://www.jstor.org/stable/26269051 doi: 10.5751/ES-04705-170229
   Web of Science ®Google Scholar
• Starr, J., Schweik, C. M., Bush, N., Fletcher, L., Finn, J., Fish, J., & Bargeron, C. T. (2014). Lights, camera … citizen science: Assessing the effectiveness of smartphone-based video training in invasive plant identification. PloS one, 9(11), e111433. doi: 10.1371/journal.pone.0111433
   PubMed Web of Science ®Google Scholar
• Swanson, A., Kosmala, M., Lintott, C., & Packer, C. (2016). A generalized approach for producing, quantifying, and validating citizen science data from wildlife images. Conservation Biology, 30(3), 520–531. doi: 10.1111/cobi.12695
   PubMed Web of Science ®Google Scholar
• Van der Wal, R., Sharma, N., Mellish, C., Robinson, A., & Siddharthan, A. (2016). The role of automated feedback in training and retaining biological recorders for citizen science. Conservation Biology, 30(3), 550–561. doi: 10.1111/cobi.12705
   PubMed Web of Science ®Google Scholar
• Van Horn, R. C. V., Zug, B., LaCombe, C., Velez-Liendo, X., & Paisley, S. (2014). Human visual identification of individual Andean bears Tremarctos ornatus. Wildlife Biology, 20, 291–299. doi: 10.2981/wlb.00023
   Web of Science ®Google Scholar
• Vitone, T., Stofer, K. A., Steininger, M. S., Hulcr, J., Dunn, R., & Lucky, A. (2016). School of ants goes to college: Integrating citizen science into the general education classroom increases engagement with science. J. Sci. Commun., 15, 1–24. Retrieved from https://jcom.sissa.it/sites/default/files/documents/JCOM_1501_2016_A03.pdf doi: 10.22323/2.15010203
   Web of Science ®Google Scholar
• Wiggins, A., & Crowston, K. (2012). Goals and tasks: Two typologies of citizen science projects. System Science (HICSS), 45th Hawaii International Conference (pp. 3426–3435). Washington, DC: IEEE Computer Society. doi: 10.1109/HICSS.2012.295
   Google Scholar
• Wiggins, A., Newman, G., Stevenson, R. D., & Crowston, K. (2011). Mechanisms for data quality and validation in citizen science. 2011 IEEE Seventh International Conference on e-Science Workshops (pp. 14–19). Stockholm: IEEE.
   Google Scholar
• Wiliam, D. (2011). What is assessment for learning? Studies in Educational Evaluation, 37(1), 3–14. doi: 10.1016/j.stueduc.2011.03.001
   Google Scholar