The Oceanography Concept Inventory: A Semicustomizable Assessment for Measuring Student Understanding of Oceanography

REFERENCES

• American Educational Research Association, American Psychological Association, and National Council on Measurement in Education . 1999. Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
   Google Scholar
• Anderson, D.L., Fisher, K.M., and Norman, G.J. 2002. Development and evaluation of the conceptual inventory of natural selection. Journal of Research in Science Teaching , 39:952–978.
   Web of Science ®Google Scholar
• Arnaudin, M.W. and Mintzes, J.J. 1985. Students' alternative conceptions of the human circulatory system: A cross-age study. Science Education , 69 (5):721–733
   Web of Science ®Google Scholar
• Arthurs, L. and Templeton, A. 2009. Coupled collaborative in-class activities and individual follow-up homework promote interactive engagement and improve student learning outcomes in a college-level environmental geology course. Journal of Geoscience Education , 57:356–371.
   Google Scholar
• Arthurs, L. 2011. What college-level students think: Student cognitive models of geoscience concepts, their alternate conceptions, and their learning difficulties. In Feig, A.D. and Stokes, A. eds., Qualitative inquiry in geoscience education research. Boulder, CO: Geological Society of America Special Paper 474, p. 135–152.
   Google Scholar
• Arthurs, L. and Marchitto, T. 2011. Qualitative methods applied in the development of an introductory oceanography concept inventory survey. In Feig, A.D. and Stokes, A. eds., Qualitative inquiry in geoscience education research. Boulder, CO: Geological Society of America Special Paper 474, p. 97–111.
   Google Scholar
• Battisti, B.T., Hanegan, N., Sudweeks, R., and Cates, R. 2009. Using item response theory to conduct a distracter analysis on conceptual inventory of natural selection. International Journal of Science and Mathematics Education , 8:845–868.
   Web of Science ®Google Scholar
• Bond, T. and Fox, C.M. 2007. Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Boone, W.J., Townsend, J.S., and Staver, J. 2010. Using Rasch theory to guide the practice of survey development and survey data analysis in science education and to inform science reform efforts: An exemplar utilizing STEBI self-efficacy data. Science Education , 95 (2):258–280.
   Web of Science ®Google Scholar
• Boyle, F. and Monarch, I.A. 1992. Studying conceptual change in learning physics. Science Education , 76 (6):615–652.
   Web of Science ®Google Scholar
• Bozdogan, H. 2000. Akaike's information criterion and recent developments in information complexity. Journal of Mathematical Psychology , 44 (1):62–91.
   Web of Science ®Google Scholar
• Briggs, C.B., Alonzo, A.C., Schwab, C., and Wilson, M. 2006. Diagnostic assessment with ordered multiple-choice items. Educational Assessment , 11 (1):33–63.
   Google Scholar
• Charmaz, K. 2006. Constructing grounded theory: A practical guide through qualitative analysis. Washington, DC: Sage Publications Ltd.
   Google Scholar
• Creswell, J. 1998. Qualitative inquiry and research design: Choosing among five traditions. Thousand Oaks, CA: Sage Publications.
   Google Scholar
• Cortina, J.M. 1993. What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology , 78 (1):98–104.
   Web of Science ®Google Scholar
• Crocker, L., and Algina, J. 1986. Introduction to classical and modern test theory. New York: Holt, Rinehart, and Winston.
   Google Scholar
• de Ayala, R. J. 2009. The theory and practice of item response theory. New York: The Guilford Press.
   Google Scholar
• DeVellis, R.F. 2006. Classical test theory. Medical Care , 44 (11):S50–S59.
   Web of Science ®Google Scholar
• Ding, L., Chabay, R., Sherwood, B., and Beichner, R. 2006. Evaluating an electricity and magnetism assessment tool: Brief electricity and magnetism assessment. Physical Review Special Topics–Physics Education Research , 2 (1):010105-1–010105-7.
   Google Scholar
• Dodick, J. and Orion N. 2003. Measuring student understanding of geological time. Science Education , 87:708–731.
   Web of Science ®Google Scholar
• Efron, B. 1982. The jackknife, the bootstrap, and other resampling plans. Philadelphia, PA: Society for Industrial and Applied Mathematics.
   Google Scholar
• Driver, R. and Odham, V. 1986. A constructivist approach to curriculum development in science. Studies in Science Education , 13:105–122.
   Google Scholar
• Embretson, S.E. and Reise, S.P. 2000. Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
   Google Scholar
• Feig, A.D. 2011. Methodology and location in context of qualitative data and theoretical frameworks in geoscience education research. In Feig, A.D. and Stokes, A., eds., Qualitative inquiry in geoscience education research. Boulder, CO: Geological Society of America Special Paper 474, p. 1–10.
   Google Scholar
• Garrison, T. 2007. Oceanography: An invitation to marine science. Belmont, CA: Thomson Brooks/Cole.
   Google Scholar
• Garvin-Doxas, K., Klymkowski, M., and Elrod, S. 2007. Building, using, and maximizing the impact of concept inventories in the biological sciences: Report on a National Science Foundation–sponsored conference on the construction of concept inventories in the biological sciences. CBE Life Sciences Education , 6:277–282.
   PubMedGoogle Scholar
• Greenfield, P.M. 1997. Culture as process: Empirical methods for cultural psychology. In Berry, J.W., Poortinga, Y.H., and Pandey, J., eds., Handbook of cross-cultural psychology. 2nd ed., vol. 1: Theory and method. Needham Heights, MA: Allyn & Bacon, p. 301–346.
   Google Scholar
• Hake, R. 1998. Interactive-engagement vs. traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics , 66:64–74.
   Web of Science ®Google Scholar
• Hambleton, R.K. and Jones, R.W. 1993. An NCME Instructional Module on: Comparison of classical test theory and item response theory and their applications to test development. Educational Measurements: Issues and Practice , 12 (3):38–47.
   Google Scholar
• Hestenes, D., Wells, M., and Swachhamer, G. 1992. Force concept inventory. The Physics Teacher , 30:141–158.
   Google Scholar
• Kline, P. 2000. A psychometrics primer. London, UK: Free Association Books.
   Google Scholar
• Klymkowski, M.W. and Garvin-Doxas, K. 2008. Recognizing student misconceptions through Ed's tools and the biology concept inventory. PLoS Biology , 6 (1):0014–0017.
   Web of Science ®Google Scholar
• Knudson. D., Noffal. G., Bauer. J., McGinnis. P., Bird. M., Chow. J., Bahamonde, R., Blackwell, J., Strohmeyer, S., and Abendroth-Smith, J. 2003. Development and evaluation of a biomechanics concept inventory. Sports Biomechanics , 2 (2):267–277.
   Google Scholar
• Lederman, N.G., Abd-El-Khalick, F., Bell, R.L., and Schwartz, R. 2002. Views of nature of science questionnaire: Toward valid and meaningful assessment of learner's conceptions of nature of science. Journal of Research in Science Teaching , 39 (6):497–521.
   Web of Science ®Google Scholar
• Lewis, E.B. and Baker, D.R. 2010. A call for a new geoscience education research agenda. Journal of Research in Science Teaching , 47 (2):121–129.
   Web of Science ®Google Scholar
• Libarkin, J. 2008. Concept inventories in higher education science. Paper presented at the National Research Council Workshop 2: Promising Practices in Undergraduate STEM Education. Washington, DC, 13–14 October.
   Google Scholar
• Libarkin, J.C. and Anderson, S.W. 2006. The geoscience concept inventory: Application of Rasch analysis to concept inventory development in higher education. In Liu, X. and Boone, W.J., eds., Applications of Rasch measurement in science education. Maple Grove, MN: JAM Press.
   Google Scholar
• Lindell, R.S. 2005. Measuring conceptual change in college students' understanding of lunar phase. American Institute of Physics Conference Proceedings , 790 (1):53–56.
   Google Scholar
• Lindell, R.S. and Sommer, S.R. 2004. Using the lunar phases concept inventory to investigate college students‘ pre-instructional mental models of lunar phases. American Institute of Physics Conference Proceedings , 720 (1):73–76.
   Google Scholar
• Lord, F.M. 1980. Applications of item response theory to practical testing problems. Hillside, NJ: Erlbaum.
   Google Scholar
• Lord, F.M. and Novick, M.R. 1968. Statistical theories of mental test scores. Charlotte, NC: Addison-Wesley Publishing Company, Inc.
   Google Scholar
• Madsen, D. 2004. Stability coefficient. In Lewis-Beck, M.S., Bryman, A., and Liao, T.F. eds., The SAGE encyclopedia of social science research methods. Available at http://dx.doi.org/10.4135/9781412950589 (accessed 15 July 2015).
   Google Scholar
• Marbach-Ad, G., Briken, V., El-Sayed, N.M., Frauwirth, K., Fredericksen, B., Hutcheson, S., Gao, L.-Y., Joseph, S., Lee, V.T., McIver, K.S., Mosser, D., Quimby, B.B., Shields, P., Song, W., Stein, D.C., Yuan, R.T., and Smith, A.C. 2009. Assessing student understanding of host pathogen interactions using a concept inventory. Journal of Microbiology and Biology Education , 10:43–50.
   Google Scholar
• National Council on Measurement in Education and American Council on Education . 2006. Brennan, R.L., ed., Educational measurement. Westport, CT: Praeger Publishers.
   Google Scholar
• National Geographic Society's Oceans for Life Initiative and National Oceanic and Atmospheric Administration . 2007. Ocean literacy: The essential principles of ocean sciences, Washington, DC: National Geographic Society.
   Google Scholar
• National Research Council . 2000. How people learn: Brain, mind, experience, and school. Bransford, J.D., Brown, A.L., and Cocking, R.R., eds. Washington, DC: National Academy Press.
   Google Scholar
• Nunnally, J.C. and Bernstein, I.H. 1994. Psychometric theory, 3rd ed. New York: McGraw-Hill.
   Google Scholar
• O'Connor, E.F., Jr., 1972. Extending classical test theory to the measurement of change. Review of Educational Research , 42 (1):73–97.
   Web of Science ®Google Scholar
• Odom, A.L. and Barrow, L.H. 1995. Development and application of a two–tier diagnostic test measuring college biology students‘ understanding of diffusion and osmosis after a course of instruction. Journal of Research in Science Teaching , 32:45–61.
   Web of Science ®Google Scholar
• Parham T.L., Jr., Cervato, C., Gallus, W.A., Jr., Larsen, M., Hobbs, J., Stelling, P., Greenbowe, T., Gupta, T., Knox, J.A., and Gill, T.E. 2010. The InVEST volcanic concept survey: Exploring student understanding about volcanoes. Journal of Geoscience Education , 58 (3):177–187.
   Google Scholar
• Pathak, A., Patro, K., Pathak, K., and Valecha, M. 2013. Item response theory. International Journal of Computer Science and Mobile Computing , 2 (11):7–11.
   Google Scholar
• Pearsall, N.R., Skipper, J.E.J., and Mintzes, J.J. 1997. Knowledge restructuring in the life sciences: A longitudinal study of conceptual change in biology. Science Education , 81 (2):193–215.
   Web of Science ®Google Scholar
• Petcovic, H.L. and Ruhf, R.J. 2008. Geoscience conceptual knowledge of preservice elementary teachers: Results from the Geoscience Concept Inventory. Journal of Geoscience Education , 56 (3):251–260.
   Google Scholar
• Sadowski, C.J. and Gulgoz, S. 1992. Internal consistency and test-retest reliability of the need for cognition scale. Perceptual and Motor Skills , 74 (2):610–610.
   Web of Science ®Google Scholar
• Savinainen, A. and Scott, P. 2002. The force concept inventory: A tool for monitoring student learning. Physics Education 37 (1):45–52.
   Google Scholar
• Savinainen, A., Scott, P., and Viiri, J. 2005. Using a bridging representation and social interactions to foster conceptual change: Designing and evaluating an instructional sequence for Newton‘s third law. Science Education , 89 (2):175–195.
   Web of Science ®Google Scholar
• Smith, K.S., Wood, W.B., and Knight, J.K. 2008. The genetics concept assessment: A new concept inventory for gauging student understanding of genetics. CBE Life Sciences Education , 7:422–430.
   PubMed Web of Science ®Google Scholar
• Tan, K.C.D., Taber. K.S., Xiufeng. L., Coli. R.K., Lorenzo. M., Jia, L., Goh, N.K., and Chia, L.S. 2008. Students' conceptions of ionization energy: A cross-cultural study. International Journal of Science Education , 30 (2):265–285.
   Web of Science ®Google Scholar
• Thijs, G.D. 1992. Evaluation of an introductory course on force considering students‘ preconceptions. Science Education , 76 (2):155–174.
   Web of Science ®Google Scholar
• Thomson, G. and Douglass, J.A. 2009. Decoding learning gains: Measuring outcomes and the pivotal role the major and student backgrounds. Berkeley, CA: University of California at Berkeley's Center for Studies in Higher Education Research & Occasional Paper Series: CSHE.5.09.
   Google Scholar
• Vosniadou, S. 2007. Conceptual change and education. Human Development , 50:47–54.
   Web of Science ®Google Scholar
• Webb, N.M., Shavelson, R.J., and Haertel, E.H. 2006. Reliability coefficients and generalizability theory. In Rao, C.R., ed., Handbook of statistics, Vol. 26 on Psychometrics. Amsterdam, Netherlands: Elsevier, p. 81–124.
   Google Scholar
• Wright, B.D. and Stone, M. H. 1979. Best test design. Chicago, IL: MESA Press.
   Google Scholar