Computer science concept inventories: past and future

References

• ACM/IEEE-CS Joint Task Force on Computing Curricula. (2001). Computer Science Computing Curricula 2001.
   Google Scholar
• Adams, W. K., & Wieman, C. E. (2011). Development and validation of instruments to measure learning of expert-like thinking. International Journal of Science Education, 33, 1289–1312.
   Web of Science ®Google Scholar
• Allen, K. (2006). The statistics concept inventory: Development and analysis of a cognitive assessment instrument in statistics (Doctoral dissertation). Retrieved from http://pdf-release.net/external/1543023/pdf-release-dot-net-Kirk%20Allen%20dissertation.pdf
   Google Scholar
• Almstrum, V. L., Henderson, P. B., Harvey, V., Heeren, C., Marion, W., Riedesel, C., & Tew, A. E. (2006). Concept inventories in computer science for the topic discrete mathematics. ACM SIGCSE Bulletin, 38, 132–145.
   Google Scholar
• Anderson, D. L., Fisher, K. M., & Norman, G. J. (2002). Development and evaluation of the conceptual inventory of natural selection. Journal of Research in Science Teaching, 39, 952–978.
   Web of Science ®Google Scholar
• Bailey, J. M. (2008). Development of a concept inventory to assess students’ understanding and reasoning difficulties about the properties and formation of stars. Astronomy Education Review, 6, 133–139.
   Google Scholar
• Bardar, E. M., Prather, E. E., Brecher, K., & Slater, T. F. (2006). Development and validation of the light and spectroscopy concept inventory. Astronomy Education Review, 5, 103–113.
   Google Scholar
• Bayman, P., & Mayer, R. E. (1983). A diagnosis of beginning programmers’ misconceptions of BASIC programming statements. Communications of the ACM, 26, 677–679.
   Web of Science ®Google Scholar
• Buck, J. R., Wage, K. E., Hjalmarson, M. A. & Nelson, J. K. (2007). Comparing student understanding of signals and systems using a concept inventory, a traditional exam, and interviews. In IEEE frontiers in education (S1G-1). Milwaukee, WI.
   Google Scholar
• Chen, T. Y., Lewandowski, G., McCartney, R., Sanders, K. & Simon, B. (2007). Commonsense computing: Using student sorting abilities to improve instruction. In Proceedings of the 38th ACM technical symposium on computer science education (SIGCSE) (pp. 276–280), Covington, KY.
   Google Scholar
• Clancy, M. (2004). Misconceptions and attitudes that interfere with learning to program, Chap. 1. In M. Petre & S. Fincher (Eds.), Computer science education research. London: Routledge Falmer.
   Google Scholar
• Clement, J. M. (2004). A call for action (research): Applying science education research to computer science instruction. Computer Science Education, 14, 343–364.
   Google Scholar
• Clancy, M. & Linn, M. C. (1992). Case studies in the classroom. In Proceedings of the 23rd ACM technical symposium on computer science education (SIGCSE) (pp. 220–224), Kansas City, MO.
   Google Scholar
• Crouch, C. H., & Mazur, E. (2001). Peer instruction: Ten years of experience and results. American Journal of Physics, 69, 970–977.
   Web of Science ®Google Scholar
• Danielsiek, H., Paul, W. & Vahrenhold, J. (2012). Detecting and understanding students’ misconceptions related to algorithms and data structures. In Proceedings of the 43rd ACM technical symposium on computer science education (SIGCSE) (pp. 21–26), Raleigh, NC.
   Google Scholar
• Epstein, J. (2007). Development and validation of the calculus concept inventory. In Proceedings of the ninth international conference on mathematics education in a global community (Vol. 9, pp. 165–170), Charlotte, NC.
   Google Scholar
• Goldman, K., Gross, P., Heeren, C., Herman, G., Kaczmarczyk, L., Loui, M. C., & Zilles, C. (2008). Identifying important and difficult concepts in introductory computing courses using a Delphi process. In Proceedings of the 38th ACM technical symposium on computer science education (SIGCSE) (pp. 256–260), Portland, OR.
   Google Scholar
• Goldman, K., Gross, P., Heeren, C., Herman, G. L., Kaczmarczyk, L., Loui, M. C., & Zilles, C. (2010). Setting the scope of concept inventories for introductory computing subjects. ACM Transactions on Computing Education (TOCE), 10(5), 1–29.
   Google Scholar
• Götschi, T., Sanders, I. & Galpin, V. (2003). Mental models of recursion. In Proceedings of the 34th ACM technical symposium on computer science education (SIGCSE) (pp. 346–350), Reno, NV.
   Google Scholar
• Gray, G. L., Costanzo, F., Evans, D., Cornwell, P., Self, B. & Lane, J. L. (2005). The dynamics concept inventory assessment test: A progress report and some results. In Proceedings of the 2005 American Society for Engineering Education annual conference and exposition, Portland, OR.
   Google Scholar
• Guzdial, M. (2011). From science to engineering. Communications of the ACM, 54, 37–39.
   Web of Science ®Google Scholar
• Hake, R. (1998). Interactive-engagement vs. traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66, 64–74.
   Web of Science ®Google Scholar
• Hake, R. (2007). Six lessons from the physics education reform effort. Latin American Journal of Physics Education, 1, 24–31 .
   Google Scholar
• Helgeland, R. & Rancour, D. (2003). Circuits concept inventory. Retrieved from http://www.foundationcoalition.org/home/keycomponents/concept/circuits.html
   Google Scholar
• Herman, G. L. (2011). The development of a digital logic concept inventory (Doctoral dissertation), University of Illinois. Retrieved from https://www.ideals.illinois.edu/bitstream/handle/2142/24134/Herman_Geoffrey.pdf?sequence=1
   Google Scholar
• Herman, G. L. & Handzik, J. (2010). A preliminary pedagogical comparison study using the digital logic concept inventory. In IEEE frontiers in education (pp. F1G–1), Washington, DC.
   Google Scholar
• Herman, G. L., Kaczmarczyk, L., Loui, M. C. & Zilles, C. (2008). Proof by incomplete enumeration and other logical misconceptions. In Proceedings of the fourth international workshop on computing education research (ICER) (pp. 59–70), Sydney.
   Google Scholar
• Herman, G. L., Loui, M. C., Kaczmarczyk, L., & Zilles, C. (2012). Describing the what and why of students’ difficulties in boolean logic. ACM Transactions on Computing Education (TOCE), 12(3), 1–28 .
   Google Scholar
• Herman, G. L., Loui, M. C. & Zilles, C. (2010a). Creating the digital logic concept inventory. In Proceedings of the 41st ACM technical symposium on computer science education (SIGCSE) (pp. 102–106), Milwaukee, WI.
   Google Scholar
• Herman, G. L., Loui, M. C. & Zilles, C. (2010b). Work in progress-how do engineering students misunderstand number representations? In IEEE frontiers in education (pp. T3G–1), Washington, DC.
   Google Scholar
• Herman, G. L., Loui, M. C., & Zilles, C. (2011). Students’ misconceptions about medium-scale integrated circuits. IEEE Transactions on Education, 54, 637–645.
   Web of Science ®Google Scholar
• Herman, G. L., Loui, M. & Zilles, C. (2011). Administering a digital logic concept inventory at multiple institutions. In Proceedings of the 2011 American Society for Engineering Education annual conference and exposition (pp. 26–29), Vancouver, BC.
   Google Scholar
• Herman, G. L., Zilles, C. & Loui, M. C. (2009). Work in progress-students’ misconceptions about state in digital systems. In IEEE frontiers in education (pp. 1–2), San Antonio, TX.
   Google Scholar
• Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. The Physics Teacher, 30, 141–146.
   Google Scholar
• Kaczmarczyk, L. C., Petrick, E. R., East, J. P. & Herman, G. L. (2010). Identifying student misconceptions of programming. In Proceedings of the 41st ACM technical symposium on computer science education (SIGCSE) (pp. 107–111), Milwaukee, WI.
   Google Scholar
• Karpierz, K. & Wolfman, S. A. (2014). Misconceptions and concept inventory questions for binary search trees and hash tables. In Proceedings of the 45th ACM technical symposium on computer science education (SIGCSE) (pp. 109–114), Atlanta, GA.
   Google Scholar
• Libarkin, J., Ward, E., Andersln, S., Kortemeyer, G., & Raeburn, S. (2011). Revisiting the geoscience concept inventory: A call to the community. GSA Today, 21, 26–28.
   Google Scholar
• Lindell, R. S., Peak, E. & Foster, T. M. (2007). Are they all created equal? A comparison of different concept inventory development methodologies. In Proceedings of the American Institute of Physics conference (AIP) (Vol. 883, pp. 14–17), Syracuse, NY.
   Google Scholar
• Linn, M. C., & Clancy, M. (1992). The case for case studies of programming problems. Communications of the ACM, 35, 121–132.
   Web of Science ®Google Scholar
• Lister, R., Adams, E. S., Fitzgerald, S., Fone, W., Hamer, J., Lindholm, M., ... Thomas, L. (2004). A multi-national study of reading and tracing skills in novice programmers. ACM SIGCSE Bulletin, 36, 119–150.
   Google Scholar
• Longino, J. T. (2006). Boolean blunders: Identification and assessment of student misconceptions in a digital logic course (Doctoral dissertation), University of Illinois. Retrieved from http://www.cs.illinois.edu/~zilles/papers/digital_concepts.msthesis.pdf
   Google Scholar
• Ma, L., Ferguson, J., Roper, M., & Wood, M. (2007). Investigating the viability of mental models held by novice programmers. ACM SIGCSE Bulletin, 39, 499-503.
   Google Scholar
• Mazur, E. (2009). Confessions of a converted lecturer. Baltimore County: Guest lecture at the University of Maryland.
   Google Scholar
• McCracken, M., Almstrum, V., Diaz, D., Guzdial, M., Hagan, D., Kolikant, Y. B.-D., & Wilusz, T. (2001). A multi-national, multi-institutional study of assessment of programming skills of first-year CS students. ACM SIGCSE Bulletin, 33, 125–180.
   Google Scholar
• Nevison, C. H., Kmoch, J., Noonan, R. E., Corica, T., Fix, S., & Kay, D. G. (1995). Changes in the advanced placement computer science course: Case studies and C++. ACM SIGCSE Bulletin, 27, 374-375.
   Google Scholar
• Ogunfunmi, T. & Rahman, M. (2010). A concept inventory for an electric circuits course: Rationale and fundamental topics. In Proceedings of the 2010 IEEE international symposium on circuits and systems (pp. 2804–2807), Paris.
   Google Scholar
• Paul, W. & Vahrenhold, J. (2013). Hunting high and low: Instruments to detect misconceptions related to algorithms and data structures. In Proceedings of the 44th ACM technical symposium on computer science education (SIGCSE) (pp. 29–34), Denver, CO.
   Google Scholar
• Pea, R. D. (1986). Language-independent conceptual “bugs” in novice programming. Journal of Educational Computing Research, 2, 25-36.
   Google Scholar
• Porter, L., Garcia, S., Tseng, H. W. & Zingaro, D. (2013). Evaluating student understanding of core concepts in computer architecture. In Proceedings of the 18th annual conference on innovation and technology in computer science education (ITiCSE) (pp. 279–284), Canterbury.
   Google Scholar
• Porter, L., Taylor, C. & Webb, K. (2014). Leveraging open source principles for flexible concept inventory development. In Proceedings of the 19th annual conference on innovation and technology in computer science education (ITiCSE) (pp. 243–248), Uppsala.
   Google Scholar
• Reay, N. W., Li, P., & Bao, L. (2008). Testing a new voting machine question methodology. American Journal of Physics, 76, 171-178.
   Web of Science ®Google Scholar
• Robins, A., Haden, P. & Garner, S. (2006). Problem distributions in a CS1 course. In Proceedings of the 8th Australasian conference on computing education (Vol. 52, 165–173), Darlinghurst.
   Google Scholar
• Sadler, P. M., Coyle, H., Miller, J. L., Cook-Smith, N., Dussault, M., & Gould, R. R. (2009). The Astronomy and Space Science Concept Inventory: Development and validation of assessment instruments aligned with the K-12 National Science Standards. Astronomy Education Review, 8. doi:10.3847/AER2009005
   Google Scholar
• Sanders, K., Ahmadzadeh, M., Clear, T., Edwards, S. H., Goldweber, M., Johnson, C., ... Spacco, J. (2013). The Canterbury questionbank: Building a repository of multiple-choice CS1 and CS2 questions. In Proceedings of the 18th annual conference on innovation and technology in computer science education (ITiCSE) – working group reports (pp. 33–52), Canterbury.
   Google Scholar
• Schulte, C. & Bennedsen, J. (2006). What do teachers teach in introductory programming? In Proceedings of the second international workshop on computing education research (ICER) (pp. 17–28), Canterbury.
   Google Scholar
• Simon. (2013). Soloway’s rainfall problem has become harder. In Proceedings of the 2013 international conference on learning and teaching in computing and engineering (pp. 130–135), Macau.
   Google Scholar
• Simon, B., Clancy, M., McCartney, R., Morrison, B. B., Richards, B. & Sanders, K. (2010). Making sense of data structures exams. In Proceedings of the sixth international workshop on computing education research (ICER) (pp. 97–106), Aarhus.
   Google Scholar
• Smith, M. K., Wood, W. B., & Knight, J. K. (2008). The genetics concept assessment: A new concept inventory for gauging student understanding of genetics. CBE-life sciences Education, 7, 422–430.
   PubMed Web of Science ®Google Scholar
• Soloway, E., Bonar, J., & Ehrlich, K. (1983). Cognitive strategies and looping constructs: An empirical study. Communications of the ACM, 26, 853–860.
   Web of Science ®Google Scholar
• Soloway, E., Ehrlich, K., Bonar, J. & Greenspan, J. (1982). What do novices know about programming? In A. Badre & B. Shneiderman (Eds.), Directions in human-computer interaction. New York: Ablex.
   Google Scholar
• Steif, P. S., & Dantzler, J. A. (2005). A statics concept inventory: Development and psychometric analysis. Journal of Engineering Education, 94, 363–371.
   Web of Science ®Google Scholar
• Steif, P. S., & Hansen, M. A. (2007). New practices for administering and analyzing the results of concept inventories. Journal of Engineering Education, 96, 205-212.
   Web of Science ®Google Scholar
• Tew, A. E. (2010). Assessing fundamental introductory computing concept knowledge in a language independent manner (Doctoral dissertation). Georgia Institute of Technology. Retrieved from http://smartech.gatech.edu/bitstream/handle/1853/37090/tew_allison_e_201012_phd.pdf
   Google Scholar
• Tew, A. E. & Guzdial, M. (2010). Developing a validated assessment of fundamental CS1 concepts. In Proceedings of the 40th ACM technical symposium on computer science education (SIGCSE) (pp. 97–101), Milwaukee, WI.
   Google Scholar
• Tew, A. E. & Guzdial, M. (2011). The FCS1: A language independent assessment of CS1 knowledge. In Proceedings of the 41st ACM technical symposium on computer science education (SIGCSE) (pp. 111–116), Dallas, TX.
   Google Scholar
• Tew, A. E., McCracken, W. M. & Guzdial, M. (2005). Impact of alternative introductory courses on programming concept understanding. In Proceedings of the first international workshop on computing education research (ICER) (pp. 25–35), Seattle, WA.
   Google Scholar
• Wage, K. E., Buck, J. R., Wright, C. H., & Welch, T. B. (2005). The signals and systems concept inventory. IEEE Transactions on Education, 48, 448–461.
   Web of Science ®Google Scholar
• Webb, K. & Taylor, C. (2014). Developing a pre- and post-course concept inventory to gauge operating systems learning. In Proceedings of the 45th ACM technical symposium on computer science education (SIGCSE) (pp. 103–108), Atlanta, GA.
   Google Scholar
• Zeilik, M. (2002). Birth of the astronomy diagnostic test: prototest evolution. Astronomy Education Review, 1, 46–52.
   Google Scholar
• Zilles, C., Longino, J. & Loui, M. (2006). Student misconceptions in an introductory digital logic design course. In Proceedings of the 2006 American Society for Engineering Education annual conference and exposition, Chicago, IL.
   Google Scholar
• Zingaro, D., Petersen, A. & Craig, M. (2012). Stepping up to integrative questions on CS1 exams. In Proceedings of the 42nd ACM technical symposium on computer science education (SIGCSE) (pp. 253–258), Raleigh, NC.
   Google Scholar