Assessing collaborative computing: development of the Collaborative-Computing Observation Instrument (C-COI)

References

• Barr, V., & Stephenson, C. (2011). Bringing computational thinking to K-12: What is involved and what is the role of the computer science education community? ACM Inroads, 2, 48–54.10.1145/1929887
   Google Scholar
• Barron, B. (2003). When smart groups fail. Journal of the Learning Sciences, 12, 307–359. doi:10.1207/S15327809JLS1203_1
   Web of Science ®Google Scholar
• Baytak, A., & Land, S. M. (2011). An investigation of the artifacts and process of constructing computers games about environmental science in a fifth grade classroom. Education Technology Research Development, 59, 765–782. doi:10.1007/s11423-010-9184-z
   Web of Science ®Google Scholar
• Brennan, K., & Resnick, M. (2012). New frameworks for studying and assessing the development of computational thinking. Presented at the American educational researcher association, Vancouver, BC, Canada.
   Google Scholar
• College Board. (2015). AP computer science principles: A curriculum Framework 2016–2017. Retrieved from https://secure-media.collegeboard.org/digitalServices/pdf/ap/ap-computer-science-principles-curriculum-framework.pdf
   Google Scholar
• Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.10.1037/h0040957
   PubMed Web of Science ®Google Scholar
• Denner, J., Werner, L., Campe, S., & Ortiz, E. (2014). Pair programming: Under what conditions is it advantageous for middle school students? Journal of Research on Technology in Education, 46, 277–296.10.1080/15391523.2014.888272
   Google Scholar
• Dewey, J. (1938). Logic: The theory of inquiry. New York, NY: Holt, Rinehart & Winston.
   Google Scholar
• Fessakis, G., Gouli, E., & Mavroudi, E. (2013). Problem solving by 5–6 years old kindergarten children in a computer programming environment: A case study. Computers & Education, 63, 87–97. doi:10.1016/2012.11.016
   Web of Science ®Google Scholar
• Gress, C. L. Z., Fior, M., Hadwin, A. F., & Winne, P. H. (2010). Measurement and assessment in computer-supported collaborative learning. Computers in Human Behavior, 26, 806–814.10.1016/j.chb.2007.05.012
   Web of Science ®Google Scholar
• Grover, S., & Pea, R. (2013). Computational thinking in K–12: A review of the state of the field. Educational Researcher, 42, 38–43.10.3102/0013189X12463051
   Web of Science ®Google Scholar
• Harlow, D. B., & Leak, A. E. (2014). Mapping students’ ideas to understand learning in a collaborative programming environment. Computer Science Education, 24, 229–247.10.1080/08993408.2014.963360
   Google Scholar
• Harrer, A., Zeini, S., Kahrimanis, G., Avouris, N., Marcos, J. A., Martínez-Mones, A., … Spada, H. (2007, July). Towards a flexible model for computer-based analysis and visualization of collaborative learning activities. Proceedings of the 8th international conference on computer supported collaborative learning (pp. 283–285). New Brunswick, NJ: International Society of the Learning Sciences.
   Google Scholar
• Israel, M., Pearson, J., Tapia, T., Wherfel, Q. M., & Reese, G. (2015). Supporting all learners in school-wide computational thinking: A cross case analysis. Computers & Education, 82, 263–279. doi:10.1016/j.compedu.2014.11.022
   Web of Science ®Google Scholar
• Israel, M., Wherfel, Q. M., Pearson, J., Shehab, S., & Tapia, T. (2015). Empowering K-12 student with disabilities to learn computational thinking and computer programming. TEACHING Exceptional Children, 48, 45–53.10.1177/0040059915594790
   Web of Science ®Google Scholar
• Jona, K., Wilensky, U., Trouille, L., Horn, M., Orton, K., Weintrop, D., & Beheshti, E. (2014). Embedding computational thinking in science, technology, engineering, and math (CT-STEM). Presented at the future directions in computer science education summit meeting, Orlando, FL.
   Google Scholar
• Jordan, M. E., & McDaniel, Jr., R. R. (2014). Managing uncertainty during collaborative problem solving in elementary school teams: The role of peer influence in robotics engineering activity. Journal of the Learning Sciences, 23, 490–536. doi:10.1080/10508406.2014.896254
   Web of Science ®Google Scholar
• Kaendler, C., Wiedmann, M., Rummel, N., & Spada, H. (2014). Teacher competencies for the implementation of collaborative learning in the classroom: A framework and research review. Educational Psychology Review, 27, 505–536. doi:10.1007/s10648-014-9288-9
   Web of Science ®Google Scholar
• Kafai, Y. B., & Burke, Q. (2014). Connected code: Why children need to learn programming. Cambridge, MA: MIT Press.
   Google Scholar
• Karabenick, S. A., & Newman, R. S. (2009). Seeking help as an adaptive response to learning difficulties: person, situation, and developmental influences. In M. Wosnitza, S. A. Karabenick, A. Efklides, & P. Nenniger (Eds.), Contemporary motivation research: From global to local perspectives (pp. 24–47). Amsterdam: Hogrefe.
   Google Scholar
• Koschmann, T. (1999). Toward a dialogic theory of learning: Bakhtin’s contribution to understanding learning in settings of collaboration. In C.M. Hoadley & J. Roschelle (Eds.), International conference on computer support for collaborative learning (CSCL) (pp. 308–313). Palo Alto: ISLS.
   Google Scholar
• Kreijns, K., Kirschner, P. A., & Jochems, W. (2003). Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: A review of the research. Computers in Human Behavior, 19, 335–353.10.1016/S0747-5632(02)00057-2
   Web of Science ®Google Scholar
• Kreijns, K., Kirschner, P. A., & Vermeulen, M. (2013). Social aspects of CSCL environments: A research framework. Educational Psychologist, 48, 229–242. doi:10.1080/00461520.2012.750225
   Web of Science ®Google Scholar
• Kuhn, D. (2015). Thinking together and alone. Educational Researcher, 44, 46–53. doi:10.3102/0013189X15569531
   Web of Science ®Google Scholar
• Lewis, C. M. (2011). Is pair programming more effective than other forms of collaboration for young learners? Computer Science Education, 21, 105–134. doi:10.1080/08993408.2011.579805
   Google Scholar
• Lewis, C. M., & Shah, N. (2015, July). How equity and inequity can emerge in pair programming. In Proceedings of the eleventh annual international conference on international computing education research (pp. 41–50). ACM. doi: 10.1145/2787622.2787716
   Google Scholar
• Mercier, E., Fong, C., Cober, R., Slotta, J. D., Forssell, K. S., Israel, M., … Rummel, N. (2015). Researching and designing for the orchestration of learning in the CSCL classroom. Proceedings of the 11th international conference on computer supported collaborative learning (pp. 599–606). Gothenburg, Sweden: International Society of the Learning Sciences.
   Google Scholar
• Mueller, J. S., Melwani, S., & Goncalo, J. A. (2012). The bias against creativity. Why people desire but reject creative ideas. Psychological Science, 23, 13–17.doi:10.1177/0956797611421018.
   PubMed Web of Science ®Google Scholar
• Nelson-Le Gall, S. (1981). Help-seeking: An understudied problem-solving skill in children. Developmental Review, 1, 224–246.10.1016/0273-2297(81)90019-8
   Google Scholar
• Nelson-Le Gall, S. (1985). Help-seeking behavior in learning. In Review of research in education (Vol. 12, pp. 55–90). Washington, DC: American Educational Research Association.
   Web of Science ®Google Scholar
• Newman, R. S. (1994). Adaptive help-seeking: A strategy of self-regulated learning. In D.H. Schunk & B. T. Zimmerman (Eds.), Self-regulation of learning and performance: Issues and educational applications (pp. 283–301). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Newman, R. S. (2000). Social Influences on the development of children’s adaptive help seeking: The role of parents, teachers, and peers. Developmental Review, 20, 350–404. doi:10.1006/drev.1999.0502
   Web of Science ®Google Scholar
• Nicolini, D., Mengis, J., & Swan, J. (2012). Understanding the role of objects in cross-disciplinary collaboration. Organization Science, 23, 612–629.10.1287/orsc.1110.0664
   Web of Science ®Google Scholar
• Puustinen, M., Lyyra, A. L., Metsäpelto, R. L., & Pulkkinen, L. (2008). Children’s help seeking: The role of parenting. Learning and Instruction, 18, 160–171.10.1016/j.learninstruc.2007.02.001
   Web of Science ®Google Scholar
• Reffay, C., & Chanier, T. (2002). Social network analysis used for modeling collaboration in distance learning groups. In S. A. Cerri, G. Guardéres, & F. Paraguaçu (Eds.), Intelligent tutoring systems: 6th international conference (ITS 2002) (pp. 31–40). Biarritz and San Sebastian, France: Springer-Verlag.10.1007/3-540-47987-2
   Google Scholar
• Roschelle, J. (1992). Learning by collaborating: convergent conceptual change. The Journal of the Learning Sciences, 2, 235–276.10.1207/s15327809jls0203_1
   Google Scholar
• Sarmiento, J. W., & Stahl, G. (2008). Extending the joint problem space: Time and sequence as essential features of knowledge building. International Conference of the Learning Sciences (ICLS 2008), Utrecht, Netherlands. Retrieved March 23, 2016, from http://gerrystahl.net/pub/icls2008johann.pdf
   Google Scholar
• Stahl, G. (2015). The group as paradigmatic unit of analysis: The contested relationship of CSCL to the learning sciences. In M. Evans, M. Packer, & K. Sawyer (Eds.), The learning sciences: Mapping the terrain (pp. 1–19). Cambridge: Cambridge University Press.
   Google Scholar
• Stahl, G., Law, N., Cress, U., & Ludvigsen, S. (2014). Analyzing roles of individuals in small-group collaboration processes. International Journal of Computer-Supported Collaborative Learning, 9, 365–370.10.1007/s11412-014-9204-9
   Web of Science ®Google Scholar
• Tatsuoka, M. M. (1986). Graph theory and its applications in educational research: A review and integration. Review of Educational Research, 56, 291–329.10.3102/00346543056003291
   Web of Science ®Google Scholar
• Teasley, S. D., & Roschelle, J. (1993). Constructing a joint problem space: The computer as a tool for sharing knowledge. In S. P. Lajoie & S. J. Derry (Eds.), Computers as cognitive tools (pp. 229–258). New York, NY: Routledge.
   Google Scholar
• Tsan, J., Boyer, K. E., & Lynch, C. F. (2016, February). How early does the CS gender gap emerge? A study of collaborative problem solving in 5th grade computer science. In Proceedings of the 47th ACM technical symposium on computing science education (pp. 388–393). ACM.
   Google Scholar
• Vygotsky, L. S. (1978). Mind in society: The development of higher mental process. Cambridge, MA: Harvard University Press.
   Google Scholar
• Webb, N. (2009). The teacher’s role in promoting collaborative dialogue in the classroom. British Journal of Educational Psychology, 79, 1–28.10.1348/000709908X380772
   PubMed Web of Science ®Google Scholar
• Wilson, J. D., Hosking, N., & Nosek, J. T. (1993). The benefits of collaboration for student programmers. ACM SIGCSE Bulletin, 25, 160–164.10.1145/169073
   Google Scholar
• Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49, 33–35.10.1145/1118178
   Web of Science ®Google Scholar