Identifying nonconformities in contributions to programming projects: from an engagement perspective in improving code quality

References

• Abdi, Hervé, and Lynne J. Williams. 2010. “Principal Component Analysis.” Wiley Interdisciplinary Reviews: Computational Statistics 2 (4): 433–459. doi:10.1002/wics.101.
   Google Scholar
• ABET. 2020. “Criteria for Accrediting Engineering Programs, 2020–2021, ABET.” 2020. https://www.abet.org/accreditation/accreditation-criteria/criteria-for-accrediting-engineering-programs-2020-2021/.
   Google Scholar
• Aggarwal, Praveen, and Connie L. O’Brien. 2008. “Social Loafing on Group Projects: Structural Antecedents and Effect on Student Satisfaction.” Journal of Marketing Education 30 (3): 255–264. doi:10.1177/0273475308322283.
   Google Scholar
• Alker Jr, Hayward R., and Bruce M. Russett. 1964. “On Measuring Inequality.” Behavioral Science 9 (3): 207–218.
   PubMedGoogle Scholar
• Bacon, Donald R., Kim A. Stewart, and William S. Silver. 1999. “Lessons from the Best and Worst Student Team Experiences: How a Teacher Can Make the Difference.” Journal of Management Education 23 (5): 467–488.
   Google Scholar
• Barkley, Elizabeth, C. Howell Major, and K. Cross. 2008. “Técnicas de Aprendizaje Colaborativo. Manual Para El Profesorado Universitario.”.
   Google Scholar
• Barr, Terri Feldman, Andrea L. Dixon, and Jule B. Gassenheimer. 2005. “Exploring the ‘Lone Wolf’ Phenomenon in Student Teams.” Journal of Marketing Education 27 (1): 81–90. doi:10.1177/0273475304273459.
   Google Scholar
• Börjesson, Per Ola, Ali Hamidian, Eligijus Kubilinskas, Ulrike Richter, Kim Weyns, and Per Ödling. 2005. “Free-Riding in Group Work - Mechanisms and Countermeasures.” Introduction to Teaching and Learning in Higher Education. https://journals.lub.lu.se/KG/article/view/5921.
   Google Scholar
• Brooks, Charles M., and Janice L. Ammons. 2003. “Free Riding in Group Projects and the Effects of Timing, Frequency, and Specificity of Criteria in Peer Assessments.” Journal of Education for Business 78 (5): 268–272. doi:10.1080/08832320309598613.
   Google Scholar
• CDIO. 2011. “The CDIO Syllabus 2.0: An Updated Statement of Goals for Engineering Education.” 2011. http://www.cdio.org/framework-benefits/cdio-syllabus.
   Google Scholar
• Chen, Hsi-Min, Wei-Han Chen, and Chi-Chen Lee. 2018. “An Automated Assessment System for Analysis of Coding Convention Violations in Java Programming Assignments.” Journal of Information Science and Engineering 34 (5): 1203–1221.
   Web of Science ®Google Scholar
• Chen, Hsi-Min, Bao-An Nguyen, Yi-Xiang Yan, and Chyi-Ren Dow. 2020. “Analysis of Learning Behavior in an Automated Programming Assessment Environment: A Code Quality Perspective.” IEEE Access 8: 167341–167354.
   Web of Science ®Google Scholar
• Chua, Yi Han Victoria, Preman Rajalingam, Seng Chee Tan, and Justin Dauwels. 2019. “EduBrowser: A Multimodal Automated Monitoring System for Co-Located Collaborative Learning.” Communications in Computer and Information Science 1011 (April): 125–138. doi:10.1007/978-3-030-20798-4_12.
   Google Scholar
• Cristescu, Irina, and Alexandru Balog. 2018. “Exploring Motives for Using Facebook: A Latent Profile Analysis.” Studies in Informatics and Control 27 (3): 331–338.
   Web of Science ®Google Scholar
• De Bassi, Patricia Rücker, Gregory Moro Puppi, Pedro Henrique Banali, and Emerson Cabrera Paraiso. 2018. “Measuring Developers’ Contribution in Source Code Using Quality Metrics.” Proceedings of the 2018 IEEE 22nd international conference on computer supported cooperative work in design, CSCWD 2018, 869–71.
   Google Scholar
• Demerouti, Evangelia, Kim J. P. M. van Erp, Josette M. P. Gevers, and Sonja Rispens. 2014. “Bystander Conflict: Training Interventions for Teams in High-Stake Professions.” In Social Conflict Within and Between Groups, edited by Carsten K.W. De Dreu, 166–182. Current Issues in Social Psychology. New York, NY, USA: Psychology Press.
   Google Scholar
• DeRoma, Virginia M., Angela Young, Suzanne T. Mabrouk, Kenneth P. Brannan, Russell O. Hilleke, and Kristy Y. Johnson. 2003. “Procrastination and Student Performance on Immediate and Delayed Quizzes.” Education 124 (1): 40–48.
   Google Scholar
• Dubrovsky, Vitaly J., Sara Kiesler, and Beheruz N. Sethna. 1991. “The Equalization Phenomenon: Status Effects in Computer-Mediated and Face-to-Face Decision-Making Groups.” Human–Computer Interaction 6 (2): 119–146. doi:10.1207/s15327051hci0602_2.
   Google Scholar
• Dyrud, Marilyn A. 2001. “Group Projects and Peer Review.” Business Communication Quarterly 64 (4): 106–112. doi:10.1177/108056990106400412.
   Google Scholar
• Edwards, Stephen H., Nischel Kandru, and Mukund B. M. Rajagopal. 2017. “Investigating Static Analysis Errors in Student Java Programs.” ICER 2017 - proceedings of the 2017 ACM conference on international computing education research, 65–73. New York, NY, USA: Association for Computing Machinery, Inc.
   Google Scholar
• Eraslan, Sukru, Kamilla Kopec-Harding, Caroline Jay, Suzanne M. Embury, Robert Haines, Julio César Cortés Ríos, and Peter Crowther. 2020. “Integrating GitLab Metrics Into Coursework Consultation Sessions in a Software Engineering Course.” Journal of Systems and Software 167 (September): 110613, 1–11. doi:10.1016/j.jss.2020.110613.
   Web of Science ®Google Scholar
• Ferguson, Eamonn, Ruslan Shichman, and Jonathan H.W. Tan. 2020. “When Lone Wolf Defectors Undermine the Power of the Opt-Out Default.” Scientific Reports 10 (1): 1–12. doi:10.1038/s41598-020-65163-1.
   PubMed Web of Science ®Google Scholar
• Fidalgo-Blanco, Ángel, María Luisa Sein-Echaluce, Francisco J. García-Peñalvo, and Miguel Ángel Conde. 2015. “Using Learning Analytics to Improve Teamwork Assessment.” Computers in Human Behavior 47 (June): 149–156. doi:10.1016/j.chb.2014.11.050.
   Web of Science ®Google Scholar
• Flunger, Barbara, Ulrich Trautwein, Benjamin Nagengast, Oliver Lüdtke, Alois Niggli, and Inge Schnyder. 2015. “The Janus-Faced Nature of Time Spent on Homework: Using Latent Profile Analyses to Predict Academic Achievement Over a School Year.” Learning and Instruction 39 (October): 97–106. doi:10.1016/j.learninstruc.2015.05.008.
   Web of Science ®Google Scholar
• Gary, Kevin A., and Suhas Xavier. 2015. “Agile Learning through Continuous Assessment.” Proceedings - frontiers in education conference, FIE. Institute of Electrical and Electronics Engineers Inc.
   Google Scholar
• Goggins, Sean, Wanli Xing, Xin Chen, Bodong Chen, and Bob Wadholm. 2015. “Learning Analytics at ‘Small’ Scale: Exploring a Complexity-Grounded Model for Assessment Automation.” Journal of Universal Computer Science 21 (1): 66–92.
   Web of Science ®Google Scholar
• Gress, Carmen L. Z., Meghann Fior, Allyson F. Hadwin, and Philip H. Winne. 2010. “Measurement and Assessment in Computer-Supported Collaborative Learning.” Computers in Human Behavior 26 (5): 806–814. doi:10.1016/j.chb.2007.05.012.
   Web of Science ®Google Scholar
• Haaranen, Lassi, and Teemu Lehtinen. 2015. “Teaching Git on the Side - Version Control System as a Course Platform.” Annual conference on innovation and technology in computer science education, ITiCSE 2015-June (D): 87–92.
   Google Scholar
• Hair, Joseph F., William C. Black, Barry J. Babin, Rolph E. Anderson, Ronald L. Tatham, and others. 1998. Multivariate Data Analysis. Vol. 5. Upper Saddle River, NJ: Prentice Hall.
   Google Scholar
• Hall, David, and Simone Buzwell. 2013. “The Problem of Free-Riding in Group Projects: Looking Beyond Social Loafing as Reason for Non-Contribution.” Active Learning in Higher Education 14 (1): 37–49. doi:10.1177/1469787412467123.
   Web of Science ®Google Scholar
• Hoegl, Martin, and Hans Georg Gemuenden. 2001. “Teamwork Quality and the Success of Innovative Projects: A Theoretical Concept and Empirical Evidence.” Organization Science 12 (4): 435–449. doi:10.1287/orsc.12.4.435.10635.
   Web of Science ®Google Scholar
• Hudson, James M., and Amy S. Bruckman. 2004. “The Bystander Effect: A Lens for Understanding Patterns of Participation.” Journal of the Learning Sciences 13 (2): 165–195. doi:10.1207/s15327809jls1302_2.
   Web of Science ®Google Scholar
• Hughes, Richard L., and Steven K. Jones. 2011. New Directions for Institutional Research 2011 (149): 53–64. doi:10.1002/ir.380.
   Google Scholar
• Janssen, Jeroen, Gijsbert Erkens, Gellof Kanselaar, and Jos Jaspers. 2007. “Visualization of Participation: Does It Contribute to Successful Computer-Supported Collaborative Learning?” Computers and Education 49 (4): 1037–1065. doi:10.1016/j.compedu.2006.01.004.
   Web of Science ®Google Scholar
• Jeon, Lieny, Cynthia K. Buettner, and Eunhye Hur. 2016. “Preschool Teachers’ Professional Background, Process Quality, and Job Attitudes: A Person-Centered Approach.” Early Education and Development 27 (4): 551–571. doi:10.1080/10409289.2016.1099354.
   Web of Science ®Google Scholar
• Jeong, Heisawn, Cindy E. Hmelo-Silver, and Kihyun Jo. 2019. “Ten Years of Computer-Supported Collaborative Learning: A Meta-Analysis of CSCL in STEM Education During 2005–2014.” Educational Research Review 28 (November): 100284, 1–17. doi:10.1016/j.edurev.2019.100284.
   Web of Science ®Google Scholar
• Johnston, Lucy, and Lynden Miles. 2004. “Assessing Contributions to Group Assignments.” Assessment & Evaluation in Higher Education 29 (6): 751–768. doi:10.1080/0260293042000227272.
   Google Scholar
• Karavirta, Ville, Ari Korhonen, and Lauri Malmi. 2006. “On the Use of Resubmissions in Automatic Assessment Systems.” Computer Science Education 16 (3): 229–240. doi:10.1080/08993400600912426.
   Google Scholar
• Kato, Toshiyasu, Yasushi Kambayashi, and Yasushi Kodama. 2016. “Data Mining of Students’ Behaviors in Programming Exercises.” In Smart Education and E-Learning 2016, edited by Vladimir L. Uskov, Robert J. Howlett, and Lakhmi C. Jain, 121–133. Cham: Springer International Publishing.
   Google Scholar
• Kawaguchi, Kohsuke. 2011. “Jenkins.” 2011. https://www.jenkins.io/.
   Google Scholar
• Keuning, Hieke, Johan Jeuring, and Bastiaan Heeren. 2019. “A Systematic Literature Review of Automated Feedback Generation for Programming Exercises.” ACM Transactions on Computing Education 19 (1): 3, 1–43. doi:10.1145/3231711.
   Web of Science ®Google Scholar
• Latane, B., B. Latané, and J. M. Darley. 1970. The Unresponsive Bystander: Why Doesn’t He Help?. New York: Appleton-Century Crofts.
   Google Scholar
• Liu, Arita L., and John C. Nesbit. 2020. “Dashboards for Computer-Supported Collaborative Learning.” In Machine Learning Paradigms: Advances in Learning Analytics, edited by Maria Virvou, Efthimios Alepis, George A. Tsihrintzis, and Lakhmi C. Jain, 158, 157–182. Cham: Springer International Publishing.
   Google Scholar
• MacDonald, Janet. 2003. “Assessing Online Collaborative Learning: Process and Product.” Computers and Education 40 (4): 377–391. doi:10.1016/S0360-1315(02)00168-9.
   Web of Science ®Google Scholar
• MacMillan, Jean, Michael J. Paley, Eileen B. Elliot, E. Entin, Eileen B. Elliot, and E. Entin. 2004. “Questionnaires for Distributed Assessment of Team Mutual Awareness.” In Handbook of Human Factors and Ergonomics Methods, edited by Neville A. Stanton, Alan Hedge, Karel Brookhuis, Eduardo Salas, and Hal W. Hendrick, 510–520. Boca Raton: CRC Press.
   Google Scholar
• Maiden, Barbara, and Bob Perry. 2011. “Dealing with Free-Riders in Assessed Group Work: Results from a Study at a UK University.” Assessment and Evaluation in Higher Education 36 (4): 451–464. doi:10.1080/02602930903429302.
   Web of Science ®Google Scholar
• Martin, Robert C. 2009. Clean Code: A Handbook of Agile Software Craftsmanship. New Jersey: Pearson Education.
   Google Scholar
• Meijer, Hajo, Rink Hoekstra, Jasperina Brouwer, and Jan-Willem Strijbos. 2020. “Unfolding Collaborative Learning Assessment Literacy: A Reflection on Current Assessment Methods in Higher Education.” Assessment & Evaluation in Higher Education 45 (8): 1222–1240. doi:10.1080/02602938.2020.1729696.
   Web of Science ®Google Scholar
• Meyer, John P., Laura J. Stanley, and Robert J. Vandenberg. 2013. “A Person-Centered Approach to the Study of Commitment.” Human Resource Management Review 23 (2): 190–202. doi:10.1016/j.hrmr.2012.07.007.
   Web of Science ®Google Scholar
• Nguyen, Bao-An, Kuan-Yu Ho, and Hsi-Min Chen. 2020. “Measure Students’ Contribution in Web Programming Projects by Exploring Source Code Repository.” In International Computer Symposium. Tainan, Taiwan.
   Google Scholar
• Parizi, Reza M., Paola Spoletini, and Amritraj Singh. 2018. “Measuring Team Members’ Contributions in Software Engineering Projects Using Git-Driven Technology.” Proceedings - frontiers in education conference, FIE. Vol. 2018-Octob. Institute of Electrical and Electronics Engineers Inc.
   Google Scholar
• Pastor, Dena A., Kenneth E. Barron, B. J. Miller, and Susan L. Davis. 2007. “A Latent Profile Analysis of College Students’ Achievement Goal Orientation.” Contemporary Educational Psychology 32 (1): 8–47. doi:10.1016/j.cedpsych.2006.10.003.
   Web of Science ®Google Scholar
• Petersen, Kimberly J., Pamela Qualter, and Neil Humphrey. 2019. “The Application of Latent Class Analysis for Investigating Population Child Mental Health: A Systematic Review.” Frontiers in Psychology 10 (MAY): 1214, 1–16. doi:10.3389/fpsyg.2019.01214.
   Web of Science ®Google Scholar
• Pieterse, Vreda, and Lisa Thompson. 2010. “Academic Alignment to Reduce the Presence of ‘Social Loafers’ and ‘Diligent Isolates’ in Student Teams.” Teaching in Higher Education 15 (4): 355–367. doi:10.1080/13562517.2010.493346.
   Web of Science ®Google Scholar
• Raibulet, Claudia, and Francesca Arcelli Fontana. 2018. “Collaborative and Teamwork Software Development in an Undergraduate Software Engineering Course.” Journal of Systems and Software 144 (October): 409–422. doi:10.1016/j.jss.2018.07.010.
   Web of Science ®Google Scholar
• Rajaguru, Rajesh, Roshni Narendran, and Gayathri Rajesh. 2020. “Social Loafing in Group-Based Learning: Student-Created and Instructor-Created Group Perspectives.” Education and Training 62 (4): 483–501. doi:10.1108/et-01-2019-0018.
   Web of Science ®Google Scholar
• Scrucca, Luca, Michael Fop, T. Brendan Murphy, and Adrian E. Raftery. 2016. “Mclust 5: Clustering, Classification and Density Estimation Using Gaussian Finite Mixture Models.” R Journal 8 (1): 289–317. doi:10.32614/rj-2016-021.
   Web of Science ®Google Scholar
• Søndergaard, Harald, and Raoul A. Mulder. 2012. “Collaborative Learning Through Formative Peer Review: Pedagogy, Programs and Potential.” Computer Science Education 22 (4): 343–367. doi:10.1080/08993408.2012.728041.
   Google Scholar
• Stahl, Gerry. 2013. “Theories of Collaborative Cognition: Foundations for CSCL and CSCW Together.” In Computer-Supported Collaborative Learning at the Workplace: CSCL@Work, edited by Sean P. Goggins, Isa Jahnke, and Volker Wulf, 43–63. Boston, MA: Springer US.
   Google Scholar
• Stanley, Laura, Christian Vandenberghe, Robert Vandenberg, and Kathleen Bentein. 2013. “Commitment Profiles and Employee Turnover.” Journal of Vocational Behavior 82 (3): 176–187. doi:10.1016/j.jvb.2013.01.011.
   Web of Science ®Google Scholar
• Strijbos, Jan Willem. 2011. “Assessment of (Computer-Supported) Collaborative Learning.” IEEE Transactions on Learning Technologies 4 (1): 59–73. doi:10.1109/TLT.2010.37.
   Web of Science ®Google Scholar
• Stuart, Alan, Steven Arnold, J. Keith Ord, Anthony O’Hagan, and Jonathan Forster. 1994. Kendall’s Advanced Theory of Statistics. 6th ed. West Sussex: John Wiley and Sons.
   Google Scholar
• Vermunt, Jeroen K., and Jay Magidson. 2002. “Latent Class Cluster Analysis.” In Applied Latent Class Analysis, edited by Jacques A. Hagenaars and Allan L. McCutcheon, 89–106. Cambridge: Cambridge University Press.
   Google Scholar
• Webb, Noreen M. 1997. “Assessing Students in Small Collaborative Groups.” Theory Into Practice 36 (4): 205–213. doi:10.1080/00405849709543770.
   Web of Science ®Google Scholar
• Zagalsky, Alexey, Joseph Feliciano, Margaret Anne Storey, Yiyun Zhao, and Weiliang Wang. 2015. “The Emergence of GitHub as a Collaborative Platform for Education.” Proceedings of the 2015 ACM international conference on computer-supported cooperative work and social computing, 1906–17.
   Google Scholar