79
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Virtual pair programming and online oral exams: effects on social interaction, performance, and academic integrity in a remote computer programming course

ORCID Icon, , , , , , , , , , & show all
Received 22 Jul 2023, Accepted 15 Apr 2024, Published online: 05 May 2024

References

  • Anaya, G., & Cole, D. G. (2001). Latina/O student achievement: Exploring the influence of student–faculty interactions on college grades. Journal of College Student Development, 42(1), 3–14.
  • Beck, K., & Andres, C. (2004). Extreme programming explained: Embrace change (2nd ed.). Addison-Wesley.
  • Begel, A., & Nagappan, N. (2008). Pair programming: What’s in it for me? Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (pp. 120–128). https://doi.org/10.1145/1414004.1414026
  • Benaya, T., & Zur, E. (2007). Collaborative programming projects in an advanced CS course. Journal of Computing Sciences in Colleges, 22(6), 126–135.
  • Bilen, E., & Matros, A. (2021). Online cheating amid COVID-19. Journal of Economic Behavior & Organization, 182, 196–211. https://doi.org/10.1016/j.jebo.2020.12.004
  • Bluestein, S. A. (2015). Connecting student-faculty interaction to academic dishonesty. Community College Journal of Research and Practice, 39(2), 179–191. https://doi.org/10.1080/10668926.2013.848176
  • Blumenfeld, P. C., Kempler, T. M., & Krajcik, J. S. (2005). Motivation and cognitive engagement in learning environments. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 475–488). Cambridge University Press. https://doi.org/10.1017/CBO9780511816833.029.
  • Boedigheimer, R., Ghrist, M., Peterson, D., & Kallemyn, B. (2015). Individual oral exams in mathematics courses: 10 years of experience at the air force academy. PRIMUS, 25(2), 99–120. https://doi.org/10.1080/10511970.2014.906008
  • Cao, L., & Xu, P. (2005). Activity patterns of pair programming. Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS’05) - Track 3 (Vol. 03. pp. 88.1). https://doi.org/10.1109/HICSS.2005.66
  • Carless, D. R. (2002). The “mini-viva” as a tool to enhance assessment for learning. Assessment & Evaluation in Higher Education, 27(4), 353–363. https://doi.org/10.1080/0260293022000001364
  • Carver, J. C., Henderson, L., He, L., Hodges, J., & Reese, D. (2007). Increased retention of early computer science and software engineering students using pair programming. 20th Conference on Software Engineering Education & Training (CSEET’07) (pp. 115–122). https://doi.org/10.1109/CSEET.2007.29
  • Cavaleri, M., & Tran, K. (2021). Online academic support during the COVID-19 pandemic. Journal of Academic Language and Learning, 15(1), R1–R11.
  • Chao, J., & Atli, G. (2006). Critical personality traits in successful pair programming. AGILE 2006 (AGILE’06), 5, 93. https://doi.org/10.1109/AGILE.2006.20
  • Clark, M. R. (2005). Negotiating the freshman year: Challenges and strategies among first-year college students. Journal of College Student Development, 46(3), 296–316. https://doi.org/10.1353/csd.2005.0022
  • da Silva Estácio, B. J., & Prikladnicki, R. (2015). Distributed pair programming: A systematic literature review. Information and Software Technology, 63, 1–10. https://doi.org/10.1016/j.infsof.2015.02.011
  • Davids, L. K. (2012). A study on the effectiveness of team-based oral examinations in an undergraduate engineering course. Proceedings of the 2012 ASEE Annual Conference & Exposition, San Antonio, Texas (pp. 25–108). https://doi.org/10.18260/1-2–20868.
  • Delahunty, J., Verenikina, I., & Jones, P. (2014). Socio-emotional connections: Identity, belonging and learning in online interactions. A literature review. Technology, Pedagogy & Education, 23(2), 243–265. https://doi.org/10.1080/1475939X.2013.813405
  • Demir, Ö., & Seferoglu, S. S. (2021). The effect of determining pair programming groups according to various individual difference variables on group compatibility, flow, and coding performance. Journal of Educational Computing Research, 59(1), 41–70. https://doi.org/10.1177/0735633120949787
  • Dick, M. (2005). Student interviews as a tool for assessment and learning in a systems analysis and design course. Proceedings of the 10th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education (pp. 24–28). https://doi.org/10.1145/1067445.1067456
  • Eaton, S. E., & Turner, K. L. (2020). Exploring academic integrity and mental health during covid-19: Rapid review. Journal of Contemporary Education Theory & Research, 4(1), 35–41.
  • Faja, S. (2011). Pair programming as a team based learning activity: A review of research. Issues in Information Systems, XII(2), 207–216. https://doi.org/10.48009/2_iis_2011_207-216
  • Gallant, T. B., & Drinan, P. (2006). Organizational theory and student cheating: Explanation, responses, and strategies. The Journal of Higher Education, 77(5), 839–860. https://doi.org/10.1080/00221546.2006.11778946
  • Gamage, K. A. A., Pradeep, R. G. G. R., Najdanovic-Visak, V., & Gunawardhana, N. (2020). Academic standards and quality assurance: The impact of COVID-19 on university degree programs. Sustainability, 12(23), Article 23. 10032. https://doi.org/10.3390/su122310032
  • Gašević, D., Zouaq, A., & Janzen, R. (2013). “Choose your classmates, your GPA is at stake!”: The association of cross-class social ties and academic performance. American Behavioral Scientist, 57(10), 1460–1479. https://doi.org/10.1177/0002764213479362
  • Gehringer, E. F. (2003). A pair-programming experiment in a non-programming course. Companion of the 18th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (pp. 187–190). https://doi.org/10.1145/949344.949397
  • Genereux, R. L., & McLeod, B. A. (1995). Circumstances surrounding cheating: A questionnaire study of college students. Research in Higher Education, 36(6), 687–704. https://doi.org/10.1007/BF02208251
  • Goodman, A. L. (2020). Can group oral exams and team assignments help create a supportive student community in a biochemistry course for nonmajors? Journal of Chemical Education, 97(9), 3441–3445. https://doi.org/10.1021/acs.jchemed.0c00815
  • Grunwald, D., Boese, E., Hoenigman, R., Sayler, A., & Stafford, J. (2015). Personalized attention @ scale: Talk Isn’t cheap, but It’s effective. Proceedings of the 46th ACM Technical Symposium on Computer Science Education (pp. 610–615). https://doi.org/10.1145/2676723.2677283
  • Guest, K. E., & Murphy, D. S. (2000). In support of memory retention: A cooperative oral final exam. Education, 121(2), 350–353.
  • Hahn, J. H., Mentz, E., & Meyer, L. (2009). Assessment strategies for pair programming. Journal of Information Technology Education Research, 8(1), 273–284. https://doi.org/10.28945/694
  • Hanks, B. (2008). Empirical evaluation of distributed pair programming. International Journal of Human-Computer Studies, 66(7), 530–544. https://doi.org/10.1016/j.ijhcs.2007.10.003
  • Hanks, B., Fitzgerald, S., McCauley, R., Murphy, L., & Zander, C. (2011). Pair programming in education: A literature review. Computer Science Education, 21(2), 135–173. https://doi.org/10.1080/08993408.2011.579808
  • Hanrahan, S. J., & Isaacs, G. (2001). Assessing self- and peer-assessment: The students’ views. Higher Education Research & Development, 20(1), 53–70. https://doi.org/10.1080/07294360123776
  • Hawlitschek, A., Berndt, S., & Schulz, S. (2022). Empirical research on pair programming in higher education: A literature review. Computer Science Education, 1–29. https://doi.org/10.1080/08993408.2022.2039504
  • Hopcan, S., Polat, E., & Albayrak, E. (2022). Collaborative behavior patterns of students in programming instruction. Journal of Educational Computing Research, 60(4), 1035–1062. https://doi.org/10.1177/07356331211062260
  • Huxham, M., Campbell, F., & Westwood, J. (2012). Oral versus written assessments: A test of student performance and attitudes. Assessment & Evaluation in Higher Education, 37(1), 125–136. https://doi.org/10.1080/02602938.2010.515012
  • Iannone, P., Czichowsky, C., & Ruf, J. (2020). The impact of high stakes oral performance assessment on students’ approaches to learning: A case study. Educational Studies in Mathematics, 103(3), 313–337. https://doi.org/10.1007/s10649-020-09937-4
  • Iannone, P., & Simpson, A. (2015). Students’ views of oral performance assessment in mathematics: Straddling the ‘assessment of’ and ‘assessment for’ learning divide. Assessment & Evaluation in Higher Education, 40(7), 971–987. https://doi.org/10.1080/02602938.2014.961124
  • Johnson, D. W., Johnson, R. T., & Smith, K. (2007). The state of cooperative learning in postsecondary and professional settings. Educational Psychology Review, 19(1), 15–29. https://doi.org/10.1007/s10648-006-9038-8
  • Joughin, G. (1998). Dimensions of oral assessment. Assessment & Evaluation in Higher Education, 23(4), 367–378. https://doi.org/10.1080/0260293980230404
  • Kantanis, T. (2000). The role of social transition in students’: Adjustment to the first-year of university. Journal of Institutional Research, 9(1), 100–110.
  • Katira, N., Williams, L., Wiebe, E., Miller, C., Balik, S., & Gehringer, E. (2004). On understanding compatibility of student pair programmers. Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education (pp. 7–11). https://doi.org/10.1145/971300.971307
  • Kim, M., Pilegard, C., Lubarda, M., Schurgers, C., Baghdadchi, S., Phan, A., & Qi, H. (2022). Midterm oral exams add value as a predictor of final written exam performance in engineering classes: A multiple regression analysis. Proceedings of the 2022 ASEE Annual Conference & Exposition, June 26-29, 2022, Minneapolis, Minnesota. https://doi.org/10.18260/1-2–41102
  • Koulouri, T., Lauria, S., & Macredie, R. D. (2015). Teaching introductory programming: A quantitative evaluation of different approaches. ACM Transactions on Computing Education, 14(4), 1–28. https://doi.org/10.1145/2662412
  • Kuh, G. D., & Hu, S. (2001). The effects of student-faculty interaction in the 1990s. Review of Higher Education: Journal of the Association for the Study of Higher Education, 24(3), 309–332. https://doi.org/10.1353/rhe.2001.0005
  • Lee, Y., & Choi, J. (2011). A review of online course dropout research: Implications for practice and future research. Educational Technology Research & Development, 59(5), 593–618. https://doi.org/10.1007/s11423-010-9177-y
  • Lee, N. T. S., Kurniawan, O., & Choo, K. T. W. (2021). Assessing programming skills and knowledge during the COVID-19 pandemic: An experience report. Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education (Vol. 1. pp. 352–358). https://doi.org/10.1145/3430665.3456323
  • Liebenberg, J., Mentz, E., & Breed, B. (2012). Pair programming and secondary school girls’ enjoyment of programming and the subject Information Technology (IT). Computer Science Education, 22(3), 219–236. https://doi.org/10.1080/08993408.2012.713180
  • Lubarda, M., Delson, N., Schurgers, C., Ghazinejad, M., Baghdadchi, S., Phan, A., Minnes, M., Relaford-Doyle, J., Klement, L., & Sandoval, C. (2021). Oral exams for large-enrollment engineering courses to promote academic integrity and student engagement during remote instruction. 2021 Frontiers in Education Conference, October 13-16, 2021, Lincoln, Nebraska. https://doi.org/10.1109/FIE49875.2021.9637124
  • Lubarda, M. V., Phan, A. M., Ghazinejad, M., Delson, N., Baghdadchi, S., Schurgers, C., Kim, M., Relaford-Doyle, J., Sandoval, C. L., & Qi, H. (2023). Peer oral exams: A learner-centered authentic assessment approach scalable to large classes. Proceedings of the 2023 ASEE Annual Conference & Exposition, June 25-28, 2023, Baltimore, Maryland. https://doi.org/10.18260/1-2–43878
  • Lundberg, C. A., & Schreiner, L. A. (2004). Quality and frequency of faculty-student interaction as predictors of learning: An analysis by student race/ethnicity. Journal of College Student Development, 45(5), 549–565. https://doi.org/10.1353/csd.2004.0061
  • McCabe, D. L., Butterfield, K. D., & Treviño, L. K. (2012). Cheating in college: Why students do it and what educators can do about it. JHU Press.
  • McDowell, C., Hanks, B., & Werner, L. (2003a). Experimenting with pair programming in the classroom. Proceedings of the 8th Annual Conference on Innovation and Technology in Computer Science Education (pp. 60–64). https://doi.org/10.1145/961511.961531
  • Mcdowell, C., Werner, L., Bullock, H. E., & Fernald, J. (2003b). The impact of pair programming on student performance, perception and persistence. 25th International Conference on Software Engineering, 2003. Proceedings. (pp. 602–607). https://doi.org/10.1109/ICSE.2003.1201243
  • McDowell, C., Werner, L., Bullock, H. E., & Fernald, J. (2006). Pair programming improves student retention, confidence, and program quality. Communications of the ACM, 49(8), 90–95. https://doi.org/10.1145/1145287.1145293
  • Melnik, G., & Maurer, F. (2002). Perceptions of agile practices: A student survey. In D. Wells & L. Williams (Eds.), Extreme programming and agile methods—XP/Agile universe 2002 (pp. 241–250). Springer. https://doi.org/10.1007/3-540-45672-4_27.
  • Morrissett, I. (1958). An experiment with oral examinations. The Journal of Higher Education, 29(4), 185–190. https://doi.org/10.1080/00221546.1958.11776366
  • Odafe, V. U. (2006). Oral examination in college mathematics: An alternative assessment technique. PRIMUS, 16(3), 243–256. https://doi.org/10.1080/10511970608984149
  • Pereira, D., Flores, M. A., & Niklasson, L. (2016). Assessment revisited: A review of research in assessment and evaluation in higher education. Assessment & Evaluation in Higher Education, 41(7), 1008–1032. https://doi.org/10.1080/02602938.2015.1055233
  • Phan, A., Kim, M., Lubarda, M. V., Schurgers, C., & Qi, H. (2023). Impact of Perceived Stress during Oral Examination on Student Performance Outcomes, 25-28, 2023,Baltimore, Maryland. https://doi.org/10.18260/1-2–43487
  • Qi, H., Kim, M., Li, Y., Sandoval, C. L., Schurgers, C., Lubarda, M. V., Gedney, X. E., Baghdadchi, S., & Phan, A. (2023). Proceedings of the 2023 ASEE Annual Conference & Exposition, June 25-28, 2023, Baltimore, Maryland. https://doi.org/10.18260/1-2–43756
  • Qi, H., Lubarda, M., Schurgers, C., Sandoval, C. L., Ghazinejad, M., Relaford-Doyle, J., Kim, M., Minnes, M., Baghdadchi, S., Phan, A. M., Pilegard, C., & Delson, N. (2022). Insights from the first year of project # 2044472: Improving the conceptual mastery of engineering students in high enrollment engineering courses through oral exams. Proceedings of the 2022 ASEE Annual Conference & Exposition, June 26-29, 2022, Minneapolis, Minnesota. https://doi.org/10.18260/1-2–42102
  • Radermacher, A. D., & Walia, G. S. (2011). Investigating the effective implementation of pair programming: An empirical investigation. Proceedings of the 42nd ACM Technical Symposium on Computer Science Education (pp. 655–660). https://doi.org/10.1145/1953163.1953346
  • Ragusa, A. T., & Crampton, A. (2018). Sense of connection, identity and academic success in distance education: Sociologically exploring online learning environments. Rural Society, 27(2), 125–142. https://doi.org/10.1080/10371656.2018.1472914
  • Ramella, D. (2019). Oral exams: A deeply neglected tool for formative assessment in chemistry. In Active learning in general chemistry: Specific interventions (Vol. 1340, pp. 79–89). American Chemical Society. https://doi.org/10.1021/bk-2019-1340.ch006.
  • Reckinger, S. J., & Reckinger, S. M. (2021). Oral proficiency exams in high-enrollment computer science courses. Proceedings of the 2021 ASEE Virtual Annual Conference.
  • Reckinger, S. J., & Reckinger, S. M. (2022). A study of the effects of oral proficiency exams in introductory programming courses on underrepresented groups. Proceedings of the 53rd ACM Technical Symposium on Computer Science Education, 1(1), 633–639. https://doi.org/10.1145/3478431.3499382
  • Rouser, K. P. (2017). Oral assessments of student learning in undergraduate aerospace propulsion and power courses. Journal of Engineering for Gas Turbines and Power, 139(12). https://doi.org/10.1115/1.4037577
  • Sabin, M., Jin, K. H., & Smith, A. (2021). Oral exams in shift to remote learning. Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (pp. 666–672). https://doi.org/10.1145/3408877.3432511
  • Salleh, N., Mendes, E., & Grundy, J. (2011). Empirical studies of pair programming for CS/SE teaching in higher education: A systematic literature review. IEEE Transactions on Software Engineering, 37(4), 509–525. https://doi.org/10.1109/TSE.2010.59
  • Salleh, N., Mendes, E., Grundy, J., & Burch, G. S. J. (2009). An empirical study of the effects of personality in pair programming using the five-factor model. 2009 3rd International Symposium on Empirical Software Engineering and Measurement (pp. 214–225). https://doi.org/10.1109/ESEM.2009.5315997
  • Sanagavarapu, P., Abraham, J., & Taylor, E. (2019). Development and validation of a scale to measure first year students’ transitional challenges, wellbeing, help-seeking, and adjustments in an Australian university. Higher Education, 77(4), 695–715. https://doi.org/10.1007/s10734-018-0298-2
  • Satratzemi, M., Stelios, X., & Tsompanoudi, D. (2023). Distributed pair programming in higher education: A systematic literature review. Journal of Educational Computing Research, 61(3), 546–577. https://doi.org/10.1177/07356331221122884
  • Stearns, S. A. (2001). The student-instructor relationship’s effect on academic integrity. Ethics & Behavior, 11(3), 275–285. https://doi.org/10.1207/S15327019EB1103_6
  • Sun, D., Ouyang, F., Li, Y., & Chen, H. (2021). Three contrasting pairs’ collaborative programming processes in China’s secondary education. Journal of Educational Computing Research, 59(4), 740–762. https://doi.org/10.1177/0735633120973430
  • Theobold, A. S. (2021). Oral exams: A more meaningful assessment of students’ understanding. Journal of Statistics and Data Science Education, 29(2), 156–159. https://doi.org/10.1080/26939169.2021.1914527
  • Thomas, L., Ratcliffe, M., & Robertson, A. (2003). Code warriors and code-a-phobes: A study in attitude and pair programming. ACM SIGCSE Bulletin, 35(1), 363–367. https://doi.org/10.1145/792548.612007
  • Tippitt, M. P., Ard, N., Kline, J. R., Tilghman, J., Chamberlain, B., & Meagher, G. P. (2009). Creating environments that foster academic integrity. Nursing Education Perspectives, 30(4), 239–244.
  • Turner, K., Roberts, L., Heal, C., & Wright, L. (2013). Oral presentation as a form of summative assessment in a master’s level PGCE module: The student perspective. Assessment & Evaluation in Higher Education, 38(6), 662–673. https://doi.org/10.1080/02602938.2012.680016
  • VanDegrift, T. (2004). Coupling pair programming and writing: Learning about students’ perceptions and processes. ACM SIGCSE Bulletin, 36(1), 2–6. https://doi.org/10.1145/1028174.971306
  • Vandenberg, J., Zakaria, Z., Tsan, J., Iwanski, A., Lynch, C., Boyer, K. E., & Wiebe, E. (2021). Prompting collaborative and exploratory discourse: An epistemic network analysis study. International Journal of Computer-Supported Collaborative Learning, 16(3), 339–366. https://doi.org/10.1007/s11412-021-09349-3
  • Villarroel, V., Boud, D., Bloxham, S., Bruna, D., & Bruna, C. (2020). Using principles of authentic assessment to redesign written examinations and tests. Innovations in Education and Teaching International, 57(1), 1–12. https://doi.org/10.1080/14703297.2018.1564882
  • Werner, L. L., Hanks, B., & McDowell, C. (2004). Pair-programming helps female computer science students. Journal on Educational Resources in Computing, 4(1), 4–es. https://doi.org/10.1145/1060071.1060075
  • Williams, L. A., & Kessler, R. R. (2000). All I really need to know about pair programming I learned in kindergarten. Communications of the ACM, 43(5), 108–114. https://doi.org/10.1145/332833.332848
  • Williams, L. A., & Kessler, R. R. (2001). Experiments with industry’s “pair-programming” model in the computer science classroom. Computer Science Education, 11(1), 7–20. https://doi.org/10.1076/csed.11.1.7.3846
  • Williams, L., Layman, L., Slaten, K. M., Berenson, S. B., & Seaman, C. (2007). On the impact of a collaborative pedagogy on African American millennial students in software engineering. 29th International Conference on Software Engineering (ICSE’07) (pp. 677–687). https://doi.org/10.1109/ICSE.2007.58
  • Williams, L., McDowell, C., Nagappan, N., Fernald, J., & Werner, L. (2003). Building pair programming knowledge through a family of experiments. 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings (pp. 143–152). https://doi.org/10.1109/ISESE.2003.1237973
  • Williams, L., Wiebe, E., Yang, K., Ferzli, M., & Miller, C. (2002). In support of pair programming in the introductory computer science course. Computer Science Education, 12(3), 197–212. https://doi.org/10.1076/csed.12.3.197.8618
  • Xinogalos, S., Satratzemi, M., Chatzigeorgiou, A., & Tsompanoudi, D. (2019). Factors affecting students’ performance in distributed pair programming. Journal of Educational Computing Research, 57(2), 513–544. https://doi.org/10.1177/0735633117749432
  • Young, R. L., Miller, G. N. S., & Barnhardt, C. L. (2018). From policies to principles: The effects of campus climate on academic integrity, a mixed methods study. Journal of Academic Ethics, 16(1), 1–17. https://doi.org/10.1007/s10805-017-9297-7
  • Zarb, M., & Hughes, J. (2015). Breaking the communication barrier: Guidelines to aid communication within pair programming. Computer Science Education, 25(2), 120–151. https://doi.org/10.1080/08993408.2015.1033125

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.