A model to combine qualitative and quantitative measures in education for better assessment of learning outcomes

References

• Bhattacharyya, T., Prasath, R., & Bhattacharya, B. (2013). Qualitative learning outcome through computer assisted instructions. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 8284 LNAI (pp. 567–578). https://doi.org/10.1007/978-3-319-03844-5_56
   Google Scholar
• Biggs, J., & Tang, C. (2011). Teaching for quality learning at university (4th ed.). Open University Press.
   Google Scholar
• Chilukuri, K. (2020). A novel framework for active learning in engineering education mapped to course outcomes. Procedia Computer Science, 172, 28–33. https://doi.org/10.1016/j.procs.2020.05.004
   Google Scholar
• Chung, J., & Lee, S. (2019). Dropout early warning systems for high school students using machine learning. Children and Youth Services Review, 96, 346–353. https://doi.org/10.1016/j.childyouth.2018.11.030
   Web of Science ®Google Scholar
• Coates, H. (2016). Assessing student learning outcomes internationally: Insights and frontiers. Assessment and Evaluation in Higher Education, 41(5), 662–676. https://doi.org/10.1080/02602938.2016.1160273
   Web of Science ®Google Scholar
• Coates, H., & Zlatkin-Troitschanskaia, O. (2019). The governance, policy, and strategy of learning outcomes assessment in higher education. Higher Education Policy, 32(4), 507–512. https://doi.org/10.1057/s41307-019-00161-1
   Web of Science ®Google Scholar
• Dewaele, J., & Alfawzan, M. (2018). Does the effect of enjoyment outweigh that of anxiety in foreign language performance? Studies in Second Language Learning and Teaching, 8(1), 21–45. https://doi.org/10.14746/ssllt.2018.8.1.2
   Web of Science ®Google Scholar
• Dirkx, J. (2008). The meaning and role of emotions in adult learning. New Directions for Adult and Continuing Education, 120(120), 7–18. https://doi.org/10.1002/ace.311
   Google Scholar
• Dobbins, K., Brooks, S., Scott, J., Rawlinson, M., & Norman, R. (2014). Understanding and enacting learning outcomes: The academic's perspective. Studies in Higher Education, 41(7), 1217–1235. https://doi.org/10.1080/03075079.2014.966668
   Web of Science ®Google Scholar
• Frederickson, N., Reed, P., & Clifford, V. (2005). Evaluating web-supported learning versus lecture-based teaching: Quantitative and qualitative perspectives. Higher Education, 50(4), 645–664. https://doi.org/10.1007/s10734-004-6370-0
   Web of Science ®Google Scholar
• Gerritsen-van Leeuwenkamp, K., Joosten-ten Brinke, D., & Kester, L. (2019). Students’ perceptions of assessment quality are related to their learning approaches and learning outcomes. Studies in Educational Evaluation, 63, 72–82. https://doi.org/10.1016/j.stueduc.2019.07.005
   Web of Science ®Google Scholar
• Goebel, J., & Maistry, S. (2019). Recounting the role of emotions in learning economics: Using the threshold concepts framework to explore affective dimensions of students’ learning. International Review of Economics Education, 30, 100145. https://doi.org/10.1016/j.iree.2018.08.001
   Web of Science ®Google Scholar
• Goleman, D. J. (2002). Emotional intelligence: Issues in paradigm building from the book the emotionally intelligent workplace.
   Google Scholar
• Gopee, N., & Deane, M. (2013). Strategies for successful academic writing — Institutional and non-institutional support for students. Nurse Education Today, 33(12), 1624–1631. https://doi.org/10.1016/j.nedt.2013.02.004
   PubMed Web of Science ®Google Scholar
• Gray, C. C., & Perkins, D. (2019). Utilizing early engagement and machine learning to predict student outcomes. Computers & Education, 131, 22–32. https://doi.org/10.1016/j.compedu.2018.12.006
   Web of Science ®Google Scholar
• Halliday, S. E., Calkins, S. D., & Leerkes, E. M. (2018). Measuring preschool learning engagement in the laboratory. Journal of Experimental Child Psychology, 167, 93–116. https://doi.org/10.1016/j.jecp.2017.10.006
   PubMed Web of Science ®Google Scholar
• Hammond, K. M., & Brown, S. (2021). Transitioning to learning outcomes at the coalface: An academic’s quantitative evaluation at the course level. Studies in Educational Evaluation, 68(December 2020), 100961. https://doi.org/10.1016/j.stueduc.2020.100961
   Google Scholar
• Hein, J., Daumiller, M., Janke, S., Dresel, M., & Dickhäuser, O. (2019). How learning time mediates the impact of university scholars’ learning goals on professional learning in research and teaching. Learning and Individual Differences, 72, 15–25. https://doi.org/10.1016/j.lindif.2019.04.002
   Web of Science ®Google Scholar
• Jarvis, P. (2012). Watts, M. International handbook of learning. Routledge Publication.
   Google Scholar
• Jayachandran, S., Biradavolu, M., & Cooper, J. (2021). Using machine learning and qualitative interviews to design a five-question women’s agency index. SSRN Electronic Journal Working Paper No. 28626, March 2021, https://doi.org/10.2139/ssrn.3820285
   Google Scholar
• Jeongyeon, K., & Hye Young, S. (2020). Negotiation of emotions in emerging language teacher identity of graduate instructors. System, 95, 102365. https://doi.org/10.1016/j.system.2020.102365
   Web of Science ®Google Scholar
• Johnson, D., & Parrado, A. (2021). Assessing the assessments: Taking stock of learning outcomes data in India. International Journal of Educational Development, 84, 102409. https://doi.org/10.1016/j.ijedudev.2021.102409
   PubMed Web of Science ®Google Scholar
• Katawazai, R. (2021). Implementing outcome-based education and student-centered learning in Afghan public universities: The current practices and challenges. Heliyon, 7(5), e07076. https://doi.org/10.1016/j.heliyon.2021.e07076
   PubMed Web of Science ®Google Scholar
• Kent, C., Laslo, E., & Rafaeli, S. (2016). Interactivity in online discussions and learning outcomes. Computers & Education, 97, 116–128. https://doi.org/10.1016/j.compedu.2016.03.002
   Web of Science ®Google Scholar
• Ketonen, E., & Lonka, K. (2012). Do situational academic emotions predict academic outcomes in a lecture course? Procedia Social and Behavioral Sciences, 69, 1901–1910. https://doi.org/10.1016/j.sbspro.2012.12.144
   Google Scholar
• Lajoie, S., Pekrun, R., Azevedo, R., & Leighton, J. (2020). Understanding and measuring emotions in technology-rich learning environments. Learning and Instruction, 70, 101272. https://doi.org/10.1016/j.learninstruc.2019.101272
   Web of Science ®Google Scholar
• Leeuwenkamp, K. J. G., Brinke, D. J., & Kester, L. (2017). Assessment quality in tertiary education: An integrative literature review. Studies in Educational Evaluation, 55, 94–116. https://doi.org/10.1016/j.stueduc.2017.08.001
   Web of Science ®Google Scholar
• Lepak, N., Newingham, B., Kachergis, E., Toledo, D., & Moffitt, J. (2022). Where do qualitative assessments fit in an era of increasingly quantitative monitoring? Perspectives from interpreting indicators of rangeland health. Rangelands, 44(1), 39–49. https://doi.org/10.1016/j.rala.2021.07.008
   Google Scholar
• Linnenbrink-Garcia, L., & Pekrun, R. (2011). Students’ emotions and academic engagement: Introduction to the special issue. Contemporary Educational Psychology, 36(1), 1–3. https://doi.org/10.1016/j.cedpsych.2010.11.004
   Web of Science ®Google Scholar
• Mayer, R. (2020). Searching for the role of emotions in e-learning. Learning and Instruction, 70, 101213. https://doi.org/10.1016/j.learninstruc.2019.05.010
   Web of Science ®Google Scholar
• Mustfina, R., Ilina, M., & Shcherbak, I. (2020). Emotions and their effect on learning. Utopia y Praxis Latinoamericana, 7, 318–324. http://doi.org/10.5281/zenodo.4009736
   Google Scholar
• Newhart, D. W. (2015). Daniel W. Newhart, Ph.D, 5–11.
   Google Scholar
• Panigrahi, R., Srivastava, P. R., & Sharma, D. (2018). Online learning: Adoption, continuance, and learning outcome—A review of literature. International Journal of Information Management, 43, 1–14. https://doi.org/10.1016/j.ijinfomgt.2018.05.005
   Web of Science ®Google Scholar
• Parker, P., Perry, R., Hamm, J., Chipperfield, J., Pekrun, R., Dryden, R., Daniels, L. M., & Tze, V. M. C. (2021). A motivation perspective on achievement appraisals, emotions, and performance in an online learning environment. International Journal of Educational Research, 108, 101772. https://doi.org/10.1016/j.ijer.2021.101772
   Web of Science ®Google Scholar
• Pekrun, R., Goetz, T., Frenzel, A., Barchfeld, P., & Perry, R. (2011). Measuring emotions in students’ learning and performance: The achievement emotions questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36–48. https://doi.org/10.1016/j.cedpsych.2010.10.002
   Web of Science ®Google Scholar
• Queen, D., Trager, M., Fan, W., & Samie, F. (2021). Patient satisfaction of general dermatology providers: A quantitative and qualitative analysis of 38,008 online reviews. JID Innovations, 1(4), 100049. https://doi.org/10.1016/j.xjidi.2021.100049
   PubMedGoogle Scholar
• Rahimi, S., & Vallerand, R. J. (2021, May). The role of passion and emotions in academic procrastination during a pandemic (COVID-19). Personality and Individual Differences, 179, 110852. https://doi.org/10.1016/j.paid.2021.110852
   Web of Science ®Google Scholar
• Rana, P., Raj Gupta, L., Dubey, M. K., & Kumar, G. (2021a). Review on evaluation techniques for better student learning outcomes using machine learning. In 2021 2nd International conference on intelligent engineering and management (ICIEM) (pp. 86–90). https://doi.org/10.1109/ICIEM51511.2021.9445294
   Google Scholar
• Rana, P., Raj Gupta, L., Kumar, G., & Kumar Dubey, M. (2021b). A taxonomy of various applications of artificial intelligence in education. In 2nd International conference on intelligent engineering and management (ICIEM) (pp. 23–28). https://doi.org/10.1109/ICIEM51511.2021.9445339
   Google Scholar
• Rowe, A. D. (2017). Feelings about feedback: The role of emotions in assessment for learning. In: D. Carless, S. Bridges, C. Chan, & R. Glofcheski, (eds.), Scaling up assessment for learning in higher education. The enabling power of assessment, vol. 5. Springer. https://doi.org/10.1007/978-981-10-3045-1_11
   Google Scholar
• Sabahi, S., & Parast, M. M. (2020). The impact of entrepreneurship orientation on project performance: A machine learning approach. International Journal of Production Economics, 226, 107621. https://doi.org/10.1016/j.ijpe.2020.107621
   Web of Science ®Google Scholar
• Sadoughi, M., & Hejazi, S. Y. (2021, June). Teacher support and academic engagement among EFL learners: The role of positive academic emotions. Studies in Educational Evaluation, 70, 101060. https://doi.org/10.1016/j.stueduc.2021.101060
   Web of Science ®Google Scholar
• Salazar, C., Aguilar, J., Monsalve-Pulido, J., & Montoya, E. (2021). Affective recommender systems in the educational field. A systematic literature review. Computer Science Review, 40, 100377. https://doi.org/10.1016/j.cosrev.2021.100377
   Web of Science ®Google Scholar
• Schoepp, K. (2017). The state of course learning outcomes at leading universities. Studies in Higher Education, 44(4), 615–627. https://doi.org/10.1080/03075079.2017.1392500
   Web of Science ®Google Scholar
• Tam, H., Kwok, S., Hui, A., Chan, D., Leung, C., Leung, J., Lo, H., & Lai, S. (2021). The significance of emotional intelligence to students’ learning motivation and academic achievement: A study in Hong Kong with a Confucian heritage. Children and Youth Services Review, 121, 105847. https://doi.org/10.1016/j.childyouth.2020.105847
   Web of Science ®Google Scholar
• Thomas, G., Anne, Z., Reinhard, P., & Hall, N. (2003). Emotions, learning and achievement from an educational-psychological perspective. In Learning emotions: the influence of affective factors on classroom learning (Vol. 1, pp. 9–28).
   Google Scholar
• Tyng, C., Amin, H., Saad, M., & Malik, A. (2017). The influences of emotion on learning and memory. Frontiers in Psychology, 8, Article id 1454. https://doi.org/10.3389/fpsyg.2017.01454
   PubMed Web of Science ®Google Scholar
• Van Laer, S., & Elen, J. (2019). The effect of cues for calibration on learners’ self-regulated learning through changes in learners’ learning behaviour and outcomes. Computers & Education, 135, 30–48. https://doi.org/10.1016/j.compedu.2019.02.016
   Web of Science ®Google Scholar
• Violante, M., & Vezzetti, E. (2017). Kano qualitative vs quantitative approaches: An assessment framework for products attributes analysis. Computers in Industry, 86, 15–25. https://doi.org/10.1016/j.compind.2016.12.007
   Web of Science ®Google Scholar
• Wang, H., Peng, A., & Patterson, M. (2021). The roles of class social climate, language mindset, and emotions in predicting willingness to communicate in a foreign language. System, 99, 102529. https://doi.org/10.1016/j.system.2021.102529
   Web of Science ®Google Scholar
• Werder, K. P., & Strand, K. (2011). Measuring student outcomes: An assessment of service-learning in the public relations campaigns course. Public Relations Review, 37(5), 478–484. https://doi.org/10.1016/j.pubrev.2011.09.014
   Web of Science ®Google Scholar
• Westphal, A., Kretschmann, J., Gronostaj, A., & Vock, M. (2018). More enjoyment, less anxiety and boredom: How achievement emotions relate to academic self-concept and teachers’ diagnostic skills. Learning and Individual Differences, 62, 108–117. https://doi.org/10.1016/j.lindif.2018.01.016
   Web of Science ®Google Scholar
• Wiljer, D., & Hakim, Z. (2019). Developing an artificial intelligence–enabled health care practice: Rewiring health care professions for better care. Journal of Medical Imaging and Radiation Sciences, 50(4), S8–S14. https://doi.org/10.1016/j.jmir.2019.09.010
   PubMed Web of Science ®Google Scholar
• Yih-Tong Sun, P., & Scott, J. L. (2003). Towards better qualitative performance measurement in organizations. The Learning Organization, 10(5), 258–271. https://doi.org/10.1108/09696470310486610
   Google Scholar
• Yurkofsky, M. M., Blum-Smith, S., & Brennan, K. (2019). Expanding outcomes: Exploring varied conceptions of teacher learning in an online professional development experience. Teaching and Teacher Education, 82, 1–13. https://doi.org/10.1016/j.tate.2019.03.002
   Web of Science ®Google Scholar
• Zacharis, N. Z. (2015). A multivariate approach to predicting student outcomes in web-enabled blended learning courses. Internet and Higher Education, 27, 44–53. https://doi.org/10.1016/j.iheduc.2015.05.002
   Web of Science ®Google Scholar
• Zahed-Babelan, A., & Moenikia, M. (2010). The role of emotional intelligence in predicting students’ academic achievement in distance education system. Procedia - Social and Behavioral Sciences, 2(2), 1158–1163. https://doi.org/10.1016/j.sbspro.2010.03.164
   Google Scholar
• Zala-Mezö, E., Datnow, A., Müller-Kuhn, D., & Häbig, J. (2020). Feeding back research results – Changes in principal and teacher narratives about student participation. Studies in Educational Evaluation, 65, 100848. https://doi.org/10.1016/j.stueduc.2020.100848
   Web of Science ®Google Scholar
• Zheng, J., Huang, L., Li, S., Lajoie, S., Chen, Y., & Hmelo-Silver, C. (2021). Self-regulation and emotion matter: A case study of instructor interactions with a learning analytics dashboard. Computers & Education, 159, 53–63. https://doi.org/10.1016/j.compedu.2020.104061
   Google Scholar