Students' proficiency evaluation: a non-parametric multilevel latent variable model approach

References

• Abarda, A., M. Dakkon, M. Azhari, A. Zaaloul, and M. Khabouze. 2020. “Latent Transition Analysis (LTA): A Method for Identifying Differences in Longitudinal Change Among Unobserved Groups.” Procedia Computer Science 170:1116–1121. https://doi.org/10.1016/j.procs.2020.03.059.
   Google Scholar
• Aleksieva-Petrova, A., and M. Petrov. 2022. “Recommendation Engine of Learning Contents and Activities Based on Learning Analytics.” In New Realities, Mobile Systems and Applications: Proceedings of the 14th IMCL Conference, Thessaloniki, Greece, 372–378.
   Google Scholar
• Alivernini, F., and F. Lucidi. 2008. “The Academic Motivation Scale (AMS): Factorial Structure, Invariance and Validity in the Italian Context.” Testing, Psychometrics, Methodology in Applied Psychology 15 (4): 211–220.
   Google Scholar
• Allman, E. S., C. Matias, and J. A. Rhodes. 2009. “Identifiability of Parameters in Latent Structure Models with Many Observed Variables.” The Annals of Statistics 37 (6A): 3099–3132. https://doi.org/10.1214/09-AOS689.
   Web of Science ®Google Scholar
• Aryadoust, V., L. Y. Ng, and H. Sayama. 2021. “A Comprehensive Review of Rasch Measurement in Language Assessment: Recommendations and Guidelines for Research.” Language Testing 38 (1): 6–40. https://doi.org/10.1177/0265532220927487.
   Web of Science ®Google Scholar
• Asparouhov, T., and B. Muthen. 2008. “Multilevel Mixture Models.” In Advances in Latent Variable Mixture Models, 27–51. Charlotte, NC: Information Age Publishing Inc.
   Google Scholar
• Baker, R. S., and P. S. Inventado. 2014. “Educational Data Mining and Learning Analytics.” In Learning Analytics, 61–75. New York, NY: Springer.
   Google Scholar
• Bartolucci, F., A. Farcomeni, and F. Pennoni. 2014. “Latent Markov Models: A Review of a General Framework for the Analysis of Longitudinal Data with Covariates.” Test 23 (3): 433–465. https://doi.org/10.1007/s11749-014-0381-7.
   Web of Science ®Google Scholar
• Bonanomi, A., M. G. Olivari, E. Mascheroni, E. Gatti, and E. Confalonieri. 2018. “USING A MULTIDIMENSIONAL RASH ANALYSIS TO EVALUATE THE PSYCHOMETRIC PROPERTIES OF THE MOTIVATED STRATEGIES FOR LEARNING QUESTIONNAIRE (MSLQ) AMONG HIGH SCHOOL STUDENTS.” Testing, Psychometrics, Methodology in Applied Psychology 25 (1): 83–100.
   Google Scholar
• Budé, L., M. W. J. Van De Wiel, T. Imbos, M. J. J. M. Candel, N. J. Broers, and M. P. F. Berger. 2007. “Students' Achievements in a Statistics Course in Relation to Motivational Aspects and Study Behaviour.” Statistics Education Research Journal 6 (1): 5–21. https://doi.org/10.52041/serj.v6i1.
   Google Scholar
• Carless, D., D. Salter, M. Yang, and J. Lam. 2011. “Developing Sustainable Feedback Practices.” Studies in Higher Education 36 (4): 395–407. https://doi.org/10.1080/03075071003642449.
   Web of Science ®Google Scholar
• Chiesi, F., and C. Primi. 2009. “Assessing Statistics Attitudes Among College Students: Psychometric Properties of the Italian Version of the Survey of Attitudes Toward Statistics (SATS).” Learning and Individual Differences 19 (2): 309–313. https://doi.org/10.1016/j.lindif.2008.10.008.
   Web of Science ®Google Scholar
• Chiesi, F., and C. Primi. 2010. “Cognitive and Non-Cognitive Factors Related to Students'statistics Achievement.” Statistics Education Research Journal 9 (1): 6–26. https://doi.org/10.52041/serj.v9i1.
   Google Scholar
• Chiesi, F., C. Primi, and J. Carmona. 2011. “Measuring Statistics Anxiety: Cross-Country Validity of the Statistical Anxiety Scale (SAS).” Journal of Psychoeducational Aassessment 29 (6): 559–569. https://doi.org/10.1177/0734282911404985.
   Web of Science ®Google Scholar
• Choi, N. 2005. “Self-Efficacy and Self-Concept as Predictors of College Students' Academic Performance.” Psychology in the Schools 42 (2): 197–205. https://doi.org/10.1002/pits.v42:2.
   Web of Science ®Google Scholar
• Clow, D. 2012. “The Learning Analytics Cycle: Closing the Loop Effectively.” In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, edited by S. Buckingham Shum, D. Gasevic, and R. Ferguson, 134–138. New York: ACM.
   Google Scholar
• Coetzee, S., and P. Merwe. 2010. “Industrial Psychology Students' Attitudes Towards Statistics.” SA Journal of Industrial Psychology 36 (1): 1–8.
   Google Scholar
• Cokley, K. O., N. Bernard, D. Cunningham, and J. Motoike. 2001. “A Psychometric Investigation of the Academic Motivation Scale Using a United States Sample.” Measurement and Evaluation in Counseling and Development 34 (2): 109–119. https://doi.org/10.1080/07481756.2001.12069027.
   Web of Science ®Google Scholar
• Conole, G., D. Gašević, P. Long, and G. Siemens. 2011. Proceedings of the 1st International Conference on Learning Analytics and Knowledge. New York: ACM.
   Google Scholar
• de Barba, P. G., G. E. Kennedy, and M. D. Ainley. 2016. “The Role of Students' Motivation and Participation in Predicting Performance in a MOOC.” Journal of Computer Assisted Learning 32 (3): 218–231. https://doi.org/10.1111/jcal.v32.3.
   Web of Science ®Google Scholar
• Di Mari, R., Z. Bakk, J. Oser, and J. Kuha. 2023. “A Two-Step Estimator for Multilevel Latent Class Analysis with Covariates.” Psychometrika 88 (4): 1144–1170.
   PubMedGoogle Scholar
• Emmioğlu, E., and Y. Capa-Aydin. 2012. “Attitudes and Achievement in Statistics: A Meta-Analysis Study.” Statistics Education Research Journal 11 (2): 95–102. https://doi.org/10.52041/serj.v11i2.
   Google Scholar
• Eysenck, M. W., N. Derakshan, R. Santos, and M. G. Calvo. 2007. “Anxiety and Cognitive Performance: Attentional Control Theory.” Emotion (Washington, D.C.) 7 (2): 336–353. https://doi.org/10.1037/1528-3542.7.2.336.
   PubMed Web of Science ®Google Scholar
• Fabbricatore, R., R. Di Mari, Z. Bakk, M. de Rooij, and F. Palumbo. 2023. “A Three-Step Rectangular Latent Markov Modeling for Advising Students in Self-Learning Platforms.” In Quantitative Psychology - The 87th Annual Meeting of the Psychometric Society. Vol. 422, edited by M. Wiberg, D. Molenaar, J.-S. Gonzàlez Kim, and H. Hwang, 97–100. Cham: Springer.
   Google Scholar
• Fabbricatore, R., A. Parola, G. Pepicelli, and F. Palumbo. 2021. “A Latent Class Approach for Advising in Learning Statistics: Implementation in the ALEAS System.” CEUR Workshop Proceedings 2817.
   Google Scholar
• Fabbricatore, R., A. Parola, G. Pepicelli, and F. Palumbo. 2022. “Academic Procrastination Scale: Psychometric Evidence for the Italian Version Based on CFA and IRT Models.” Under review.
   Google Scholar
• Fabbricatore, R., A. Parola, G. Pepicelli, and F. Palumbo. 2023. “Successful Factors in Statistics Learning for Non-STEM Courses Students: A PLS-PM Approach.” Italian Journal of Applied Statistics 34 (2): 1–30.
   Google Scholar
• Fagginger Auer, M. F., M. Hickendorff, C. M. Van Putten, A. A. Béguin, and W. J. Heiser. 2016. “Multilevel Latent Class Analysis for Large-Scale Educational Assessment Data: Exploring the Relation Between the Curriculum and Students' Mathematical Strategies.” Applied Measurement in Education29 (2): 144–159. https://doi.org/10.1080/08957347.2016.1138959.
   Web of Science ®Google Scholar
• Ferguson, R. 2012. “Learning Analytics: Drivers, Developments and Challenges.” International Journal of Technology Enhanced Learning 4 (5/6): 304–317. https://doi.org/10.1504/IJTEL.2012.051816.
   Google Scholar
• Finch, W. H., and B. F. French. 2014. “Multilevel Latent Class Analysis: Parametric and Nonparametric Models.” The Journal of Experimental Education 82 (3): 307–333. https://doi.org/10.1080/00220973.2013.813361.
   Web of Science ®Google Scholar
• Galli, S., F. Chiesi, and C. Primi. 2008. “The Construction of a Scale to Measure Mathematical Ability in Psychology Students: An Application of the Rasch Model.” Testing, Psychometrics, Methodology in Applied Psychology 15 (1): 1–16.
   Google Scholar
• Gamage, S. H., J. R. Ayres, and M. B. Behrend. 2022. “A Systematic Review on Trends in Using Moodle for Teaching and Learning.” International Journal of STEM Education 9 (1): 1–24. https://doi.org/10.1186/s40594-021-00323-x.
   Web of Science ®Google Scholar
• Ghani, F. H. A., and S. M. Maat. 2018. “Anxiety and Achievement in Statistics: A Systematic Review on Quantitative Studies.” Creative Education 9 (14): 2280. https://doi.org/10.4236/ce.2018.914168.
   Google Scholar
• Gudeva, L. K., V. Dimova, N. Daskalovska, and F. Trajkova. 2012. “Designing Descriptors of Learning Outcomes for Higher Education Qualification.” Procedia-Social and Behavioral Sciences 46:1306–1311. https://doi.org/10.1016/j.sbspro.2012.05.292.
   Google Scholar
• Hatziapostolou, T., and I. Paraskakis. 2010. “Enhancing the Impact of Formative Feedback on Student Learning Through An Online Feedback System.” Electronic Journal of E-Learning 8 (2): 111–122.
   Google Scholar
• Honicke, T., and J. Broadbent. 2016. “The Influence of Academic Self-Efficacy on Academic Performance: A Systematic Review.” Educational Research Review 17:63–84. https://doi.org/10.1016/j.edurev.2015.11.002.
   Web of Science ®Google Scholar
• Johnson, M., and E. Kuennen. 2006. “Basic Math Skills and Performance in An Introductory Statistics Course.” Journal of Statistics Education 14 (2): 1–15.
   Google Scholar
• Judi, H. M., N. S. Ashaari, H. Mohamed, and T. M. T. Wook. 2011. “Students Profile Based on Attitude Towards Statistics.” Procedia-Social and Behavioral Sciences 18:266–272. https://doi.org/10.1016/j.sbspro.2011.05.038.
   Google Scholar
• Ketterlin-Geller, L. R., and P. Yovanoff. 2009. “Diagnostic Assessments in Mathematics to Support Instructional Decision Making.” Practical Assessment, Research, and Evaluation 14 (1): 16.
   Google Scholar
• Kim, K. R., and E. H. Seo. 2015. “The Relationship Between Procrastination and Academic Performance: A Meta-Analysis.” Personality and Individual Differences 82:26–33. https://doi.org/10.1016/j.paid.2015.02.038.
   Web of Science ®Google Scholar
• Lam, R. 2016. “Assessment As Learning: Examining a Cycle of Teaching, Learning, and Assessment of Writing in the Portfolio-Based Classroom.” Studies in Higher Education 41 (11): 1900–1917. https://doi.org/10.1080/03075079.2014.999317.
   Web of Science ®Google Scholar
• Lavidas, K., T. Barkatsas, D. Manesis, and V. Gialamas. 2020. “A Structural Equation Model Investigating the Impact of Tertiary Students'Attitudes Toward Statistics, Perceived Competence At Mathematics, and Engagement on Statistics Performance.” Statistics Education Research Journal 19 (2): 27–41. https://doi.org/10.52041/serj.v19i2.
   Google Scholar
• Lester, D. 2016. “Predicting Success in Psychological Statistics Courses.” Psychological Reports 118 (3): 772–777. https://doi.org/10.1177/0033294116647687.
   PubMedGoogle Scholar
• Lizzio, A., and K. Wilson. 2008. “Feedback on Assessment: Students' Perceptions of Quality and Effectiveness.” Assessment & Evaluation in Higher Education 33 (3): 263–275. https://doi.org/10.1080/02602930701292548.
   Web of Science ®Google Scholar
• Logman, P. S. W. M., and J. Kautz. 2021. “From Dublin Descriptors to Implementation in Bachelor Labs.” In Journal of Physics: Conference Series, Vol 1929, 012065. IOP Publishing.
   Google Scholar
• Lukočienė, O., and J. K. Vermunt. 2009. “Determining the Number of Components in Mixture Models for Hierarchical Data.” In Advances in Data Analysis, Data Handling and Business Intelligence, 241–249. Heidelberg, DE: Springer.
   Google Scholar
• Macher, D., M. Paechter, I. Papousek, K. Ruggeri, H. H. Freudenthaler, and M. Arendasy. 2013. “Statistics Anxiety, State Anxiety During An Examination, and Academic Achievement.” British Journal of Educational Psychology 83 (4): 535–549. https://doi.org/10.1111/bjep.2013.83.issue-4.
   PubMed Web of Science ®Google Scholar
• McCutcheon, A. L. 1987. Latent Class Analysis. No. 64. Newbury Park, CA: Sage.
   Google Scholar
• McMullen, J., and M. Hickendorff. 2018. “Latent Variable Mixture Models in Research on Learning and Individual Differences.” Learning and Individual Differences 66:1–3. https://doi.org/10.1016/j.lindif.2018.05.008.
   Google Scholar
• Morrell, L. J. 2021. “Iterated Assessment and Feedback Improves Student Outcomes.” Studies in Higher Education 46 (3): 485–496. https://doi.org/10.1080/03075079.2019.1643301.
   Web of Science ®Google Scholar
• Muslim, A., M. A. Chatti, and M. Guesmi. 2020. “Open Learning Analytics: A Systematic Literature Review and Future Perspectives.” In Artificial Intelligence Supported Educational Technologies, edited by A. Muslim, M. A. Chatti, and M. Guesmi. 3–29. Berlin: Springer.
   Google Scholar
• Nasser, F. M. 2004. “Structural Model of the Effects of Cognitive and Affective Factors on the Achievement of Arabic-Speaking Pre-Service Teachers in Introductory Statistics.” Journal of Statistics Education 12 (1): 1–19.
   Google Scholar
• Nylund-Gibson, K., and A. Y. Choi. 2018. “Ten Frequently Asked Questions About Latent Class Analysis.” Translational Issues in Psychological Science 4 (4): 440–461. https://doi.org/10.1037/tps0000176.
   Google Scholar
• Onwuegbuzie, A. J., and V. A. Wilson. 2003. “Statistics Anxiety: Nature, Etiology, Antecedents, Effects, and Treatments–a Comprehensive Review of the Literature.” Teaching in Higher Education 8 (2): 195–209. https://doi.org/10.1080/1356251032000052447.
   Google Scholar
• Peng, Y. E., and E. Mason. 2014. “Motivational and Cognitive Test-Taking Strategies and Their Influence on Test Performance in Mathematics.” Educational Research and Evaluation 20 (5): 366–385. https://doi.org/10.1080/13803611.2014.966115.
   Google Scholar
• Purpura, J. E. 1997. “An Analysis of the Relationships Between Test Takers' Cognitive and Metacognitive Strategy Use and Second Language Test Performance.” Language Learning 47 (2): 289–325. https://doi.org/10.1111/lang.1997.47.issue-2.
   Web of Science ®Google Scholar
• Rabin, L., L. Fink, A. Krishnan, J. Fogel, L. Berman, and R. Bergdoll. 2018. “A Measure of Basic Math Skills for Use with Undergraduate Statistics Students: The MACS.” Statistics Education Research Journal 17 (2): 179–195. https://doi.org/10.52041/serj.v17i2.
   Google Scholar
• Rajiah, K., C. Saravanan, and O. W. Ying. 2014. “Relationship of Test Anxiety, Psychological Distress and Academic Motivation Among First Year Undergraduate Pharmacy Students.” International Journal of Applied Psychology 4 (2): 68–72.
   Google Scholar
• Richardson, M., C. Abraham, and R. Bond. 2012. “Psychological Correlates of University Students' Academic Performance: A Systematic Review and Meta-Analysis.” Psychological Bulletin 138 (2): 353–387. https://doi.org/10.1037/a0026838.
   PubMed Web of Science ®Google Scholar
• Rodarte-Luna, B., and A. Sherry. 2008. “Sex Differences in the Relation Between Statistics Anxiety and Cognitive/learning Strategies.” Contemporary Educational Psychology 33 (2): 327–344. https://doi.org/10.1016/j.cedpsych.2007.03.002.
   Web of Science ®Google Scholar
• Rosli, M. K., and S. M. Maat. 2017. “Attitude Towards Statistics and Performance Among Post-Graduate Students.” In AIP Conference Proceedings, Vol 1847, 030004. AIP Publishing LLC.
   Google Scholar
• Sen, S., and L. Bradshaw. 2017. “Comparison of Relative Fit Indices for Diagnostic Model Selection.” Applied Psychological Measurement 41 (6): 422–438. https://doi.org/10.1177/0146621617695521.
   PubMed Web of Science ®Google Scholar
• Sesé, A., R. Jiménez, J. J. Montaño, and A. Palmer. 2015. “Can Attitudes Towards Statistics and Statistics Anxiety Explain Students' Performance.” Psicodidáct 20 (2): 285–304. https://doi.org/10.1387/RevPsicodidact.13080.
   Google Scholar
• Siew, C. S. Q., M. J. McCartney, and M. S. Vitevitch. 2019. “Using Network Science to Understand Statistics Anxiety Among College Students.” Scholarship of Teaching and Learning in Psychology 5 (1): 75–89. https://doi.org/10.1037/stl0000133.
   Google Scholar
• Skrondal, A., and S. Rabe-Hesketh. 2004. Generalized Latent Variable Modeling: Multilevel, Longitudinal, and Structural Equation Models. London: Chapman and Hall/CRC.
   Google Scholar
• Steel, P., T. Brothen, and C. Wambach. 2001. “Procrastination and Personality, Performance, and Mood.” Personality and Individual Differences 30 (1): 95–106. https://doi.org/10.1016/S0191-8869(00)00013-1.
   Web of Science ®Google Scholar
• Tempelaar, D. T., S. S. Van Der Loeff, and W. H. Gijselaers. 2007. “A Structural Equation Model Analyzing the Relationship of Students' Attitudes Toward Statistics, Prior Reasoning Abilities and Course Performance.” Statistics Education Research Journal 6 (2): 78–102. https://doi.org/10.52041/serj.v6i2.
   Google Scholar
• Thomas, C. L., J. C. Cassady, and M. L. Heller. 2017. “The Influence of Emotional Intelligence, Cognitive Test Anxiety, and Coping Strategies on Undergraduate Academic Performance.” Learning and Individual Differences 55:40–48. https://doi.org/10.1016/j.lindif.2017.03.001.
   Web of Science ®Google Scholar
• Toomaneejinda, A. 2017. “Zone of Proximal Development, Dynamic Assessment and Learner Empowerment.” LEARN Journal: Language Education and Acquisition Research Network 10 (1): 176–185.
   Google Scholar
• Vermunt, J. K. 2003. “Multilevel Latent Class Models.” Sociological Methodology 33 (1): 213–239. https://doi.org/10.1111/j.0081-1750.2003.t01-1-00131.x.
   Web of Science ®Google Scholar
• Vermunt, J. K. 2008. “Latent Class and Finite Mixture Models for Multilevel Data Sets.” Statistical Methods in Medical Research 17 (1): 33–51. https://doi.org/10.1177/0962280207081238.
   PubMed Web of Science ®Google Scholar
• Vermunt, J. K., and J. Magidson. 2020. Upgrade Manual for Latent Gold 6.0. Belmont, MA: Statistical Innovations Inc.
   Google Scholar
• von Davier, M., and Y. S. Lee. 2019. Handbook of Diagnostic Classification Models. Cham: Springer International Publishing.
   Google Scholar
• Walker, E. R., and K. E. Brakke. 2017. “Undergraduate Psychology Students' Efficacy and Attitudes Across Introductory and Advanced Statistics Courses.” Scholarship of Teaching and Learning in Psychology 3 (2): 132. https://doi.org/10.1037/stl0000088.
   Google Scholar
• Wang, Y. S., and E. A. Erosheva. 2015. “Fitting Mixed Membership Models Using Mixedmem.” https://cran.r-project.org/web/packages/mixedMem/vignettes/mixedMem.pdf.
   Google Scholar
• Wang, S., Y. Yang, S. A. Culpepper, and J. A. Douglas. 2018. “Tracking Skill Acquisition with Cognitive Diagnosis Models: A Higher-Order, Hidden Markov Model with Covariates.” Journal of Educational and Behavioral Statistics 43 (1): 57–87. https://doi.org/10.3102/1076998617719727.
   Web of Science ®Google Scholar
• Wen, H., Y. Liu, and N. Zhao. 2020. “Longitudinal Cognitive Diagnostic Assessment Based on the HMM/ANN Model.” Frontiers in Psychology 11:2145. https://doi.org/10.3389/fpsyg.2020.02145.
   PubMedGoogle Scholar
• Whitney, B. M., Y. Cheng, A. S. Brodersen, and M. R. Hong. 2019. “The Scale of Student Engagement in Statistics: Development and Initial Validation.” Journal of Psychoeducational Assessment 37 (5): 553–565. https://doi.org/10.1177/0734282918769983.
   Web of Science ®Google Scholar
• Winstone, N. E., and D. Boud. 2022. “The Need to Disentangle Assessment and Feedback in Higher Education.” Studies in Higher Education 47 (3): 656–667. https://doi.org/10.1080/03075079.2020.1779687.
   Web of Science ®Google Scholar
• Winter, C., and V. L. Dye. 2005. “An Investigation into the Reasons Why Students do not Collect Marked Assignments and the Accompanying Feedback.” In Learning and Teaching Projects 2003/04, edited by H. Gale. Wolverhampton: University of Wolverhampton Press.
   Google Scholar
• Zare, H., A. Rastegar, and S. M. D. Hosseini. 2011. “The Relation Among Achievement Goals and Academic Achievement in Statistics: The Mediating Role of Statistics Anxiety and Statistics Self-Efficacy.” Procedia-Social and Behavioral Sciences 30:1166–1172. https://doi.org/10.1016/j.sbspro.2011.10.227.
   Google Scholar
• Zimmerman, B. J., and A. Kitsantas. 2014. “Comparing Students' Self-Discipline and Self-Regulation Measures and Their Prediction of Academic Achievement.” Contemporary Educational Psychology39 (2): 145–155. https://doi.org/10.1016/j.cedpsych.2014.03.004.
   Web of Science ®Google Scholar
• Zlatkin-Troitschanskaia, O., R. J. Shavelson, and C. Kuhn. 2015. “The International State of Research on Measurement of Competency in Higher Education.” Studies in Higher Education 40 (3): 393–411. https://doi.org/10.1080/03075079.2015.1004241.
   Web of Science ®Google Scholar