Can Artificial Intelligence Identify Reading Fluency and Level? Comparison of Human and Machine Performance

References

• Abbott, M., Wills, H., Miller, A., & Kaufman, J. (2012). The relationship of error rate and comprehension in second and third grade oral reading fluency. Reading Psychology, 33(1–2), 104–132. https://doi.org/10.1080/02702711.2012.630613
   Google Scholar
• Akyol, H. (2016). Programa uygun Türkçe öğretim yöntemleri. Pegem Akademi.
   Google Scholar
• Ali, A., Renals, S. (2018). Word error rate estimation for speech recognition: e-WER. 56th Annual Meeting of the Association for Computational Linguistics, 2, 20–24. https://doi.org/10.18653/v1/p18-2004
   Google Scholar
• Altun Alkan, H., & Çetinkaya, G. (2021). Okuma çıraklığı yaklaşımı. In İ. S. Aydın & Ö. Yahşi (Eds.), PISA ve okuma kültürü (pp. 63–84). Nobel.
   Google Scholar
• Amendum, S. J., Conradi, K., & Liebfreund, M. D. (2016). The push for more challenging texts: An analysis of early readers’ rate, accuracy, and comprehension. Reading Psychology, 37(4), 570–600. https://doi.org/10.1080/02702711.2015.1072609
   Web of Science ®Google Scholar
• Bai, Y., Hubers, F., Cucchiarini, C., & Strik, H. (2021). An ASR-based reading tutor for practicing reading skills in the first grade: Improving performance through threshold adjustment < SE-END> [Paper presentation].</SE-END> IberSPEECH, 1, 11–15. https://doi.org/10.21437/IberSPEECH.2021-3
   Google Scholar
• Balogh, J., Bernstein, J., Cheng, J., Van Moere, A., Townshend, B., & Suzuki, M. (2012). Validation of automated scoring of oral reading. Educational and Psychological Measurement, 72(3), 435–452. https://doi.org/10.1177/0013164411412590
   Web of Science ®Google Scholar
• Bernstein, J., Cheng, J., Balogh, J., & Downey, R. (2020). Artificial intelligence for scoring oral reading fluency. In H. Jiao & R. W. Lissitz (Eds.), Application of artificial intelligence to assessment (pp. 51–76). Information Age.
   Google Scholar
• Bolaños, D., Cole, R. A., Ward, W., Borts, E., & Svirsky, E. (2011). Flora, fluent oral reading assessment of children’s speech. ACM Transactions on Speech and Language Processing, 7(4), 1–19. https://doi.org/10.1145/1998384.1998390
   Google Scholar
• Bolaños, D., Cole, R. A., Ward, W. H., Tindal, G. A., Hasbrouck, J., & Schwanenflugel, P. J. (2013a). Human and automated assessment of oral reading fluency. Journal of Educational Psychology, 105(4), 1142–1151. https://doi.org/10.1037/a0031479
   Web of Science ®Google Scholar
• Bolaños, D., Cole, R. A., Ward, W. H., Tindal, G. A., Schwanenflugel, P. J., & Kuhn, M. R. (2013b). Automatic assessment of expressive oral reading. Speech Communication, 55(2), 221–236. https://doi.org/10.1016/j.specom.2012.08.002
   Web of Science ®Google Scholar
• Büyüköztürk, Ş., Kılıç Çakmak, E., Akgün, Ö. E., Karadeniz, Ş., & Demirel, F. (2020). Eğitimde bilimsel araştırma yöntemleri. Pegem Akademi.
   Google Scholar
• Chi-San Ho, J., McBride, C., & Hong Lui, K. F. (2023). What explains children’s digital word reading performance in L2? Reading and Writing, 1–22. https://doi.org/10.1007/s11145-023-10420-8
   PubMed Web of Science ®Google Scholar
• Dynamic Measurement Group. (2018). DIBELS. https://dibels.org/dibels.html
   Google Scholar
• Feinberg, A. B., & Shapiro, E. (2009). Teacher accuracy: An examination of teacher-based judgments of students’ reading with differing achievement levels. The Journal of Educational Research, 102(6), 453–462. https://doi.org/10.3200/JOER.102.6.453-462
   Web of Science ®Google Scholar
• Foncha, J. W., Mafumo, T., & Abongdia, J. F. A. (2017). Reading and response as facilitation to the teaching and learning of second/foreign language. Gender and Behaviour, 15(2), 8751–8760. https://www.ajol.info/index.php/gab/article/view/163228
   Google Scholar
• Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A primer on partial least squares structural equation modeling. (PLS-SEM). https://doi.org/10.1007/978-3-030-80519-7
   Google Scholar
• Hartmann, S., Klasen, L., Keller, N., & Huxhold, O. (2023). Reading books in the second half of life: What correlations are there with aspects of quality of life and health? (DZA aktuell, 04/2023). Deutsches Zentrum für Altersfragen. https://nbn-resolving.org/urn:nbn:de:0168-ssoar-91670-7
   Google Scholar
• Hoskins, W. H., Hobbs, W. I., Eason, M. J., Decker, S., & Tang, J. (2021). The design and implementation of the Carolina Automated Reading Evaluation for reading deficit screening. Computers in Human Behavior Reports, 4(, 100123. https://doi.org/10.1016/j.chbr.2021.100123
   Google Scholar
• Houghton Mifflin Harcourt. (2018). EasyCBM. https://www.easyCBM.com
   Google Scholar
• IBM. (2020). IBM SPSS statistics for windows. (Version 27.0) [Computer software]IBM Corporation.
   Google Scholar
• Ikhtiyorovna, K. G. (2023). Mastering the art of effective speaking and reading: Strategies for improving speaking and reading skills. International Journal of Literature and Languages, 3(10), 32–38. https://doi.org/10.37547/ijll/Volume03Issue10-06
   Google Scholar
• JASP Team. (2022). JASP. (Version 0.16.1) [Computer software]JASP.
   Google Scholar
• Kara, Y., Kamata, A., Özkeskin, E. E., Qiao, X., & Nese, J. F. (2023). Predicting oral reading fluency scores by between-word silence times using natural language processing and random forest algorithm. Psychological Test and Assessment Modeling, 65(2), 36–54. https://www.psychologie-aktuell.com/fileadmin/Redaktion/Journale/ptam_2023-1/PTAM__1-2023_2_kor.pdf
   Google Scholar
• Khalilova, K. (2023). Mastering reading comprehension: A vital skill for academic success. Academic Research in Modern Science, 2(23), 83–89. https://doi.org/10.5281/zenodo.10020449
   Google Scholar
• Khan, R. U., Cheng, J. L. A., & Bee, O. Y. (2018). Machine learning and dyslexia: Diagnostic and classification system (DCS) for Kids with Learning Disabilities. International Journal of Engineering & Technology, 7(3.18), 97–100. https://www.academia.edu/download/59232703/2.1_MachineLearningandDyslexia-DiagnosticandClassificationSystemDCSforKidswithLearningDisabilities20190513-3123-13dhfvq.pdf
   Google Scholar
• Kim, Y.-S G., Park, C. H., & Wagner, R. K. (2014). Is oral/text reading fluency a “bridge” to reading comprehension? Reading and Writing, 27(1), 79–99. https://doi.org/10.1007/s11145-013-9434-7
   PubMed Web of Science ®Google Scholar
• Landis, J. R., & Koch, G. G. (1977). The Measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310
   PubMed Web of Science ®Google Scholar
• Lin, P.-H., Su, Y.-N., & Huang, Y.-M. (2019). Evaluating reading fluency behavior via reading rates of elementary school students reading e-books. Computers in Human Behavior, 100, 258–265. https://doi.org/10.1016/j.chb.2018.10.004
   Web of Science ®Google Scholar
• Liu, Z. (2005). Reading behavior in the digital environment: Changes in reading behavior over the past ten years. Journal of Documentation, 61(6), 700–712. https://doi.org/10.1108/00220410510632040
   Web of Science ®Google Scholar
• Mahfouz, M. A. S., & Mohamed, A. H. H. (2023). Using word reading fluency curriculum-based measurements to monitor students’ reading progress in grade 2. Education Sciences, 13(2), 217–12. (1https://www.mdpi.com/2227-7102/13/2/217 https://doi.org/10.3390/educsci13020217
   Web of Science ®Google Scholar
• Maki, K. E., & Hammerschmidt-Snidarich, S. (2022). Reading fluency intervention dosage: A novel meta-analysis and research synthesis. Journal of School Psychology, 92, 148–165. https://doi.org/10.1016/j.jsp.2022.03.008
   PubMed Web of Science ®Google Scholar
• Massler, U., Müller, W., Iurgel, I., Haake, S., Gantikow, A., & Hadzilacos, T. (2022). Meaningful, gamified training of reading fluency. Frontiers in Computer Science, 4(968137), 1–22. https://doi.org/10.3389/fcomp.2022.968137
   Google Scholar
• McKenna, M. C., & Stahl, S. A. (2003). Assessment for reading instruction. The Guilford.
   Google Scholar
• Mich, O., Mana, N., Gretter, R., Matasonni, M., & Falavigna, D. (2020). Automatically assess children’s reading skills. 1st Workshop on Tools and Resources to Empower People with Reading Difficulties (READI2020), 1, 20–26. https://aclanthology.org/2020.readi-1.4
   Google Scholar
• Ministry of National Education [MoNE] (2019). PISA 2018 Türkiye ön raporu. Eğitim Analiz ve Değerlendirme Raporları Serisi, Report No: 10. MoNE. https://pisa.meb.gov.tr/www/pisa-2018-turkiye-on-raporu-yayimlandi/icerik/3
   Google Scholar
• Molenaar, B., Tejedor Garcia, C., Strik, H., & Cucchiarini, C. (2023). Automatic Assessment of Oral Reading Accuracy for Reading Diagnostics. Interspeech, 2023 5232., 5236. https://doi.org/10.48550/arXiv.2306.03444
   Google Scholar
• Nese, J. F. T., & Kamata, A. (2020). Evidence for automated scoring and shorter passages of CBM-R in early elementary school. School Psychology (Washington, D.C.), 36(1), 47–59. https://doi.org/10.1037/spq0000415
   PubMedGoogle Scholar
• Pearson (2018). aimswebPlus. https://www.aimswebplus.com/
   Google Scholar
• Polat, H., & Oyucu, S. (2020). Building a speech and text corpus of Turkish: Large corpus collection with initial speech recognition results. Symmetry, 12(2), 290–309. https://doi.org/10.3390/sym12020290
   Google Scholar
• Rasinski, V. T., & Padak, N. (2003). 3-minute reading assessments: Word recognition, comprehension, vocabulary. Grade 1-8. Scholastic.
   Google Scholar
• Rodrigues, A. D. N., Ribeiro, G., Silva, V., Carvalho, W., Ramírez, M., Alves, L., Finger, M., Navas, A. L., & Ribeiro, C. (2023). AI and Reading Fluency for Brazilian Portuguese: A Preliminary Study. Speech Communication, March, 6, 1–18. https://doi.org/10.2139/ssrn.4429229
   Google Scholar
• Rosebrock, C., & Gold, A. (2018). Flüssigkeit als Kategorie für die Diagnose und Förderung von Lesefertigkeit. In S. Kutzelmann & C. Rosebrock (Eds.), Praxis der Lautleseverfahren (pp. 7–19). Schneider.
   Google Scholar
• Schiefele, U., Schaffner, E., Möller, J., & Wigfield, A. (2012). Dimensions of reading motivation and their relation to reading behavior and competence. Reading Research Quarterly, 47(4), 427–463. https://doi.org/10.1002/RRQ.030
   Web of Science ®Google Scholar
• Silva, W. A., Carchedi, L. C., Junior, J. G., Souza, J. V., Barrere, E., & Souza, J. F. (2021). A framework for large-scale automatic fluency assessment. International Journal of Distance Education Technologies, 19(3), 70–88. https://doi.org/10.4018/IJDET.2021070105
   Web of Science ®Google Scholar
• Stevens, E. A., Walker, M. A., & Vaughn, S. (2017). The effects of reading fluency interventions on the reading fluency and reading comprehension performance of elementary students with learning disabilities: A synthesis of the research from 2001 to 2014. Journal of Learning Disabilities, 50(5), 576–590. https://doi.org/10.1177/0022219416638028
   PubMed Web of Science ®Google Scholar
• Virinkoski, R., Lerkkanen, M. K., Eklund, K., & Aro, M. (2022). Special education teachers’ identification of students’ reading difficulties in grade 6. Scandinavian Journal of Educational Research, 66(1), 59–72. https://doi.org/10.1080/00313831.2020.1833241
   Web of Science ®Google Scholar
• Wawire, B. A., & Zuilkowski, S. S. (2021). The role of vocabulary and decoding language skills in reading comprehension: A cross-linguistic perspective. International Multilingual Research Journal, 15(1), 23–42. https://doi.org/10.1080/19313152.2020.1753953
   Web of Science ®Google Scholar
• Whisper ASR (2023). OpenAi, 2023. https://openai.com/research/whisper
   Google Scholar
• Yildiz, M., & Çetinkaya, E. (2017). The relationship between good readers’ attention, reading fluency and reading comprehension. Universal Journal of Educational Research, 5(3), 366–371. https://doi.org/10.13189/ujer.2017.050309
   Google Scholar
• Yu, Y., Xie, R., Wu, X., Xia, Y., Wang, Z., & Nguyen, T. P. (2023). The relationship between metalinguistic awareness and reading fluency in elementary school children: The mediating role of character recognition and vocabulary knowledge. Acta Psychologica Sinica, 55(6), 941–953. https://doi.org/10.3724/SP.J.1041.2023.00941
   Google Scholar
• Žabkar, J., Urankar, T., Javornik, K., & Babuder, M. K. (2023). Identifying reading fluency in pupils with and without dyslexia using a machine learning model on texts assessed with a readability application. Center for Educational Policy Studies Journal, 13(4), 233–256. https://doi.org/10.26529/cepsj.1367
   Google Scholar