Use of technology-based assessments: a systematic review covering over 30 countries

References

• Abidin, A. Z., Istiyono, E., Fadilah, N., & Dwandaru, W. S. B. (2019). A computerized adaptive test for measuring the physics critical thinking skills in high school students. International Journal of Evaluation & Research in Education (IJERE), 8(3), 376–383. https://doi.org/10.11591/ijere.v8i3.19642
   Google Scholar
• Al A’ali, M. (2007). Implementation of an improved adaptive testing theory. Educational Technology & Society, 10(4), 80–94. https://eric.ed.gov/?id=EJ814891
   Web of Science ®Google Scholar
• Alruwais, N., Wills, G., & Wald, M. (2018). Advantages and challenges of using e-assessment. International Journal of Information and Education Technology, 8(1), 34–37. https://doi.org/10.18178/ijiet.2018.8.1.1008
   Google Scholar
• Aristizábal, J. (2018). Using learning analytics to improve students’ reading skills: A case study in an American International School with EAL students. GIST Education and Learning Research Journal, 17(17), 193–214. https://doi.org/10.26817/16925777.434
   Google Scholar
• Ashley, L., Mcloughlin, C., Aslam, M., Engel, J., Wales, J., Rawal, S., Batley, R., Kingdon, G., Nicolai, S., & Rose, P. (2014). The role and impact of private schools in developing countries: A rigorous review of the evidence (Education Rigorous Literature Review). Department for International Development. https://assets.publishing.service.gov.uk/media/5a756e0de5274a1baf95e829/private-schools-full-report.pdf
   Google Scholar
• Aslam, R., Khan, N., & Ahmed, U. (2020). Technology integration and teachers’ professional knowledge with reference to International Society for technology in Education (ISTE)-standard: A causal study. Journal of Education and Educational Development, 7(2), 307–327. https://doi.org/10.22555/joeed.v7i2.31
   Google Scholar
• Auphan, P., Ecalle, J., & Magnan, A. (2020). The high potential of computer-based reading assessment. Canadian Journal of Learning and Technology / La Revue Canadienne de L’apprentissage Et de la Technologie, 46(1), 1–23. https://doi.org/10.21432/cjlt27847
   Google Scholar
• Barana, A., Marchisio, M., & Sacchet, M. (2021). Interactive feedback for learning mathematics in a digital learning environment. Education Sciences, 11(6), 279–299. https://doi.org/10.3390/educsci11060279
   Web of Science ®Google Scholar
• Bausili, A. (2019). Technology-based assessment. In Oxford bibliographies. Oxford University Press. https://www.oxfordbibliographies.com/display/document/obo-9780199756810/obo-9780199756810-0215.xml
   Google Scholar
• Bennett, R. E. (2002). Inexorable and inevitable: The continuing story of technology and assessment. Computer-Based Testing and the Internet, 1(1), 201–217. https://doi.org/10.1002/9780470712993.ch11
   Google Scholar
• Benton, T. (2021). Item response theory, computer adaptive testing and the risk of self-deception. Research Matters, 32, 82–100. https://eric.ed.gov/?id=EJ1317443
   Google Scholar
• Black, P. Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102
   Google Scholar
• Blumenthal, S., & Blumenthal, Y. (2020). Tablet or paper and pen? Examining mode effects on German elementary school students’ computation skills with curriculum-based measurements. International Journal of Educational Methodology, 6(4), 669–680. https://doi.org/10.12973/ijem.6.4.669
   Google Scholar
• Card, N. A. (2012). Applied meta-analysis for social science research. The Guilford Press.
   Google Scholar
• Care, E., & Anderson, K. (2016). How education systems approach breadth of skills. The Brookings Institution. https://www.brookings.edu/articles/how-education-systems-approach-breadth-of-skills/
   Google Scholar
• Chan, K. T. (2021). Embedding formative assessment in blended learning environment: The case of secondary Chinese language teaching in Singapore. Education Sciences, 11(7), 360–371. https://doi.org/10.3390/educsci11070360
   Web of Science ®Google Scholar
• Cheang, B., Kurnia, A., Lim, A., & Oon, W.-C. (2003). On automated grading of programming assignments in an academic institution. Computers & Education, 41(2), 121–131. https://doi.org/10.1016/S0360-1315(03)00030-7
   Web of Science ®Google Scholar
• Chen, D. (2023). Toward an understanding of 21st-century skills: From a systematic review. International Journal for Educational and Vocational Guidance, 23(2), 275–294. https://doi.org/10.1007/s10775-021-09511-1
   Web of Science ®Google Scholar
• Chuah, S. C., Drasgow, F., & Luecht, R. (2006). How big is big enough? Sample size requirements for CAST item parameter estimation. Applied Measurement in Education, 19(3), 241–255. https://doi.org/10.1207/s15324818ame1903_5
   Web of Science ®Google Scholar
• Çimen, S. S. (2022). Exploring EFL assessment in Turkey: Curriculum and teacher practices. International Online Journal of Education and Teaching, 9(1), 531–550. https://eric.ed.gov/?id=EJ1327768
   Google Scholar
• Clarke, M. (2012). What matters most for student assessment systems: A framework paper Working Paper No.1. World Bank Group. https://openknowledge.worldbank.org/bitstream/handle/10986/17471/682350WP00PUBL0WP10READ0web04019012.pdf?sequence=1&isAllowed=y
   Google Scholar
• Clarke, M., & Luna-Bazaldua, D. (2021). Primer on large-scale assessments of educational achievement. World Bank. https://doi.org/10.1596/978-1-4648-1659-8
   Google Scholar
• Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
   Web of Science ®Google Scholar
• DFID. (2014). Assessing the strength of evidence (how to Note). Department for International Development. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/291982/HTN-strength-evidence-march2014.pdf
   Google Scholar
• Dwiyono, Y., Mulawarman, W. G., Pramono, P. O., Salim, N. A., & Ikhsan, M. (2021). Implementation of national examination based on computer based test at Vocational school 1 North Sangatta. Cypriot Journal of Educational Sciences, 16(1), 86–95. https://doi.org/10.18844/cjes.v16i1.5510
   Google Scholar
• Ercikan, K., Asil, M., & Grover, R. (2018). Digital divide: A critical context for digitally based assessments. Education Policy Analysis Archives, 26(51), 1–18. https://doi.org/10.14507/epaa.26.3817
   Google Scholar
• Fawns, T., & O’Shea, C. (2018). Distributed learning and isolated testing: Tensions in traditional assessment practices. Proceedings of the 11th International Conference on Networked Learning, 132–139.
   Google Scholar
• Feng, M., Heffernan, N., & Koedinger, K. (2009). Addressing the assessment challenge with an online system that tutors as it assesses. User Modeling and User-Adapted Interaction, 19(3), 243–266. https://doi.org/10.1007/s11257-009-9063-7
   Web of Science ®Google Scholar
• Ferretti, F., Santi, G. R. P., Del Zozzo, A., Garzetti, M., & Bolondi, G. (2021). Assessment practices and beliefs: Teachers’ perspectives on assessment during long distance learning. Education Sciences, 11(6), 264–280. https://doi.org/10.3390/educsci11060264
   Web of Science ®Google Scholar
• Fisher, M., Maylahn, P., Pota, V., & Rappallini, J. (2022). Effective Assessment and Progress Monitoring in an Online Environment: A Study in Six Countries. T4 Education. https://24886661.fs1.hubspotusercontent-eu1.net/hubfs/24886661/T4_Assessment%20and%20Progress%20Monitoring%20Online-F1.pdf
   Google Scholar
• Fuchs, L. S., Fuchs, D., & Hamlett, C. L. (1994). Strengthening the connection between assessment and instructional planning with expert systems. Exceptional Children, 61(2), 138–147. https://go.gale.com/ps/i.do?p=HRCA&sw=w&issn=00144029&v=2.1&it=r&id=GALE%7CA15824007&sid=googleScholar&linkaccess=abs
   Web of Science ®Google Scholar
• Grunwald, A. (2009). Technology assessment: Concepts and methods. In Philosophy of technology and engineering sciences (pp. 1103–1146). Elsevier. https://doi.org/10.1016/B978-0-444-51667-1.50044-6
   Google Scholar
• Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Springer Dordrecht.
   Google Scholar
• Hanna, G. S., & Dettmer, P. (2003). Assessment for effective teaching: Using context-adaptive planning. Allyn & Bacon.
   Google Scholar
• Hattie, J. A. C. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement (1st ed.). Routledge.
   Google Scholar
• Headden, S., & McKay, S. (2015). Motivation matters: How new research can help teachers boost student engagement. Carnegie Foundation for the Advancement of Teaching. https://www.carnegiefoundation.org/wp-content/uploads/2015/07/Motivation_Matters_July_2015.pdf
   Google Scholar
• Herwin, H., Hastomo, A., Saptono, B., Ardiansyah, A. R., & Wibowo, S. E. (2021). How elementary school teachers organized online learning during the COVID-19 pandemic?. World Journal on Educational Technology: Current Issues, 13(3), 437–449. https://doi.org/10.18844/wjet.v13i3.5952
   Google Scholar
• Ibrohim, I., Sudrajat, A. K., & Saefi, M. (2021). Assessing Indonesian teachers’ perspective on the implementation of distance learning due to COVID-19 based on online survey. Journal of Turkish Science Education, 18, 46–59. https://eric.ed.gov/?id=EJ1313854
   Google Scholar
• Istiningsih, I. (2022). Impact of ICT integration on the development of vocational high school teacher TPACK in the Digital Age 4.0. World Journal on Educational Technology: Current Issues, 14(1). 103–116. https://doi.org/10.18844/wjet.v14i1.6642
   Google Scholar
• Jaiswal, A., & Arun, C. J. (2021). Potential of artificial intelligence for transformation of the education system in India. International Journal of Education and Development Using Information and Communication Technology, 17(1), 142–158. http://ijedict.dec.uwi.edu/viewissue.php?id=60
   Google Scholar
• Jong, B., & Tan, K. H. (2021). Using Padlet as a technological tool for assessment of students’ writing skills in online classroom settings. International Journal of Education and Practice, 9(2), 411–423. https://doi.org/10.18488/journal.61.2021.92.411.423
   Google Scholar
• Jowett, S., & Baginsky, M. (1988). Parents and education: A survey of their involvement and a discussion of some issues. Educational Research, 30(1), 36–45. https://doi.org/10.1080/0013188880300105
   Web of Science ®Google Scholar
• Jung, I., & Rha, I. (2000). Effectiveness and cost-effectiveness of online education: A review of the literature. Educational Technology, 40(4), 57–60. https://www.jstor.org/stable/44428629
   Google Scholar
• Kim, B. (2015). Designing gamification in the right way. Library Technology Reports, 51(2), 29–35. https://doi.org/10.5860/ltr.51n2
   Google Scholar
• Kusuma, I. P. I., Mahayanti, N. W. S., Adnyani, L. D. S., & Budiarta, L. G. R. (2021). Incorporating e-portfolio with flipped classrooms: An in-depth analysis of students’ speaking performance and learning engagement. The JALT CALL Journal, 17(2), 93–111. https://doi.org/10.29140/jaltcall.v17n2.378
   Google Scholar
• Littell, J. H., Corcoran, J., & Pillai, V. (2008). Systematic reviews and meta-analysis. Oxford University Press.
   Google Scholar
• Liu, K. (2022). Success plan for the remote assessments: Lessons learnt in COVID-19 outbreak. International Journal of Multidisciplinary and Current Educational Research, 4(1), 37–42. https://eric.ed.gov/?id=ED618438
   Google Scholar
• Lock, D. (2007). Project management (9th ed.). Gower Publishing Company Ltd.
   Google Scholar
• Lord, F. (1980). Applications of item response theory to practical testing problems. Lawrence Erlbaum Associates, Inc.
   Google Scholar
• Lubiano, M. L. D. (2018). Interactive e-learning portal for enrichment of conceptual understanding of grade 8 learners in physics. Tilamsik: The Southern Luzon Journal of Arts and Sciences, 10, 37–50. https://eric.ed.gov/?id=ED608927
   Google Scholar
• Meadows, M. (2021, June 15). Dr Michelle Meadows Speech at City of London Schools Conference 2021. GOV.UK. https://www.gov.uk/government/speeches/dr-michelle-meadows-speech-at-city-of-london-schools-conference-2021
   Google Scholar
• Morse, J. M. (1995). The significance of saturation. Qualitative Health Research, 5(2), 147–149. https://doi.org/10.1177/104973239500500201
   Web of Science ®Google Scholar
• Neumann, M. M., Anthony, J. L., Erazo, N. A., & Neumann, D. L. (2019). Assessment and technology: Mapping future directions in the early childhood classroom. Frontiers in Education, 4, 1–13. https://doi.org/10.3389/feduc.2019.00116
   Google Scholar
• OECD. (2021). Using digital technologies for early education during COVID-19: OECD report for the G20 2020 education working group. OECD Publishing. https://www.oecd-ilibrary.org/education/using-digital-technologies-for-early-education-during-covid-19_fe8d68ad-en
   Google Scholar
• O’Keefe, L., Dellinger, J. T., Scragg, B., Amelina, N., & Mathes, J. (2020). The state of online learning in the Kingdom of Saudi Arabia: A COVID-19 impact study for K-12. In Online learning consortium. Online Learning Consortium, Inc. https://eric.ed.gov/?id=ED608877
   Google Scholar
• Özdil, G., Simsek, F. M., & Tugluk, M. N. (2021). Comparison of digital assessment and documentation systems used in the early childhood education in Turkey, Germany and Spain. Southeast Asia Early Childhood, 10(2), 1–15. https://ejournal.upsi.edu.my/index.php/SAECJ/article/view/4953
   Google Scholar
• Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, 1-9. https://doi.org/10.1136/bmj.n71
   Google Scholar
• PAL Network. (n.d.) Assessment: Tests and Tools. Retrieved August 22, 2022, from https://palnetwork.org/tools/
   Google Scholar
• Potashnik, M., & Adkins, D. (1996). Cost analysis of information technology projects in education: Experiences from developing countries. World Bank Group. https://documents1.worldbank.org/curated/en/444741468247804554/pdf/multi-page.pdf
   Google Scholar
• Redecker, C., & Punie, Y. (2017). European framework for the digital competence of educators: DigCompedu. Publications Office of the European Union Joint Research Centre (European Commission). https://data.europa.eu/doi/10.2760/159770
   Google Scholar
• Robles, M., & Braathen, S. (2002). Online assessment techniques. The Delta Pi Epsilon Journal, 44(1), 39–49. https://www.learntechlib.org/p/93435/
   Google Scholar
• Romero-Tena, R., Lopez-Lozano, L., & Gutierrez, M. P. (2020). Types of use of technologies by Spanish early childhood teachers. European Journal of Educational Research, 9(2), 511–522. https://doi.org/10.12973/eu-jer.9.2.511
   Google Scholar
• Samosa, R. C. (2022). Reframing remote learning assessment practices of teachers’: Input for school based testing reforms. International Journal of Academic Pedagogical Research, 6(1), 4–20. https://eric.ed.gov/?id=ED618062
   Google Scholar
• Sánchez-Rivas, E., Ruiz-Palmero, J., & Sánchez-Rodríguez, J. (2019). Gamification of assessments in the natural sciences subject in primary education. Educational Sciences: Theory & Practice, 19(1), 95–111. https://jestp.com/article-detail/?id=8
   Google Scholar
• Simsek, F. M., & Tugluk, M. N. (2021). Making learning visible in the 21st century; examining of the use of digital assessment tools in Montessori education. Pegem Journal of Education and Instruction, 11(2), 72–86. https://www.pegegog.net/index.php/pegegog/article/view/1291
   Google Scholar
• Singh, C. K. S., Muhammad, M. M., Mostafa, N. A., Yunus, M. M., Noordin, N., & Darm, R. (2022). Exploring ESL teachers’ alternative assessment strategies and practices in the classroom. Journal of Language and Linguistic Studies, 18(1), 411–426. https://eric.ed.gov/?id=EJ1325859
   Google Scholar
• Stylianidou, N., Sofianidis, A., Manoli, E., & Meletiou-Mavrotheris, M. (2020). “Helping Nemo!”—using augmented reality and alternate reality games in the context of universal design for learning. Education Sciences, 10(4), 95–118. https://doi.org/10.3390/educsci10040095
   Web of Science ®Google Scholar
• Tas, Y., Eminoglu, S., Atila, G., Yildiz, Y., & Bozkurt, U. (2021). Teachers’ self-efficacy beliefs and opinions about distance education during the COVID-19 pandemic. Turkish Online Journal of Distance Education, 22(4), 229–253. https://doi.org/10.17718/tojde.1002868
   Web of Science ®Google Scholar
• Tashbolatovna, M. K., Duisenbaevna, U. Z., Kaldyhanovna, K. R., Koyshibaevna, A. G., Ulmeken, Z., & Gulzat, S. (2022). Development of the evaluative activities of teachers in the conditions of updated education. Cypriot Journal of Educational Sciences, 17(4), 1304–1319. https://doi.org/10.18844/cjes.v17i4.7156
   Google Scholar
• Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A. (2016). Rethinking assessment in a digital age: Opportunities, challenges and risks. British Educational Research Journal, 42(3), 454–476. https://doi.org/10.1002/berj.3215
   Web of Science ®Google Scholar
• Tong, A., Sainsbury, P., & Craig, J. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care, 19(6), 349–357. https://doi.org/10.1093/intqhc/mzm042
   PubMed Web of Science ®Google Scholar
• Turan, Z., & Meral, E. (2018). Game-based versus to non-game-based: The impact of student response systems on students’ achievements, engagements and test anxieties. Informatics in Education, 17(1), 105–116. https://doi.org/10.15388/infedu.2018.07
   Web of Science ®Google Scholar
• Vista, A., Kim, H., & Care, E. (2018). Use of data from 21st century skills assessments: Issues and key principles. The Brookings Institution. https://www.brookings.edu/wp-content/uploads/2018/10/EffectiveUse-Vista-Kim-Care-10-2018-FINALforwebsite.pdf
   Google Scholar
• Wainer, H. (2000). Computerized adaptive testing: A primer (2nd ed.). Lawrence Erlbaum Associates, Inc.
   Google Scholar
• Werbach, K., & Hunter, D. (2012). For the win: How game thinking can revolutionize your business. Wharton Digital Press.
   Google Scholar
• What Works Clearinghouse. (2022). What works Clearinghouse procedures and standards handbook, version 5.0. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance (NCEE). https://ies.ed.gov/ncee/wwc/Docs/referenceresources/Final_WWC-HandbookVer5_0-0-508.pdf
   Google Scholar
• Wiliam, D. (2006). Formative assessment: Getting the focus right. Educational Assessment, 11(3–4), 283–289. https://doi.org/10.1080/10627197.2006.9652993
   Google Scholar
• Yamamoto, K., Khorramdel, L., & Shin, H. J. (2018). Introducing multistage adaptive testing into international large-scale assessments designs using the example of PIAAC. Psychological Test and Assessment Modeling, 60(3), 347–368. https://www.psychologie-aktuell.com/fileadmin/Redaktion/Journale/ptam_3-2018_347-368.pdf
   Google Scholar
• Yilmaz, F. (2021). Comparing paper-pencil and computer-based tests: A meta-analysis study in the sample of Turkey. Eurasian Journal of Educational Research, 93, 279–300. https://eric.ed.gov/?id=EJ1300027
   Google Scholar
• Yulia, A., Husin, N. A., & Anuar, F. I. (2019). Channeling assessments in English language learning via interactive online platforms. Studies in English Language and Education, 6(2), 228–238. Article 2. https://doi.org/10.24815/siele.v6i2.14103
   Google Scholar
• Yunus, C. C., & Hua, T. K. (2021). Exploring a gamified learning tool in the ESL classroom: The case of Quizizz. Journal of Education and E-Learning Research, 8(1), 103–108. https://doi.org/10.20448/journal.509.2021.81.103.108
   Google Scholar