References
- Alemdag, E., and K. Cagiltay. 2018. “A Systematic Review of Eye Tracking Research on Multimedia Learning.” Computers & Education 125: 413–428.
- American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. 2014. Standards for Educational and Psychological Testing. Lanham, MD: American Educational Research Association.
- Baker, R., and J. Clarke-Midura. 2013. “Predicting Successful Inquiry Learning in a Virtual Performance Assessment for Science.” Paper presented at the 21st International Conference on User Modeling, Adaptation, and Personalization, Rome, June 10–14. doi:10.1007/978-3-642-38844-6_17.
- Berry, R. 2011. “Assessment Reforms Around the World.” In Assessment Reform in Education: Policy and Practice, edited by R. Berry and B. Adamson, 89–102. Dordrecht: Springer.
- Braun, V., and V. Clarke. 2006. “Using Thematic Analysis in Psychology.” Qualitative Research in Psychology 3 (2): 77–101. doi:https://doi.org/10.1191/1478088706qp063oa.
- Bryant, W. 2017. “Developing a Strategy for Using Technology-Enhanced Items in Large-Scale Standardized Tests.” Practical Assessment, Research & Evaluation 22 (1): 1–5. https://pareonline.net/getvn.asp?v=22&n=1.
- Cantillon, P., B. Irish, and D. Sales. 2004. “Using Computers for Assessment in Medicine.” British Medical Journal (Clinical Research Edition) 329 (7466): 606–609.
- Chatterji, M. 2013. “Insights, Emerging Taxonomies, and Theories of Action Toward Improving Validity.” In Validity and Test Use: An International Dialogue on Educational Assessment, Accountability and Equity, edited by M. Chatterji, 273–330. Bingley: Emerald Group Publishing.
- Cheung, A., and R. Slavin. 2013. “The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis.” Educational Research Review 9: 88–113.
- Department of Education and Skills (DES). 2015. Digital Strategy for Schools 2015-2020: Enhancing Teaching, Learning and Assessment. https://www.education.ie/en/Publications/Policy-Reports/Digital-Strategy-for-Schools-2015-2020.pdf.
- Department of Education and Skills (DES). 2017. Digital Learning Framework for Post-Primary Schools. https://www.education.ie/en/Schools-Colleges/Information/Information-Communications-Technology-ICT-in-Schools/digital-learning-framework-secondary.pdf.
- Department of Education and Skills (DES). 2020. Digital Learning 2020: Reporting on Practice in Early Learning and Care, Primary and Secondary Contexts. https://assets.gov.ie/78007/a37413f9-7423-44bf-86df-01762e04a408.pdf.
- Department of Education and Skills (DES). 2021. Digital Strategy for School Consultation Framework [website]. https://www.education.ie/en/Schools-Colleges/Information/Information-Communications-Technology-ICT-in-Schools/digital-strategy-for-schools-consultation-framework.html.
- Deutsch, T., K. Herrmann, T. Frese, and H. Sandholzer. 2012. “Implementing Computer-Based Assessment—A web-Based Mock Examination Changes Attitudes.” Computers & Education 58 (4), 1068–1075. https://www.learntechlib.org/p/67493/.
- Donnolly, K. 2021. “Leaving Cert Computer Science a ‘Fair Exam with Some Challenges’”. Irish Times, May 22. https://www.independent.ie/irish-news/education/leaving-cert-computer-sciencea-fair-exam-with-some-challenges-40456899.html.
- Elbabour, F., O. Alhadreti, and P. Mayhew. 2017. “Eye Tracking in Retrospective Think-Aloud Usability Testing: Is There Added Value?” Journal of Usability Studies 12 (3): 95–110. http://uxpajournal.org/wp-content/uploads/sites/8/pdf/JUS_Elbabour_May2017.pdf.
- Flynn, P. 2017. Embedding Student Voices in Education Discourse: Curricular co-Construction and Development. Dublin: National Council for Curriculum and Assessment (NCCA). https://ncca.ie/media/3442/16539-ncca-the-learner-voice-research-study-v2.pdf.
- Fraillon, J., W. Schulz, and J. Ainley. 2013. “International Computer and Information Literacy Study: Assessment Framework.” International Association for the Evaluation of Educational Achievement (IEA).
- Garrett, H. 1937. Statistics in Psychology and Education. New York: Longmans.
- Harms, M., and J. Adams. 2008. “Usability and Design Considerations for Computer-Based Learning and Assessment”. Paper Presented at American Educational Research Associations (AERA), New York. https://pdfs.semanticscholar.org/3661/cbe8b6d8fec7ad37648164d02f2a80d47960.pdf.
- Hochlehnert, A., K. Brass, A. Moeltner, and J. Juenger. 2011. “Does Medical Students’ Preference of Test Format (Computer-Based vs. Paper-Based) Have an Influence on Performance.” BMC Medical Education 11: 89. doi:https://doi.org/10.1186/2F1472-6920-11-89.
- Hoffler, T., and D. Leutner. 2007. “Instructional Animation vs. Static Pictures: A Meta-Analysis.” Learning and Instruction 17 (6): 722–738.
- Huff, K. L., and S. G. Sireci. 2001. “Validity Issues in Computer-Based Testing.” Educational Measurement: Issues and Practice 20 (3): 16–25. https://www.learntechlib.org/p/94639/.
- Ilomäki, L., and M. Lakkala. 2018. “Digital Technology and Practices for School Improvement: Innovative Digital School Model.” Research and Practice in Technology Enhanced Learning 13: 1–32.
- Jordan, K. 1998. “Defining Multimedia.” IEEE Multimedia 5: 8–15.
- Karakolidis, A., M. O'Leary, and D. Scully. 2021. “Animated Videos in Assessment: Comparing Validity Evidence from and Test-Takers’ Reactions to an Animated and a Text-Based Situational Judgement Test.” International Journal of Testing 21 (2): 57–79. doi:https://doi.org/10.1080/15305058.2021.1916505.
- Lazonder, A. W., A. Walraven, H. Gijlers, and N. Janssen. 2020. “Longitudinal Assessment of Digital Literacy in Children: Findings from a Large Dutch Single-School Study.” Computers & Education 143: 103681.
- Lee, Y. H., J. Hao, K. Man, and L. Ou. 2019. “How Do Test Takers Interact with Simulation-Based Tasks? A Response-Time Perspective.” Frontiers in Psychology 10: 906.
- Lehane, P. 2019. Leaving Certficicate Computer Science: Factors to Consider When Developing Computer-Based Examinations. Dublin: National Council of Curriculum and Assessment. https://www.ncca.ie/media/4081/lccs_cbe_factorstoconsider_lehane2019-for-ncca-website.pdf.
- Levy, R. 2012. “Psychometric Advances, Opportunities, and Challenges for Simulation-Based Assessment.” Paper Presented at the Invitational Research Symposium on Science Assessment, May 2012. https://www.ets.org/Media/Research/pdf/session2-levy-paper-tea2012.pdf.
- Lindner, M., A. Eitel, J. Barenethien, and O. Köller. 2021. “An Integrative Study on Learning and Testing with Multimedia: Effects on Students’ Performance and Metacognition.” Learning and Instruction 71: 101100.
- Lindner, M., O. Lüdtke, S. Grund, and O. Köller. 2017. “The Merits of Representational Pictures in Educational Assessment: Evidence for Cognitive and Motivational Effects in a Time-on-Task Analysis.” Contemporary Educational Psychology 51: 482–492.
- Mayer, R. 2008. “Applying the Science of Learning: Evidence Based Principles for the Design of Multimedia Instruction.” American Psychologist 63 (8): 760–769. doi:https://doi.org/10.1037/0003-066X.63.8.760.
- Mayer, R. 2014. “Cognitive Theory of Multimedia Learning.” In The Cambridge Handbook of Multimedia Learning. 2nd ed., edited by R. E. Mayer, 43–71. Cambridge: Cambridge University Press.
- Mayer, R., and R. Moreno. 2002. “Animation as an Aid to Multimedia Learning.” Educational Psychology Review 14 (1): 87–99.
- Messick, S. 1994. “The Interplay of Evidence and Consequences in the Validation of Performance Assessments.” Educational Researcher 23 (2): 13–23.
- Mitra, D. 2018. “Student Voice in Secondary Schools: The Possibility for Deeper Change.” Journal of Educational Administration 56 (5): 473–487. doi:https://doi.org/10.1108/JEA-01-2018-0007.
- New Zealand Qualification Authority (NZQA). 2021. 2021 Examination Timetable [webpage]. https://www.nzqa.govt.nz/assets/qualifications-and-standards/qualifications/ncea/exams-and-portfolios/examination-timetable.pdf.
- New Zealand Qualifications Authority (NZQA). 2018. Digital Assessment: NCEA Digital Trials and Pilots [webpage]. https://www.nzqa.govt.nz/about-us/future-state/digital-assessment-trials-pilots/.
- O’Brien, C. 2021. “Leaving Cert has ‘pernicious’ Impact on Learning, Committee Hears.” Irish Times, November 16. https://www.irishtimes.com/news/education/leaving-cert-has-pernicious-impact-on-learning-committee-hears-1.4730570.
- Olsen, A., L. Smolentzov, and T. Strandvall. 2010. “Comparing Different Eye Tracking Cues When Using the Retrospective Think Aloud Method in Usability Testing.” Paper presented at the Journal of Usability Studies, British Computer Society, September, 45–53. https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2010.8.
- Organisation for Economic Co-operation and Development (OECD). 2015a. Students, Computers and Learning: Making the Connection. https://doi.org/https://doi.org/10.1787/9789264239555-en.
- Organisation for Economic Co-Operation and Development (OECD). 2015b. PISA 2015 Released Field Trial Cognitive Items. https://www.oecd.org/pisa/test/PISA2015-Released-FT-Cognitive-Items.pdf.
- Organisation for Economic Co-Operation and Development (OECD). 2017. PISA: 2015 Technical Report. https://www.oecd.org/pisa/data/2015-technical-report/PISA2015_TechRep_Final.pdf.
- Parshall, C., and J. Harmes. 2008. “The Design of Innovative Item Types: Targeting Constructs, Selecting Innovations, and Refining Prototypes.” CLEAR Exam Review 19 (2): 18–25. https://www.clearhq.org/resources/CLEAR_summer08_4.pdf.
- Ponsford, R., R. Meiksin, S. Bragg, J. Crichton, L. Emmerson, T. Tancred, N. Tilouche, et al. 2021. “Co-production of Two Whole-School Sexual Health Interventions for English Secondary Schools: Positive Choices and Project Respect.” Pilot & Feasibility Studies 7: 50. https://pilotfeasibilitystudies.biomedcentral.com/articles/10.1186/s40814-020-00752-5.
- Prensky, M. 2001. “Digital Natives, Digital Immigrants: Part 1.” On the Horizon 9 (5): 1–6.
- QSR International. 2020. “NVivo 12.” http://www.qsrinternational.com/products_nvivo.aspx.
- Russell, M. 2016. “A Framework for Examining the Utility of Technology-Enhanced Items.” Journal of Applied Testing Technology 17 (1): 20–32. http://www.jattjournal.com/index.php/atp/article/view/89189/67798%5Cnhttp://www.jattjournal.com/.
- Salkind, N. J. 2010. Encyclopedia of Research Design. Thousand Oaks, CA: SAGE. doi:https://doi.org/10.4135/9781412961288.n460.
- Salomon, G. 1991. “Transcending the Qualitative-Quantitative Debate: The Analytic and Systemic Approaches to Educational Research.” Educational Researcher 20 (6): 10–18.
- Scully, D. 2017. “Constructing Multiple-Choice Items to Measure Higher-Order Thinking.” Practical Assessment, Research, and Evaluation 22: 4.
- Shiel, G., C. Kelleher, C. McKeown, and S. Denner. 2016. “Future Ready? The Performance of 15-Year-Olds in Ireland on Science, Reading Literacy and Mathematics in PISA 2015.” Educational Research Centre.
- Siozos, P., G. Palaigeorgiou, G. Triantafyllakos, and T. Despotakis. 2009. “Computer Based Testing Using “Digital ink”: Participatory Design of a Tablet PC Based Assessment Application for Secondary Education.” Computers & Education 52 (4): 811–819.
- Starkey, L., M. Shonfeld, S. Prestridge, and M. Gisbert Cervera. 2021. “Special Issue: Covid-19 and the Role of Technology and Pedagogy on School Education During a Pandemic.” Technology, Pedagogy & Education 30 (1): 1–5.
- State Examination Commission. 2021. Leaving Certificate Computer Science [webpage]. https://www.examinations.ie/?l=en&mc=ex&sc=cs.
- Tamim, R. M., R. M. Bernard, E. Borokhovski, P. C. Abrami, and R. F. Schmid. 2011. “What Forty Years of Research Says About the Impact of Technology on Learning: A Second-Order Meta-Analysis and Validation Study.” Review of Educational Research 81 (1): 4–28.
- Teig, N., R. Scherer, and M. Kjærnsli. 2020. “Identifying Patterns of Students’ Performance on Simulated Inquiry Tasks Using PISA 2015 log-File Data.” Journal of Research in Science Teaching 57 (9): 1400–1429.
- Tuzinski, K. 2013. “Simulations for Personnel Selection: An Introduction.” In Simulations for Personnel Selection, edited by M. Fetzer and K. Tuzinski, 1–16. New York: Springer.
- Walker, R., and Z. Handley. 2016. “Designing for Learner Engagement with Computer-Based Testing.” Research in Learning Technology 24: 1–14.
- Weick, K. E. 1995. Sensemaking in Organizations. Thousand Oaks, CA: Sage Publications.
- Wise, S. 2019. “Controlling Construct-Irrelevant Factors Through Computer-Based Testing: Disengagement, Anxiety, & Cheating.” Education Inquiry 10 (1): 21–33.