837
Views
5
CrossRef citations to date
0
Altmetric
Articles

Student perceptions of predictability of examination requirements and relationship with outcomes in high-stakes tests in Ireland

, &
Pages 361-379 | Received 20 Jul 2015, Accepted 22 Jun 2016, Published online: 20 Sep 2016
 

Abstract

Entirely predictable examinations are ones for which the questions are known in advance. Some assessments are designed this way, but in public examinations, predictability is subtler. Students familiarise themselves with the requirements broadly: likely topics that will come up, question formats and how to maximise their marks. If students can predict what they have to do, they can memorise performances, such as essays, and restrict their learning to fit only with examination requirements. The danger is that this focus could undermine curriculum aims. Further, examinations that are overly predictable might produce results that do not generalise to other performances or have predictive validity. This paper presents part of a broader project investigating whether the Higher Level Irish Leaving Certificate (LC) examinations were too predictable. Here, the development of a rating scale for students’ views of examination predictability is described. Data were collected from 1002 Irish LC students taking higher level examinations in biology (n = 536), English (n = 749) and geography (n = 387). Students’ views on predictability of the examination could be grouped consistently across subject areas into three factors: valuable learning, predictability and narrowing of the curriculum. Belief that narrowing of the curriculum was a good examination preparation tactic had a negative relationship with examination scores and perceived learning value of examinations was positively associated with students’ scores in biology and English. These findings indicate that the scoring system rewards students who believe they must study the discipline broadly.

Acknowledgements

This project was commissioned by the State Examinations Commission in Ireland. We are grateful to them for their support of the research and for the participation of the teachers and learners in Ireland in this project.

Disclosure statement

No potential conflict of interest was reported by the authors.

Notes on contributors

Jo-Anne Baird is Director of the Department of Education, University of Oxford, and Pearson Professor of Educational Assessment. She is a Visiting Professor at Queen’s University, Belfast, and Professor II in psychology at the University of Bergen. Her research interests include examination standards, marking reliability and assessment design.

Dr Daniel Caro is a Research Fellow at the Oxford University Centre for Educational Assessment at the Department of Education, University of Oxford. His research interests include socioeconomic effects on educational attainment and school effectiveness, international tests and production of freeware packages in R, such as ‘intsvy’.

Dr Therese N. Hopfenbeck is Director of the Oxford University Centre for Educational Assessment at the Department of Education, University of Oxford. Her research interests include assessment for learning, self-regulated learning and international tests.

Notes

Additional information

Funding

This research was funded by the State Examinations Commission (SEC) of Ireland

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 53.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 235.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.