Evaluating Fairness and Justice of External English Language Test Score Interpretation and Use for Japanese University Admission

References

• Ali, M. M., & Hamid, M. O. (2020). Teaching English to the test: Why does negative washback exist within secondary education in Bangladesh? Language Assessment Quarterly, 17(2), 129–146. https://doi.org/10.1080/15434303.2020.1717495
   Web of Science ®Google Scholar
• Allen, D. (2016). Investigating washback to the learner from the IELTS test in the Japanese tertiary context. Language Testing in Asia, 6(7), 1–20. https://link.springer.com/content/pdf/10.1186/s40468-016-0030-z.pdf
   Google Scholar
• Allen, D., & Nagatomo, D. H. (2019). Investigating the consequential validity of TEAP: Washback to high school learners of English. Eiken Bulletin. https://www.eiken.or.jp/center_for_research/pdf/bulletin/vol99/vol_99_21.pdf
   Google Scholar
• Andrews, S., Fullilove, J., & Wong, Y. (2002). Targeting washback—a case-study. System, 30(2), 207–223. https://doi.org/10.1016/S0346-251X(02)00005-2
   Google Scholar
• Bachman, L., & Palmer, A. (2010). Language assessment in practice. Oxford University Press.
   Google Scholar
• Badger, R., & Yan, X. (2012). To what extent is communicative language teaching a feature of IELTS classes in China? IELTS Research Reports, 13. https://www.ielts.org/-/media/research-reports/ielts_rr_volume13_report4.ashx
   Google Scholar
• Brown, J. D. H. (1998). Does IELTS preparation work? An application of the context-adaptive model of language program evaluation. IELTS Research Reports, 1, 20–37. https://www.ielts.org/for-researchers/research-reports/volume-01-report-2
   Google Scholar
• Chalhoub-Deville, M. (2016). Validity theory: Reform policies, accountability testing, and consequences. Language Testing, 33(4), 453–472. https://doi.org/10.1177/0265532215593312
   Web of Science ®Google Scholar
• Chappell, P., Bodis, A., & Jackson, H. (2015). The impact of teacher cognition and classroom practices on IELTS test preparation courses in the Australian ELICOS sector. IELTS Research Report Series. https://www.ielts.org/research/research-reports/online-series-2015-6
   Google Scholar
• Chappell, P., Yates, L., & Benson, P. (2019). Investigating test preparation practices: Reducing risks. IELTS Research Reports Online-Series, 3. https://www.ielts.org/teaching-and-research/research-reports/online-series-2019-3
   Google Scholar
• Cohen, A. S., Kane, M. T., & Crooks, T. J. (1999). A generalized examinee-centered method for setting standards on achievement tests. Applied Measurement in Education, 12(4), 343–366. https://doi.org/10.1207/S15324818AME1204_2
   Web of Science ®Google Scholar
• Council of Europe. (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge University Press.
   Google Scholar
• Council of Europe. (2009). Relating language examinations to the common European Framework of reference for languages: Learning, teaching, assessment (CEFR): A manual. Language Policy Division.
   Google Scholar
• Coxhead, A. (2000). A new academic word list. TESOL Quarterly, 34(2), 213–238. https://doi.org/10.2307/3587951
   Web of Science ®Google Scholar
• Deygers, B., Van den Branden, K., & Van Gorp, K. (2018). University entrance language tests: A matter of justice. Language Testing, 35(4), 449–476. https://doi.org/10.1177/0265532217706196
   Web of Science ®Google Scholar
• Deygers, B., Van Gorp, K., & Demeester, T. (2018). The B2 level and the dream of a common standard. Language Assessment Quarterly, 15(1), 44–58. https://doi.org/10.1080/15434303.2017.1421955
   Web of Science ®Google Scholar
• Figueras, N., North, B., Takala, S., Verhelst, N., & Van Avermaet, P. (2005). Relating examinations to the common European framework: A manual. Language Testing, 22(3), 261–279. https://doi.org/10.1191/0265532205lt308oa
   Google Scholar
• Gibson, C., & Swan, A. (2008). The significance of sociolinguistic backgrounds of teachers of IELTS test preparation courses in selected Malaysian institutions. IELTS Research Reports, 8. https://www.ielts.org/research/research-reports/volume-08-report-2
   Google Scholar
• Green, A. (2006). Washback to the learner: Learner and teacher perspectives on IELTS preparation course expectations and outcomes. Assessing Writing, 11(2), 113–134. https://doi.org/10.1016/j.asw.2006.07.002
   Google Scholar
• Green, A. (2007). IELTS washback in context: Preparation for academic writing in higher education. Cambridge University Press.
   Google Scholar
• Green, A. (2014). The Test of English for Academic Purposes (TEAP) impact study: Report 1 - Preliminary questionnaires to Japanese high school students and teachers. https://www.eiken.or.jp/teap/group/pdf/teap_washback_study.pdf.
   Google Scholar
• Green, A. (2018). Linking tests of English for academic purposes to the CEFR: The score user’s perspective. Language Assessment Quarterly, 15(1), 59–74. https://doi.org/10.1080/15434303.2017.1350685
   Web of Science ®Google Scholar
• Haebara, T. (2018). 英語入試改革の現状と共通テストのゆくえ[The status-quo of the English entrance exam reform and future of the Common Test. In T. Haebara (Ed.), 検証迷走する英語入試: スピーキング導入と民間委託 [Examining the English entrance test that goes astray: Introduction of speaking and outsourcing] (pp. 5–25). Iwanami Shoten.
   Google Scholar
• Hama, M., & Okabe, Y. (2016). GTEC CBT and English language education in Japan: A study of washback. https://www.benesse.co.jp/gtec/schoolofficials/research/pdf/doc-2016-01.pdf
   Google Scholar
• Harsch, C. (2018). How suitable is the CEFR for setting university entrance standards? Language Assessment Quarterly, 15(1), 102–108. https://doi.org/10.1080/15434303.2017.1420793
   Web of Science ®Google Scholar
• Hawkey, R. (2006). Impact theory and practice: Studies of the IELTS test and Progetto Lingue 2000. Cambridge University Press.
   Google Scholar
• Hayes, B. M. (2003). IELTS preparation in New Zealand: An investigation into the nature of the courses and evidence of washback [ Doctoral Dissertation]. Victoria University of Wellington.
   Google Scholar
• Hsieh, M. (2013). Comparing yes/no Angoff and bookmark standard setting methods in the context of English assessment. Language Assessment Quarterly, 10(3), 331–350. https://doi.org/10.1080/15434303.2013.769550
   Web of Science ®Google Scholar
• Kaftandjieva, F. (2004). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the common European framework of reference for languages: Learning, teaching, assessment. Council of Europe Publishing.
   Google Scholar
• Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000
   Web of Science ®Google Scholar
• Kaneko, M. (2020). Lexical frequency profiling of high-stakes English tests: Text coverage of Cambridge First, EIKEN, GTEC, IELTS, TEAP, TOEFL, and TOEIC. JACET Journal, 64, 79–93. https://doi.org/10.32234/jacetjournal.64.0_79
   Google Scholar
• Kunnan, J. A. (2018). Evaluating language assessments. Routledge.
   Google Scholar
• Laufer, B., & Sim, D. D. (1985). Taking the easy way out: Non-use or misuse of clues in EFL reading. English Teaching Forum, 23, 7–10.
   Google Scholar
• Lavery, M. R., Bostic, J. D., Kruse, L., Krupa, E. E., & Carney, M. B. (2020). Argumentation surrounding argument-based validation: A systematic review of validation methodology in peer-reviewed articles. Educational Measurement: Issues and Practice, 39(4), 116–130. https://doi.org/10.1111/emip.12378
   Web of Science ®Google Scholar
• Liu, N., & Nation, I. S. P. (1985). Factors affecting guessing vocabulary in context. RELC Journal, 16(1), 33–42. https://doi.org/10.1177/003368828501600103
   Google Scholar
• Macqueen, S., Knoch, U., Wigglesworth, G., Nordlinger, R., Singer, R., McNamara, T., & Brickle, R. (2019). The impact of national standardized literacy and numeracy testing on children and teaching staff in remote Australian Indigenous communities. Language Testing, 36(2), 265–287. https://doi.org/10.1177/0265532218775758
   Web of Science ®Google Scholar
• McNamara, T., & Roever, C. (2006). Language testing: The social dimension. Blackwell.
   Google Scholar
• McNamara, T., & Ryan, K. (2011). Fairness versus justice in language testing: The place of English literacy in the Australian citizenship test. Language Assessment Quarterly, 8(2), 161–178. https://doi.org/10.1080/15434303.2011.565438
   Web of Science ®Google Scholar
• MEXT. (2011). The revisions of the courses of study for elementary and secondary schools. https://www.mext.go.jp/en/policy/education/elsec/title02/detail02/__icsFiles/afieldfile/2011/03/28/1303755_001.pdf
   Google Scholar
• MEXT. (2017a). 大学入学共通テスト実施方針策定にあっての考え方. https://www.mext.go.jp/component/a_menu/education/micro_detail/__icsFiles/afieldfile/2017/10/24/1397731_002.pdf
   Google Scholar
• MEXT. (2017b). 平成29 年度英語力調査結果 (高校3年生) の概要. http://www.mext.go.jp/a_menu/kokusai/gaikokugo/icsFiles/afieldfile/2018/04/06/1403470_03_1.pdf
   Google Scholar
• MEXT. (2018). 高等学校学習指導要領 (平成30) 解説 外国語編 [The Course of Study for foreign languages at high school announced in 2018].
   Google Scholar
• Mickan, P., & Motteram, J. (2008). An ethnographic study of classroom instruction in an IELTS preparation program. IELTS Research Reports, 8. https://www.ielts.org/research/research-reports/volume-08-report-1
   Google Scholar
• Mickan, P., & Motteram, J. (2009). The preparation practices of IELTS candidates: Case studies. IELTS Research Reports, 10. https://www.ielts.org/en-us/research/research-reports/volume-10-report-5
   Google Scholar
• Milton, J. (2009). Measuring second language vocabulary acquisition. Multilingual Matters.
   Google Scholar
• Moore, S., Stroupe, R., & Mahony, P. (2012). Perceptions of IELTS in Cambodia: A case study of test impact in a small developing country. IELTS Research Reports, 13. https://www.ielts.org/-/media/research-reports/ielts_rr_volume13_report6.ashx.
   Google Scholar
• Nation, I. S. P. (2013). Learning vocabulary in another language (2nd ed.). Cambridge University Press.
   Google Scholar
• Papageorgiou, S., Tannenbaum, R. J., Bridgeman, B., & Cho, Y. (2015). The association between the TOEFL iBT® test scores and the Common European Framework of Reference (CEFR) levels. ETS. ETS Research Memorandum No. ETS RM-15-06
   Google Scholar
• Qi, L. (2005). Stakeholders’ conflicting aims undermine the washback function of a high stakes test. Language Testing, 22(2), 142–173. https://doi.org/10.1191/0265532205lt300oa
   Google Scholar
• Sahlberg, P. (2011). Finnish lessons: What can the world learn from educational change in Finland? Teachers College Press.
   Google Scholar
• Sandelowski, M., & Barroso, J. (2007). Handbook for synthesizing qualitative research. Springer.
   Google Scholar
• Sasaki, M. (2008). The 150-year history of English language assessment in Japanese education. Language Testing, 25(1), 63–83. https://doi.org/10.1177/0265532207083745
   Web of Science ®Google Scholar
• Sato, M. (2018). The impact of the Test of English for Academic Purposes (TEAP) on Japanese students’ English learning. JACET Journal, 62, 89–107. https://doi.org/10.32234/jacetjournal.62.0_89
   Google Scholar
• Schmitt, N., Jiang, X., & Grabe, W. (2011). The percentage of words known in a text and reading comprehension. The Modern Language Journal, 95(1), 26–43. https://doi.org/10.1111/j.1540-4781.2011.01146.x
   Web of Science ®Google Scholar
• Shohamy, E. (2001). The power of tests: A critical perspective on the uses of language tests. Longman.
   Google Scholar
• Sixty five % thinks English external exams problematic [英語の民間試験問題ある65%] (2019, September 16). Asahi Shinbun, pp. 1–2.
   Google Scholar
• Tannenbaum, R. J., & Cho, Y. (2014). Critical factors to consider in evaluating standard-setting studies to map language test scores to frameworks of language proficiency. Language Assessment Quarterly, 11(3), 233–249. https://doi.org/10.1080/15434303.2013.869815
   Web of Science ®Google Scholar
• Tannenbaum, R. J., & Wylie, E. C. (2008). Linking English-language test scores onto the Common European Framework of Reference: An application of standard-setting methodology. ETS Research Report Series, 2008(1). https://doi.org/10.1002/j.2333-8504.2008.tb02120.x
   Google Scholar
• Toulmin, S. E. (2003). The uses of argument. Cambridge University Press.
   Google Scholar
• Tsagari, D. (2009). The complexity of test washback: An empirical study. Peter Lang.
   Google Scholar
• Wall, D. (2005). The impact of high-stakes examinations on classroom teaching: A case study using insights from testing and innovation theory. Cambridge University Press.
   Google Scholar
• Wall, D., & Horák, T. (2011). The impact of changes in the TOEFL® exam on teaching in a sample of countries in Europe: Phase 3, the role of the coursebook phase 4, describing change. TOEFL iBT® ETS Research Report Series Volume 2011(2). https://doi.org/10.1002/j.2333-8504.2011.tb02277.x
   Google Scholar
• Watanabe, Y. (2013). The national center test for university admissions. Language Testing, 30(4), 565–573. https://doi.org/10.1177/0265532213483095
   Web of Science ®Google Scholar
• Xi, X. (2010). How do we go about investigating test fairness? Language Testing, 27(2), 147–170. https://doi.org/10.1177/0265532209349465
   Web of Science ®Google Scholar