References
- Alghamdi, E. (2021). Automated video difficulty assessment. [Unpublished doctoral thesis]. University of Melbourne.
- American Educational Research Association [AERA], American Psychological Association [APA], National Council on Measurement in Education [NCME], & Joint Committee on Standards for Educational and Psychological Testing. (2014). Standards for educational and psychological testing. American Educational Research Association.
- Andringa, S., & Godfroid, A. (2020). Sampling bias and the problem of generalizability in applied linguistics. Annual Review of Applied Linguistics, 40, 134–142. https://doi.org/https://doi.org/10.1017/S0267190520000033
- *Baltova, I. 1994. The impact of video on the comprehension skills of core French students. Canadian Modern Language Review, 50(3), 507–531. https://doi.org/https://doi.org/10.3138/cmlr.50.3.507
- *Batty, A. O. (2015). A comparison of video- and audio-mediated listening tests with many-facet Rasch modeling and differential distractor functioning. Language Testing, 32(1), 3–20. https://doi.org/https://doi.org/10.1177/0265532214531254
- *Batty, A. O. (2018). Investigating the impact of nonverbal communication cues on listening item types. In G. Ockey & E. Wagner, Assessing L2 listening: Moving towards authenticity (pp. 161–175). John Benjamins. https://doi.org/https://doi.org/10.1075/lllt.50.11bat
- *Batty, A. O. (2020). An eye-tracking study of attention to visual cues in L2 listening tests. Language Testing. Advance online publication. https://doi.org/https://doi.org/10.1177/0265532220951504
- Bejar, I., Douglas, D., Jamieson, J., Nissan, S., & Turner, J. (2000). TOEFL 2000 listening framework: A working paper (Report No. RM-00-07). Educational Testing Service. https://www.ets.org/Media/Research/pdf/RM-00-07.pdf
- *Brett, P. (1997). A comparative study of the effects of the use of multimedia on listening comprehension. System, 25(1), 39–53. https://doi.org/https://doi.org/10.1016/S0346-251X(96)00059-0
- Center for Open Science. (2021, May 5). Open Science Badges. https://www.cos.io/initiatives/badges
- *Chung, U. K. (1994). The effect of audio, a single picture, multiple pictures, or video on second-language listening comprehension (Publication No. 9416350) [Doctoral dissertation, University of Illinois at Urbana-Champaign]. ProQuest Dissertations Publishing. http://hdl.handle.net/2142/20385
- *Coniam, D. (2001). The use of audio or video comprehension as an assessment instrument in the certification of English language teachers: A case study. System, 29(1), 1–14. https://doi.org/https://doi.org/10.1016/S0346-251X(00)00057-9
- Creswell, J. W., & Plano Clark, V. L. (2017). Designing and conducting mixed methods research (3rd ed.). Sage.
- *Cubilo, J. (2017). Video-mediated listening passages and typed note-taking: Examining their effects on examinee listening test performance and item characteristics (Publication No. 10757729) [Doctoral dissertation, University of Hawaii at Mānoa]. ProQuest Dissertations Publishing.
- *Cubilo, J., & Winke, P. (2013). Redefining the L2 listening construct within an integrated writing task: Considering the impacts of visual-cue interpretation and note-taking. Language Assessment Quarterly, 10(4), 371–397. https://doi.org/https://doi.org/10.1080/15434303.2013.824972
- *Dahl, T. I., & Ludvigsen, S. (2014). How I see what you’re saying: The role of gestures in native and foreign language listening comprehension. The Modern Language Journal, 98(3), 813–833. https://doi.org/https://doi.org/10.1111/modl.12124
- Field, J. (2013). Cognitive validity. In A. Geranpayeh & L. Taylor (Eds.), Examining listening: Research and practice in assessing second language listening (pp. 77–151). Cambridge University Press.
- *Ginther, A. (2002). Context and content visuals and performance on listening comprehension stimuli. Language Testing, 19(2), 133–167. https://doi.org/https://doi.org/10.1191/0265532202lt225oa
- *Gruba, P. (1993). A comparison study of audio and video in language testing. JALT Journal, 15(1), 85–88.
- *Hsieh, C., & Davis, L. (2019). The effect of audiovisual input on academic listen-speak task performance. In S. Papageorgiou & K. Bailey (Eds.), Global perspectives on language assessment: Research, theory, and practice (pp. 96–107). Routledge.
- *İnceçay, V., & Koçoğlu, Z. (2017). Investigating the effects of multimedia input modality on L2 listening skills of Turkish EFL learners. Education and Information Technologies, 22(3), 901–916. https://doi.org/https://doi.org/10.1007/s10639-016-9463-3
- *Jing, Z. (2010). Testing via news videos: An exploratory study. International Journal of Applied Linguistics, 20(2), 178–205. https://doi.org/https://doi.org/10.1111/j.1473-4192.2009.00236.x
- Kang, T., Gutierrez Arvizu, M. N., Chaipuapae, P., & Lesnov, R. O. (2019). Reviews of academic English listening tests for non-native speakers. International Journal of Listening, 33(1), 1–38. https://doi.org/https://doi.org/10.1080/10904018.2016.1185210
- *Lesnov, R. O. (2017). Using videos in ESL listening achievement tests: Effects on difficulty. Eurasian Journal of Applied Linguistics, 3(1), 67–91. https://doi.org/https://doi.org/10.32601/ejal.461034
- *Lesnov, R. O. (2018a). Content-rich versus content-deficient video-based visuals in L2 academic listening tests: Pilot study. International Journal of Computer-Assisted Language Learning and Teaching, 8(1), 15–30. https://doi.org/https://doi.org/10.4018/IJCALLT.2018010102
- *Lesnov, R. O. (2018b). The role of content-rich visuals in the L2 academic listening assessment construct (Publication No. 10821812) [Doctoral dissertation, Northern Arizona University]. ProQuest Dissertations Publishing. http://openknowledge.nau.edu/id/eprint/5448
- *Londe, Z. C. (2009). The effects of video media in English as a second language listening comprehension tests. Issues in Applied Linguistics, 17(1), 41–50. https://escholarship.org/uc/item/0c080191
- Macaro, E. (2020). Systematic reviews in applied linguistics. In J. McKinley & H. Rose (Eds.), The Routledge handbook of research methods in applied linguistics (pp. 230–239). Routledge. https://doi.org/https://doi.org/10.4324/9780367824471-20
- Marsden, E., Thompson, S., & Plonsky, L. (2018). A methodological synthesis of self-paced reading in second language research. Applied Psycholinguistics, 39(5), 861–904. https://doi.org/https://doi.org/10.1017/S0142716418000036
- Newman, M., & Gough, D. (2020). Systematic reviews in educational research: Methodology, perspectives and application. In O. Zawacki-Richter, M. Kerres, S. Bedenlier, M. Bond, & K. Buntins (Eds.), Systematic reviews in educational research: Methodology, perspectives and application (pp. 3–22). Springer VS. https://doi.org/https://doi.org/10.1007/978-3-658-27602-7_1
- *Ockey, G. J. (2007). Construct implications of including still image or video in computer-based listening tests. Language Testing, 24(4), 517–537. https://doi.org/https://doi.org/10.1177/0265532207080771
- Ockey, G., & Wagner, E. (2018). Assessing L2 listening: Moving towards authenticity. John Benjamins. https://doi.org/https://doi.org/10.1075/lllt.50
- *Parry, T. S., & Meredith, R. A. (1984). Videotape vs. audiotape for listening comprehension tests: An experiment. OMLTA Journal, 47–53.
- Plonsky, L. (2014). Study quality in quantitative L2 research (1990–2010): A methodological synthesis and call for reform. The Modern Language Journal, 98(1), 450–470. https://doi.org/https://doi.org/10.1111/j.1540-4781.2014.12058.x
- Plonsky, L., & Derrick, D. J. (2016). A meta-analysis of reliability coefficients in second language research. The Modern Language Journal, 100(2), 538–553. https://doi.org/https://doi.org/10.1111/modl.12335
- Plonsky, L., & Gass, S. (2011). Quantitative research methods, study quality, and outcomes: The case of interaction research. Language Learning, 61(2), 325–366. https://doi.org/https://doi.org/10.1111/j.1467-9922.2011.00640.x
- Plonsky, L., & Kim, Y. (2016). Task-based learner production: A substantive and methodological review. Annual Review of Applied Linguistics, 36, 73–97. https://doi.org/https://doi.org/10.1017/S0267190516000015
- Plonsky, L., Marsden, E., Crowther, D., Gass, S. M., & Spinner, P. (2020). A methodological synthesis and meta-analysis of judgment tasks in second language research. Second Language Research, 36(4), 583–621. https://doi.org/https://doi.org/10.1177/0267658319828413
- Porte, G., & McManus, K. (2019). Doing replication research in applied linguistics. Routledge. https://doi.org/https://doi.org/10.4324/9781315621395
- *Progosh, D. (1996). Using video for listening assessment: Opinions of test-takers. TESL Canada Journal, 14(1), 34–44. https://doi.org/https://doi.org/10.18806/tesl.v14i1.676
- *Pusey, K. (2020). Assessing L2 listening at a Japanese university: Effects of input type and response format. Language Education and Assessment, 3(1), 13–35. https://doi.org/https://doi.org/10.29140/lea.v3n1.193
- *Pusey, K., & Lenz, K. (2014). Investigating the interaction of visual input, working memory, and listening comprehension. Language Education in Asia, 5(1), 66–80. https://doi.org/http://dx.doi.org/10.5746/LEiA/14/V5/I1/A06/Pusey_Lenz
- *Ruhe, V. (1996). Graphics and listening comprehension. TESL Canada Journal, 14(1), 45–60. https://doi.org/https://doi.org/10.18806/tesl.v14i1.677
- Saldaña, J. (2009). The coding manual for qualitative researchers. Sage.
- *Schroeders, U., Wilhelm, O., & Bucholtz, N. (2010). Reading, listening, and viewing comprehension in English as a foreign language: One or more constructs? Intelligence, 38(6), 562–573. https://doi.org/https://doi.org/10.1016/j.intell.2010.09.003
- SCImago. (n.d.). SJR — SCImago journal & country rank [Portal]. http://www.scimagojr.com
- *Shi, Y. (2019). Effect of input mode on EFL free-recall listening performance: A mixed-method study. Eurasian Journal of Applied Linguistics, 5(1), 1–22. https://doi.org/http://doi.org/10.32601/ejal.543773
- *Shin, D. (1998). Using videotaped lectures for testing academic listening proficiency. International Journal of Listening, 12(1), 57–80. https://doi.org/https://doi.org/10.1080/10904018.1998.10499019
- Smagorinsky, P. (2008). The Method section as conceptual epicenter in constructing social science research reports. Written Communication, 25(3), 389–411. https://doi.org/https://doi.org/10.1177/0741088308317815
- *Stallings, W. M. (1972). A comparison of television and audio presentations of the MLA French listening examination. The Journal of Educational Research, 65(10), 472–474. https://doi.org/https://doi.org/10.1080/00220671.1972.10884382
- *Sueyoshi, A., & Hardison, D. (2005). The role of gestures and facial cues in second language listening comprehension. Language Learning, 55(4), 661–699. https://doi.org/https://doi.org/10.1111/j.0023-8333.2005.00320.x
- *Suvorov, R. (2009). Context visuals in L2 listening tests: The effects of photographs and video vs. audio-only format. In C. A. Chapelle, H. G. Jun, & I. Katz (Eds.), Developing and evaluating language learning materials (pp. 53–68). Iowa State University.
- *Suvorov, R. (2013). Interacting with visuals in L2 listening tests: An eye-tracking study (Publication No. 3597397) [Doctoral dissertation, Iowa State University]. ProQuest Dissertations Publishing. https://doi.org/https://doi.org/10.31274/etd-180810-667
- *Suvorov, R. (2015). The use of eye tracking in research on video-based second language (L2) listening assessment: A comparison of context videos and content videos. Language Testing, 32(4), 463–483. https://doi.org/https://doi.org/10.1177/0265532214562099
- Suvorov, R. (2018a). Investigating test-taking strategies during the completion of computer-delivered items from Michigan English Test (MET): Evidence from eye tracking and cued retrospective reporting. Cambridge Michigan Language Assessment (CaMLA) Working Papers 2018–02. https://michiganassessment.org/wp-content/uploads/2020/02/20.02.pdf.Res_.MichiganEnglishTestMET-EvidencefromeyeTrackingandCuedRetrospectiveReporting.pdf
- *Suvorov, R. (2018b). Test takers’ use of visual information in an L2 video-mediated listening test: Evidence from cued retrospective reporting. In G. Ockey & E. Wagner, Assessing L2 listening: Moving towards authenticity (pp. 145–160). John Benjamins. https://doi.org/https://doi.org/10.1075/lllt.50.10suv
- Vandergrift, L. (2010). Researching listening. In B. Paltridge & A. Phakiti (Eds.), Continuum companion to research methods in applied linguistics (pp. 160–173). Continuum International Publishing Group.
- Vorobel, O., Voorhees, T. T., & Gokcora, D. (2021). Language learners’ digital literacies: Focus on students’ information literacy and reading practices online. Journal of Computer Assisted Learning. Advance online publication. https://doi.org/https://doi.org/10.1111/jcal.12550
- *Wagner, E. (2007). Are they watching? Test-taker viewing behavior during an L2 video listening test. Language Learning & Technology, 11(1), 67–86. https://doi.org/https://doi.org/10.125/44089
- *Wagner, E. (2008). Video listening tests: What are they measuring? Language Assessment Quarterly, 5(3), 218–243. https://doi.org/https://doi.org/10.1080/15434300802213015
- *Wagner, E. (2010a). Test-takers‘ interaction with an L2 video listening test. System, 38(2), 280–291. https://doi.org/https://doi.org/10.1016/j.system.2010.01.003
- *Wagner, E. (2010b). The effect of the use of video texts on ESL listening test-taker performance. Language Testing, 27(4), 493–513. https://doi.org/https://doi.org/10.1177/0265532209355668
- *Wagner, E. (2013). An investigation of how the channel of input and access to test questions affect L2 listening test performance. Language Assessment Quarterly, 10(2), 178–195. https://doi.org/https://doi.org/10.1080/15434303.2013.769552