Huiying Cai & Xun Yan. (2023) Triangulating NLP-based analysis of rater comments and MFRM: An innovative approach to investigating raters’ application of rating scales in writing assessment. Language Testing.
Crossref

Wenfeng Jia & Peixin Zhang. (2023) Rater cognitive processes in integrated writing tasks: from the perspective of problem-solving. Language Testing in Asia 13:1.
Crossref

Norah Almusharraf & Hind Alotaibi. (2022) An error-analysis study from an EFL writing context: Human and Automated Essay Scoring Approaches. Technology, Knowledge and Learning 28:3, pages 1015-1031.
Crossref

Shuai Li, Ting Wen, Xian Li, Yali Feng & Chuan Lin. (2022) Comparing holistic and analytic marking methods in assessing speech act production in L2 Chinese. Language Testing 40:2, pages 249-275.
Crossref

Joshua Matthews. (2021) Using Inter-Rater Discourse to Trace the Origins of Disagreement: Towards Collective Reflective Practice in L2 Assessment. RELC Journal 54:1, pages 99-113.
Crossref

Iasonas Lamprianou, Dina Tsagari & Nansia Kyriakou. (2023) Experienced but detached from reality: Theorizing and operationalizing the relationship between experience and rater effects. Assessing Writing 56, pages 100713.
Crossref

Jinyan Huang, Danni Zhu, Duquan Xie & Tiantian Shu. (2023) Examining the reliability of an international Chinese proficiency standardized writing assessment: Implications for assessment policy makers. Assessing Writing 55, pages 100693.
Crossref

Haoshan Ren, Stephen Daniel Looney & Sara T. Cushing. 2023. Local Language Testing. Local Language Testing 13 33 .

Aitor Garcés-Manzanera. (2022) affordances of rubrics in L2 writing in Higher Education. HUMAN REVIEW. International Humanities Review / Revista Internacional de Humanidades 11:Monográfico, pages 1-12.
Crossref

Apichat Khamboonruang. (2022) Building an Initial Validity Argument for Binary and Analytic Rating Scales for an EFL Classroom Writing Assessment: Evidence from Many-Facets Rasch Measurement. rEFLections 29:3, pages 675-699.
Crossref

Nasim Heidari, Nasim Ghanbari & Abbas Abbasi. (2022) Raters’ perceptions of rating scales criteria and its effect on the process and outcome of their rating. Language Testing in Asia 12:1.
Crossref

Muhamad Firdaus Mohd Noh & Mohd Effendi Ewan Mohd Matore. (2022) Rater severity differences in English language as a second language speaking assessment based on rating experience, training experience, and teaching experience through many-faceted Rasch measurement analysis. Frontiers in Psychology 13.
Crossref

Beverly A. Baker & Carolyn E. Turner. 2013. The Encyclopedia of Applied Linguistics. The Encyclopedia of Applied Linguistics 1 7 .

Pakize Uludag & Kim McDonough. (2022) Validating a rubric for assessing integrated writing in an EAP context. Assessing Writing 52, pages 100609.
Crossref

De Van Phung & Michael Michell. (2022) Inside Teacher Assessment Decision-Making: From Judgement Gestalts to Assessment Pathways. Frontiers in Education 7.
Crossref

Junfei Li & Jinyan Huang. (2022) The impact of essay organization and overall quality on the holistic scoring of EFL writing: Perspectives from classroom english teachers and national writing raters. Assessing Writing 51, pages 100604.
Crossref

Li Liu & Guodong Jia. 2022. Assessing the English Language Writing of Chinese Learners of English. Assessing the English Language Writing of Chinese Learners of English 155 173 .

Vahid Nimehchisalem, Jayakaran Mukundan, Shameem Rafik-Galea & Arshad Abd Samad. (2021) Assessment of the Analytic Scale of Argumentative Writing (ASAW). Pertanika Journal of Social Sciences and Humanities 29:S3.
Crossref

Yingliang Liu & Jinyan Huang. (2020) The quality assurance of a national English writing assessment: Policy implications for quality improvement. Studies in Educational Evaluation 67, pages 100941.
Crossref

Changhan Zhao & Jinyan Huang. (2020) The impact of the scoring system of a large-scale standardized EFL writing assessment on its score variability and reliability: Implications for assessment policy makers. Studies in Educational Evaluation 67, pages 100911.
Crossref

Vahid Aryadoust, Azrifah Zakaria, Mei Hui Lim & Chaomei Chen. (2020) An Extensive Knowledge Mapping Review of Measurement and Validity in Language Assessment and SLA Research. Frontiers in Psychology 11.
Crossref

皖栋许. (2020) Applying Eye-Tracking Technology into Language Assessment Research: Status Quo and Prospects. Overseas English Testing: Pedagogy and Research 02:04, pages 175-183.
Crossref

Heejeong Jeong. (2019) Writing scale effects on raters: an exploratory study. Language Testing in Asia 9:1.
Crossref

Jungmin Lim. (2019) An investigation of the text features of discrepantly-scored ESL essays: A mixed methods study. Assessing Writing 39, pages 1-13.
Crossref

Ute Knoch & Carol A. Chapelle. (2017) Validation of rating processes within an argument-based framework. Language Testing 35:4, pages 477-499.
Crossref

Ying Xu. (2018) Measuring L2 Essay Rating Strategy: Scale Development and Preliminary Validation. Frontiers in Education 3.
Crossref

Chao Han. (2018) Using rating scales to assess interpretation. Interpreting. International Journal of Research and Practice in Interpreting Interpreting / International Journal of Research and Practice in Interpreting Interpreting 20:1, pages 63-101.
Crossref

Larry Davis. 2018. The TESOL Encyclopedia of English Language Teaching. The TESOL Encyclopedia of English Language Teaching 1 6 .

Marina A. Bodony. (2018) FOREIGN LANGUAGE WRITING ASSESSMENT: MODELSOF THE SUBJECT’S ACTIVITIES ASSESSMENT. Bulletin of the Moscow State Regional University (Pedagogics):3, pages 99-107.
Crossref

Niken Dwi Wahyu Cahyani, Ben Martini, Kim-Kwang Raymond Choo & Helen Ashman. 2018. Security and Privacy in Communication Networks. Security and Privacy in Communication Networks 488 506 .

Elsa Fernanda González, Nelly Paulina Trejo & Ruth Roux. (2017) Assessing EFL university students' writing: A study of score reliability. Revista Electrónica de Investigación Educativa 19:2, pages 91-103.
Crossref

Yigal Attali. (2015) A comparison of newly-trained and experienced raters on a standardized writing assessment. Language Testing 33:1, pages 99-115.
Crossref

Jie Zhang. (2016) Same text different processing? Exploring how raters’ cognitive and meta-cognitive strategies influence rating accuracy in essay scoring. Assessing Writing 27, pages 37-53.
Crossref

Kat Leung, Barley Mak & Howard Leung. (2015) Using a tablet-based composition marking recording system to conduct think-aloud for composition rating research. Research and Practice in Technology Enhanced Learning 10:1.
Crossref

Paula Winke & Hyojung Lim. (2015) ESL essay raters’ cognitive processes in applying the Jacobs et al. rubric: An eye-movement study. Assessing Writing 25, pages 38-54.
Crossref

Soo Jung Youn. (2014) Validity argument for assessing L2 pragmatics in interaction using mixed methods. Language Testing 32:2, pages 199-225.
Crossref

Heike Neumann. (2014) Teacher assessment of grammatical ability in second language academic writing: A case study. Journal of Second Language Writing 24, pages 83-107.
Crossref

Miyuki Sasaki. 2013. The Companion to Language Assessment. The Companion to Language Assessment 1340 1357 .

CHOIYEONHEE. (2013) Rating Performance of EFL Teachers in Writing Assessment: Comparison of Experienced and Novice Raters. Journal of Research in Curriculum Instruction 17:1, pages 199-215.
Crossref

Claudia Harsch & Guido Martin. (2012) Adapting CEF-descriptors for rating purposes: Validation by a combined rater training and scale revision approach. Assessing Writing 17:4, pages 228-250.
Crossref

Cynthia S. Wiseman. (2012) Rater effects: Ego engagement in rater decision-making. Assessing Writing 17:3, pages 150-173.
Crossref

Gad S. Lim. (2011) The development and maintenance of rating quality in performance writing assessment: A longitudinal study of new and experienced raters. Language Testing 28:4, pages 543-560.
Crossref

Beverly A. Baker. (2010) Playing with the stakes: A consideration of an aspect of the social context of a gatekeeping writing assessment. Assessing Writing 15:3, pages 133-153.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Share icon
Back to Top

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.

People also read
Recommended articles
Cited by

To cite this article:

Reference style: APA Chicago Harvard

Citation copied to clipboard

Reference styles above use APA (6th edition), Chicago (16th edition) & Harvard (10th edition)

Download citation

Download a citation file in RIS format that can be imported by citation management software including EndNote, ProCite, RefWorks and Reference Manager.

Choose format: RIS BibTex RefWorks Direct Export

Choose options: Citation Citation & abstract Citation & references

Variability in ESL Essay Rating Processes: The Role of the Rating Scale and Rater Experience

Articles from other publishers (43)

Information for

Open access

Opportunities

Help and information

Your download is now in progress and you may close this window

Login or register to access this feature