The purposes of the present investigation were to determine the sources and amount of error variance associated with rating speeches and other communicative performance. Using students’ everyday ratings of their classmates’ speeches, interrater reliability and interrater agreement were computed by utilizing the completed rating scale. Leniency error, halo error, and trait error scores were computed by utilizing the six trait scores comprising the rating scale. Raters were both unreliable and a source of considerable error. The leniency error, and the halo error accounted for the majority of the total error variance. The six trait errors accounted for the remaining error. Raters within class were consistent but there was no consistency among raters in different classes. Finally, untrained raters committed more of all eight types of errors and more leniency errors than trained raters.
Reliability of raters: The effects of rating errors on the speech rating process
Reprints and Corporate Permissions
Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?
To request a reprint or corporate permissions for this article, please click on the relevant link below:
Academic Permissions
Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?
Obtain permissions instantly via Rightslink by clicking on the button below:
If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.
Related research
People also read lists articles that other readers of this article have read.
Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.
Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.