Reliability of raters: The effects of rating errors on the speech rating process

Bibliography

• Adams , G. S. 1964 . Measurement and evaluation in education , New York : Holt and Rinehart & Winston .
   Google Scholar
• Applbaum , R. L. 1974 . Intrarater reliability: A function of scale complexity and rater training . Central States Speech Journal , 24 : 277 – 81 .
   Google Scholar
• Barker , L. L. 1969 . The relationship between sociometric choice and speech evaluation . The Speech Teacher , 17 : 204 – 07 .
   Google Scholar
• Barker , L. L. , Kibler , R. J. and Geter , A. W. 1958 . Two investigations of the relationships among selected ratings of speech effectiveness and comprehension . Speech Monographs , 35 : 400 – 06 .
   Google Scholar
• Becker , S. L. and Cronkhite , G. L. 1965 . Reliability as a function of utilized scale steps . The Speech Teacher , 4 : 291 – 93 .
   Google Scholar
• Bock , D. G. 1971 . Reliability and validity of speech rating behavior: Some error effects . Central States Speech Journal , 23 : 146 – 51 .
   Google Scholar
• Bock , D. G. and Bock , E. H. 1977 . The effects of sex on the experimenter expectancy indictions, and sex of the rater on leniency, halo, and trait errors in speech rating behavior . Communication Education , 26 : 298 – 06 .
   Web of Science ®Google Scholar
• Bock , D. G. and Bock , E. H. 1982 . Evaluating classroom speaking , Urbana : ERIC .
   Google Scholar
• Bostrom , R. M. 1964 . Dogmatism, rigidity, and rating behavior . The Speech Teacher , 13 : 203 – 07 .
   Google Scholar
• Bowers , J. W. 1964 . Training speech raters with films . The Speech Teacher , 13 : 228 – 31 .
   Google Scholar
• Brown , F. G. 1970 . Principles of educational and psychological testing , Hinsdale : Dryden Press .
   Google Scholar
• Clevenger , T. Jr. 1964 . Influence of scale complexity on the reliability of rating general effectiveness in public speaking . Speech Monographs , 31 : 153 – 56 .
   Web of Science ®Google Scholar
• DiSalvo , V. and Bochner , A. P. 1972 . The use of simulated speech profiles and the PROF technique in capturing the policies of speech raters . The Speech Teacher , 23 : 273 – 80 .
   Google Scholar
• Gronlund , N. E. 1976 . Measurement and evaluation in teaching, , 3rd ed. , New York : Macmillian .
   Google Scholar
• Guilford , L. P. 1954 . Psychometric methods , New York : McGraw‐Hill Book Company .
   Google Scholar
• Gundersen , D. F. 1978 . Video tape modules as a device for training speech raters . The Southern Speech Communication Journal , 43 : 395 – 06 .
   Google Scholar
• Henrikson , E. H. 1940 . The relation among knowing a person, liking a person, and judging him as a speaker . Speech Monographs , 7 : 22 – 5 .
   Google Scholar
• Horrocks , J. E. and Schoonover , T. S. 1968 . Measurement for teachers , Columbus : C. E. Merril .
   Google Scholar
• Jabusch , D. M. 1970 . Reliability Unpublished manuscript.
   Google Scholar
• Kirlinger , F. N. 1973 . Foundations of behavioral research, , 2nd ed. , New York : Holt, Rinehart and Winston, Inc. .
   Google Scholar
• Linsley , H. E. A. and Weiss , D. 1975 . Interrater reliability and agreement of subjective judgments . Journal of Counseling Psychology , 22 : 358 – 76 .
   Google Scholar
• Miller , G. R. 1964 . Agreement and the grounds for it: Persistent problems in speech rating . The Speech Teacher , 13 : 257 – 61 .
   Google Scholar
• Nie , N. H. , Hull , C. H. , Jenkins , J. G. , Steinbrenner , K. and Bent , D. H. 1975 . Statistical package for the social sciences, , 2nd ed. , New York : McGraw‐Hill Book Company .
   Google Scholar
• Rover , J. E. 1976 . Audience perception of speaker training: An expectancy artifact in communication research . Central Slates Speech Journal , 27 : 47 – 55 .
   Google Scholar
• Stevens , W. E. 1928 . A rating scale for public speakers . The Quarterly Journal of Speech , 14 : 223 – 32 .
   Google Scholar
• Tiemens , R. K. 1965 . Validation of informative speech ratings by retention tests . The Speech Teacher , 14 : 211 – 15 .
   Google Scholar
• Thompson , W. E. 1943 . So is there a yardstick for measuring speaking skill . The Quarterly Journal of Speech , 24 : 87 – 91 .
   Google Scholar
• Thompson , W. E. 1946 . A study of the characteristics of student raters of public speaking performances . Speech Monographs , 3 : 45 – 53 .
   Google Scholar