Advanced search
Publication Cover
Disability and Rehabilitation Volume 44, 2022 - Issue 4
Submit an article Journal homepage
11,462
Views
3
CrossRef citations to date
0
Altmetric
Assessment Procedures

Inter-rater reliability, intra-rater reliability and internal consistency of the Brisbane Evidence-Based Language Test

Alexia Rohdea Speech Pathology Department, Southern Cross University, Bilinga, Australia;b Speech Pathology Department, The University of Queensland, Brisbane, AustraliaCorrespondence[email protected]
,
Molly McCrackenb Speech Pathology Department, The University of Queensland, Brisbane, Australia
,
Linda Worrallb Speech Pathology Department, The University of Queensland, Brisbane, AustraliaORCID Iconhttps://orcid.org/0000-0002-3283-7038
ORCID Icon,
Anna Farrellc Department of Speech Pathology, Royal Brisbane and Women’s Hospital, Brisbane, Australia
,
Robyn O’Hallorand Department of Community and Clinical Allied Health, La Trobe University, Melbourne, AustraliaORCID Iconhttps://orcid.org/0000-0002-2772-2164
ORCID Icon,
Erin Godeckee Department of Speech Pathology, Edith Cowan University, Joondalup, Australia
,
Michael Davidf School of Public Health, The University of Queensland, Brisbane, Australia
&
Suhail A. Doig Department of Population Medicine, Qatar University, Doha, Qatar
 show all
Pages 637-645 | Received 25 Jan 2019, Accepted 28 May 2020, Published online: 22 Jun 2020

References

  • National Stroke Foundation. Clinical guidelines for stroke management. Melbourne (VIC); 2010.
  • Maas MB, Lev MJ, Ay H, et al. The prognosis for aphasia in stroke. J Stroke Cerebrovasc Disc. 2012;21:350–357.
  • Feteke R, Jeevan D, Marks SJ, et al. Hemorrhagic transformation of ischaemic stroke in patient treated with rivaroxaban. J Hematol. 2013;2:48–50.
  • Spreen O, Risser AH. Assessment of aphasia. New York (NY): Oxford University Press; 2003.
  • Rohde A, Doi S, Worrall L, et al. Development and diagnostic validation of the Brisbane Evidence-Based Language Test. Disabil Rehabil. 2020. Available from: https://mc.manuscriptcentral.com/dandr
  • Vogel AP, Maruff P, Morgan AT. Evaluation of communication assessment practices during the acute stages post stroke. J Eval Clin Pract. 2010;16:1183–1188.
  • Rohde A, Worrall L, Godecke E, et al. Diagnosis of aphasia in stroke populations: a systematic review of language tests. PLoS One. 2018;13:e0194143.
  • Kottner J, Audigé L, Brorson S, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106.
  • Eliasziw M, Young SL, Woodbury MG, et al. Statistical methodology for the concurrent assessment of interrater and intrarater reliability: using goniometric measurements as an example. Phys Ther. 1994;74:777–788.
  • Saito Y, Sozu T, Hamada C, et al. Effective number of subjects and number of raters for inter-rater reliability studies. Stat Med. 2006;25:1547–1560.
  • Binder JR, Frost JA, Hammeke TA, et al. Human brain language areas identified by functional magnetic resonance imaging. J Neurosci. 1997;17:353–362.
  • Altman DG, Bland JM. Statistics notes: how to randomise. BMJ. 1999;319:703–704.
  • Alonzo TA, Pepe MS. Using a combination of reference tests to assess the accuracy of a new diagnostic test. Statist Med. 1999;18:2987–3003.
  • Kernan WN, Viscoli CM, Makuch RW, et al. Stratified randomization for clinical trials. J Clin Epidemiol. 1999;52:19–26.
  • Särndal CE, Swensson B, Wretman J. Model assisted survey sampling. New York (NY): Springer; 2003.
  • Fleiss JL. Reliability of measurement. In: Fleiss JL. editor. Design and analysis of clinical experiments. New York (NY): John Wiley & Sons; 1986. p.1–32.
  • Graham M, Milanowski A, Miller J. Measuring and promoting inter-rater agreement of teacher and principal performance ratings. Center for Educator Compensation Reform; 2012. p. 1–33. Available from: files.eric.ed.gov/fulltext/ED532068.pdf
  • Cohen JA, Fischer JS, Bolibrush DM, et al. Intrarater and interrater reliability of the MS functional composite outcome measure. Neurology. 2000;54:802–806.
  • Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53–55.
  • Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174.
  • Maas CJM, Hox JJ. The influence of violations of assumptions on multilevel parameter estimates and their standard errors. Comput Stat Data Anal. 2004;46:427–440.
  • Schafer JL. Multiple imputation: a primer. Stat Methods Med Res. 1999;8:3–15.
  • Bland JM, Altman DG. Cronbach’s alpha. BMJ. 1997;314:572.
  • Kertesz A. Western aphasia battery – revised. San Antonio (TX): Hardcourt Assessment; 2007.
  • Howard D, Swinburn K, Porter G. Comprehensive aphasia test. New York (NY): Psychology Press; 2004.
  • Ellmo W, Graser J, Krchnavek B. Measure of cognitive-linguistic abilities (MCLA). Norcross (GA): The Speech Bin, Incorporated; 1995.
  • Goodglass H, Kaplan E, Barresi B. Boston diagnostic aphasia examination. 3rd ed. Baltimore (MD): Lippincott Williams & Wilkins; 2001.
  • Kline P. The handbook of psychological testing. 2nd ed. London (UK): Routledge; 2000.
  • Button KS, Ioannidis JPA, Mokrysz C, et al. Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14:365–376.
  • Berg K, Wood-Dauphinee S, Williams JI. The balance scale: reliability assessment with elderly residents and patients with an acute stroke. Scand J Rehab Med. 1995;27:27–36.
  • Fawcett AL. Principles of assessment and outcome measurement for occupational therapists and physiotherapists: theory, skills and application. Chichester (UK): Wiley; 2007.
  • Theodoros D, Hill A, Russell T, et al. Assessing acquired language disorders in adults via the internet. Telemed J E Health. 2008;14:552–559.
  • Brennan P, Silman A. Statistical methods for assessing observer variability in clinical measures. BMJ. 1992;304:1491–1494.
  • Hand PJ, Haisma JA, Kwan J, et al. Interobserver agreement for the bedside clinical assessment of suspected stroke. Stroke. 2006;37:776–780.
  • Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43:543–549.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.