161
Views
7
CrossRef citations to date
0
Altmetric
Original Articles

Assessing Observer Agreement in Studies Involving Replicated Binary Observations

, &
Pages 757-766 | Received 18 Jul 2006, Accepted 22 Nov 2006, Published online: 05 Jul 2007

REFERENCES

  • Baker , S. G. , Freedman , L. S. , Parmar , M. K. B. ( 1991 ). Using replicated observations in observer agreement studies with binary assessments . Biometrics 47 : 1327 – 1338 .
  • Barnhart , H. X. , Kosinski , A. S. , Haber , M. ( 2007 ) Assessing individual agreement . Journal of Biopharmaceutical Statistics 17 ( 4 ): xx – xx .
  • Baughman , A. L. ( 2000 ). Latent Structure Models for Evaluating Diagnostic Agreement Using Replicate Binary Measurements . Ph.D. dissertation , Emory University , Atlanta , GA .
  • Dawid , A. P. , Skene , A. M. ( 1979 ). Maximum likelihood estimation of observer error-rates using the EM algorithm . Appl. Statist. 28 : 20 – 28 .
  • Elmore , J. G. , Wells , C. K. , Lee , C. H. , Howard , D. H. , Feinstein , A. R. ( 1994 ). Variability in radiologist' interpretation of mammograms . New Eng. J. Med. 331 : 1493 – 1499 .
  • Feinstein , A. R. , Cicchetti , D. V. ( 1990 ). High agreement but low kappa . J. Clin. Epi. 43 : 543 – 549 , 551 – 558 .
  • Haber , M. , Barnhart , H. X. ( 2007 ). A general approach to evaluating agreement between two observers or methods of measurement . Statistical Methods in Medical Research (accepted) .
  • Kirchner , H. L. , Lemke , J. H. ( 2002 ). Simultaneous estimation of intrarater and interrater agreement for multiple raters under order restrictions for a binary trait . Statistics in Medicine 21 : 1761 – 1772 .
  • Kraemer , H. C. ( 1979 ). Ramifications of a population model for kappa as a coefficient of reliability . Psychometrika 44 : 461 – 472 .
  • Lin , L. , Hedayat , A. S. , Sinha , B. , Yang , M. ( 2002 ). Statistical methods in assessing agreement: models, issues and tools . J. Amer. Stat. Assoc. 97 : 257 – 270 .

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.