481
Views
41
CrossRef citations to date
0
Altmetric
Original Articles

Assessing Individual Agreement

, &
Pages 697-719 | Received 16 Oct 2006, Accepted 10 Jan 2007, Published online: 05 Jul 2007
 

Abstract

Evaluating agreement between measurement methods or between observers is important in method comparison studies and in reliability studies. Often we are interested in whether a new method can replace an existing invasive or expensive method, or whether multiple methods or multiple observers can be used interchangeably. Ideally, interchangeability is established only if individual measurements from different methods are similar to replicated measurements from the same method. This is the concept of individual equivalence. Interchangeability between methods is similar to bioequivalence between drugs in bioequivalence studies. Following the FDA guidelines on individual bioequivalence, we propose to assess individual agreement among multiple methods via individual equivalence using the moment criteria. In the case where there is a reference method, we extend the individual bioequivalence criteria to individual equivalence criteria and propose to use individual equivalence coefficient (IEC) to compare multiple methods to one or multiple references. In the case where there is no reference method available, we propose a new IEC to assess individual agreement between multiple methods. Furthermore, we propose a coefficient of individual agreement (CIA) that links the IEC with two recent agreement indices. A method of moments is used for estimation, where one can utilize output from ANOVA models. The nonparametric and bootstrap approaches are used for inference. Five examples are used for illustration.

ACKNOWLEDGMENT

This research is supported by the National Institutes of Health Grant R01 MH70028.

Notes

*bCI is the confidence interval based on the bootstrap percentile method.

*bCI is the confidence interval based on the bootstrap percentile method.

*bCI is the confidence interval based on the bootstrap percentile method.

*bCI is the confidence interval based on the bootstrap percentile method.

*bCI is the confidence interval based on the bootstrap percentile method.

*bCI is the confidence interval based on the bootstrap percentile method.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.