EM and SEM algorithms to compare the weighted kappa coefficients of two diagnostic tests in the presence of partial verification and discrete covariates

Abstract

The weighted kappa coefficient of a binary diagnostic test is a measure of the beyond chance agreement between the diagnostic test and the gold standard, and depends on the sensitivity and the specificity of the diagnostic test, on the disease prevalence and on the relative importance between the false positives and the false negatives. This manuscript studies a hypothesis test to compare the weighted kappa coefficients of two binary diagnostic tests when, in the presence of partial disease verification, a discrete covariate is observed in all individuals. The EM algorithm is applied to estimate the weighted kappa coefficients and the SEM algorithm is applied to estimate their variances-covariances. Simulation experiments were carried out to study the size and the power of the proposed hypothesis test. The results were applied to a real example on the diagnosis of the Alzheimer’s disease.

KEYWORDS:

• Discrete covariate
• EM and SEM algorithms
• partial verification
• weighted kappa coefficient

Mathematics Subject Classification: 62P10:

• 6207

Acknowledgements

This research was supported by the Spanish Ministry of Economy, Grant Number MTM2016-76938-P.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by Spanish Ministry of Economy [grant number: MTM2016-76938-P].