45
Views
11
CrossRef citations to date
0
Altmetric
Short Report

Validity of an algorithm to identify osteonecrosis of the jaw in women with postmenopausal osteoporosis in the Danish National Registry of Patients

, , , , , , , , , & show all
Pages 263-267 | Published online: 01 Aug 2013

Abstract

Background

Osteonecrosis of the jaw (ONJ) is an adverse effect of drugs that suppress bone turnover – for example, drugs used for the treatment of postmenopausal osteoporosis. The Danish National Registry of Patients (DNRP) is potentially valuable for monitoring ONJ and its prognosis; however, no specific code for ONJ exists in the International Classification of Diseases 10th revision (ICD-10), which is currently used in Denmark. Our aim was to estimate the positive predictive value (PPV) of an algorithm to capture ONJ cases in the DNRP among women with postmenopausal osteoporosis.

Methods

We conducted this cross-sectional validation study in the Central and North Denmark Regions, with approximately 1.8 million inhabitants. In total, 54,956 women with postmenopausal osteoporosis were identified from June 1, 2005 through May 31, 2010. To identify women potentially suffering from ONJ, we applied an algorithm based on ICD-10 codes in the DNRP originating from hospital-based departments of oral and maxillofacial surgery (DOMS). ONJ was adjudicated by chart review and defined by the presence of exposed maxillofacial bone for 8 weeks or more, in the absence of recorded history of craniofacial radiation therapy. We estimated the PPV for the overall algorithm and for each separate ICD-10 code used in the algorithm.

Results

Charts were obtained and reviewed for all 60 women with an ICD-10 code potentially representing ONJ. Nineteen potential ONJ cases were confirmed, corresponding to an overall PPV of 32% (95% confidence interval: 20%–45%).

Conclusion

Among women with postmenopausal osteoporosis, only about one-third of the potential ONJ cases identified by our ICD-10 based algorithm were confirmed by medical chart review, despite the restriction to patients treated at DOMS. To capture true ONJ cases among women with postmenopausal osteoporosis, alternative approaches are needed.

Introduction

Osteonecrosis of the jaw (ONJ) is a potentially serious adverse effect of treatment with drugs that suppress bone turnover, especially when given in high-dose regimens to cancer patients.Citation1 ONJ can also occur in patients receiving low-dose treatments – for example, among women with postmenopausal osteoporosis.Citation2 ONJ is defined by the presence of an exposed maxillofacial bone for at least 8 weeks in patients without a history of prior craniofacial radiation therapy. ONJ severity ranges from asymptomatic exposed bone to severe pain, secondary infection, and/or pathological fractures.Citation2

Valid ascertainment of ONJ is important for monitoring adverse drug reactions and for research on ONJ prevention, treatment, and prognosis. The Danish National Registry of Patients (DNRP) is a potentially valuable source of such data, as it contains information on all hospital contacts, including all visits to departments of oral and maxillofacial surgery (DOMS), to which patients with ONJ are typically referred in Denmark. Diagnoses in the DNRP are coded using the International Classification of Diseases, 10th revision (ICD-10).Citation3 Unlike the clinical modification of the ICD-10 (ICD-10-CM), the ICD-10 does not contain a specific code for ONJ.Citation3

We have previously assessed the positive predictive value (PPV) of an ICD-10-based algorithm to identify ONJ among cancer patients in Denmark and among women with postmenopausal osteoporosis in Sweden.Citation4,Citation5 However, PPV depends on the prevalence of the disease in the population where the algorithm is used and may also depend on country-specific coding practices and referral patterns.Citation6 We therefore set out to assess the PPV of the algorithm to capture ONJ among women with postmenopausal osteoporosis in Denmark, using the DNRP.

Methods

We conducted a cross-sectional validation study among women with postmenopausal osteoporosis in the Central and North Denmark Regions (approximately 1.8 million inhabitants), identified from June 1, 2005 through May 31, 2010. The Danish National Health Service provides tax-supported health care to all Danish residents, with universal access to public hospitals, including DOMS. The unique ten digit civil registration number, assigned to all Danish residents since 1968, permits unambiguous linkage between registries used in the study.

The DNRP includes data from non-psychiatric hospital admissions since 1977. Since 1995, the registry has also covered all emergency room and outpatient clinic visits. Reportable data include patients’ civil registration number, dates of admission and discharge, codes for the treating hospital and department, surgical procedures, and up to 20 discharge diagnoses per visit. Since 1994, diagnoses have been coded using the ICD-10.Citation7,Citation8

The Aarhus University Prescription Database includes data on prescriptions dispensed in the outpatient pharmacies of the Central and North Denmark Regions, and includes dispensing date and drug type, coded using the Anatomical Therapeutic Chemical Classification.Citation9 Through linkage of the Danish Civil Registration System, the DNRP, and the Aarhus University Prescription Database, we identified women with postmenopausal osteoporosis. Postmenopausal women were defined as women aged 55 years or older within the study period. Among those, osteoporosis was defined as any diagnosis of osteoporosis or osteoporotic fracture, or record of a medication used to treat osteoporosis (bisphosphonates, selective estrogen receptor modulators, ipriflavone, strontium ranelate, denosumab, parathyroid hormones, and calcitonin) within a 5-year period before the date of fulfillment of postmenopausal status in the study period (a list of relevant codes is provided in ).

Potential ONJ cases were identified among patients registered at one of the three DOMS in Central and North Denmark Regions, using prespecified ICD-10 codes. ICD-codes were selected by the research team together with experts in ONJ to refect the local coding practices and definitions of ONJ by the American Association of Oral and Maxillofacial Surgeons and the American Society of Bone and Mineral Research.Citation2 One of the following ICD-10 codes was required: idiopathic aseptic necrosis of bone (M87.0); osteonecrosis due to drugs (M87.1); osteonecrosis due to previous trauma (M87.2); other secondary osteonecrosis (M87.3); other osteonecrosis (M87.8); osteonecrosis, unspecified (M87.9); inflammatory conditions of the jaw (K10.2); alveolitis of the jaws (K10.3); or periapical abscess with sinus (K04.6).

Because cancer patients may receive higher dosages of drugs that suppress bone turnover, we used the DNRP to identify history of cancer, which was defined as a cancer diagnosis – with the exception of nonmelanoma skin cancer (ICD-10 codes C00-C97, except C44) – within 5 years before the date of the potential ONJ diagnosis.

One author (HG) obtained and reviewed hospital charts of all potential cases to confirm or rule out ONJ. A confirmed ONJ case was defined by the presence of exposed maxillofacial bone for 8 weeks or longer, with no history of craniofacial radiation therapy evident in the chart.Citation2 The additional criterion of current or previous treatment with bisphosphonates was not included, because ONJ in recent years has been found in cancer patients treated with other antiresorptive medications such as the monoclonal antibody, denosumab.Citation10 For each confirmed case, we retrieved data from the medical chart regarding bisphosphonate use, dentoalveolar surgery, and denture use before ONJ diagnosis, together with information on the lesion location.

We estimated the PPV as the proportion of confirmed ONJ cases among the potential cases. Furthermore, the PPV was calculated for each ICD-10 code. To examine the potential impact of cancer status, we repeated the analysis among women with postmenopausal osteoporosis without a history of cancer. All estimates were reported with 95% confidence intervals (CI).

Results

During the study period, we identified 60 potential ONJ cases among 54,956 women with postmenopausal osteoporosis in the Central and North Denmark Regions. The number of potential cases sampled using each of the included ICD-10 codes varied from 0 (ICD-10 codes: M87.0, M87.2, M87.3, M87.9, K04.6) to 51 (ICD-10 code K10.2). All medical charts were available for review (retrieval rate, 100%). The median age of the women with potential ONJ was 72 years (interquartile range: 65–85 years).

Nineteen out of the 60 potential ONJ cases were confirmed by medical chart review, corresponding to a PPV of 32% (95% CI: 20%–45%) (). confirmed cases were primarily captured by ICD-10 code K10.2 (n = 17). The PPVs varied from 0% for K04.6 (one-sided 97.5% CI: 0%–41%) to 100% for M87.1 (one-sided 97.5% CI: 25%–100%) for the different ICD-10 codes included in the algorithm. History of cancer was present among 17 (28%) of the 60 women with postmenopausal osteoporosis with potential ONJ. After excluding these women, the overall PPV decreased to 21% (95% CI: 10%–36%).

Table 1 PPV of an algorithm to identify ONJ based on ICD-10 codes and treatment at departments of oral and maxillofacial surgery, Central and North Denmark Regions, 2005–2010

The median age at diagnosis of the 19 patients with confirmed ONJ was 72 years (interquartile range: 67–79). Among the 19 patients, all but one had a record of treatment with bisphosphonates prior to ONJ diagnosis: ten administered intravenously and eight orally. Ten (53%) patients with confirmed ONJ had a history of cancer. Dentoalveolar surgery had occurred in ten (53%) of the patients prior to ONJ diagnosis, and twelve patients (63%) used dentures. The lesions were localized to the mandible in 14 (74%) patients and to the maxilla in four (21%) patients. One patient had lesions both in the mandible and maxilla ().

Table 2 Characteristics of the 19 women with postmenopausal osteoporosis with confirmed ONJ, North and Central Denmark Regions, June 1, 2005 through May 31, 2010

Discussion

In this validation study, we found that only about one-third of the potential ONJ cases identified by the algorithm based on ICD-10 codes registered at DOMS corresponded to true ONJ, as confirmed by medical chart review; however, there was large variation in the PPV among the different ICD-10 codes.

The overall PPV of the suggested algorithm to identify ONJ cases was slightly higher than that reported in a previous Danish study evaluating the PPV of the same algorithm among cancer patients in Denmark (PPV 20% [95% CI: 12%–29%]).Citation4 This is unexpected, given that cancer patients receive higher doses of antiresorptive treatment and are expected to have a higher prevalence of ONJ. This finding may be explained by referral practices whereby some cancer patients are routinely referred to DOMS, for example, for a prophylactic oral exam and treatment prior to start of intravenous treatment with antiresorptive medications. Non-ONJ conditions in those patients could potentially have been coded using one of the ICD-10 codes in the current algorithm. In Sweden, the PPV for the same ONJ algorithm among women with postmenopausal osteoporosis was lower than that reported here (PPV 18% [95% CI: 10%–28%]).Citation5 This may result from differences between countries in referral patterns and in preferences for particular ICD-10 codes in settings where no specific code for ONJ exists.

The estimated PPV of the proposed ICD-10-based ONJ algorithm in Denmark is lower than PPVs typically reported for specific diagnostic codes in the DNRP, usually above 85%.Citation11Citation13 The primary explanation may be the absence of a specific code for ONJ in the current version of ICD-10 used in Denmark; as a result, the codes in the suggested algorithm are also used for conditions other than ONJ.

Our study has limitations. First, we could not estimate the sensitivity or specificity of the suggested codes, because we did not have access to an independent sample of true ONJ cases, nor do we know the true prevalence of ONJ. This is a common limitation of validation studies of databases. Second, we applied a broad list of ICD-10 codes selected by the research team together with ONJ experts that could be related to ONJ. Some of the suggested ICD-10 codes did not capture any true cases. Nevertheless, the results of this study do not allow for narrowing of the algorithm to particular codes because code-specific PPVs are based on too few observations. Third, the PPV of the suggested ONJ algorithm was evaluated among women with postmenopausal osteoporosis, and results may therefore not be generalizable to other groups of patients. Fourth, the number of potential ONJ cases was small, resulting in imprecise PPV estimates, particularly for those codes which captured a small number of patients.

Conclusion

Although the suggested algorithm was based on a combination of ICD-10 codes and registration at DOMS, its overall PPV was low, and code-specific PPVs based on a small number of observations do not allow for improvement of the algorithm by narrowing it to particular codes. These approaches could include the implementation of pan-Nordic guidelines for using specific ICD-10 codes or code combinations to designate ONJ, or they could involve the establishment of dedicated ONJ databases.

Acknowledgments

This study was partially funded by Amgen, Inc, through a contract administered by Aarhus University. Aarhus University subcontracted part of the work related to this project to the Department of Global Public Health and Primary Care, University of Bergen, Bergen, Norway and to the Center of Pharmacoepidemiology at Karolinska Institutet, Stockholm, Sweden.

Supplementary table

Table S1 Case algorithm for osteoporosis

Disclosure

HG, CS, SEN, BN, JB, YTL, HK, GST, and VE are salaried employees of their respective institutions. CC and FX are full-time employees of Amgen, Inc. The authors report no other conflicts of interest in this work.

References

  • SilvermanSLLandesbergROsteonecrosis of the jaw and the role of bisphosphonates: a critical reviewAm J Med2009122Suppl 2S33S4519187811
  • RuggieroSLDodsonTBAssaelLALandesbergRMarxREMehrotraBAmerican Association of Oral and Maxillofacial SurgeonsAmerican Association of Oral and Maxillofacial Surgeons position paper on bisphosphonate-related osteonecrosis of the jaws – 2009 updateJ Oral Maxillofac Surg200967Suppl 521219371809
  • World Health OrganizationInternational Statistical Classification of Diseases and Related Health Problems 10th Revision [homepage on the Internet] Available from: http://apps.who.int/Classifications/icd10/browse/2010/enAccessed May 16, 2013
  • GammelagerHErichsenRAntonsenSPositive predictive value of the International Classification of Diseases, 10th revision, codes to identify osteonecrosis of the jaw in patients with cancerCancer Epidemiol201236438138322534488
  • BergdahlJJarnbringFEhrensteinVEvaluation of an algorithm ascertaining cases of osteonecrosis of the jaw in the Swedish National Patient RegisterClin Epidemiol201351723323023
  • RothmanKJEpidemiology in Clinical SettingsRothmanKJEpidemiology: An introduction1st edNew YorkOxford University Press2002198217
  • AndersenTFMadsenMJørgensenJMellemkjoerLOlsenJHThe Danish National Hospital Register. A valuable source of data for modern health sciencesDan Med Bull199946326326810421985
  • LyngeESandegaardJLReboljMThe Danish National Patient RegisterScand J Public Health201139Suppl 7303321775347
  • EhrensteinVAntonsenSPedersenLExisting data sources for clinical epidemiology: Aarhus University Prescription DatabaseClin Epidemiol2010227327921152254
  • SaadFBrownJEVan PoznakCIncidence, risk factors, and outcomes of osteonecrosis of the jaw: integrated analysis from three blinded active-controlled phase III trials in cancer patients with bone metastasesAnn Oncol20122351341134721986094
  • RixTARiahiSOvervadKLundbye-ChristensenSSchmidtEBJoensenAMValidity of the diagnoses atrial fibrillation and atrial flutter in a Danish patient registryScand Cardiovasc J201246314915322397620
  • SøgaardMKornumJBSchønheyderHCThomsenRWPositive predictive value of the ICD-10 hospital diagnosis of pleural empyema in the Danish National Registry of PatientsClin Epidemiol20113858921386977
  • VestbergKThulstrupAMSørensenHTOttesenPSabroeSVilstrupHData quality of administratively collected hospital discharge data for liver cirrhosis epidemiologyJ Med Syst199721111209172066