1,099
Views
23
CrossRef citations to date
0
Altmetric
Original Article

Echo-based screening of rheumatic heart disease in children: a cost-effectiveness Markov model

&
Pages 410-419 | Accepted 07 Jan 2015, Published online: 09 Feb 2015

Abstract

Objectives:

To project the cost-effectiveness of population-based echo screening to prevent rheumatic heart disease (RHD) consequences.

Background:

RHD is a leading cause of cardiovascular mortality and morbidity during adolescence and young adulthood in low- and middle-per capita income settings. Echocardiography-based screening approaches can dramatically expand the number of children identified at risk of progressive RHD. Cost-effectiveness analysis can inform public health agencies and payers about the net economic benefit of such large-scale population-based screening.

Methods:

A Markov model was constructed comparing a no-screen to echo screen approach. The echo screen program was modeled as a 2-staged screen of a cohort of 11-year-old children with initial short screening performed by dedicated technicians and follow-up complete echo by cardiologists. Penicillin RHD prophylaxis was modeled to only reduce rheumatic fever recurrence-related exacerbation. Quality-adjusted life years (QALYs) and societal costs (in 2010 Australian dollars) associated with each approach were estimated. One-way, two-way and probabilistic sensitivity analyses were performed on RHD prevalence and transition probabilities; echocardiography test characteristics; and societal level costs including supplies, transportation, and labor.

Results:

The incremental costs and QALYs of the screen compared to no screen strategy were −$432 (95% CI = −$1357 to $575) and 0.007 (95% CI = −0.0101 to 0.0237), respectively. The joint probability that the screen was both less costly and more effective exceeded 80%. Sensitivity analyses suggested screen strategy dominance depends mostly on the probability of transitioning out of sub-clinical RHD.

Conclusion:

Two-stage echo RHD screening and secondary prophylaxis may achieve modestly improved outcomes at lower cost compared to clinical detection and deserves closer attention from health policy stakeholders.

Introduction

Rheumatic heart disease (RHD) occupies an unusual space within global health. RHD is a chronic disease of the heart valves with debilitating consequences including congestive heart failure, stroke and arrhythmia during the prime of life. RHD impacts functional status, quality-of-life, earning potential, fertility and ultimately causes mortality in more than 250,000 persons per yearCitation1,Citation2. However, as RHD is a consequence of an aberrant immune response to group A streptococcal infection, a scalable intervention analogous to infectious disease mitigation campaigns appears to be a rational method of preventing chronic RHD and complications. Antibiotic prophylaxis in affected individuals with monthly intra-muscular benzathine penicillin prevents the progression of RHDCitation3–5. A challenge to secondary prophylaxis regimes is intervening at an early stage, since affected persons often present with advanced diseaseCitation6.

Recent reports document the feasibility of population-based echocardiography screening to identify early, clinically latent valvular damage consistent with RHDCitation7–13. These studies suggest a greater prevalence of valvular RHD damage than suspected by clinical exam alone, leading to uncertainty about proper utilization of echo and provision of prophylaxis. To aid in echo utilization, a recent multi-center World Heart Federation expert panel promulgated standardized guidelines to rigorously identify true RHDCitation14. The expert panel identified determining the cost-effectiveness of echo-based screening as a research priority that can form the rational basis for scaling up such screening. We respond to this evidence gap by constructing a Markov cohort model to evaluate the cost-effectiveness of echo-based RHD screening. Fixing the effect of improved screening solely as increasing the number of eligible persons on prophylaxis to prevent rheumatic fever recurrence, with no effect on later progression or complications, we estimated the cost-effectiveness of a single echo-based RHD screening at age 11 years of age as a function of RHD prevalence, a range of health and non-health related costs, and the projected improvement in health status over time. The robustness of our findings was tested using one way, two way and probabilistic sensitivity analyses.

Methods

Model

Markov cohort models can be a transparent and efficient way to compare interventions with respect to health outcomes and consequent costs among cohorts of patients over time. The models consist of mutually exclusive disease states and allow given proportions of individuals to transition between these states over time. Costs and utilities are assigned to each state and aggregated. We formulated a Markov model on a yearly time cycle and compared societal costs and quality-adjusted life years (QALYs) between (a) routine clinical exam detection (current practice) vs (b) a population-based rapid echocardiography single screening followed by full echo in screen positive patients. The screening occurs in a hypothetical cohort of 11 year olds followed for 40 yearly cycles following that screen (longer evaluations did not change our conclusions). We chose 11 year olds as the age roughly around which published echo screening investigators were centeredCitation7–9,Citation11,Citation12,Citation15. Our target population was the Northern Territory, Australia, a location with highly endemic RHD and reliable cost and census data in which we identified 3663 11-year-olds. However, in sensitivity analyses we also aimed to test the model across a range of costs and transition probabilities which can reflect situations beyond the selected population, as detailed below.

Initial distributions across health states were derived from recently published studies. We used a weighted average approach (fixed effect meta-analysis) to combine incidence rates when more than one study was available and then converted these rates to annual probabilities. In transitions where only cross-sectional data were available, we calculated age-specific incidence rates using a constant rate approach after excluding those prevalent cases calculated to have occurred during a previous age stratum. We assumed screening echo was highly sensitive for RHD, but the estimates that we used do account for some false negatives as children with echo visible RHD have recovered with no echo evidence of RHDCitation11,Citation12. Test characteristics for screening echo and prevalence data were extracted from the literature. We began by assuming full delivery and compliance for secondary prophylaxis, and then modeled relaxation of this assumption. Since no actual patients were involved, the Boston Children’s Hospital Committee on Clinical Investigation declined review.

State definitions, care, and costs

We allocated apparently well children into seven simplified health states (). Dead is the costless, absorbing state available from all other states and relevant causes of death, including penicillin anaphylaxis. These state names reflect current clinical consensus.

Figure 1. Model diagram of relevant health states.

Figure 1. Model diagram of relevant health states.

Well or sub-clinical RHD

Well indicates a child with neither clinically evident nor echo-visible RHD. Sub-clinical RHD exists when a child has echo visible lesions consistent with RHD, but no murmur nor clinical signs of RHD. As reliable data on transition from sub-clinical to other forms of RHD do not currently exist, we assumed the minimum transition probability must be no lower than acute rheumatic fever (ARF) without cardiac involvement progressing to RHD in natural history studies and then widely varied this assumption in sensitivity analyses. The essential difference between No screen and Screen scenarios was the presence and transition of the Sub-clinical RHD group to more severe health states. All other transitions across health states occurred with the same probability between the two scenarios.

Well children underwent local general practice (GP) check-ups on a yearly basis, transportation to and from a local provider for that check-up and 1 day lost wages at minimum wage to their caregiver or themselves for attending the GP visit. Sub-clinical RHD accrued the same costs each year as the Well group, since without an echo there is no clinical distinction from Well.

Clinical or resolved RHD

Clinical RHD exists when a child has echo evidence of RHD and an RHD murmur but no other clinical signs of RHD. Resolved RHD indicates a child with previously detected Clinical RHD who at a subsequent cycle no longer has a murmur. RHD CHF (congestive heart failure), RHD pVR (post-valve replacement) and Sub-clinical RHD patients cannot enter the resolved RHD state.

Clinical RHD entails the same yearly costs as Well, plus costs of secondary prophylaxis until age 25. Contemporaneous on-site mixing of penicillin was modeled in lieu of a cold-chain supported pre-mixed regime. The modeled regime included two 600 mg vials per month, diluent, syringe, needle, 0.5 mL of 2% lidocaine solution to minimize muscle discomfort, salary for a level 4 nurse to mix and administer prophylaxis, and the transport cost of the local health clinic nurse to each child at an average distance of 25 km each way. We assume the single prophylaxis person can engage 10 children per day given travel time, with sensitivity analyses varying this efficiency. In the Resolved state, the same costs accrue. For both states, no RHD specific follow-up occurs due to the lack of clinical symptoms.

RHD CHF or RHD pVR

RHD CHF indicates a child with exertional shortness of breath or peripheral edema and echo evidence of RHD. RHD pVR indicates the health state after valve replacement surgery among children who have been RHD CHF for at least 1 year prior. We focused on replacement alone as the destination intervention in resource-poor circumstances where repeated interventions are infeasible. Individuals in the RHD CHF state are only allowed to stay in RHD CHF, obtain valve replacement surgery or die, as we are unaware of data indicating secondary prophylaxis altering the natural history of RHD once CHF is present. Similarly, RHD pVR is allowed only to remain in state or die. Progression from Clinical RHD directly to RHD pVR was not allowed to ensure a symptomatic state was a necessary precursor to surgery.

Beyond the costs of Clinical RHD, we assume lifelong prophylaxis, an average of a GP visit every 3 months for symptom management with attendant costs, an annual trip to a cardiologist with echocardiography with attendant costs, and we assume a productivity loss of 50% of one person’s yearly wages due to debilitation, either on the part of the affected person or a parent caring for a child. For CHF symptom management we assigned a regimen 20 mg of enalapril and 40 mg of furosemide per day. For those in RHD pVR, ongoing costs included all costs from RHD CHF and an average of 5 mg of Coumadin daily and monthly international normalized ratio assessment. RHD pVR also incurred the one-time cost of valve replacement, including the valve, operating theater with staff and consumables, 2 days of recovery in intensive care, 10 days of recovery in an inpatient ward, 1 day of rehabilitation training, another 14 days of recovery at home, lost wages for the full month, and transport to the referral center.

Interventions costs

The echo screening costs were decomposed into the per child average cost of the echo machine, screening staff salary at the level of a registered nurse, one time echo training for the screener, screen staff transport costs from a referral center, and cardiologist salary of 24 days per year for quality control regime of screening echoes. For all children positive in step 1 of screening, step 2 full echocardiography confirmation and transport to referral site for cardiology visit are included. We assume 18 children screened per day in the initial screen stage and modeled more and less children screened per day in sensitivity analysis. The costs related to screening were divided over the entire cohort of screened children.

Transport costs were based on the assumption that the average person lives 250 km from a referral center and 25 km from a primary health center. The price of petrol was assumed at $1.5 per liter, with an average fuel economy of 100 km with 13.8 LCitation16,Citation17. All costs are denominated in 2010 Australian dollars and adjusted for inflation using the Australian Consumer Price IndexCitation18. Costs and QALYs were discounted by 3.5% yearly.

Outcomes

Outcomes are measured in QALYs and net healthcare costs as accumulated in the No screen and Screen scenarios separately. We borrowed utilities from echo diagnosed congestive heart failure as follows: Well at 0.9; Sub-clinical RHD, Clinical RHD, Resolved RHD at 0.75; RHD CHF, RHD pVR at 0.58; and Death at 0Citation19. The same utility was assigned for clinically equivalent states of sub-clinical and clinical RHD as they only differ by virtue of the presence of murmur and prophylaxis administration. While children may favor Sub-clinical RHD in order to avoid prophylaxis injection disutility, we did not have reliable data on this disutility.

Statistical analysis

Incremental cost-effectiveness ratios were constructed by dividing the differences in per patient costs and QALYs between the Screen vs No screen scenarios. The base case adopted a societal perspective; in sub-analyses we adopted a healthcare system perspective by including direct health costs alone and excluding transport and wage loss. In one-way sensitivity analyses, single cost, disease prevalence, test characteristic, or transition probability was varied one at a time. We also performed one-way sensitivity analyses where the range of values was extended to 90% of each point transition probability and cost estimate. This collection of sensitivity analyses allowed us, for example, to relax the full delivery assumption by modeling ranges around the transition probability from treated RHD to downstream consequences, or vary the number of children screened by varying the costs accrued per screened child, or account for very low cost echo equipment by varying the echo machine cost per child. We also conducted select sensitivity analyses, where two variables were varied simultaneously with ranges derived from weighted averages in the literature or reasonable estimated ranges as explicitly specified. Probabilistic sensitivity analysis (PSA) was performed via 5000 Monte Carlo simulations of the model using beta distributions around the transition probabilities for Clinical RHD to RHD CHF, Clinical RHD to Resolved RHD, Clinical RHD to Dead, RHD CHF to Dead, Sub-clinical RHD to Clinical RHD, RHD pVR to Dead, and RHD CHF to RHD pVR; as well as the probabilities for echo screen specificity, Sub-clinical RHD prevalence, and Clinical RHD prevalence. Utilities were also incorporated in the PSA assuming a uniform distribution with lower and upper bounds of ±5% of the base value. Finally, we conducted sensitivity analyses using a discount rate of 0–6%. Sensitivity analyses when adopting the healthcare system perspective were repeated, and had no impact on our conclusions. TreeAge Pro 2013 (Williamstown, MA) was used for all modeling. Willingness-to-pay (WTP) threshold was placed at $64,000 based on the societal willingness to pay for an additional QALY elicited from a sample of the Australian populationCitation20. The authors had full access to the data and the corresponding author takes final responsibility for the decision to submit for publication.

Results

The initial distributions of both cohorts across health states were as follows: Well (98.15%), Sub-clinical RHD (1.71%), Clinical RHD (0.14%), resolved RHD (0%), RHD with congestive heart failure (RHD CHF, 0%), RHD post-valve replacement (RHD pVR,0%), and Dead (0%), as compiled from echo screening data ().

Table 1. Initial state distributions and Echo screen results.

The proportion of Screen positive children with actual RHD was estimated at 45.60 ± 2.21%. Fixed and age-specific transition probabilities are given in . The estimated annual costs by state are given in . As can be expected, the RHD CHF and the RHD pVR states accumulated the largest per patient costs ($16,757 and 16,054, respectively). The bulk of these costs were driven by productivity losses. It is also worth noting the relatively high cost associated with prophylaxis, which occurred at a greater rate in the Screen and is, therefore, of potential interest to decision-makers. presents the underlying costs that were used to estimate total annual costs per state, as well as a breakdown of all intervention costs.

Table 2. Annual transition probabilities.

Table 3. Costs by health state per person per year in 2010 Australian dollars.

Table 4. Cost inputs per person per event in 2010 Australian dollars.

After running the Markov model over 40 yearly cycles, the No screen strategy accrued roughly 19.15 QALYs, while Screen accrued 19.16 QALYs (). Considering total costs, Screen was associated with lower cost compared to No screen, making Screen the dominant strategy. From a healthcare system perspective, however, Screen was associated with higher cost than No screen, with an ICER of $3571 per QALY

Table 5. Average per person costs (2010 Australian dollars) and QALYs.

Sensitivity analyses

One-way sensitivity analyses varying all costs between 33–300% of the point estimate showed that Screen remains the dominant strategy (). Two-way sensitivity analyses simultaneously varying the Sub-clinical RHD prevalence from 1 to 50/1000 against a false positive echo screening prevalence from 0–70% demonstrated Screen was the superior strategy [not shown]. In PSA using 5000 random draws from the parameters’ distributions, Screen had more QALYs with lower cost in 81% of the iterations. It had both lower cost and QALYs in 1.2%, was more effective but had an ICER exceeding the $64,000 per QALY willingness-to-pay threshold in 1.1%, and was dominated in 16.6% of the iterations (). Cost-effectiveness acceptability curves (not shown) suggest that the probability of Screen being cost-effective exceeded 80% across a wide range of WTP thresholds. In analyses varying the Sub-clinical RHD exit transitions, the model was sensitive to the probability of transitioning from Sub-clinical to RHD CHF. Screen was cost-effective when the transition was higher than 1.53% and was the dominant strategy above 1.65%. Varying utilities and limiting to direct health costs did not alter Screen dominance. The discount rate had little impact on the results; when it was varied from 0–6%, savings associated with screening were $954 and $324, respectively; the gain in QALYs was 0.02 and 0.004, respectively.

Figure 2. Cost-effectiveness plane for incremental change of Screen strategy over No screen. Incremental benefit is along the x-axis and incremental cost in on the y-axis. Toward the right indicates more QALYs and toward the top indicates higher cost.

Figure 2. Cost-effectiveness plane for incremental change of Screen strategy over No screen. Incremental benefit is along the x-axis and incremental cost in on the y-axis. Toward the right indicates more QALYs and toward the top indicates higher cost.

Table 6. One-way sensitivity analyses for ICER of Screen vs No screen.

Discussion

Echocardiographic screening detects several-fold more children with RHD-type changes than clinical exam aloneCitation7–9,Citation11–13,Citation21. Juxtaposed against this usefulness is the absence of sophisticated, expensive medical equipment and personnel in many of the places most affected by RHD. In such places public health decision-makers are faced with the dilemma of whether to invest in such additional health resources as they lack information about long-term savings and net societal benefits resulting from improved health. Acknowledging the current controversy inherent in expanding the definition of RHD to include echo only cases, we engaged in a Markov modeling scenario to test the cost-effectiveness of echo-based RHD screening vs clinical detection. Screen was associated with modestly improved outcomes and appeared to be cost-effective below the $64,000 per QALY threshold. This result remained robust to widely ranging assumptions about underlying costs and health utilities. Given the uncertainty of transition probabilities and costs, since many places with endemic RHD are precisely where data capture is poorest, PSA was performed, and again Screen was deemed the dominant strategy in the vast majority of simulations. The PSA did show some combinations of transition probabilities where Screen was not cost-effective, indicating that the cost-effectiveness may vary by the transition probabilities. Specifically, while Screen superiority was robust across a range of hypothetical Sub-clinical to Clinical RHD transition values, it was highly sensitive to the Sub-clinical RHD to RHD CHF transition probability. However, overall the wide variety of sensitivity analyses performed using wide ranges of model inputs suggests the model inferences are robust across a range of possible scenarios.

Previous investigators from RHD endemic sites have suggested echo screening is a low cost tool and perhaps a cost-effective toolCitation3,Citation9. The present results are consonant with these previous conclusions and are bolstered by the Markov modeling techniques detailed herein, including detailed delineation of costs, utilities, and pooled transition probabilities and the inclusion of a societal perspective with inclusion of non-healthcare costs. Alternatively, other experts have promoted primary prophylaxis as the superior approachCitation22–24. This work does not examine a scenario preventing primary group A streptococcal pharyngitis progression to RHD as secondary prophylaxis is currently the most widely accepted approach. We leave the resolution of the controversial primary vs secondary prophylaxis debate to other investigatorsCitation7,Citation8,Citation11,Citation14,Citation25. Likewise, experts are debating the severity of echo only RHD that triggers secondary prophylaxis, leading to wide ranges of RHD affected children depending of the selected threshold. As no current consensus exists, published data was used to develop a pooled estimate of Sub-clinical RHD prevalence and then that pooled estimate was widely varied to simulate various thresholds. The uncertainty about which RHD severity to initiate prophylaxis can affect prophylaxis effectiveness. We modeled a change in RHD progression and prognosis assuming Sub-clinical RHD and Clinical RHD are similar with some variation around progression rates for Sub-clinical RHD. More data is needed to document the actual health effects of prophylaxis of Sub-clinical RHD to validate the great hopes in this area. Nevertheless, using the best available data, the results of this model can be applied by policymakers based on the particular RHD prevalence in their locality deserving prophylaxis, wherever that threshold is eventually set. We solicit other investigators and stakeholders to utilize our model with local probabilities and costs by contacting the corresponding author.

Limitations

This model entails a variety of limitations. First, some parameters are gleaned from single sources or are assigned based on conservative assumptions. These assumptions were systematically explored through multiple sensitivity analyses and the key results remained largely unaffected. While our conclusions remained unchanged within the utility ranges used in sensitivity analyses, more data on relevant inputs, including the health utilities of various RHD states, would be most welcome. Second, this model is theoretical. It does not, for instance, account for sex differences or health system issues. Third, much of the natural history data is more than 40 years old. Careful follow-up of Sub-clinical patients in the current milieu where the indications for prophylaxis are unclear may be appropriate, since more persons prophylaxed will likely appear more clinically effective in preventing RHD cases. Repeated screening of the same cohort was not modeled as conditional probabilities cannot be interpolated from currently available data. Similarly, we acknowledge time dependency of transitions between an attack of rheumatic fever and progression to RHD, but the existing literature limits our ability to reliably model this dependency on a population basis. We also limit this model to RHD and do not include effects of detecting other structural heart diseases. Finally, applying the inference from this study to any specific set of local circumstances must be done cautiously, since under a few conditions echo screening was not cost-effective.

Conclusions

In a Markov model of idealized population-based RHD screening and secondary prophylaxis, 2-stage echocardiography is an attractive strategy compared to clinical screening. However, attention to local Sub-clinical RHD disease prevalence and transitions are warranted. Combined with population education about the precursors and signs of ARF and RHD, widespread availability and delivery of secondary prophylaxis, rising standards of living, and widely scalable echo screening across populations, the burden of RHD can be reduced. RHD echo screening appears to be a reasonable health investment and deserves closer attention from health policy stakeholders.

Transparency

Declaration of funding

This work was supported by a National Heart, Lung, and Blood Institute Career Development Award (K23) HL111335.

Declaration of financial/other relationships

JPZ and MS have disclosed that they have no significant relationships with or financial interests in any commercial companies related to this study or article.

Acknowledgment

The authors acknowledge Dr Rosemary Wyber (Harvard School of Public Health) for her excellent assistance.

References

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.