1,594
Views
0
CrossRef citations to date
0
Altmetric
Pneumococcal – Research Paper

A cost-effectiveness analysis of PHiD-CV compared to PCV13 in a national immunization program setting in Tunisia

Article: 2079305 | Received 21 Dec 2021, Accepted 06 May 2022, Published online: 15 Jun 2022

ABSTRACT

Background

In response to the substantial clinical and economic burden of diseases caused by Streptococcus pneumoniae and non-typeable Haemophilus influenzae (NTHi) in Tunisia, the 10-valent pneumococcal non-typeable Haemophilus influenzae protein D conjugate vaccine (PHiD-CV) was recently introduced into the national immunization program. However, there has yet to be a full-scale health economic analysis comparing currently available pneumococcal conjugate vaccines (PCVs) in Tunisia.

Methods

A Markov model that simulated the disease processes of invasive pneumococcal disease (IPD), pneumonia, and acute otitis media (AOM) over a newborn cohort lifetime was used to evaluate the cost-effectiveness/utility of PHiD-CV and the 13-valent pneumococcal conjugate vaccine (PCV13) from payer’s perspective, using 3% discounting. Vaccine effects were considered for up to 9 years of age.

Results

Vaccination with PHiD-CV or PCV13 was estimated to avert approximately 700 cases of IPD (200 meningitis, 500 bacteremia), and around 5,000 cases of all-cause pneumonia. However, PHiD-CV vaccination was estimated to avert around 4,000 additional AOM cases (18,000) versus PCV13 (14,000). Both PCVs were demonstrated to be cost-effective interventions, but PHiD-CV was estimated to generate additional cost savings of almost $1 million US dollars (USD) with similar levels of clinical benefits. An additional scenario which incorporated serotype-specific vaccine efficacy found no significant change in overall results.

Conclusion

PCVs are a cost-effective strategy to relieve the burden associated with diseases caused by S. pneumoniae and NTHi in Tunisia. PHiD-CV is more cost-effective than PCV13, generating similar health benefits, at a reduced net cost of almost $1 million USD per vaccinated cohort.

GRAPHICAL ABSTRACT

Introduction

Streptococcus pneumoniae is a leading cause of invasive pneumococcal disease (IPD), pneumonia, and acute otitis media (AOM) in adults and children worldwide.Citation1 Similarly, in Tunisia, S. pneumoniae is one of the more frequently isolated bacteria in cases of bacterial meningitis,Citation2–4 and community-acquired pneumonia (CAP).Citation5 Pneumococcal meningitis, in particular, is associated with a high case fatality rate of approximately 14%, and neurological sequalae in a third of survivors.Citation6 The societal economic burden of pneumococcal infections is also substantial. In a prospective multicenter study across 15 pediatric departments in Tunisia, pneumococcal pneumonia and pneumococcal meningitis were estimated to cause 1,091 and 69 hospitalizations a year, respectively; incurring a total cost of 502,079.408 Tunisian dinars (TND) or $256,065.05 US dollars (USD).Citation7

In response to the substantial prevalence, morbidity, and mortality of pneumococcal diseases, numerous countries have adopted pneumococcal conjugate vaccines (PCVs) into national immunization programs. A seven-valent pneumococcal conjugate vaccine (PCV7), which offers protection against the seven serotypes responsible for a high proportion of disease worldwide (4, 6B, 9V, 14, 18C, 19F, and 23F), was licensed in the US in 2000.Citation8 More recently, PCVs with broader serotype coverage have become available, including a 10-valent pneumococcal non-typeable Haemophilus influenzae (NTHi) protein D conjugate (PHiD-CV; GlaxoSmithKline Biologicals SA) vaccine that includes three additional serotypes (1, 5, and 7F) and a 13-valent pneumococcal polysaccharide protein conjugate vaccine (PCV13; Pfizer Inc.) that includes six additional serotypes (1, 3, 5, 6A, 7F and 19A).Citation9,Citation10

Vaccination is a major pillar of public health policy in Tunisia, and in 2019, the Ministry of Health extended the previous national immunization program to include PHiD-CV, which has been available in the private market since 2011. PCV13 was also launched in Tunisia in 2011, but remains available only in the private sector. As vaccine serotypes of S. pneumoniae have been identified as a prominent cause of IPD in Tunisia,Citation11 the introduction of PCVs are expected to result in reduced disease burden and medical costs. However, cost of vaccination remains a major concern for decision makers in Tunisia.

There has yet to be a full-scale health economic analysis comparing currently available PCVs to assess their economic impact from a payer perspective in Tunisia. Therefore, the aim of the current study was to provide data on the cost-utility and cost-effectiveness of PHiD-CV and PCV13 from a payer perspective, in order to facilitate the decision-making process of immunization policy at a national level.

Materials and methods

Modeling description

A previously published Markov cohort model, implemented in Microsoft Office Excel (2007),Citation12 was adapted to simulate the health and economic impact of pneumococcal diseases in Tunisia (). This model simulated the disease process of IPD, CAP, and AOM caused by S. pneumoniae and NTHi in a single birth cohort over a lifetime (1,128 monthly cycles or 94 years).

Figure 1. Markov cohort model design.

The cohort model is Markov-based with exclusive health states: no disease, sequelae, and death. The transition from ‘no disease’ to ‘sequelae’ or ‘death’ is calculated based on this decision tree. In the model, only meningitis can lead to long-term sequelae and non-consulting AOM are accounted for in the quality-of-life impact calculation. AOM: acute otitis media; GP: general practitioner; PCP: primary care physician; PCV13: 13-valent pneumococcal conjugate vaccine; PHiD-CV: 10-valent pneumococcal non-typeable Haemophilus influenzae protein D conjugate vaccine.
Figure 1. Markov cohort model design.

In the base case, three steady state scenarios were compared: no vaccination or vaccination of either PHiD-CV or PCV13 with a 2 + 1 schedule (defined as two doses at 2 and 4 months of age and a booster at 11 months of age). A direct vaccine effect was estimated as a reduction in the incidence of IPD, CAP, and AOM. Costs (from a payer perspective) and outcomes were discounted at 3%, consistent with a previously reported cost-effectiveness study of PCVs conducted for Tunisia and Algeria by Pugh et al.Citation13

Epidemiological inputs

Demographic input for the birth cohort size (200,831) was extracted from the published birth rate for Tunisia, as applied to the size of the entire population.Citation14 Annual general mortality rates were obtained from the World Health Organization (WHO) Life Tables by country.Citation15

The study’s model required serotype data (i.e. incidence of S. pneumoniae serotypes) by age group. Pneumococcal serotype distribution data for Tunisia were available from six local studies. However, many of them contained a reduced number of strains without the adequate discrimination by age group.Citation11,Citation16–20 As a result, data from one of the larger studies were used in this model,Citation18 providing the data by age as needed (Supplementary Table S1).

Age-specific incidence rates of IPD, as well as age-specific case-fatality ratios and proportions of cases with sequelae for IPD meningitis were obtained from the epidemiological parameter values reported by Pugh et al. 2019 for Tunisia.Citation13 These values were then adjusted accordingly using an epidemiological study specific to Tunisia by Sfar et al. 2012 (Supplementary Table S2 and S3).Citation21 All-cause pneumonia hospitalization rates, case fatality ratios and general practitioner consultations were also obtained from Pugh et al. 2019 (Supplementary Table S4).Citation13

However, as Pugh et al. 2019 considered a very high incidence of AOM from a classic study conducted in Boston, US from 1989,Citation22 age-specific incidence of AOM was calibrated using values from a cost-effectiveness analysis of PCVs conducted for Taiwan (Supplementary Table S5).Citation23 Hospitalizations for tympanostomy tube placement procedures, sequelae data, and complications associated with AOM were not considered for this analysis, due to the lack of available data.

Finally, the frequency of NTHi and S. pneumoniae (32.3% for NTHi and 35.9% for S. pneumoniae) and the distribution of pneumococcal serotypes in AOM were obtained from international reviews, as Tunisia-specific epidemiological data for AOM were not available (Supplementary Table S6).Citation24,Citation25

Vaccine efficacy assumptions

As in the previously described Markov model, this analysis assumed that vaccine efficacy (VE) increased from 2–12 months with the increasing number of doses; had full effectiveness from 12 months–3 years; and then declined until age 9. To simulate waning over these time periods, the model linearly adjusted VE each month.Citation12

PCV13 includes three additional S. pneumoniae serotypes compared to PHiD-CV. However, there is no systematic evidence of differences in VE when comparing these PCVs. In line with this, and the conclusions of independent reviews conducted by the Pan American Health Organization (PAHO), the International Vaccine Access Center (IVAC) and the WHO, the same VE in the base case scenario was used for both PHiD-CV and PCV13 against IPD and all-cause pneumonia ().Citation26–28

Table 1. Vaccine efficacies used in the base case scenario (WHO recommendation scenario).

VE against all-types IPD were provided by a study conducted by Deceuninck et al. 2015 in Canada, as this study contained a comparison of the effectiveness of both PCVs in the same population setting. This study estimated that the point effect against all-types of IPD was 72% for PHiD-CV and 66% for PCV13, with overlapping 95% confidence intervals (CIs).Citation29 For the base case scenario, the higher point estimate (72% [95% CI: 46–85%]) was used in order to consider other studies which report higher VE against IPD for these vaccines.Citation33,Citation34

VE data against all-cause pneumonia generated from this PHiD-CV clinical trial were also used for both PCVs. In this case, VE reported against consolidated CAP (21.8% [7.7–33.7%]) was used as a proxy to vaccine effect against hospitalized pneumonias, and VE reported against suspected CAP (8.7% [3.8–13.4%]) was used as a proxy to vaccine effect against ambulatory pneumonias.Citation30

VE against AOM were taken from clinical trials related for both PCVs.Citation30,Citation32 As both the PHiD-CV clinical trial and the Finnish Otitis Media trial showed high VE against AOM associated with S. pneumoniae vaccine-types for both PCVs with overlapping CIs, a VE of 69.9% (29.8–87.1%) was assumed for both vaccines.Citation30,Citation31 VE against AOM associated with non-vaccine types of S. pneumoniae was taken from the Finnish Otitis Media Vaccine Trial and also considered equal for both vaccines.Citation31 Lastly, VE against NTHi AOM for PHiD-CV and PCV13 were taken from the PHiD-CV clinical trial and Finnish Otitis Media Vaccine Trial, respectively.Citation30–32

Cost-effectiveness analysis

Cost-effectiveness was compared between PHiD-CV, PCV13, and no vaccination. For this analysis, vaccine coverage of 87% was used for both vaccines, in line with the official vaccine coverage reported by Tunisia for the 3rd dose of the pneumococcal vaccine and reported to the WHO for the year 2020.Citation35 Vaccine prices per dose in USD were obtained from the 2020 PAHO Revolving Fund for PHiD-CV ($12.85) and PCV13 ($14.50) as they are publicly available on the PAHO web page.Citation36 Vaccine costs also included a 10% wastage cost and a $1 administrative cost per dose for either vaccine.Citation37

Following the recommendations of the commission on Macroeconomics and Health of the WHO, cost-effectiveness thresholds of one gross domestic product (GDP) per capita were used.Citation38,Citation39 GDP per capita for the cost-effectiveness threshold was obtained from the World Bank National Accounts ($3,317 USD per capita for Tunisia, 2019).Citation40 The PCVs with incremental cost-effectiveness ratios (ICERs) lower than one GDP per capita were considered cost-effective for Tunisia.

Cost inputs

Average costs of treatment for the different outcomes were estimated for Tunisia using the values previously reported by Pugh et al. 2019,Citation13 which were compared with results of a local study by Sfar et al.Citation21 As treatment costs of sequelae were not reported for this model, these costs were taken from a local study.Citation7,Citation21

Average treatment costs were then updated to USD using the consumer price index per year between 2016 and 2020 for Tunisia,Citation41 and the 2020 exchange rate for USD and TND.Citation42 Adult costs were based on the same cost reported for children plus 20% (Supplementary Table S7). Indirect costs, such as productivity losses, were not included.

Utility inputs

Due to the lack of local data, normative utilities and disutility values used in the model were obtained from international sources (Supplementary Table S8).Citation43–45 These values were then used to estimate population quality-adjusted life year (QALY) loss. Losses in future utilities due to premature death or long-term sequelae associated with events occurring during the study year were assigned to the present year at an annual discount rate of 3% in order to estimate the net present value.Citation13 Life expectancy was estimated using normative utilities according to age.

Sensitivity analysis

Univariate sensitivity analysis was completed for all model input (73 parameters). Here, each parameter was varied up and down from the base-case value using realistic ranges, following which the new incremental cost-utility ratio (ICUR) obtained was compared to the cost-effectiveness/utility threshold.

In addition, probabilistic sensitivity analysis (PSA) of the ICURs for the comparisons of PHiD-CV versus no vaccine, and PHiD-CV versus PCV13, was performed by recording the results of 1,000 Monte Carlo iterations, each of which simultaneously sampled each of the model’s input parameters from an appropriate probabilistic distribution (normal distribution for VE, triangular distribution for disease incidence and costs, and beta distribution for disutility). The list of model parameters and their associated sampling uncertainty are shown in Supplementary Table S9.

Alternative scenario

In the alternative scenario, VE against IPD was calculated as a sum product of local serotype distribution and the serotype-specific efficacy of each vaccine to account for the three additional serotypes included in PCV13 (). The sensitivity analysis for the alternative scenario used similar parameters as listed in Supplementary Table S9 but considered the VEs included in .

Table 2. Vaccine efficacies used in the alternative scenario.

Protection against vaccine-type IPD

Randomized control trials of PHiD-CV and real-world effectiveness data of PCV13 against IPD in children have shown that both PHiD-CV and PCV13 reduce the incidence of vaccine-types IPD.Citation29,Citation30,Citation34,Citation50 However, evidence of the serotype-specific VE of PHiD-CV and PCV13 is limited, given the low incidence of the serotypes common to PCV7 due to prior mass vaccination programs.

Therefore, serotype-specific effectiveness data were largely extrapolated from estimates of vaccine effectiveness developed from a CDC case-control study conducted in the US for PCV7 and reported by Whitney et al.Citation55 It was assumed that the ten common types covered by both PHiD-CV and PCV13 (1, 4, 5, 6B, 7F, 9 V, 14, 18C, 19F, 23F) would have a VE of 94.7% (95% CI: 93.0–98.0%), which is the mean of the serotype-specific estimates (≥1 dose) for the serotypes covered by PCV7.Citation34

Protection against serotype 6A

Evidence for cross-protection of PCV7 against serotype 6A (through the inclusion of the cross-reactive 6B serotype) has been demonstrated in many countries.Citation55,Citation56 PHiD-CV, which also contains serotype 6B, was assessed to be immunologically noninferior to PCV7 and real-world protection against 6A has been observed from PHiD-CV use in Finland.Citation49,Citation57 Based on the above evidence, cross-protection for 6A was assumed at 76.0% for PHiD-CV.Citation29,Citation33,Citation49 For PCV13, VE against serotype 6A was assumed to be the same as that of other vaccine-type serotypes (94.7% [95% CI:93.0–98.0%]).Citation34

Protection against serotype 19A

While the serotype 19A is not included in PHiD-CV, real-word effectiveness data from post-marketing case-control studies in Canada and Brazil, a population-based study in Finland and a surveillance study from the Netherlands, have all demonstrated a substantial impact of PHiD-CV on IPD caused by serotype 19A.Citation29,Citation49,Citation58,Citation59 The case-control study from Canada additionally demonstrated no substantial difference in VE against 19A IPD between PHiD-CV and PCV13.Citation29 Consequently, a VE of 72.0% was assumed for PHiD-CV in this alternative scenario.Citation29

On the other hand, real-world evidence on the effectiveness against serotype 19A showed a lower value than the estimates for the serotypes shared with PCV7.Citation29,Citation46–48 For example, while the highest reported VE against 19A IPD for PCV13 was 86% (US study) the Canadian case-control study reported a VE of 66%.Citation29,Citation47 As a result, an estimate of 80% was used as an optimal assumption for PCV13.Citation29,Citation46–48

Protection against serotype 3

There is conflicting evidence on the effectiveness of PCV13 for protecting against serotype 3 IPD infections.Citation47,Citation48,Citation50–53 Based on recent data from the UK for a 2 + 1 schedule, a statistically non-significant effectiveness estimate of 26% (95% CI: -‍69–‍68%) was observed for PCV13 against serotype 3.Citation48 This lack of effectiveness of PCV13 against serotype 3 was highlighted by the UK Joint Committee on Vaccination and Immunization (JCVI).Citation54 As a result, a VE of 0% was assumed for both vaccines.

Results

Public health and economic results

The modeled health burden of pneumococcal and NTHi-related diseases during the first 10 years of life in Tunisia for the base case is shown in . For the projected birth cohort of 200,831, it was estimated that without vaccination, there would be 1,708 cases of IPD (400 cases of meningitis and 1,308 cases of bacteremia) with 32 cases of long-term sequalae, 76,594 cases of all-cause pneumonia and 130,863 cases of AOM.

Table 3. Public health and economic results of PCVs in the base case (WHO recommendation scenario; undiscounted).

All-cause pneumonia was estimated to be responsible for the majority of deaths. However, disease burden with meningitis was highest, accounting for 2,706 QALYs lost due to morbidity compared to 1,261, 1,151 and 36 for pneumonia, AOM and bacteremia, respectively. Total lifetime direct medical costs (undiscounted) to the Tunisian healthcare system were $112,355,166 USD.

Base case (WHO recommendation scenario)

For the base-case scenario, vaccination with either PHiD-CV or PCV13 was estimated to avert 672 cases of IPD during the first 10 years of life (159 meningitis, 513 bacteremia), as well as 5,256 cases of all-cause pneumonia. However, PHiD-CV vaccination was estimated to avert 4,386 additional AOM cases (18,183) compared to PCV13 (13,797). Both vaccines were estimated to prevent 180 deaths.

Between the two PCVs, PHiD-CV was estimated to result in 20 QALYs gained due to the decrease in QALYs associated with AOM morbidity in comparison to PCV13. Total lifetime direct medical costs saved with PHiD-CV and PCV13 (including vaccine cost) were $3,163,792 USD and $2,154,191 USD, respectively. Costs were around $1 million USD less for PHiD-CV, due to the lower cost of the vaccination program and savings in AOM treatments.

Alternative scenario

When taking into account the serotype-specific VE of each vaccine, the alternative scenario estimated that PCV13 would avert two further cases of pneumococcal bacteremia compared to PHiD-CV. Nevertheless, the differences described in the base case with regards to averted cases of AOM and vaccine cost remained consistent across scenarios ().

Table 4. Public health and economic results of PCVs in the alternative scenario.

Base case cost-effectiveness and cost-utility analysis results

Base case (WHO recommendation scenario)

Overall, for the base case scenario, both vaccines were shown to have a ICUR below the cost-effectiveness threshold for Tunisia (1 GDP per capita or $3,317 USD per QALY gained). However, PHiD-CV was estimated to generate 20 more QALYs gained over a lifetime than PCV13, with a reduced investment of $982,016 USD in the cost-utility analysis (). Moreover, although both vaccines are predicted to save the same number of life years (LYs), PHiD-CV is predicted to conserve these with a reduced investment of $982,016 USD in the cost-effectiveness analysis (Supplementary Table S10). Therefore, PHiD-CV was predicted to be the most cost-effective vaccine, whether costs per QALY or costs per LY are considered.

Table 5. Cost-utility analysis for PCVs in Tunisia for the base case (WHO recommendation scenario).

Alternative scenario

As in the base case scenario, both vaccines were shown to have an ICUR and ICER below the cost-effectiveness threshold for Tunisia (1 GDP per capita or $3,317 USD per QALY gained). PHiD-CV was estimated to generate five more QALYs gained than PCV13, with a reduced investment of $971,031 USD in the cost-utility analysis (). However, in the cost-effectiveness analysis, PCV13 was estimated to generate 16 more LYs gained than PHiD-CV, with an increased investment of $971,031 USD (Supplementary Table S11).

Table 6. Cost-utility analysis for PCVs in Tunisia for the alternative scenario.

Sensitivity analysis of the cost-utility analysis

The one-way sensitivity analyses found that the most influential parameters for the cost-effectiveness results for PHiD-CV and PCV13 were incidence of meningitis, VE for IPD, and the vaccine administration and wastage costs (). However, no parameter was able to move the ICUR result close to the 1 GPD per capita threshold of cost-effectiveness, confirming that the conclusion that both vaccines are cost-effective for Tunisia is robust in the scenarios analyzed.

Figure 2. Univariate sensitivity analysis of ICURs for the base case (WHO recommendation scenario).

(a) PHiD-CV versus no vaccine; (b) PCV13 versus no vaccine. Only the most influential parameters are shown. AOM: acute otitis media; CAP: community acquired pneumonia; GP: general practitioner; IPD: invasive pneumococcal disease; ICUR: incremental cost-utility ratio; NTHi: non-typeable Haemophilus influenzae; PCV13: 13-valent pneumococcal conjugate vaccine; PHiD-CV: 10-valent pneumococcal non-typeable Haemophilus influenzae protein D conjugate vaccine; Sp VT: Streptococcus pneumoniae vaccine-type; WHO: World Health Organization.
Figure 2. Univariate sensitivity analysis of ICURs for the base case (WHO recommendation scenario).

The PSA on the ICUR of PHiD-CV versus no vaccination in the base-case scenario also confirmed PHiD-CV as a cost-effective intervention, with 100% of the iterations resulting in an ICUR below the cost-effectiveness threshold for Tunisia (). When comparing PHiD-CV versus PCV13 in the PSA, the differences between QALYs generated were not significant between vaccines as iterations were equally distributed around the x-axis zero value, with 50% of iterations resulting in a QALY benefit for each vaccine. However, the savings generated by PHiD-CV of almost $1 million USD was robust in the PSA comparison and confirmed with 98% of PSA iterations below the y-axis zero value ().

Figure 3. Probabilistic sensitivity analysis of ICURs for the base case (WHO recommendation scenario).

(a) PHiD-CV versus no vaccine; (b) PCV13 versus no vaccine. The diagonal grey line indicated the cost-utility threshold for Tunisia. ICUR: incremental cost-utility ratio; PCV13: 13-valent pneumococcal conjugate vaccine; PHiD-CV: 10-valent pneumococcal non-typeable Haemophilus influenzae protein D conjugate vaccine; QALY: quality-adjusted life year; WHO: World Health Organization.
Figure 3. Probabilistic sensitivity analysis of ICURs for the base case (WHO recommendation scenario).

Alternative scenario

The one-way sensitivity analyses found that the most influential parameters for the cost-effectiveness results for PHiD-CV and PCV13 in the alternative scenario were incidence of meningitis, vaccine administration and wastage costs, and VE for hospitalizations due to pneumonia (Supplementary Figure S1). Similar to the base case scenario, the PSA for the alternative scenario showed that the difference in QALYs and LYs between vaccines was not significant. However, the difference between PCVs with respect to cost ($971,031 USD savings favoring PHiD-CV) was significant and robust (Supplementary Figure S2)

Discussion

Globally, and in Tunisia, pneumococcal diseases have been found to result in substantial medical costs.Citation7 In line with these findings, this study estimated substantial health and economic burden of pneumococcal and NTHi-related diseases over the first 10 years of life in Tunisia. For the projected Tunisian birth cohort of 200,831, it was estimated that there would be a total of 1,708 cases of IPD (400 cases of meningitis and 1,308 cases of bacteremia) with 32 cases of long-term sequalae, 76,594 cases of all-cause pneumonia and 130,863 cases of AOM. Total lifetime, direct medical costs of pneumococcal and NTHi diseases in an unvaccinated birth cohort to the Tunisian healthcare system were $112,355,166 USD.

Compared with no vaccination, PCVs were demonstrated to have a substantial impact on pneumococcal and NTHi-related diseases between 0–10 years of age in Tunisia, reducing the burden associated to IPD, pneumonia and AOM.

Furthermore, both PCVs provided similar levels of health benefits, whether measured as QALYs or LYs. Finally, both PCVs were demonstrated to be highly cost-effective interventions for Tunisia in any of the scenarios analyzed, consistent with results of previous studies of the region.Citation13 The sensitivity analyses further demonstrated that these conclusions were robust, even when all uncertainties in the parameters used were considered.

When comparing PHiD-CV and PCV13 vaccination strategies, PHiD-CV was estimated to avert 4,386 additional AOM cases compared to PCV13. Moreover, PHiD-CV was estimated to result in 20 QALYs gained due to the decrease in QALYs lost associated with AOM morbidity. This, along with a lower price per dose of $12.85 USD compared with $14.50 USD, would result in financial savings of almost $1 million USD per cohort vaccinated with PHiD-CV versus PCV13. With respect to the cost-utility and cost-effectiveness analyses, the PSA demonstrated that both vaccines had similar health effects, however, the difference of almost $1 million USD savings in direct medical costs with PHiD-CV versus PCV13 was shown to be robust.

These findings are consistent with those of other cost-effectiveness analyses conducted around the world, including Peru,Citation60 the Philippines,Citation61 CanadaCitation12 and Europe,Citation12,Citation62,Citation63 which estimate that PHiD-CV is a dominant intervention when compared to PCV13. However, the previous cost-effectiveness analysis conducted by Pugh et al. 2019, which compared the cost-effectiveness of these PCVs for Algeria and Tunisia, reported that PCV13 versus no vaccination was more cost-effective when compared to PHiD-CV versus no vaccination.Citation13

While many of the parameters used for this analysis were taken from Pugh et al. 2019, there are key differences in considerations between these studies that may have led to the conclusions of Pugh et al. 2019 being different to those reported in the current study. Namely, Pugh et al. 2019 calculated VE of both PCVs against IPD, pneumonia and AOM based on VE estimates from PCV7 clinical trial data, adjusted based on country-specific serotype coverage proportional to the additional serotypes covered by either PHiD-CV or PCV13. Therefore, cross-protection of PHiD-CV against serotypes included in PCV13 as reported across various real-world evidence studies was not accounted for.Citation13,Citation49,Citation55,Citation58,Citation59 Pugh et al. also assumed that PCV13 would provide serotype-specific VE against all-cause pneumonia, while various systematic reviews have concluded that all PCVs have similar effects against pneumonia cases.Citation13,Citation26–28 Moreover, VE against AOM was estimated to be higher for PCV13 despite PHiD-CV containing protein D of NTHi, the second most prevalent agent of AOM worldwide.Citation64 Finally, Pugh et al. 2019 assumed indirect effects of vaccination with PCV13 based on those observed in the US, with no indirect effects assumed for PHiD-CV.Citation13 Given the differences in the features of the PCV programs between the US and Tunisia, this assumption may not be adequate.

However, several limitations must be addressed when interpreting these results of the current study. Firstly, while local data were used wherever possible, the information required for some variables was not available for Tunisia. As a consequence, some data from other countries had to be used to calibrate the model. Secondly, this study used the vaccine costs provided by the 2020 PAHO Revolving Fund as they were publicly available. As Tunisia is not a part of PAHO, the actual vaccine costs of PHiD-CV and PCV13 may differ from what is reported here. Lastly, this model did not account for herd effects. While such data are available for other countries, due to the differences in many aspects of the PCV vaccination program of Tunisia, the epidemiologic and intervention scenarios between countries were not considered comparable. Therefore, the benefit of both PCVs in terms of reducing pneumococcal and NTHi-related diseases and the cost-effectiveness of these interventions may be underestimated in this analysis.

Finally, although this analysis of pneumococcal vaccines for Tunisia demonstrated a good economic profile for the country, authorities have to consider these data alongside data on affordability, budget impact, fairness, feasibility and other important criteria for the local context.

Conclusions

The results of this study predict that PCVs are a very cost-effective strategy to relieve the epidemiological and economic burden associated with pneumococcal and NTHi diseases in Tunisia. Furthermore, PHiD-CV is more likely to be the dominant intervention, with similar health gains at a reduced net cost, when compared to PCV13.

Author’s contributions

Substantial contributions to study conception and design: YL, MTS, JG; substantial contributions to analysis and interpretation of the data: YL, MTS, JG; drafting the article or revising it critically for important intellectual content: YL, MTS, JG; final approval of the version of the article to be published: YL, MTS, JG.

Supplemental material

Supplemental Material

Download MS Word (76.6 KB)

Acknowledgements

The authors acknowledge Bella Dragova-Maurin, GSK, Belgium, for publication management. The authors also thank Costello Medical for editorial assistance and publication coordination, on behalf of GSK, and acknowledge Kaity McCafferty Layte, Costello Medical, UK, for medical writing and Helen Chambers, Costello Medical, UK, for publication coordination and editorial assistance based on author’s input and direction. This study was funded by GlaxoSmithKline Biologicals SA.

Disclosure statement

YL and JG are employees of the GSK group of companies and hold GSK shares. MTS reports personal fees from GSK during the conduct of this study.

Data availability statement

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Supplementary material

Supplemental data for this article can be accessed on the publisher’s website at https://doi.org/10.1080/21645515.2022.2079305.

Additional information

Funding

This study was sponsored by GlaxoSmithKline Biologicals SA. Support for third-party writing assistance for this article, provided by Kaity McCafferty Layte, Costello Medical, UK, and Helen Chambers, Costello Medical, UK, was funded by GSK in accordance with Good Publication Practice (GPP3) guidelines (http://www.ismpp.org/gpp3).

References

  • Wuorimaa T, Käyhty H. Current state of pneumococcal vaccines. Scand J Immunol. 2002;56(2):111–11. doi:10.1046/j.1365-3083.2002.01124.x.
  • Maalej SM, Kassis M, Rhimi FM, Damak J, Hammami A. Bacteriology of community acquired meningitis in Sfax, Tunisia (1993-2001). Med Mal Infect. 2006;36(2):105–10. doi:10.1016/j.medmal.2005.10.011.
  • Sfaihi L, Kamoun F, Kamoun T, Aloulou H, Mezghani S, Hammemi A, Hachicha M. Bacterial meningitis in children: epidemiological data and outcome. Tunis Med. 2014;92:141–46.
  • Haddad-Boubaker S, Lakhal M, Fathallah C, Mhimdi S, Bouafsoun A, Kechrid A, Smaoui H. Epidemiological study of bacterial meningitis in Tunisian children, beyond neonatal age, using molecular methods: 2014-2017. Afr Health Sci. 2020;20(3):1124–32. doi:10.4314/ahs.v20i3.14.
  • Belkhouja K, Ben Romdhane K, Ghariani A, Ben Khelil J, Besbes M, Ghariani A, M’-Hiri E, Slim-Saidi L. Severe pneumococcal community-acquired pneumonia admitted to medical Tunisian ICU. J Infect Chemother. 2012;18(3):324–31. doi:10.1007/s10156-011-0337-8.
  • Thabet F, Tilouche S, Tabarki B, Amri F, Guediche MN, Sfar MT, Harbi A, Yacoub M, Essoussi AS. Pneumococcal meningitis mortality in children. Prognostic factors in a series of 73 cases. Arch Pediatr. 2007;14(4):334–37. doi:10.1016/j.arcped.2006.11.012.
  • Ben Salah A, El Mhamdi S, Ben Fredj M, Ben Meriem C, Bouguila J, Ben Helel K, Sfaihi L, Mustapha R, Sfar M, Soltani M, et al. Hospital costs of invasive pneumococcal disease in children under 15 years of age in Tunisia. Emhj. 2019;25(12):861–71. doi:10.26719/emhj.19.036.
  • Preventing pneumococcal disease among infants and young children. Recommendations of the advisory committee on immunization practices (ACIP). MMWR Recomm Rep. 2000;49(Rr–9):1–35.
  • Prymula R, Schuerman L. 10-Valent pneumococcal nontypeable Haemophilus influenzae PD conjugate vaccine: Synflorix. Expert Rev Vaccines. 2009;8(11):1479–500. doi:10.1586/erv.09.113.
  • Duggan ST. Pneumococcal polysaccharide conjugate vaccine (13-valent, adsorbed) [prevenar 13®]. Drugs. 2010;70(15):1973–86. doi:10.2165/11205110-000000000-00000.
  • Ktari S, Jmal I, Mroua M, Maalej S, Ben Ayed NE, Mnif B, Rhimi F, Hammami A. Serotype distribution and antibiotic susceptibility of Streptococcus pneumoniae strains in the south of Tunisia: a five-year study (2012–2016) of pediatric and adult populations. Int J Infect Dis. 2017;65:110–15. doi:10.1016/j.ijid.2017.10.015.
  • Knerer G, Ismaila A, Pearce D. Health and economic impact of PHiD-CV in Canada and the UK: a Markov modelling exercise. J Med Econ. 2012;15(1):61–76. doi:10.3111/13696998.2011.622323.
  • Pugh SJ, Fletcher MA, Charos A, Imekraz L, Wasserman M, Farkouh R. Cost-Effectiveness of the pneumococcal conjugate vaccine (10- or 13-valent) versus no vaccination for a national immunization program in Tunisia or Algeria. Infect Dis Ther. 2019;8(1):63–74. doi:10.1007/s40121-018-0226-x.
  • United Nations. World population prospects 2019. Annual population (both sexes combined) of <1-year age group, for Tunisia, projections for 2020. [accessed 2021 Aug]. https://population.un.org/wpp/Download/Standard/Population/.
  • World Health Organization. Life tables by country (Tunisia); global health observatory. General mortality by age for Tunisia. [acessed 2021 Aug]. https://www.who.int/data/gho/data/indicators/indicator-details/GHO/gho-ghe-life-tables-by-country
  • Rachdi M, Boutiba-Ben Boubaker I, Mahjoubi-Rhimi F, Smaoui H, Hammami A, Kéchrid A, Slim A, Ben Redjeb S. Serotype distribution and antimicrobial resistance patterns of Streptococcus pneumoniae isolated in Tunisia. J Med Microbiol. 2011;60(3):391–93. doi:10.1099/jmm.0.024901-0.
  • Marzouk M, Ferjani A, Bouafia N, Harb H, Ben Salem Y, Boukadida J. Serotype distribution and antimicrobial resistance of invasive and noninvasive pneumococcal isolates in Tunisia. Microb Drug Resist. 2015;21(1):85–89. doi:10.1089/mdr.2014.0084.
  • Charfi F, Smaoui H, Kechrid A. Non-Susceptibility trends and serotype coverage by conjugate pneumococcal vaccines in a Tunisian paediatric population: a 10-year study. Vaccine. 2012;30:G18–G24. doi:10.1016/j.vaccine.2012.07.017.
  • Raddaoui A, Simões AS, Baaboura R, Félix S, Achour W, Ben Othman T, Béjaoui M, Sá-Leão R, Ben Hassen A. Serotype distribution, antibiotic resistance and clonality of streptococcus pneumoniae isolated from immunocompromised patients in Tunisia. PLoS One. 2015;10(10):e0140390. doi:10.1371/journal.pone.0140390.
  • Midouni B, Mehiri E, Ghariani A, Draoui H, Essalah L, Bouzouita I, Raoult D, Slim-Saidi L, Fournier PE. Genetic diversity of streptococcus pneumoniae in Tunisia. Int J Antimicrob Agents. 2019;53(1):63–69. doi:10.1016/j.ijantimicag.2018.09.023.
  • Sfar MT, Amri F, Barsaoui A, Ben Becher S, Ben Dridi MF, Ben Helal K, Ben Jaballah N, Bouaziz A, Boughamoura L, Bousina S, et al. Epidemiology and expense of the streptococcus pneumoniæ meningitis in Tunisian chidren. Revue Maghrébine de Pédiatrie Hôpital D’Enfants. 2012;22(7):3–8.
  • Teele DW, Klein JO, Rosner B. Epidemiology of otitis media during the first seven years of life in children in greater Boston: a prospective, cohort study. J Infect Dis. 1989;160(1):83–94. doi:10.1093/infdis/160.1.83.
  • Lu C-Y, Chung C-H, Huang L-M, Kruger E, Tan S-C, Zhang X-H, Chiu N-C. Cost-Effectiveness evaluation of the 10-valent pneumococcal non-typeable Haemophilus influenzae protein D conjugate vaccine for children in Taiwan. Cost Eff Resour Alloc. 2020;18(1):30. doi:10.1186/s12962-020-00225-9.
  • Hausdorff WP, Yothers G, Dagan R, Kilpi T, Pelton SI, Cohen R, Jacobs MR, Kaplan SL, Levy C, Lopez EL, et al. Multinational study of pneumococcal serotypes causing acute otitis media in children. Pediatr Infect Dis J. 2002;21(11):1008–16. doi:10.1097/00006454-200211000-00007.
  • Leibovitz E, Jacobs MR, Dagan R. Haemophilus influenzae: a significant pathogen in acute otitis media. Pediatr Infect Dis J. 2004;23:1142–52.
  • de Oliveira LH, Camacho LAB, Coutinho ESF, Martinez-Silveira MS, Carvalho AF, Ruiz-Matus C, Toscano CM. Impact and Effectiveness of 10 and 13-valent pneumococcal conjugate vaccines on hospitalization and mortality in children aged less than 5 years in Latin American countries: a systematic review. PLoS One. 2016;11(12): e0166736-e. doi:10.1371/journal.pone.0166736.
  • Cohen O, Knoll M, O’Brien K, Ramakrishnan M, Constenla D, Privor-Dumm L, Buss-Younkin J, Farrar J, Pilishvili T, Whitney C, et al. Pneumococcal conjugate vaccine (PCV) product assessment I.V.A.C. [accessed 2020 Dec]. https://www.jhsph.edu/ivac/wp-content/uploads/2018/05/pcv-productassessment-april-25-2017.pdf.
  • World Health Organization. Regional technical advisory groups on immunization. [accessed 2020 Dec]. http://www.who.int/immunization/sage/regional/en/.
  • Deceuninck G, De Serres G, Boulianne N, Lefebvre B, De Wals P. Effectiveness of three pneumococcal conjugate vaccines to prevent invasive pneumococcal disease in Quebec, Canada. Vaccine. 2015;33(23):2684–89. doi:10.1016/j.vaccine.2015.04.005.
  • Tregnaghi MW, Sáez-Llorens X, López P, Abate H, Smith E, Pósleman A, Calvo A, Wong D, Cortes-Barbosa C, Ceballos A, et al. Efficacy of pneumococcal nontypable Haemophilus influenzae protein D conjugate vaccine (PHiD-CV) in young Latin American children: a double-blind randomized controlled trial. PLoS Med. 2014;11(6): e1001657-e. doi:10.1371/journal.pmed.1001657.
  • Eskola J, Kilpi T, Palmu A, Jokinen J, Eerola M, Haapakoski J, Herva E, Takala A, Käyhty H, Karma P, et al. Efficacy of a pneumococcal conjugate vaccine against acute Otitis media. N Engl J Med. 2001;344(6):403–09. doi:10.1056/NEJM200102083440602.
  • Prymula R, Peeters P, Chrobok V, Kriz P, Novakova E, Kaliskova E, Kohl I, Lommel P, Poolman J, Prieels J-P, et al. Pneumococcal capsular polysaccharides conjugated to protein D for prevention of acute otitis media caused by both Streptococcus pneumoniae and non-typable Haemophilus influenzae: a randomised double-blind efficacy study. Lancet. 2006;367(9512):740–48. doi:10.1016/S0140-6736(06)68304-9.
  • Rinta-Kokko H, Palmu AA, Auranen K, Nuorti JP, Toropainen M, Siira L, Virtanen MJ, Nohynek H, Jokinen J. Long-Term impact of 10-valent pneumococcal conjugate vaccination on invasive pneumococcal disease among children in Finland. Vaccine. 2018;36(15):1934–40. doi:10.1016/j.vaccine.2018.03.001.
  • Palmu AA, Jokinen J, Borys D, Nieminen H, Ruokokoski E, Siira L, Puumalainen T, Lommel P, Hezareh M, Moreira M, et al. Effectiveness of the ten-valent pneumococcal Haemophilus influenzae protein D conjugate vaccine (PHiD-CV10) against invasive pneumococcal disease: a cluster randomised trial. Lancet. 2013;381(9862):214–22. doi:10.1016/s0140-6736(12)61854-6.
  • World Health Organization. Immunization: pneumococcal vaccination coverage for Tunisia 2020. Global Health Observatory Data Repository. [accessed 2022 Jan]. https://immunizationdata.who.int/pages/coverage/PCV.html?CODE=TUN&ANTIGEN=PCV3&YEAR=.
  • PAHO Revolving Fund. Vaccine Prices per dose 2020. [accessed 2021 Aug]. https://www.paho.org/hq/index.php?option=com_docman&view=download&category_slug=vaccines-9979&alias=51457-revolving-fund-vaccine-prices-2020&Itemid=270&lang=fr.
  • Constenla DO. Economic impact of pneumococcal conjugate vaccination in Brazil, Chile, and Uruguay. Rev Panam Salud Publica. 2008;24(2):101–12. doi:10.1590/s1020-49892008000800004.
  • Sachs JD Macroeconomics and health: investing in health for economic development. report of the commission on macroeconomics and health. [accessed 2021 Aug]. https://apps.who.int/iris/handle/10665/4243.
  • World Health Organization: The World Health report 2002. Reducing risks, promoting healthy life. [accessed 2021 Aug]. http://www.who.int/whr/2002/en/whr02_en.pdf.
  • World Bank National Accounts. GDP per capita in current US dollars, 2019. [accessed 2021 Aug]. https://data.worldbank.org/indicator/NY.GDP.PCAP.CD?locations=TN.
  • Consumer Price Index for Tunisia. United Nations office for the coordination of humanitarian affairs. [accessed 2021 Aug. https://data.humdata.org/dataset/faostat-prices-for-tunisia/resource/c5309d15-f25e-45c0-bb4c-a8ff5ecdb6d2.
  • XE. Historical currency rates for Tunisia. [accessed 2021 Aug]. https://www.xe.com/currencytables/.
  • Morrow A, De Wals P, Petit G, Guay M, Erickson LJ. The burden of pneumococcal disease in the Canadian population before routine use of the seven-valent pneumococcal conjugate vaccine. Can J Infect Dis Med Microbiol. 2007;18(2):121–27. doi:10.1155/2007/713576.
  • Oh PI, Maerov P, Pritchard D, Knowles SR, Einarson TR, Shear NH. A cost-utility analysis of second-line antibiotics in the treatment of acute otitis media in children. Clin Ther. 1996;18(1):160–82. doi:10.1016/s0149-2918(96)80188-3.
  • Bennett JE, Sumner W II, Downs SM, Jaffe DM. Parents’ utilities for outcomes of occult bacteremia. Arch Pediatr. 2000;154(1):43–48. doi:10.1001/pubs.PediatrAdolescMed.-ISSN-1072-4710-154-1-poa9043.
  • Weinberger R, van der Linden M, Imöhl M, von Kries R. Vaccine effectiveness of PCV13 in a 3+1 vaccination schedule. Vaccine. 2016;34(18):2062–65. doi:10.1016/j.vaccine.2016.02.043.
  • Moore MR, Link-Gelles R, Schaffner W, Lynfield R, Holtzman C, Harrison LH, Zansky SM, Rosen JB, Reingold A, Scherzinger K, et al. Effectiveness of 13-valent pneumococcal conjugate vaccine for prevention of invasive pneumococcal disease in children in the USA: a matched case-control study. Lancet Respir Med. 2016;4(5):399–406. doi:10.1016/s2213-2600(16)00052-7.
  • Andrews NJ, Waight PA, Burbidge P, Pearce E, Roalfe L, Zancolli M, Slack M, Ladhani SN, Miller E, Goldblatt D. Serotype-Specific effectiveness and correlates of protection for the 13-valent pneumococcal conjugate vaccine: a postlicensure indirect cohort study. Lancet Infect Dis. 2014;14(9):839–46. doi:10.1016/s1473-3099(14)70822-9.
  • Jokinen J, Rinta-Kokko H, Siira L, Palmu AA., Virtanen MJ, Nohynek H, Virolainen-Julkunen A, Toropainen M, Nuorti JP. Impact of ten-valent pneumococcal conjugate vaccination on invasive pneumococcal disease in Finnish children–a population-based study. PLoS One. 2015;10(3):e0120290. doi:10.1371/journal.pone.0120290.
  • Kaplan SL, Barson WJ, Lin PL, Romero JR, Bradley JS, Tan TQ, Hoffman JA, Givner LB, Mason EO. Early trends for invasive pneumococcal infections in children after the introduction of the 13-valent pneumococcal conjugate vaccine. Pediatr Infect Dis J. 2013;32(3):203–07. doi:10.1097/INF.0b013e318275614b.
  • Steens A, Bergsaker MA, Aaberge IS, Rønning K, Vestrheim DF. Prompt effect of replacing the 7-valent pneumococcal conjugate vaccine with the 13-valent vaccine on the epidemiology of invasive pneumococcal disease in Norway. Vaccine. 2013;31(52):6232–38. doi:10.1016/j.vaccine.2013.10.032.
  • Harboe ZB, Dalby T, Weinberger DM, Benfield T, Mølbak K, Slotved HC, Suppli CH, Konradsen HB, Valentiner-Branth P. Impact of 13-valent pneumococcal conjugate vaccination in invasive pneumococcal disease incidence and mortality. Clin Infect Dis. 2014;59(8):1066–73. doi:10.1093/cid/ciu524.
  • Demczuk WH, Martin I, Griffith A, Lefebvre B, McGeer A, Lovgren M, Tyrrell GJ, Desai S, Sherrard L, Adam H et al. Serotype distribution of invasive Streptococcus pneumoniae in Canada after the introduction of the 13-valent pneumococcal conjugate vaccine, 2010-2012. Can J Microbiol. 2013;59(12):778–88. doi:10.1139/cjm-2013-0614.
  • Health Protection Agency. UK pneumococcal weekly surveillance 2014. [accessed 2018 June]. https://webarchivenationalarchives.gov.uk/20140714084352/https://www.hpa.org.uk/Topics/InfectiousDiseases/InfectionsAZ/Pneumococcal/EpidemiologicalDataPneumococcal/CurrentEpidemiologyPneumococcal/.
  • Whitney CG, Pilishvili T, Farley MM, Schaffner W, Craig AS, Lynfield R, Nyquist AC, Gershman KA, Vazquez M, Bennett NM., et al. Effectiveness of seven-valent pneumococcal conjugate vaccine against invasive pneumococcal disease: a matched case-control study. Lancet. 2006;368(9546):1495–502. doi:10.1016/S0140-6736(06)69637-2.
  • Pilishvili T, Lexau C, Farley MM, Hadler J, Harrison LH, Bennett NM, Reingold A, Thomas A, Schaffner W, Craig AS, et al. Sustained reductions in invasive pneumococcal disease in the era of conjugate vaccine. J Infect Dis. 2010;201(1):32–41. doi:10.1086/648593.
  • Vesikari T, Wysocki J, Chevallier B, Karvonen A, Czajka H, Arsène JP, Lommel P, Dieussaert I, Schuerman L. Immunogenicity of the 10-valent pneumococcal non-typeable Haemophilus influenzae protein D conjugate vaccine (PHiD-CV) compared to the licensed 7vcrm vaccine. Pediatr Infect Dis J. 2009;28(4 Suppl):S66–76. doi:10.1097/INF.0b013e318199f8ef.
  • Domingues CM, Verani JR, Montenegro Renoiner EI, de Cunto Brandileone MC, Flannery B, de Oliveira LH, Santos JB, de Moraes JC. Effectiveness of ten-valent pneumococcal conjugate vaccine against invasive pneumococcal disease in Brazil: a matched case-control study. Lancet Respir Med. 2014;2(6):464–71. doi:10.1016/s2213-2600(14)70060-8.
  • Knol MJ, Wagenvoort GHJ, Sanders EAM, Elberse K, Vlaminckx BJ, de Melker HE, van der Ende A. Invasive pneumococcal disease 3 years after introduction of 10-valent pneumococcal conjugate vaccine, the Netherlands. Emerg Infect Dis. 2015;21(11):2040–44. doi:10.3201/eid2111.140780.
  • Gomez JA, Tirado JC, Navarro Rojas AA, Castrejon Alba MM, Topachevskyi O. Cost-Effectiveness and cost utility analysis of three pneumococcal conjugate vaccines in children of Peru. BMC Public Health. 2013;13(1):1025. doi:10.1186/1471-2458-13-1025.
  • Zhang X-H, Nievera MC, Carlos J, Lucero M, Bibera G, Atienza MI, Topachevskyi O, Navarro-Locsin CG. Cost-effectiveness analysis of pneumococcal vaccination with the pneumococcal polysaccharide NTHi protein D conjugate vaccine in the Philippines. Value Health Reg Issues. 2014;3:156–66. doi:10.1016/j.vhri.2014.04.004.
  • By A, Sobocki P, Forsgren A, Silfverdal S-A. Comparing health outcomes and costs of general vaccination with pneumococcal conjugate vaccines in Sweden: a Markov model. Clin Ther. 2012;34(1):177–89. doi:10.1016/j.clinthera.2011.12.007.
  • Robberstad B, Frostad CR, Akselsen PE, Kværner KJ, Berstad AKH. Economic evaluation of second generation pneumococcal conjugate vaccines in Norway. Vaccine. 2011;29(47):8564–74. doi:10.1016/j.vaccine.2011.09.025.
  • Clarke C, Bakaletz LO, Ruiz-Guiñazú J, Borys D, Mrkvan T. Impact of protein D-containing pneumococcal conjugate vaccines on non-typeable Haemophilus influenzae acute otitis media and carriage. Expert Rev Vaccines. 2017;16(7):1–14. doi:10.1080/14760584.2017.1333905.