Skip to main content
Erschienen in: Infectious Diseases and Therapy 1/2019

Open Access 11.12.2018 | Original Research

Cost-Effectiveness of the Pneumococcal Conjugate Vaccine (10- or 13-Valent) Versus No Vaccination for a National Immunization Program in Tunisia or Algeria

verfasst von: Sarah J. Pugh, Mark A. Fletcher, Apostolos Charos, Lynda Imekraz, Matt Wasserman, Raymond Farkouh

Erschienen in: Infectious Diseases and Therapy | Ausgabe 1/2019

Abstract

Introduction

To evaluate the expected impact of the Algeria national immunization program (NIP) and potential impact for a Tunisia NIP, this study assessed the public health and economic value of vaccination, through a cost-effectiveness analysis, for a PCV13 or PCV10 NIP, compared with no vaccination.

Methods

A decision-analytic model was programmed in Microsoft Excel™ and adapted to evaluate the clinical and economic outcomes of PCV vaccination. Assuming a steady state, the model estimated invasive pneumococcal disease (IPD; bacteremia and meningitis), all-cause pneumonia (inpatient and outpatient), and all-cause otitis media cases as well as the associated costs from a payer perspective. The base case scenario assumed direct effects for both PCVs and indirect effects (against IPD) for PCV13 only.

Results

In Algeria, compared with no vaccination program, PCV13 would save 2177 lives and avoid nearly 349,000 cases of IPD, pneumonia, and AOM at a highly cost-effective value of $308 per QALY. In Tunisia, PCV13 would save 308 lives and avoid 1305 cases of IPD, 4833 cases of pneumonia, and 54,957 cases of AOM at a highly cost-effective value of $848 per QALY. PCV10 prevented 1224 deaths and 270,483 cases of disease in Algeria and prevented 172 deaths and 56,610 cases in Tunisia. PCV10 was cost-effective in both Algeria at $731/QALY and in Tunisia at $1366/QALY.

Conclusion

The ongoing NIP in Algeria is projected to reduce the impact and economic toll of pneumococcal disease in Algeria. If an NIP were also introduced in Tunisia, a commensurate impact would be expected. PCV NIPs are highly cost-effective, highly impactful public health interventions.

Funding

Pfizer.
Hinweise

Electronic supplementary material

The online version of this article (https://​doi.​org/​10.​1007/​s40121-018-0226-x) contains supplementary material, which is available to authorized users.

Enhanced digital features

To view enhanced digital features for this article go to https://​doi.​org/​10.​6084/​m9.​figshare.​7381529.

Introduction

Streptococcus pneumoniae (S. pneumoniae) is a common gram-positive bacterium with more than 95 serotypes, often colonizing the nasopharynx of healthy infants. S. pneumoniae can spread across the mucosa to cause non-invasive diseases, and occasionally the bacteria cross the mucosal barrier to cause invasive disease. Non-invasive disease is represented mainly by pneumonia (lung infection) and otitis media (OM, middle ear infection). Invasive pneumococcal disease (IPD) occurs if the bacteria enter the bloodstream (bacteremia/septicemia) or travel via the bloodstream to seed other sterile sites (meningitis, septic arthritis, and osteomyelitis). Both invasive and non-invasive pneumococcal diseases present a substantial health and economic burden worldwide.
A seven-valent pneumococcal polysaccharide-protein conjugate vaccine (Prevenar®, PCV7) was licensed in February 2000 in the USA and subsequently recommended for routine immunization of all infants beginning at 2 months of age, with additional recommendations provided for the immunization of older infants and children at an increased risk of pneumococcal disease [1]. PCV7 offered protection against the seven serotypes responsible for a high proportion of disease worldwide (4, 6B, 9 V, 14, 18C, 19F, and 23F). Four years after PCV7 implementation in the USA, surveillance results indicated a 20% decrease in all-cause OM visit rates [2], a 52.4% decrease in all-cause pneumonia hospitalizations [3], and a 39% decrease in cases of all-cause pneumonia [4] in children < 2 years. Subsequently, the next generation of PCVs, the 10- (PCV10) and 13-valent (PCV13) vaccines, was introduced (Supplementary Table 1) and offered greater serotype coverage against disease caused by an additional three (1, 5, and 7F) and six (1, 3, 5, 6A, 7F, and 19A) serotypes, respectively, that were not covered in PCV7 [5, 6]. Now, 7 years since their introductions, real-word effectiveness studies indicate further effects for PCV10 [7, 8] and PCV13 [912] on invasive and non-invasive disease, in proportion to the enhanced serotype coverage beyond PCV7.
Numerous countries around the world have adopted PCVs into a national immunization program (NIP) in response to the substantial prevalence of pneumococcal diseases [13, 14], morbidity, and mortality [15]. Vaccine serotypes of S. pneumoniae have been identified as the predominant cause of IPD [16] in North Africa, causing 76.9% [18], 86.8% [16], and up to 90% [17] in Algeria and 68% [19], 78% [20], and up to 78.7% [21] in Tunisia. Some countries now have adopted PCV NIPs [13, 14], beginning with PCV13 in Morocco in October 2010 followed by PCV10 in July 2012 [22, 23] and then PCV13 in Algeria in April 2016. Likewise, PCV10 and PCV13 are registered and available within the private markets of Morocco and Tunisia. The introduction and maintenance of childhood pneumococcal vaccination programs in Morocco and Algeria, and the introduction in Tunisia, are expected to result in reduced mortality, disease burden, and direct medical costs.
Cost-effectiveness analyses are an effective tool to inform decision-makers about the value of introducing a vaccination program and the clinical and economic impact of each available PCV program [24]. Lower-middle income countries often perceive the cost of PCVs as high relative to other vaccines, but evidence suggests that PCV immunization programs can be a cost-saving and/or highly cost-effective health intervention to reduce their substantial disease burden [25, 26]. The objective of this study was to assess the public health impact and value of vaccination as assessed by the cost-effectiveness of a PCV13 or PCV10 NIP compared with no vaccination. These outcomes are presented for Algeria as the expected impact of the ongoing NIP and in Tunisia as the potential impact should an NIP begin.

Methods

Model

A decision-analytic model was programmed in Microsoft Excel™ and adapted to evaluate the clinical and economic outcomes of PCV vaccination in Tunisia and Algeria based on the total cases of IPD, pneumonia, and acute otitis media avoided, as described in detail previously [2730]. Individuals entered the model with either a PCV13 or PCV10 NIP in place. Children < 1 year were assumed to receive the full two-dose primary series and one booster dose in the 2nd year of life. Each individual vaccine recipient had a probability of the following mutually exclusive health states: no disease, pneumococcal meningitis, pneumococcal bacteremia, all-cause pneumonia (in- or outpatient), and all-cause OM (Supplementary Fig. 1). IPD (bacteremia and meningitis) and inpatient pneumonia conferred an increased risk of mortality (Table 1), while meningitis also carried a probability of long-term sequelae such as neurologic impairment and hearing loss. Outpatient pneumonia and otitis media were expected not to be associated with mortality.
Table 1
Epidemiologic inputs used in the cost-effectiveness of an infant pneumococcal vaccination program
Input
Algeria
Tunisia
Sources
Total population
40,263,711.00
11,134,588.00
Census, 2016
Population < 2 years
1,825,578.00
359,035.00
Census, 2016
Disease rates (per 100,000 person-years)
   
 Invasive pneumococcal disease (IPD)
   
 Pneumococcal bacteremia
   
  Incidence
8.2–84.1
8.2–84.1
Nakamura, 2011 (ages > 5)
  Case fatality rate (CFR)
4.3–30%
4.3–30%
O’Brien, 2009 (ages ≤ 5) 
 Pneumococcal meningitis
   
  Incidence
2.50–14.3
2.50–14.3
Nakamura, 2011 (ages > 5)
  Case fatality rate (CFR)
15.7–80%
15.7–80%
O’Brien, 2009 (ages ≤ 5) 
  Hearing loss, probability of (%)
7.0%
7.0%
Ray, 2006
  Neurologic sequelae, probability of (%)
13.0%
13.0%
Ray, 2006
 Inpatient pneumonia
  
Rudan, 2004; Rudan, 2008
  Incidence (per 100,000 person-years)
39.5–1882
14.7–925.1
Nakamura, 2011 
  Case fatality rate (CFR)
1.4–9.7%
1.4–9.7%
 
 Outpatient pneumonia
   
  Incidence (per 100,000 person-years)
98.3–20,000
98.3–8740.33
Rudan, 2004; Rudan, 2008
 Simple AOM
   
  Incidence (per 100,000 person-years)
112,500–71,666
112,500–71,666
Teele, 1989
Direct medical costs ($)
   
 Vaccine cost per dose (PCV10/PCV13)
14.60/15.70
14.60/15.70
Expert review, 2013a
 Administration cost
0.92
2.48
 
 Pneumococcal bacteremia
66,713
740
 
 Pneumococcal meningitis
166,782
1849
 
 Pneumonia inpatient
55,594
616
 
 Pneumonia outpatient
8406
118
 
 Simple AOM
3205
42
 
Life expectancy, years
   
 0 to  < 2 years
76
75
Census, 2016
 2–4 years
76
75
 
 5–17 years
69
67
 
 18–34 years
55
53
 
 35–49 years
39
38
 
 50–64 years
24
22
 
 65 + years
8
7
 
Vaccine effectiveness PCV10/PCV13
   
 Pneumococcal bacteremia
0.94/0.94
0.94/0.94
Black, 2006
 Pneumococcal meningitis
0.94/0.94
0.94/0.94
 
 Pneumonia inpatient
0.26/0.31
0.29/0.32
Black, 2000
 Pneumonia outpatient
0.06/0.07
0.07/0.07
Ray, 2000
 Simple AOM
0.07/0.08
0.08/0.09
Fireman, 2003
Utilities
   
 Utility of healthy individuals
0.90
0.90
 
 Meningitis-caused neurologic impairment
0.60
0.60
Morrow, 2007
 Meningitis-caused hearing loss
0.80
0.80
 
Serotype coverage (PCV10/PCV13)
   
 Pneumococcal bacteremia
0.50–0.72/0.67–0.88
0.54–0.78/0.57–0.83
Charfi, 2012
 Pneumococcal meningitis
0.50–0.72/0.67–0.88
0.54–0.78/0.57–0.83
Ramdani-Bouguessa, 2015
PCV10 10-valent pneumococcal conjugate vaccine, PCV13 13-valent pneumococcal conjugate vaccine, AOM acute otitis media
aSeparate meetings in Algeria (3 June 2013) and Tunisia (21 June 2013) gathered local experts (in total, 25 pediatricians, microbiologists, and epidemiologists) to provide estimates in the local currency [Algeria (DZD) and Tunisia (TND)]
Outcomes due to vaccinating an infant birth cohort were calculated for the entire population over a 1-year time horizon once the vaccine effects were assumed to reach a steady state. The model then estimates the number of cases: IPD (bacteremia and meningitis), all-cause pneumonia (inpatient and outpatient), and all-cause OM. The estimated number of cases was calculated under multiple scenarios, which also included the assumption of indirect protection, meaning that the effects of the vaccine extended to both vaccinated and unvaccinated groups. Costs and quality adjusted life years (QALYs) were discounted at an assumed rate of 3% for both Algeria and Tunisia, and the results are presented from a payer perspective.

Population and Vaccination Rates

Table 1 presents population estimates for Algeria and Tunisia in 2016 with age-specific estimates in Supplementary Tables 2 and 3 [31]. Vaccination coverage for a three-dose series of PCV in an NIP was assumed to be 95% for Algeria and 98% for Tunisia, based on DTP3 (third-dose Diphtheria Tetanus Pertussis) coverage reported to the WHO for the year 2016 [32].
Table 2
Health outcomes and costs of an infant routine vaccination program with PCV13 and PCV10 by scope of benefit compared with no vaccination under the base case scenario [direct effect plus indirect effect for IPD (PCV13 only)], by countrya
 
Algeria
Tunisia
PCV13 vs. no vaccination
PCV10 vs. no vaccination
PCV13 vs. no vaccination
PCV10 vs. no vaccination
Morbidity avoided
    
 IPD avoided
7608
2804
1305
557
 Pneumonia avoided
57,800
45,320
4833
4531
 AOM avoided
283,588
222,359
54,957
51,522
 Total cases avoided
348,997
270,483
61,095
56,610
Mortality avoided
    
 Deaths
2177
1224
308
172
QALYs gained
    
 QALYs saved, acute disease avoided
1837
1378
323
290
 QALYs saved, sequelae and death avoided
56,604
34,367
7443
4852
 Total QALYs saved
58,441
35,744
7766
5142
Base case
    
 Direct medical cost
− 25.79 Million $
− 17.66 Million $
− 2.24 Million $
− 1.80 Million $
 Vaccination program cost
43.83 Million $
43.83 Million $
8.82 Million $
8.82 Million $
 Net cost, direct medical
18.04 Million $
26.16 Million $
6.58 Million $
7.03 Million $
 Cost per QALY
308/QALY
731/QALY
848/QALY
1366/QALY
PCV10 10-valent pneumococcal conjugate vaccine, PCV13 13-valent pneumococcal conjugate vaccine, QALY quality adjusted life year, IPD invasive pneumococcal disease, AOM acute otitis media
aAll monetary values are in US dollars
Table 3
Scenario analyses (price parity)a
 
PCV13
PCV10
Algeria
  
 Direct effect + herd effect (IPD and pneumonia)
  
  Net cost, direct medical
1.80 Million $
9.42 Million $
  Cost per QALY
29/QALY
198/QALY
 Direct effect only
  
  Net cost, direct medical
21.4 Million $
26.2 Million $
  Cost per QALY
475/QALY
731/QALY
Tunisia
  
 Direct effect + herd effect (IPD and pneumonia)
  
  Net cost, direct medical
4.8 Million $
5.0 Million $
  Cost per QALY
577/QALY
650/QALY
 Direct effect only
  
  Net cost, direct medical
6.90 Million $
7.03 Million $
  Cost per QALY
1239/QALY
1366/QALY
PCV10 10-valent pneumococcal conjugate vaccine, PCV13 13-valent pneumococcal conjugate vaccine, QALY quality adjusted life year, IPD invasive pneumococcal disease
aAll monetary values are in US dollars

Incidence, Case Fatality Rates, and Serotype Coverage

Age-specific life expectancy was assumed to be the same as the general population for all individuals in the model. Incidence and case fatality rates for IPD were applied from country-specific estimates in children < 5 years of age [33] and from global estimates from lower-middle income countries of individuals ≥ 5 years of age [25]. Incidence and case-fatality rates of all-cause pneumonia were based on country-specific estimates published by Rudan et al. in children < 5 years of age [13, 14] and based on global estimates for individuals ≥ 5 years of age [25]. Hospitalized pneumonia was assumed to represent 8.6% of total cases of all-cause pneumonia in both Algeria and Tunisia. All pneumonia rates were adjusted to reflect age groups specific to the model. Due to the lack of local data, rates of all-cause OM were based on a large surveillance study conducted in the USA [34]. The only disease sequelae considered were in association with pneumococcal meningitis at an assumed rate of 7% for neurologic impairment and 13% for hearing loss [35].
Serotype coverage was obtained from local serotyping studies in Algeria [16] and Tunisia [20] by calculating the proportion of serotypes in the population covered by PCV10 and PCV13 and applied to all disease states (IPD, pneumonia, OM) and across all ages (Table 1).

Direct Effect

The direct effect of vaccine coverage corresponded to the reduction in disease among vaccinated individuals. To estimate direct effects for PCV10 or PCV13, vaccine efficacy estimates from PCV7 clinical trial data were adjusted based on country-specific serotype coverage, proportional to the additional serotypes covered in either PCV10 or PCV13, since no head-to-head efficacy trial exists, and clinical efficacy and impact data may not be directly comparable because of individual studies' differences in implementation, dosing, and underlying pneumococal etiology. Direct effects of PCV10 and PCV13 against IPD, pneumonia, and AOM were assumed. Direct effects against invasive pneumococcal disease (IPD) were taken to be 94% for the seven serotypes in common, based on clinical trial data for PCV7 [36]. Direct effects of PCV7 against pneumonia, in- and outpatient, were derived from the impact against clinical (all-cause) pneumonia [35, 36] and then adjusted to country- and vaccine-specific serotype coverage. Estimates of efficacy against all-cause AOM were also similarly derived from PCV7 trial data [37]. Effectiveness against pneumonia and AOM has been confirmed in real-world settings for PCV13, suggesting that current assumptions are conservative and may underestimate the true impact [38, 39].

Indirect Effect

Indirect effects represent the reduction in disease observed among unvaccinated individuals based on a mechanism of decreased acquistion of vaccine serotypes among vaccinated individuals that limits their circulation within the population. Since the introduction of PCV7 18 years ago and then of PCV13 8 years ago, numerous studies have demonstrated robust indirect effects of PCV7 and PCV13 [36, 38, 40]. Due to the robust data on indirect protection based on results from the US Centers for Disease Control and Prevention’s Active Bacterial Core Surveillance (ABCs) [35], we made a simplifying assumption that indirect effects of PCV7 would be similar in both Algeria and Tunisia, assuming a steady state of vaccine effects. To account for the difference in serotype distribution across countries, the indirect effects observed for PCV7 were adjusted to reflect local serotype coverage proportional to each vaccine [2, 41, 42] (Supplementary Table 4). In the base case scenario, PCV13 was assumed to confer an indirect effect on IPD, and PCV10 was not assumed to confer indirect effects, consistent with the available effectiveness data on indirect effects for both PCV10 [7, 8] and PCV13 [43]. In scenario analyses, indirect effects for pneumonia were included.

Economic Inputs

Due to a lack of local data reflecting direct medical costs, separate meetings in Algeria (3 June 2013) and Tunisia (21 June 2013) gathered local experts (in total, 25 pediatricians, microbiologists, and epidemiologists) to provide estimates in the local currency [Algeria (DZD) and Tunisia (TND)]. Costs were inflated to reflect 2016 values based on estimates from the World Bank [44] and for consistency were converted to USD based on exchange rates of 109.4 DZD:USD and 2.15 TND:USD as of April 2017.
Direct medical costs are those considered to treat cases of disease directly and for the costs for vaccine administration. Hospitalization costs for pneumococcal meningitis, pneumococcal sepsis/bacteremia, and pneumonia were based on hospital stay durations of 15, 6, and 5 days, respectively. Outpatient pneumonia costs included a physician consultation, chest X-ray, antibiotic(s), anti-inflammatory agent(s), and laboratory test(s) (Table 1). Otitis media costs included a physician consultation, antibiotic(s), and an anti-inflammatory agent (acetaminophen). Three doses per vaccinated child (2 + 1 schedule) and vaccination uptake of 95% and 98% of the birth cohort for Algeria and Tunisia, respectively, were assumed. Vaccination consisted of an administration fee per dose of USD 0.92 in Algeria and USD 2.48 in Tunisia and assumed vaccine prices per dose for PCV10 and PCV13 in both Algeria and Tunisia of USD 15.70. Additional scenario analyses were tested assuming a price per dose of either 14.13 or 12.56 for PCV10 in both Algeria and Tunisia.
In this analysis, a utility of 1.0 represented perfect health while 0.0 represented death. In the current analysis, utility weights were applied to life-years to estimate QALYs for individuals experiencing sequelae due to pneumococcal disease. Utility weights for meningitis sequelae of 0.60 for neurologic impairment and 0.80 for hearing loss (Table 1) [45] were applied for the remainder of the life expectancy.

Compliance with Ethics Guidelines

This article is based on previously conducted studies and does not contain any studies with human participants or animals performed by any of the authors.

Model Calculations

Calculated costs and outcomes for a vaccination strategy with PCV10 or PCV13 included the number of disease cases and deaths avoided, of QALYs gained, and of total costs from a payer perspective. Costs and outcomes for each PCV, versus no vaccination, were estimated. In accordance with the WHO-CHOICE [24], PCVs were considered to be cost-effective if they averted 1 quality adjusted life-year for < 3 times per capita gross domestic product (GDP) and to be highly cost-effective at < 1 time the GDP. The base case scenario assumed direct effects for each PCV against IPD, AOM, and pneumonia but indirect effects against IPD for PCV13 only.

Scenario Analysis

Additional scenario analyses were undertaken where both PCVs provide indirect protection for IPD and pneumonia, or solely with direct protection. In addition, scenario analyses varying mortality and utility rates by 20% and removing discounting (0%) were conducted.

Results

Tables 2 and 3 depict the health outcomes and costs of implementing a universal PCV vaccination program in Algeria and Tunisia under the base case scenario and under the varying sensitivity scenarios.
In Algeria, compared with no vaccination, implementing a PCV13 vaccination program would avoid 7608 cases of IPD, 57,800 cases of pneumonia, and 283,588 cases of AOM and save 2177 lives from pneumococcal diseases per year (Table 2). Each year, PCV13 is expected to offset $25.7 M of medical costs in Algeria and $2.24 M in Tunisia, respectively. Under the assumption of a 2 + 1 vaccination schedule, PCV13 would be highly cost effective at (USD) an incremental cost-effectiveness ratio (ICER) of $308 per QALY (< 1 × per capita GDP) from the payer perspective. Running a similar analysis for PCV10 versus no vaccination, 1224 deaths and 270,483 total cases of IPD, pneumonia, and acute otitis media would be avoided, and PCV10 would be highly cost-effective at $731/QALY (< 1 × per capita GDP) from the payer perspective. Each year, PCV10 is expected to offset $17.6 M of medical costs in Algeria and $1.8 M in Tunisia, respectively In scenarios assuming a price of 14.13 and 12.56 for PCV10, the cost per QALY was $616/QALY and $500/QALY, respectively.
In Tunisia, a PCV13 vaccination program would reduce the impact of pneumococcal disease by 1305 cases of IPD, 4833 cases of pneumonia, and 54,957 cases of AOM, and PCV13 would save 308 lives compared with the absence of a program at a highly cost-effective ICER of $848/QALY (< 1 × per capita GDP) (Table 2). In Tunisia, a PCV10 program would prevent 172 deaths and over 56,610 total cases of IPD, pneumonia, and acute otitis media, and it would be highly cost-effective at $1366/QALY (< 1 × per capita GDP). In scenarios assuming prices for PCV10 of 14.13 or 12.56, the cost per QALY was $1405/QALY and $1205/QALY, respectively.
Table 3 indicates the cost-effectiveness of PCV10 and PCV13 under varying assumptions for the impact of indirect effects. A PCV13 vaccination program remained highly cost-effective, even under the most restrictive assumption that there were no indirect effects, in Algeria at $475 per QALY (< 1 × per capita GDP) and Tunisia at $1239/QALY (< 1 × per capita GDP). For PCV10, the cost under the assumption that PCV10 conferred no indirect protection was $731/QALY in Algeria and $1366/QALY in Tunisia compared with no vaccination. By assuming that there was indirect protection for IPD and pneumonia, the cost per QALY decreased from the base case scenario to $198/QALY in Algeria and to $650/QALY in Tunisia. PCV13 versus no vaccination is expected to be more cost-effective compared with PCV10 versus no vaccination in all scenarios. All results remained cost-effective (< 1 × GDP per capita GDP) after varying mortality and utility rates and under a 0% discount rate.

Discussion

We used a well-established decision-analytic model to assess the cost-effectiveness in Algeria and Tunisia of a PCV13 pediatric immunization program compared with no vaccination and ran a similar analysis for PCV10. Compared with no vaccination, both PCV10 and PCV13 are cost-effective strategies in both Algeria and Tunisia. PCV13 prevents 348,997 total cases of disease in Algeria and 61,095 in Tunisia, and PCV10 prevents 270,483 and 56,610 total cases, respectively. A PCV13 program is expected to generate $25.79 M and $2.24 M in direct medical cost-savings in Algeria and Tunisia, respectively, offsetting a significant portion of the cost of vaccination. PCV10 can generate $17.6 M and $1.8 M in direct medical savings in Algeria and Tunisia, respectively.
Pharmacoeconomic analyses provide decision-makers with a holistic assessment of cost and benefits of vaccination programs and can be used as a tool to inform for future NIPs. This decision-analytic model has been applied in many settings [2730] and provides a robust estimate of cost-effectiveness for the current situations in both Algeria and in Tunisia under varying scenarios that represent potential uncertainties. Epidemiologic inputs used in the model were informed by country-level estimates from the literature.
Our findings are supported by economic evidence of the continued cost-effectiveness of pneumococcal vaccination with PCV13 around the world. For instance, a cost-effectiveness study in Tunisia reported PCV13 to be a highly cost-effective strategy compared with no vaccination [26]. In addition, a study on the cost-effectiveness of PCVs across 35 pooled lower-middle-income countries, inclusive of both Tunisia and Algeria, reported both PCV10 and PCV13 as cost-effective compared with no vaccine, though a PCV13 program would reduce the most disease and associated costs [25]. In Spain, PCV13 implemented as a 2 + 1 schedule was found to be a cost-effective intervention from the payer perspective, compared with no vaccination [46]. Similar results were reported for Portugal when comparing PCV13 to no vaccination [47]. Our results suggest both PCV10 and PCV13 are cost-effective. Due to the broader serotype coverage of PCV13, numerous European countries have implemented a PCV13 program to prevent the most morbidity and mortality due to S. pneumoniae [27, 28, 30, 48]. In part due to the cost-effectiveness of PCVs, Algeria implemented a PCV13 NIP in April 2016, and our findings suggest Tunisia would benefit from a similar program.
Several limitations must be acknowledged in interpreting these results. First, due to a lack of publicly available cost data, all direct costs were derived from local experts, utilizing a conservative view, potentially biasing our results to underestimate the value of an NIP [26]. Yet, because costs were equally applied to both PCV10 and PCV13 vaccination, the bias would likely be non-differential between the two vaccines. Second, the model extrapolated the indirect protection that has been observed for PCV7 to PCV13 (as a base case). Numerous real-world studies have demonstrated a reduction in IPD among adults after implementing a national PCV13 infant immunization program, supporting the relevant impact of indirect effects [9, 4951]. In a scenario analysis, indirect protection was assumed for PCV10. Nonetheless, even in a no indirect protection scenario analysis, each vaccine remained cost-effective in both Algeria and Tunisia. In the absence of country-specific epidemiologic data, global or regional disease estimates are an accepted method to inform gaps. However, future studies should aim to address these limitations by obtaining country-specific estimates for all disease states, as opposed to applying global or regional data, which may under- or overestimate the true disease incidence. In addition, the validity of these findings may be confirmed in future studies by assessing the impact of the implemented PCV program in Algeria.

Conclusion

A national program of pneumococcal vaccination can have a tremendous public health impact by preventing pneumococcal disease morbidity and mortality in Algeria and Tunisia. PCV13 has the highest coverage of local disease-causing pneumococcal serotypes and can offer significant prevention of disease through indirect protection, resulting in a highly cost-effective prevention program. This can lead to substantial health benefits and cost savings in North African societies.

Acknowledgements

We thank Jan Zigmond, Ales Tichopad, and Ladislav Pecen for their contributions to the manuscript.

Funding

This study and associated publication charges were funded by Pfizer. All authors had full access to all of the data in this study and take complete responsibility for the integrity of the data and accuracy of the data analysis.

Authorship

All named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this article, take responsibility for the integrity of the work as a whole, and have given their approval for this version to be published.

Disclosures

Sarah J. Pugh is an employee of Pfizer. Mark A. Fletcher is an employee of Pfizer. Apostolos Charos is an employee of Pfizer. Lynda Imekraz is an employee of Pfizer. Matt Wasserman is an employee of Pfizer. Raymond Farkouh is an employee of Pfizer.

Compliance with Ethics Guidelines

This article is based on previously conducted studies and does not contain any studies with human participants or animals performed by any of the authors.

Data Availability

The data sets during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Open Access

This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://​creativecommons.​org/​licenses/​by-nc/​4.​0/​), which permits any noncommercial use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Anhänge

Electronic supplementary material

Below is the link to the electronic supplementary material.
Literatur
1.
Zurück zum Zitat Advisory Committee on Immunization Practices, Preventing pneumococcal disease among infants and young children. Recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep. 2000;49(RR-9):1–35. Advisory Committee on Immunization Practices, Preventing pneumococcal disease among infants and young children. Recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep. 2000;49(RR-9):1–35.
2.
Zurück zum Zitat Grijalva CG, et al. National impact of universal childhood immunization with pneumococcal conjugate vaccine on outpatient medical care visits in the United States. Pediatrics. 2006;118(3):865–73.CrossRef Grijalva CG, et al. National impact of universal childhood immunization with pneumococcal conjugate vaccine on outpatient medical care visits in the United States. Pediatrics. 2006;118(3):865–73.CrossRef
3.
Zurück zum Zitat Zhou F, et al. Health care utilization for pneumonia in young children after routine pneumococcal conjugate vaccine use in the United States. Arch Pediatr Adolesc Med. 2007;161(12):1162–8.CrossRef Zhou F, et al. Health care utilization for pneumonia in young children after routine pneumococcal conjugate vaccine use in the United States. Arch Pediatr Adolesc Med. 2007;161(12):1162–8.CrossRef
4.
Zurück zum Zitat Grijalva CG, et al. Decline in pneumonia admissions after routine childhood immunisation with pneumococcal conjugate vaccine in the USA: a time-series analysis. Lancet. 2007;369(9568):1179–86.CrossRef Grijalva CG, et al. Decline in pneumonia admissions after routine childhood immunisation with pneumococcal conjugate vaccine in the USA: a time-series analysis. Lancet. 2007;369(9568):1179–86.CrossRef
5.
Zurück zum Zitat Prymula R, et al. Pneumococcal capsular polysaccharides conjugated to protein D for prevention of acute otitis media caused by both Streptococcus pneumoniae and non-typable Haemophilus influenzae: a randomised double-blind efficacy study. Lancet. 2006;367(9512):740–8.CrossRef Prymula R, et al. Pneumococcal capsular polysaccharides conjugated to protein D for prevention of acute otitis media caused by both Streptococcus pneumoniae and non-typable Haemophilus influenzae: a randomised double-blind efficacy study. Lancet. 2006;367(9512):740–8.CrossRef
6.
Zurück zum Zitat Hausdorff WP, Feikin DR, Klugman KP. Epidemiological differences among pneumococcal serotypes. Lancet Infect Dis. 2005;5(2):83–93.CrossRef Hausdorff WP, Feikin DR, Klugman KP. Epidemiological differences among pneumococcal serotypes. Lancet Infect Dis. 2005;5(2):83–93.CrossRef
9.
Zurück zum Zitat Moore MR, et al. Effect of use of 13-valent pneumococcal conjugate vaccine in children on invasive pneumococcal disease in children and adults in the USA: analysis of multisite, population-based surveillance. Lancet Infect Dis. 2015;15(3):301–9.CrossRef Moore MR, et al. Effect of use of 13-valent pneumococcal conjugate vaccine in children on invasive pneumococcal disease in children and adults in the USA: analysis of multisite, population-based surveillance. Lancet Infect Dis. 2015;15(3):301–9.CrossRef
10.
Zurück zum Zitat Lepoutre A, et al. Impact of the pneumococcal conjugate vaccines on invasive pneumococcal disease in France, 2001–2012. Vaccine. 2015;33(2):359–66.CrossRef Lepoutre A, et al. Impact of the pneumococcal conjugate vaccines on invasive pneumococcal disease in France, 2001–2012. Vaccine. 2015;33(2):359–66.CrossRef
11.
Zurück zum Zitat Steens A, et al. Prompt effect of replacing the 7-valent pneumococcal conjugate vaccine with the 13-valent vaccine on the epidemiology of invasive pneumococcal disease in Norway. Vaccine. 2013;31(52):6232–8.CrossRef Steens A, et al. Prompt effect of replacing the 7-valent pneumococcal conjugate vaccine with the 13-valent vaccine on the epidemiology of invasive pneumococcal disease in Norway. Vaccine. 2013;31(52):6232–8.CrossRef
12.
Zurück zum Zitat Ben-Shimol S, et al. Early impact of sequential introduction of 7-valent and 13-valent pneumococcal conjugate vaccine on IPD in Israeli children < 5 years: an active prospective nationwide surveillance. Vaccine. 2014;32(27):3452–9.CrossRef Ben-Shimol S, et al. Early impact of sequential introduction of 7-valent and 13-valent pneumococcal conjugate vaccine on IPD in Israeli children < 5 years: an active prospective nationwide surveillance. Vaccine. 2014;32(27):3452–9.CrossRef
13.
Zurück zum Zitat Rudan I, et al. Global estimate of the incidence of clinical pneumonia among children under five years of age. Bull World Health Organ. 2004;82(12):895–903.PubMed Rudan I, et al. Global estimate of the incidence of clinical pneumonia among children under five years of age. Bull World Health Organ. 2004;82(12):895–903.PubMed
14.
Zurück zum Zitat Rudan I, et al. Epidemiology and etiology of childhood pneumonia. Bull World Health Organ. 2008;86(5):408–16.CrossRef Rudan I, et al. Epidemiology and etiology of childhood pneumonia. Bull World Health Organ. 2008;86(5):408–16.CrossRef
15.
Zurück zum Zitat Liu L, et al. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012;379(9832):2151–61.CrossRef Liu L, et al. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012;379(9832):2151–61.CrossRef
16.
Zurück zum Zitat Ramdani-Bouguessa N, et al. Evolution of antimicrobial resistance and serotype distribution of Streptococcus pneumoniae isolated from children with invasive and noninvasive pneumococcal diseases in Algeria from 2005 to 2012. New Microb New Infect. 2015;6:42–8.CrossRef Ramdani-Bouguessa N, et al. Evolution of antimicrobial resistance and serotype distribution of Streptococcus pneumoniae isolated from children with invasive and noninvasive pneumococcal diseases in Algeria from 2005 to 2012. New Microb New Infect. 2015;6:42–8.CrossRef
17.
Zurück zum Zitat Ziane H, et al. Serotypes and antibiotic susceptibility of Streptococcus pneumoniae isolates from invasive pneumococcal disease and asymptomatic carriage in a pre-vaccination period, in Algeria. Front Microbiol. 2016;7:803.CrossRef Ziane H, et al. Serotypes and antibiotic susceptibility of Streptococcus pneumoniae isolates from invasive pneumococcal disease and asymptomatic carriage in a pre-vaccination period, in Algeria. Front Microbiol. 2016;7:803.CrossRef
18.
Zurück zum Zitat Tali-Maamar H, et al. Serotyping and antibiotic susceptibility of Streptococcus pneumoniae strains isolated in Algeria from 2001 to 2010. Med Mal Infect. 2012;42(2):59–65.CrossRef Tali-Maamar H, et al. Serotyping and antibiotic susceptibility of Streptococcus pneumoniae strains isolated in Algeria from 2001 to 2010. Med Mal Infect. 2012;42(2):59–65.CrossRef
19.
Zurück zum Zitat Marzouk M, et al. Serotype distribution and antimicrobial resistance of invasive and noninvasive pneumococcal isolates in Tunisia. Microb Drug Resist. 2015;21(1):85–9.CrossRef Marzouk M, et al. Serotype distribution and antimicrobial resistance of invasive and noninvasive pneumococcal isolates in Tunisia. Microb Drug Resist. 2015;21(1):85–9.CrossRef
20.
Zurück zum Zitat Charfi F, Smaoui H, Kechrid A. Non-susceptibility trends and serotype coverage by conjugate pneumococcal vaccines in a Tunisian paediatric population: a 10-year study. Vaccine. 2012;30(Suppl 6):G18–24.CrossRef Charfi F, Smaoui H, Kechrid A. Non-susceptibility trends and serotype coverage by conjugate pneumococcal vaccines in a Tunisian paediatric population: a 10-year study. Vaccine. 2012;30(Suppl 6):G18–24.CrossRef
21.
Zurück zum Zitat Ktari S, et al. Serotype distribution and antibiotic susceptibility of Streptococcus pneumoniae strains in the south of Tunisia: a five-year study (2012–2016) of pediatric and adult populations. Int J Infect Dis. 2017;65:110–5.CrossRef Ktari S, et al. Serotype distribution and antibiotic susceptibility of Streptococcus pneumoniae strains in the south of Tunisia: a five-year study (2012–2016) of pediatric and adult populations. Int J Infect Dis. 2017;65:110–5.CrossRef
22.
Zurück zum Zitat Elmdaghri N, et al. Changing epidemiology of pediatric Streptococcus pneumoniae isolates before vaccine introduction in Casablanca (Morocco). Vaccine. 2012;30(Suppl 6):G46–50.CrossRef Elmdaghri N, et al. Changing epidemiology of pediatric Streptococcus pneumoniae isolates before vaccine introduction in Casablanca (Morocco). Vaccine. 2012;30(Suppl 6):G46–50.CrossRef
23.
Zurück zum Zitat Diawara I, et al. Invasive pneumococcal disease among children younger than 5 years of age before and after introduction of pneumococcal conjugate vaccine in Casablanca, Morocco. Int J Infect Dis. 2015;40:95–101.CrossRef Diawara I, et al. Invasive pneumococcal disease among children younger than 5 years of age before and after introduction of pneumococcal conjugate vaccine in Casablanca, Morocco. Int J Infect Dis. 2015;40:95–101.CrossRef
24.
Zurück zum Zitat Macroeconomics and health. investing in health for economic development. Report of the Commission on Macroeconomics and Health. Geneva: World Health Organization; 2001. Macroeconomics and health. investing in health for economic development. Report of the Commission on Macroeconomics and Health. Geneva: World Health Organization; 2001.
25.
Zurück zum Zitat Nakamura MM, et al. Cost effectiveness of child pneumococcal conjugate vaccination in middle-income countries. Int Health. 2011;3(4):270–81.CrossRef Nakamura MM, et al. Cost effectiveness of child pneumococcal conjugate vaccination in middle-income countries. Int Health. 2011;3(4):270–81.CrossRef
26.
Zurück zum Zitat Zigmond JPL, Tichopad A, Roberts CS., Jomaa I. Modeled outcomes and overall costs of the 13-valent pneumococcal conjugate vaccine in the Tunisia vacciantion program. In: ISPOR 17th Annual European Congress. 2014: Amsterdam, The Netherlands. Zigmond JPL, Tichopad A, Roberts CS., Jomaa I. Modeled outcomes and overall costs of the 13-valent pneumococcal conjugate vaccine in the Tunisia vacciantion program. In: ISPOR 17th Annual European Congress. 2014: Amsterdam, The Netherlands.
27.
Zurück zum Zitat Earnshaw SR, et al. Cost-effectiveness of 2 + 1 dosing of 13-valent and 10-valent pneumococcal conjugate vaccines in Canada. BMC Infect Dis. 2012;12:101.CrossRef Earnshaw SR, et al. Cost-effectiveness of 2 + 1 dosing of 13-valent and 10-valent pneumococcal conjugate vaccines in Canada. BMC Infect Dis. 2012;12:101.CrossRef
28.
Zurück zum Zitat Klok RM, et al. Cost-effectiveness of a 10- versus 13-valent pneumococcal conjugate vaccine in Denmark and Sweden. Clin Ther. 2013;35(2):119–34.CrossRef Klok RM, et al. Cost-effectiveness of a 10- versus 13-valent pneumococcal conjugate vaccine in Denmark and Sweden. Clin Ther. 2013;35(2):119–34.CrossRef
29.
Zurück zum Zitat Mucino-Ortega E, et al. Economic evaluation of an infant immunization program in Mexico, based on 13-valent pneumococcal conjugated vaccines. Value Health. 2010;14(5 Suppl 1):S65–70. Mucino-Ortega E, et al. Economic evaluation of an infant immunization program in Mexico, based on 13-valent pneumococcal conjugated vaccines. Value Health. 2010;14(5 Suppl 1):S65–70.
30.
Zurück zum Zitat Strutton DR, et al. Cost-effectiveness of 13-valent pneumococcal conjugate vaccine: Germany, Greece, and The Netherlands. J Infect. 2012;64(1):54–67.CrossRef Strutton DR, et al. Cost-effectiveness of 13-valent pneumococcal conjugate vaccine: Germany, Greece, and The Netherlands. J Infect. 2012;64(1):54–67.CrossRef
33.
Zurück zum Zitat O’Brien KL, et al. Burden of disease caused by Streptococcus pneumoniae in children younger than 5 years: global estimates. Lancet. 2009;374(9693):893–902.CrossRef O’Brien KL, et al. Burden of disease caused by Streptococcus pneumoniae in children younger than 5 years: global estimates. Lancet. 2009;374(9693):893–902.CrossRef
34.
Zurück zum Zitat Teele DW, Klein JO, Rosner B. Epidemiology of otitis media during the first seven years of life in children in greater Boston: a prospective, cohort study. J Infect Dis. 1989;160(1):83–94.CrossRef Teele DW, Klein JO, Rosner B. Epidemiology of otitis media during the first seven years of life in children in greater Boston: a prospective, cohort study. J Infect Dis. 1989;160(1):83–94.CrossRef
35.
Zurück zum Zitat Ray GT, et al. Cost-effectiveness of pneumococcal conjugate vaccine: evidence from the first 5 years of use in the United States incorporating herd effects. Pediatr Infect Dis J. 2006;25(6):494–501.CrossRef Ray GT, et al. Cost-effectiveness of pneumococcal conjugate vaccine: evidence from the first 5 years of use in the United States incorporating herd effects. Pediatr Infect Dis J. 2006;25(6):494–501.CrossRef
36.
Zurück zum Zitat Black SB, et al. Effectiveness of heptavalent pneumococcal conjugate vaccine in children younger than five years of age for prevention of pneumonia. Pediatr Infect Dis J. 2002;21(9):810–5.CrossRef Black SB, et al. Effectiveness of heptavalent pneumococcal conjugate vaccine in children younger than five years of age for prevention of pneumonia. Pediatr Infect Dis J. 2002;21(9):810–5.CrossRef
37.
Zurück zum Zitat Fireman B, et al. Impact of the pneumococcal conjugate vaccine on otitis media. Pediatr Infect Dis J. 2003;22(1):10–6.CrossRef Fireman B, et al. Impact of the pneumococcal conjugate vaccine on otitis media. Pediatr Infect Dis J. 2003;22(1):10–6.CrossRef
38.
Zurück zum Zitat Griffin MR, et al. Declines in pneumonia hospitalizations of children aged < 2 years associated with the use of pneumococcal conjugate vaccines—Tennessee, 1998–2012. MMWR Morb Mortal Wkly Rep. 2014;63(44):995–8.PubMedPubMedCentral Griffin MR, et al. Declines in pneumonia hospitalizations of children aged < 2 years associated with the use of pneumococcal conjugate vaccines—Tennessee, 1998–2012. MMWR Morb Mortal Wkly Rep. 2014;63(44):995–8.PubMedPubMedCentral
39.
Zurück zum Zitat Greenberg D, et al. Impact of PCV7/PCV13 introduction on community-acquired alveolar pneumonia in children < 5 years. Vaccine. 2015;33(36):4623–9.CrossRef Greenberg D, et al. Impact of PCV7/PCV13 introduction on community-acquired alveolar pneumonia in children < 5 years. Vaccine. 2015;33(36):4623–9.CrossRef
40.
Zurück zum Zitat Griffin MR, et al. US hospitalizations for pneumonia after a decade of pneumococcal vaccination. N Engl J Med. 2013;369(2):155–63.CrossRef Griffin MR, et al. US hospitalizations for pneumonia after a decade of pneumococcal vaccination. N Engl J Med. 2013;369(2):155–63.CrossRef
41.
Zurück zum Zitat Pilishvili T, et al. Sustained reductions in invasive pneumococcal disease in the era of conjugate vaccine. J Infect Dis. 2010;201(1):32–41.CrossRef Pilishvili T, et al. Sustained reductions in invasive pneumococcal disease in the era of conjugate vaccine. J Infect Dis. 2010;201(1):32–41.CrossRef
42.
Zurück zum Zitat Zhou F, et al. Trends in acute otitis media-related health care utilization by privately insured young children in the United States, 1997–2004. Pediatrics. 2008;121(2):253–60.CrossRef Zhou F, et al. Trends in acute otitis media-related health care utilization by privately insured young children in the United States, 1997–2004. Pediatrics. 2008;121(2):253–60.CrossRef
43.
Zurück zum Zitat Guevara M, et al. Direct, indirect and total effects of 13-valent pneumococcal conjugate vaccination on invasive pneumococcal disease in children in Navarra, Spain, 2001 to 2014: cohort and case-control study. Euro Surveill. 2016;21(14):30186.CrossRef Guevara M, et al. Direct, indirect and total effects of 13-valent pneumococcal conjugate vaccination on invasive pneumococcal disease in children in Navarra, Spain, 2001 to 2014: cohort and case-control study. Euro Surveill. 2016;21(14):30186.CrossRef
45.
Zurück zum Zitat Morrow A, et al. The burden of pneumococcal disease in the Canadian population before routine use of the seven-valent pneumococcal conjugate vaccine. Can J Infect Dis Med Microbiol. 2007;18(2):121–7.CrossRef Morrow A, et al. The burden of pneumococcal disease in the Canadian population before routine use of the seven-valent pneumococcal conjugate vaccine. Can J Infect Dis Med Microbiol. 2007;18(2):121–7.CrossRef
46.
Zurück zum Zitat Diez-Domingo J, et al. Pharmacoeconomic assessment of implementing a universal PCV-13 vaccination programme in the Valencian public health system (Spain). Vaccine. 2011;29(52):9640–8.CrossRef Diez-Domingo J, et al. Pharmacoeconomic assessment of implementing a universal PCV-13 vaccination programme in the Valencian public health system (Spain). Vaccine. 2011;29(52):9640–8.CrossRef
47.
Zurück zum Zitat Gouveia EL, Reis JN, Flannery B. Clinical outcome of pneumococcal meningitis during the emergence of pencillin-resistant Streptococcus pneumoniae: an observational study. BMC Infect Dis. 2011;11:323.CrossRef Gouveia EL, Reis JN, Flannery B. Clinical outcome of pneumococcal meningitis during the emergence of pencillin-resistant Streptococcus pneumoniae: an observational study. BMC Infect Dis. 2011;11:323.CrossRef
48.
Zurück zum Zitat Ordonez JE, Orozco JJ. Cost-effectiveness analysis of the available pneumococcal conjugated vaccines for children under five years in Colombia. Cost Eff Resour Alloc. 2015;13:6.CrossRef Ordonez JE, Orozco JJ. Cost-effectiveness analysis of the available pneumococcal conjugated vaccines for children under five years in Colombia. Cost Eff Resour Alloc. 2015;13:6.CrossRef
49.
Zurück zum Zitat Waight PA, et al. Effect of the 13-valent pneumococcal conjugate vaccine on invasive pneumococcal disease in England and Wales 4 years after its introduction: an observational cohort study. Lancet Infect Dis. 2015;15(5):535–43.CrossRef Waight PA, et al. Effect of the 13-valent pneumococcal conjugate vaccine on invasive pneumococcal disease in England and Wales 4 years after its introduction: an observational cohort study. Lancet Infect Dis. 2015;15(5):535–43.CrossRef
50.
Zurück zum Zitat Harboe ZB, et al. Impact of 13-valent pneumococcal conjugate vaccination in invasive pneumococcal disease incidence and mortality. Clin Infect Dis. 2014;59(8):1066–73.CrossRef Harboe ZB, et al. Impact of 13-valent pneumococcal conjugate vaccination in invasive pneumococcal disease incidence and mortality. Clin Infect Dis. 2014;59(8):1066–73.CrossRef
51.
Zurück zum Zitat Elam-Evans LD, et al. National, state, and selected local area vaccination coverage among children aged 19–35 months—United States, 2013. MMWR Morb Mortal Wkly Rep. 2014;63(34):741–8.PubMedPubMedCentral Elam-Evans LD, et al. National, state, and selected local area vaccination coverage among children aged 19–35 months—United States, 2013. MMWR Morb Mortal Wkly Rep. 2014;63(34):741–8.PubMedPubMedCentral
Metadaten
Titel
Cost-Effectiveness of the Pneumococcal Conjugate Vaccine (10- or 13-Valent) Versus No Vaccination for a National Immunization Program in Tunisia or Algeria
verfasst von
Sarah J. Pugh
Mark A. Fletcher
Apostolos Charos
Lynda Imekraz
Matt Wasserman
Raymond Farkouh
Publikationsdatum
11.12.2018
Verlag
Springer Healthcare
Erschienen in
Infectious Diseases and Therapy / Ausgabe 1/2019
Print ISSN: 2193-8229
Elektronische ISSN: 2193-6382
DOI
https://doi.org/10.1007/s40121-018-0226-x

Weitere Artikel der Ausgabe 1/2019

Infectious Diseases and Therapy 1/2019 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.