Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Incidence of anogenital warts after the introduction of the quadrivalent HPV vaccine program in Manitoba, Canada

  • Christiaan H. Righolt,

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Software, Visualization, Writing – original draft

    Affiliations Vaccine and Drug Evaluation Centre, Department of Community Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada, Children’s Hospital Research Institute of Manitoba, Winnipeg, Manitoba, Canada

  • Karla Willows,

    Roles Conceptualization, Data curation, Writing – review & editing

    Affiliation Vaccine and Drug Evaluation Centre, Department of Community Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada

  • Erich V. Kliewer,

    Roles Conceptualization, Funding acquisition, Writing – review & editing

    Affiliations Vaccine and Drug Evaluation Centre, Department of Community Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada, Cancer Control Research, British Columbia Cancer Agency, Vancouver, British Columbia, Canada

  • Salaheddin M. Mahmud

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing

    Salah.Mahmud@gmail.com

    Affiliation Vaccine and Drug Evaluation Centre, Department of Community Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada

Abstract

Background

The incidence of anogenital warts (AGW) decreased after the introduction of the quadrivalent human papillomavirus (qHPV) vaccine in multiple jurisdictions. We studied how comparing AGW incidence rates with different outcomes affects the interpretation of the qHPV vaccination program. To do this, we replicated multiple study designs within a single jurisdiction (Manitoba).

Methods

We measured the incidence rates of AGW, AGW-related prescriptions, chlamydia, and gonorrhea (the latter two as sham outcomes) between 2001 and 2017 using several clinical and administrative health databases from Manitoba. We then used incidence rate ratios (IRRs) to compare, for each outcome, the rate for the 1997–1998 birth cohort (the first cohorts eligible for the publicly funded qHPV vaccination program) and the older 1995–1996 birth cohort.

Results

AGW incidence in Manitoba dropped 72% (95% confidence interval 54–83%) among 16–18 year-old girls and 51% (14–72%) among boys after the introduction of the female-only qHPV vaccination program. Trends in AGW-related prescriptions were different from trends in AGW diagnoses as these prescriptions peaked shortly after the introduction of the publicly funded qHPV vaccine program. Chlamydia and gonorrhea incidence rates also decreased 12% (5–18%) and 16% (-1-30%), respectively, for 16–18 year-old girls.

Conclusions

The publicly funded school-based qHPV vaccine program reduced AGW incidence in Manitoba by three-quarters in young females. AGW-related prescriptions are a poor proxy for medically attended AGW after the introduction of the publicly funded qHPV vaccination program. Different sexual habits in adolescents are, at most, responsible for a small portion of the reduction in AGW incidence.

Introduction

Anogenital warts (AGW) are caused by the human papillomavirus (HPV), 90% of which are caused by HPV subtypes 6 and 11 [1]. The quadrivalent HPV (qHPV) vaccine targets HPV subtypes 6 and 11, as well as 16 and 18, which cause 70% of cervical cancers [2]. In the Canadian province of Manitoba, the qHPV vaccine was introduced in September 2008 for girls as a publicly funded, three-dose, grade 6, school-based vaccination program (school grade is based on birth year in Manitoba, grade 6 children are typically 11–12 years old). The first grade 6 cohort vaccinated through this vaccination program was the 1997 birth cohort. A publicly funded, high-risk catch-up program existed between 2012 and 2014 for 19–26 year-old females who were deemed, by their health care provider, to have an increased risk of HPV infection. The routine school-based program was changed to a two-dose schedule in 2015, starting with the 2004 birth cohort. School-based male qHPV vaccination was introduced in 2016 for the 2005 birth cohort, alongside a catch-up program for the 2002–2004 birth cohorts. The program switched from using qHPV vaccine to using nonavalent HPV vaccine in June 2018.

AGW incidence rates at the population level before and after the introduction of the qHPV vaccine have been reported in numerous studies and several meta-analyses [35]. The literature is, however, highly heterogeneous, both in terms of the source data and AGW ascertainment. Study results cannot be directly compared when methods are different. Some studies examine the whole population of a country or region [6, 7], some studies examine clients of a specific health insurer [8], and others are limited to patients of a specific clinic [9, 10]. The AGW case definition in these studies is variable, ranging from using specific AGW diagnosis codes [7, 8], prescriptions for AGW medications [11], both diagnosis codes or prescriptions [6, 12], clinical diagnosis [9, 10], to patient’s self-assessment [13]. In addition, patterns of sexual behavior may have changed around the introduction of qHPV programs, but these changes, or changes in other sexually transmitted infections (STIs), are often not examined at the population level. Physician awareness and attitudes toward AGW and its treatment may have changed as well around the introduction of population-wide qHPV vaccination programs. All these factors may have affected the reported declines in AGW, but publication of trends in incidence rates in different jurisdictions does now allow for an evaluation of these non-vaccine factors.

We aimed to study how comparing AGW incidence rates with different outcomes affects the interpretation of the qHPV vaccination program. To do this, we studied multiple outcomes in a single jurisdiction (Manitoba). We examined changes in the incidence rate while varying the way AGW is measured (diagnostic codes versus dispensed prescriptions) and by comparing these results to chlamydia and gonorrhea incidence rates (as sham outcomes not prevented by HPV vaccination).

Methods

Data sources

Manitoba Health (MH) is the publicly funded health insurance agency providing comprehensive health insurance, including coverage for hospital and outpatient physician services, to the province’s 1.3 million residents. Coverage is universal with no eligibility distinction based on age or income, and participation rates are very high (>99%) [14]. Insured services include hospital, physician and preventive services, and vaccinations. MH maintains several centralized, administrative electronic databases that are linkable using a unique personal health identification number (PHIN). The completeness and accuracy of MH administrative databases are well established [15, 16], and these databases have been used extensively in studies of disease surveillance and post-marketing evaluation of various vaccines and drugs [1719].

The MH Population Registry (MHPR) tracks addresses and dates of birth, insurance coverage and death for all insured persons. Since 1971, the Hospital Abstracts database (HAD) recorded virtually all services provided by hospitals in the province, including admissions and day surgeries [15]. The data collected comprise demographic as well as diagnosis and treatment information, including primary diagnosis and service or procedure codes, coded using the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) before April, 2004, and the ICD-10-CA (Canadian adaptation of the ICD-10) and the Canadian Classification of Health Interventions (CCI) afterwards.

The Medical Services Database (MSD), also in operation since 1971, collects similar information, based on physician fee-for-service or shadow billing, on services provided by physicians in offices, hospitals and outpatient departments across the province. The Drug Program Information Network (DPIN), in operation since 1995, records all prescription drugs dispensed to Manitoba residents, including most personal care home residents [20]. The DPIN database captures data from pharmacy claims for formulary drugs dispensed to all Manitobans even those without prescription drug insurance. Because information is submitted electronically at the “point-of-sale”, the accuracy of the recorded prescription information is excellent [20]. The Communicable Disease Surveillance Database (CDS) records all cases of notifiable diseases reported by clinicians and laboratories to MH since 1992. Under the Manitoba Public Health Act, clinicians must report all cases of chlamydia and gonorrhea, while clinical laboratories must also report the results of any laboratory tests positive for Chlamydia trachomatis or Neisseria gonorrhoeae. The CDS database stores information on laboratory specimen type, collection date, and test results.

Eligibility and incidence

All persons registered with MH at any point between January 1, 2001 to December 31, 2017 (the study period) were eligible for inclusion in this study regardless of age or gender.

We used two definitions for AGW, one based on diagnostic and procedure codes (we refer to this as AGW) and one based on prescription data (AGW-related prescriptions), to examine the potential difference in trends between both methods. We identified incident AGW episodes of care using previously described algorithms [21]. Briefly, AGW episodes of care started with a tariff code specific to condyloma in the MSD (S1 Table) or a combination of specific diagnostic and procedure codes in the HAD (S2S4 Tables). An episode of care ended when no AGW code (S1S5 Tables) was identified for 12 months. We identified incident AGW-related prescription episodes from the DPIN as prescriptions for podofolix (Anatomical Therapeutic Chemical Classification System code D06BB04), imiquimod (D06BB10) or sinecatechins (D06BB12). Prescription episodes started at this first dispense date and ended when no AGW-related drugs were dispensed for a 12-month period. We used the start of each episode of care as the incidence date.

We identified incident chlamydia and gonorrhea from the CDS as reported cases at least 35 days after a previous positive test for the same STI (to allow comparison with other reported rates in Manitoba [22]).

Statistical analysis

We calculated age-standardized and age-stratified incidence rates and 95% confidence intervals (CIs) using the end-of-year MHPR as the denominator (because we use calendar year birth cohorts) and the 2006 Canadian population as the standard population.

We used a pre-post analysis to assess the effect of the 2008 introduction of the school-based qHPV vaccination program. We defined birth cohorts 1995 and 1996 as the prior cohort (the last cohort not enrolled in the routine school-aged vaccination program, even though these females could have been vaccinated privately or in a non-school catch-up program) and we defined birth cohorts 1997 and 1998 as the posterior cohort. We calculated the incidence rate ratio (IRR) between the posterior and prior cohorts for each condition at age 16–18 (the follow-up data does not extend beyond age 18 for our youngest birth cohort). We performed a sensitivity analysis with one-year (1997 versus 1996) and three-year (1997–1999 versus 1994–1996) cohorts on either side of the introduction of the vaccine program to assess the effect of birth year.

We used SAS 9.4 (SAS Institute, Cary, North Carolina) and Stata 16 (StataCorp, College Station, Texas) for all analysis. This study was approved by the University of Manitoba Research Ethics Board (REB) and by MH’s Health Information Privacy Committee. The REB waived the requirement for informed consent in this retrospective study of medical records, because the data did not contain any direct identifiers.

Results

Trends in incidence rates

Overall age-standardized AGW incidence rates for females were stable between 2001 (119 per 100,000 person-year, 95% CI 110–128) and 2008 (118, 110–127) (Fig 1, S6 Table); the rates started a steady decline after 2008 to 81 (74–88) per 100,000 person-years in 2017. AGW incidence rates in males hovered between 120 and 150 per 100,000 from 2001 to 2017 without any discernable trend. AGW-related prescriptions increased three to five-fold between 2001 and 2009 before declining back to early 2000s levels by 2017. Chlamydia incidence doubled for females and males from 2001 to 2008 and plateaued since; gonorrhea incidence was variable, with several outbreaks during the study period.

thumbnail
Fig 1. Age-standardized incidence rate ratios of conditions of interest (indexed to the 2008 introduction of the school-based qHPV vaccination program) by year and gender.

https://doi.org/10.1371/journal.pone.0267646.g001

AGW incidence in 14–18 year-old girls decreased by 85% between 2011 to 2017, from 192 (152–238) to 29 (15–51) per 100,000, (Fig 2, S7 Table). In females aged 19–23, the AGW incidence rates dropped over 50% (from 570 to 230 per 100,000) between the introduction of the vaccine in 2006 and 2017 (S8 Table). AGW incidence for males in both age groups has not shown similar strong trends, even though rates were lowest at the end of the study period. Prescriptions for AGW-related drugs generally decreased since 2009 for both genders and both age groups, although it did not follow the same pattern as AGW diagnosis rates. Incidence of both chlamydia and gonorrhea has mostly remained stable since 2008 in these age groups.

thumbnail
Fig 2. Age-standardized incidence rate ratios of conditions of interest (indexed to the 2008 introduction of the school-based qHPV vaccination program) by year, age group, and gender.

https://doi.org/10.1371/journal.pone.0267646.g002

Incidence rates for cohorts before and after the introduction of the school-based vaccination program

The incidence of AGW, but not the incidence of chlamydia and gonorrhea, is lower for the posterior cohort compared to the prior cohort (Fig 3, Table 1, S9S11 Tables). For instance, the AGW incidence rate in 17 year-old girls dropped from 159 (87–267) per 100,000 in the 1995 birth cohort to 24 (3–88) per 100,000 in the 1998 birth cohort.

thumbnail
Fig 3. Incidence rates of conditions of interest by birth cohort, age, and gender.

The 1995–1996 birth cohorts are the last cohorts not enrolled in the publicly funded school-aged vaccination program (prior cohort); the 1997–1998 birth cohorts are the first routinely enrolled cohorts (posterior cohort).

https://doi.org/10.1371/journal.pone.0267646.g003

thumbnail
Table 1. Crude incidence rates (per 100,000 person-years; 95% confidence interval) of anogenital warts among birth cohorts by age and gender.

https://doi.org/10.1371/journal.pone.0267646.t001

Female AGW incidence in the 16–18 year-old age group dropped by 72% (IRR is 0.28; 95% confidence interval 0.17–0.46; Table 2) for the posterior cohort compared to the prior cohort. The IRR among boys was 0.49 (0.28–0.86). Males, however, were excluded from the school-based vaccination program during the study period. The change in incidence at individual ages was larger for 17 and 18 year-old girls. AGW-related prescriptions declined as well, the IRR for 16–18 year-olds was 0.39 (0.24–0.65) in girls and 0.75 (0.44–1.27) in boys. The incidence of other STIs decreased slightly as well for girls. Female chlamydia decreased by 12% (IRR is 0.88; 0.82–0.95) and gonorrhea by 16% (IRR is 0.84; 0.70–1.01).

thumbnail
Table 2. Incidence rate ratios (95% confidence interval) of certain conditions for cohorts 2 years before and after the introduction of school-based qHPV vaccination (birth cohorts 1997–1998 vs 1995–1996) by gender.

https://doi.org/10.1371/journal.pone.0267646.t002

We performed a sensitivity analysis with posterior and prior cohorts spanning either one or three years on both sides of the introduction of the qHPV vaccine program (S12, S13 Tables). The effect generally became slightly larger with increasing number of birth years per cohort. The female 16–18 year old AGW IRR is 0.34 (0.18–0.63) for one-year cohorts and 0.23 (0.15–0.34) for three-year cohorts. For chlamydia these IRRs are 0.85 (0.76–0.94) and 0.82 (0.77–0.87) respectively. This pattern does not hold for AGW-related prescriptions and gonorrhea, likely because of the relatively large fluctuations in incidence rates (Fig 1).

Discussion

We found that AGW incidence dropped 72% (54–83%) for 16–18 year-old girls in the first cohorts eligible for the school-based qHPV vaccination program. AGW incidence in 16–18 year-old boys for these same cohorts dropped 51% (14–72%) after introduction of the female-only program. Chlamydia and gonorrhea incidence rates decreased 12% and 16%, respectively, for 16–18 year-old girls over this period. The vaccination rate in Manitoba was 52% for the first routinely eligible cohort and 72% three years later [23, 24]. The confidence bounds of the IRRs include the qHPV vaccination rates for girls as well as unvaccinated boys. Based on these results, we cannot categorically state that other effects, e.g., a herd effect, did not contribute to this decline on top of direct reductions from vaccinations. Because HPV is sexually transmitted, a potential herd effect might be further decreased with increasing number of sexual partners and increasing age, as there was no universal catch-up program in Manitoba.

Reductions of AGW incidence or prevalence over 25% have been reported in young females after the introduction of qHPV vaccine in many other Western jurisdictions [6, 12, 2535]. These jurisdictions differ in their baseline AGW incidence, age of routine vaccination, program implementation details (e.g., the extent of catch-up programs and mode of delivery), and vaccine coverage. This heterogeneity, combined with additional heterogeneity in study designs, led to significant residual heterogeneity in a meta-analysis of AGW reduction after qHPV vaccine introduction [3], we aimed to explore how differences in study design can drive heterogeneity, especially now early reports suggest cervical cancer incidence is reduced after introduction of an HPV vaccine program [36].

The study population may affect results; we included the full Manitoba population. In a recent US study among persons insured by an integrated health care delivery system in Washington and Oregon, pre-post IRRs of 0.33 (0.28–0.39) and 0.55 (0.41–0.74) were estimated for 15–19 year-old girls and boys [37] (compared to 0.28 [0.17–0.46] and 0.49 [0.28–0.86] in Manitoba 16–18 year-olds). This seems to indicate that similar results can be obtained from different study populations, although clinic-based data can yield vastly different results (e.g., see Fig 5 in [3]).

Prescriptions for AGW-related drugs do not follow trends in medically attended AGW in Manitoba. AGW-related prescriptions peaked around the introduction of the qHPV vaccination program. As such, they are a poor proxy for AGW incidence when diagnosis data is available, because available treatment, physician preference and guidelines change over time. We were unable to ascertain clinical diagnosis of AGW (aside from the coded diagnoses), but studies using the clinical diagnosis as an outcome have come from clinic-based studies [5] and typically report larger reductions.

Sexual behavior changes over time; in the United States, for instance, millennials and the subsequent Generation Z are less sexually active in adulthood than previous generations [38, 39]. High school students had a linearly decreasing number of sexual partners between 1991 and 2015, while condom use has trended upwards during the same period [40]. We have no reason to assume these trends were different in Manitoba; both trends combined could reduce STI incidence in 16–18 year-olds. Gonorrhea rates fluctuated too much, due to outbreaks, to serve as a good comparator over a short time period. Chlamydia rates have dropped slightly for 16–18 year-olds after the introduction of the qHPV vaccination program. Nucleic acid amplified testing was introduced for urethral and cervical swabs for chlamydia and gonorrhea testing in 2006/2007, causing a peak and subsequent decline in incidence rates [41], which may partially explain a drop in chlamydia in this age group. Changing sexual habits likely play only a minor role in the reduction of AGW incidence. It is possible that the change in chlamydia and gonorrhea testing, close to the introduction of the qHPV vaccine, changed screening patterns for STIs, which may have biased our results.

Strengths and limitations

A major strength of this study is the availability of high quality, population-based health administrative databases in Manitoba. The completeness and accuracy of the MH databases are well established [15, 16, 20]. We likely underestimated the disease’s incidence rates by including only medically attended AGW [21]. Non-differential disease misclassification would not bias these relative risk ratios. It is unlikely that persons born in 1995 and 1996 have different health seeking behavior for AGW, or different physician diagnoses, than those born in 1997 and 1998. An ecological study does not infer anything about vaccine effectiveness at the individual level. A vaccine effectiveness study for Manitoba has been published separately [42]. The sensitivity analysis shows the stability of our results when adding or subtracting an additional birth year to the prior and posterior cohorts.

Because qHPV vaccination was available privately before the introduction of the publicly funded program, it is possible that some girls in the prior cohort were vaccinated. In Manitoba, around 0.5% of 10–14 year-old girls and 1.2% of 15–19 year-old girls were vaccinated each year before the introduction of the publicly funded program [43]. A study in the neighboring province of Ontario showed that only a small fraction (about 1%) of girls born in the two years before they would have been eligible for the publicly funded qHPV program (akin to our prior cohort) received the vaccine [44]. Because the vaccination rate was 52%-72% for the prior cohort [23, 24], any potential bias in our estimates due to private vaccination is likely to be minimal.

Manitoba’s qHPV vaccination program has changed, males are now vaccinated as well, and the recommended number of doses has been reduced to two for both males and females. The nonavalent HPV vaccine has recently been introduced in Canada [45], but has only been publicly funded in Manitoba since 2018. All these changes will affect AGW incidence in Manitoba, both at the population level and the individual level. The effect of these changes in the vaccine program on AGW can be evaluated once the affected cohorts age into their late teens.

Conclusions

We found that AGW incidence in Manitoba has dropped after the introduction of the school-based qHPV vaccination program. AGW incidence dropped by three-quarters for 16–18 year-old girls in the birth cohorts directly after qHPV vaccinePVHPOV introduction and by half for boys (who were not included in the publicly funded program at that time). This reduction might be partially explained by a herd effect, although we did not find conclusive evidence for this at the population level. Because AGW-related prescriptions peak around the time the qHPV vaccination program was introduced, they are a poor proxy of incidence rates based on medically attended AGW. Different sexual habits in adolescents, as evidenced by a small drop in chlamydia incidence in the same 16–18 year-old girls, is responsible for at most a small part of the reduction. The school-based qHPV vaccination program has started to reduce AGW incidence in Manitoba significantly, most notably in females, yet the full effect will only be known once the vaccinated cohorts age into their peak incidence years.

Supporting information

S1 Table. Tariff codes used to identify a person with anogenital warts in the Medical Services Database.

https://doi.org/10.1371/journal.pone.0267646.s001

(PDF)

S2 Table. Identification of a person with anogenital warts from the Hospital Abstracts database.

https://doi.org/10.1371/journal.pone.0267646.s002

(PDF)

S3 Table. ICD-9-CM procedure codes used to assist in the identification of a person with anogenital warts.

https://doi.org/10.1371/journal.pone.0267646.s003

(PDF)

S4 Table. ICD-10-CA procedure codes used to assist in the identification of a person with anogenital warts.

https://doi.org/10.1371/journal.pone.0267646.s004

(PDF)

S5 Table. Tariff codes for treatment of anogenital warts used to assist in the identification of extended care for a person with anogenital warts in combination with an ICD-9 code of 078.

https://doi.org/10.1371/journal.pone.0267646.s005

(PDF)

S6 Table. Age-standardized incidence rate per 100,000 person-years (95% confidence interval) of certain conditions by year and gender.

https://doi.org/10.1371/journal.pone.0267646.s006

(PDF)

S7 Table. Crude incidence rate per 100,000 person-years (95% confidence interval) of certain conditions among 14–18 year-olds by year and gender.

https://doi.org/10.1371/journal.pone.0267646.s007

(PDF)

S8 Table. Crude incidence rate per 100,000 person-years (95% confidence interval) of certain conditions among 19–23 year-olds by year and gender.

https://doi.org/10.1371/journal.pone.0267646.s008

(PDF)

S9 Table. Crude incidence rates (per 100,000 person-years; 95% confidence interval) of AGW-related prescription among birth cohorts by age and gender.

https://doi.org/10.1371/journal.pone.0267646.s009

(PDF)

S10 Table. Crude incidence rates (per 100,000 person-years; 95% confidence interval) of chlamydia among birth cohorts by age and gender.

https://doi.org/10.1371/journal.pone.0267646.s010

(PDF)

S11 Table. Crude incidence rates (per 100,000 person-years; 95% confidence interval) of gonorrhea among birth cohorts by age and gender.

https://doi.org/10.1371/journal.pone.0267646.s011

(PDF)

S12 Table. Incidence rate ratios (95% confidence interval) of certain conditions for cohorts 1 year before and after the introduction of school-based qHPV vaccination (birth cohort 1997 vs 1996) by gender.

https://doi.org/10.1371/journal.pone.0267646.s012

(PDF)

S13 Table. Incidence rate ratios (95% confidence interval) of certain conditions for cohorts 3 years before and after the introduction of school-based qHPV vaccination (birth cohorts 1997–1999 vs 1994–1996) by gender.

https://doi.org/10.1371/journal.pone.0267646.s013

(PDF)

S14 Table. Crude incidence rate per 100,000 person-years (95% confidence interval) of certain conditions among 15–19 year-olds by year and gender.

https://doi.org/10.1371/journal.pone.0267646.s014

(PDF)

S15 Table. Crude incidence rate per 100,000 person-years (95% confidence interval) of certain conditions among 20–24 year-olds by year and gender.

https://doi.org/10.1371/journal.pone.0267646.s015

(PDF)

S16 Table. Crude incidence rate per 100,000 person-years (95% confidence interval) of certain conditions among 25–29 year-olds by year and gender.

https://doi.org/10.1371/journal.pone.0267646.s016

(PDF)

S17 Table. Crude incidence rate per 100,000 person-years (95% confidence interval) of certain conditions among 30–39 year-olds by year and gender.

https://doi.org/10.1371/journal.pone.0267646.s017

(PDF)

Acknowledgments

The authors acknowledge the Manitoba Centre for Health Policy for use of data contained in the Population Health Research Data Repository under project # 2015–019 (HIPC # 2014/2015-46; REB # HS18467 (H2015:026); RRIC # 2015–060). The results and conclusions are those of the authors and no official endorsement by the Manitoba Centre for Health Policy, Manitoba Health, or other data providers is intended or should be inferred. Data used in this study are from the Population Health Research Data Repository housed at the Manitoba Centre for Health Policy, University of Manitoba and were derived from data provided by Manitoba Health.

References

  1. 1. Garland SM, Steben M, Sings HL, James M, Lu S, Railkar R, et al. Natural History of Genital Warts: Analysis of the Placebo Arm of 2 Randomized Phase III Trials of a Quadrivalent Human Papillomavirus (Types 6, 11, 16, and 18) Vaccine. The Journal of infectious diseases. 2009;199(6):805–14. pmid:19199546
  2. 2. Wright TC, Jr., Huh WK, Monk BJ, Smith JS, Ault K, Herzog TJ. Age considerations when vaccinating against HPV. Gynecologic Oncology. 2008;109(2 Suppl):S40–7. pmid:18482558
  3. 3. Drolet M, Bénard É, Boily M-C, Ali H, Baandrup L, Bauer H, et al. Population-level impact and herd effects following human papillomavirus vaccination programmes: a systematic review and meta-analysis. The Lancet Infectious Diseases. 2015;15(5):565–80. pmid:25744474
  4. 4. Garland SM, Kjaer SK, Muñoz N, Block SL, Brown DR, DiNubile MJ, et al. Impact and Effectiveness of the Quadrivalent Human Papillomavirus Vaccine: A Systematic Review of 10 Years of Real-world Experience. Clinical Infectious Diseases. 2016;63(4):519–27. pmid:27230391
  5. 5. Drolet M, Bénard É, Pérez N, Brisson M, Ali H, Boily M-C, et al. Population-level impact and herd effects following the introduction of human papillomavirus vaccination programmes: updated systematic review and meta-analysis. The Lancet. 2019;394(10197):497–509. pmid:31255301
  6. 6. Bollerup S, Baldur-Felskov B, Blomberg M, Baandrup L, Dehlendorff C, Kjaer SK. Significant Reduction in the Incidence of Genital Warts in Young Men 5 Years Into the Danish Human Papillomavirus Vaccination Program for Girls and Women. Sexually transmitted diseases. 2016;43(4):238–42. pmid:26967300
  7. 7. Guerra FM, Rosella LC, Dunn S, Wilson SE, Chen C, Deeks SL. Early impact of Ontario’s human papillomavirus (HPV) vaccination program on anogenital warts (AGWs): A population-based assessment. Vaccine. 2016;34(39):4678–83. pmid:27527815
  8. 8. Flagg EW, Torrone EA. Declines in Anogenital Warts Among Age Groups Most Likely to Be Impacted by Human Papillomavirus Vaccination, United States, 2006–2014. American Journal of Public Health. 2017;108(1):112–9. pmid:29161070
  9. 9. Chow EPF, Read TRH, Wigan R, Donovan B, Chen MY, Bradshaw CS, et al. Ongoing decline in genital warts among young heterosexuals 7 years after the Australian human papillomavirus (HPV) vaccination programme. Sexually Transmitted Infections. 2015;91(3):214–9. pmid:25305210
  10. 10. Oliphant J, Stewart J, Saxton P, Lo M, Perkins N, Ward D. Trends in genital warts diagnoses in New Zealand five years following the quadrivalent human papillomavirus vaccine introduction. The New Zealand medical journal. 2017;130(1452):9–16. pmid:28337036
  11. 11. Dominiak-Felden G, Gobbo C, Simondon F. Evaluating the Early Benefit of Quadrivalent HPV Vaccine on Genital Warts in Belgium: A Cohort Study. PLoS One. 2015;10(7):e0132404. pmid:26147096
  12. 12. Bauer HM, Wright G, Chow J. Evidence of human papillomavirus vaccine effectiveness in reducing genital warts: an analysis of California public family planning administrative claims data, 2007–2010. American Journal of Public Health. 2012;102(5):833–5. pmid:22420808
  13. 13. Liu B, Donovan B, Brotherton JML, Saville M, Kaldor JM. Genital warts and chlamydia in Australian women: comparison of national population-based surveys in 2001 and 2011. Sexually Transmitted Infections. 2014;90(7):532–7. pmid:24570485
  14. 14. Martens P. NN, Lix L., Turner D., Prior H., Walld R., Soodeen R., et al,. The cost of smoking: a Manitoba study. Manitoba Centre for Health Policy; 2015.
  15. 15. Roos L, Mustard C, Nicol J, McLerran D, Malenka D, Young T, et al. Registries and administrative data: organization and accuracy. Medical Care. 1993;31(3):201–12. pmid:8450678
  16. 16. Robinson J, Young T, Roos L, Gelskey D. Estimating the burden of disease: comparing administrative data and self-reports. Medical Care. 1997;35(9):932. pmid:9298082
  17. 17. Mahmud S, Van Caeseele P, Hammond G, Kurbis C, Hilderman T, Elliott L. No Association between 2008–09 Influenza Vaccine and Influenza A(H1N1)pdm09 Virus Infection, Manitoba, Canada, 2009. Emerging Infectious Disease journal. 2012;18(5):801.
  18. 18. Mahmud S, Hammond G, Elliott L, Hilderman T, Kurbis C, Caetano P, et al. Effectiveness of the pandemic H1N1 influenza vaccines against laboratory-confirmed H1N1 infections: Population-based case–control study. Vaccine. 2011;29(45):7975–81. pmid:21884747
  19. 19. Singh H, Mahmud SM, Turner D, Xue L, Demers AA, Bernstein CN. Long-Term Use of Statins and Risk of Colorectal Cancer: A Population-Based Study. The American Journal of Gastroenterology 2009;104(12):3015–23. pmid:19809413
  20. 20. Kozyrskyj AL, Mustard CA. Validation of an electronic, population-based prescription database. Annals of Pharmacotherapy. 1998;32(11):1152–7. pmid:9825079
  21. 21. Kliewer EV, Demers AA, Elliott L, Lotocki R, Butler JR, Brisson M. Twenty-year trends in the incidence and prevalence of diagnosed anogenital warts in Canada. Sexually transmitted diseases. 2009;36(6):380–6. pmid:19556932
  22. 22. The Epidemiology of Chlamydia and Gonorrhea in the Winnipeg Health Region, 2003–2013. Winnipeg: Winnipeg Regional Health Authority, Population Health Surveillance Team; 2015.
  23. 23. 2012 Cancer System Performance Report. Canadian Partnership Against Cancer; 2012.
  24. 24. 2014 Cancer System Performance Report. Canadian Partnership Against Cancer; 2014.
  25. 25. Fairley CK, Hocking JS, Gurrin LC, Chen MY, Donovan B, Bradshaw CS. Rapid decline in presentations of genital warts after the implementation of a national quadrivalent human papillomavirus vaccination programme for young women. Sexually Transmitted Infections. 2009;85(7):499–502. pmid:19837728
  26. 26. Donovan B, Franklin N, Guy R, Grulich AE, Regan DG, Ali H, et al. Quadrivalent human papillomavirus vaccination and trends in genital warts in Australia: analysis of national sentinel surveillance data. The Lancet Infectious diseases. 2011;11(1):39–44. pmid:21067976
  27. 27. Read TR, Hocking JS, Chen MY, Donovan B, Bradshaw CS, Fairley CK. The near disappearance of genital warts in young women 4 years after commencing a national human papillomavirus (HPV) vaccination programme. Sexually Transmitted Infections. 2011;87(7):544–7. pmid:21970896
  28. 28. Oliphant J, Perkins N. Impact of the human papillomavirus (HPV) vaccine on genital wart diagnoses at Auckland Sexual Health Services. The New Zealand medical journal. 2011;124(1339):51–8. pmid:21952330
  29. 29. Mikolajczyk RT, Kraut AA, Horn J, Schulze-Rath R, Garbe E. Changes in incidence of anogenital warts diagnoses after the introduction of human papillomavirus vaccination in Germany-an ecologic study. Sexually transmitted diseases. 2013;40(1):28–31. pmid:23250300
  30. 30. Baandrup L, Blomberg M, Dehlendorff C, Sand C, Andersen KK, Kjaer SK. Significant decrease in the incidence of genital warts in young Danish women after implementation of a national human papillomavirus vaccination program. Sexually transmitted diseases. 2013;40(2):130–5. pmid:23324976
  31. 31. Smith LM, Strumpf EC, Kaufman JS, Lofters A, Schwandt M, Lévesque LE. The Early Benefits of Human Papillomavirus Vaccination on Cervical Dysplasia and Anogenital Warts. Pediatrics. 2015;135(5):e1131–e40. pmid:25917991
  32. 32. Taur Y, Smith MA. Adherence to the Infectious Diseases Society of America guidelines in the treatment of uncomplicated urinary tract infection. Clinical Infectious Diseases. 2007;44.
  33. 33. Leval A, Herweijer E, Arnheim-Dahlstrom L, Walum H, Frans E, Sparen P, et al. Incidence of genital warts in Sweden before and after quadrivalent human papillomavirus vaccine availability. The Journal of infectious diseases. 2012;206(6):860–6. pmid:22815381
  34. 34. Flagg EW, Schwartz R, Weinstock H. Prevalence of Anogenital Warts Among Participants in Private Health Plans in the United States, 2003–2010: Potential Impact of Human Papillomavirus Vaccination. American Journal of Public Health. 2013;103(8):1428–35. pmid:23763409
  35. 35. Herweijer E, Ploner A, Sparén P. Substantially reduced incidence of genital warts in women and men six years after HPV vaccine availability in Sweden. Vaccine. 2018;36(15):1917–20. pmid:29523448
  36. 36. Falcaro M, Castañon A, Ndlela B, Checchi M, Soldan K, Lopez-Bernal J, et al. The effects of the national HPV vaccination programme in England, UK, on cervical cancer and grade 3 cervical intraepithelial neoplasia incidence: a register-based observational study. The Lancet. 2021;398(10316):2084–92. pmid:34741816
  37. 37. Naleway AL, Crane B, Smith N, Francisco M, Weinmann S, Markowitz LE. Temporal Trends in the Incidence of Anogenital Warts: Impact of Human Papillomavirus Vaccination. Sexually transmitted diseases. 2020;47(3):179–86. pmid:31880738
  38. 38. Twenge JM, Sherman RA, Wells BE. Declines in Sexual Frequency among American Adults, 1989–2014. Archives of Sexual Behavior. 2017.
  39. 39. Twenge JM, Sherman RA, Wells BE. Sexual Inactivity During Young Adulthood Is More Common Among U.S. Millennials and iGen: Age, Period, and Cohort Effects on Having No Sexual Partners After Age 18. Archives of Sexual Behavior. 2017;46(2):433–40. pmid:27480753
  40. 40. Kann L, McManus T, Harris WA, Shanklin SL, Flint KH, Hawkins J, et al. Youth Risk Behavior Surveillance—United States, 2015. MMRW Surveillance Summaries. 2016;65(6):1–174. pmid:27280474
  41. 41. Wylie JL, Van Caeseele P. Interpretation of laboratory detection trends for Chlamydia trachomatis and Neisseria gonorrhoeae: Manitoba, Canada, 2000–2012. Sexually Transmitted Infections. 2016;92(1):55–7. pmid:25969541
  42. 42. Willows K, Bozat-Emre S, Righolt CH, Kliewer EV, Mahmud SM. Early Evidence of the Effectiveness of the Human Papillomavirus Vaccination Program Against Anogenital Warts in Manitoba, Canada: A Registry Cohort Study. Sexually transmitted diseases. 2018;45(4):254–9. pmid:29465699
  43. 43. Kliewer E, Demers A, Lambert P, Brisson M. Uptake of the Human Papillomavirus Vaccine in Manitoba Prior to the Implementation of a Provincial Vaccination Program Winnipeg: CancerCare Manitoba; 2010.
  44. 44. Smith LM, Lévesque LE, Kaufman JS, Strumpf EC. Strategies for evaluating the assumptions of the regression discontinuity design: a case study using a human papillomavirus vaccination programme. International Journal of Epidemiology. 2016.
  45. 45. Deeks SL, Tunis MC, Ismail S. Summary of the NACI Update on the recommended use of Human Papillomavirus (HPV) vaccine: Nine-valent HPV vaccine two-dose immunization schedule and the use of HPV vaccines in immunocompromised populations. Canada Communicable Disease Report. 2017;43(6):138–42. pmid:29770079