Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Influenza Illness and Hospitalizations Averted by Influenza Vaccination in the United States, 2005–2011

  • Deliana Kostova ,

    kiv0@cdc.gov

    Affiliation Influenza Division, National Center for Immunizations and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Carrie Reed,

    Affiliation Influenza Division, National Center for Immunizations and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Lyn Finelli,

    Affiliation Influenza Division, National Center for Immunizations and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Po-Yung Cheng,

    Affiliation Influenza Division, National Center for Immunizations and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Paul M. Gargiullo,

    Affiliation Influenza Division, National Center for Immunizations and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • David K. Shay,

    Affiliation Influenza Division, National Center for Immunizations and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • James A. Singleton,

    Affiliation Immunizations Services Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Martin I. Meltzer,

    Affiliation Division of Preparedness and Emerging Infections, National Center for Enteric and Zoonotic Infectious Disease, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Peng-jun Lu,

    Affiliation Immunizations Services Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Joseph S. Bresee

    Affiliation Influenza Division, National Center for Immunizations and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

Abstract

Context

The goal of influenza vaccination programs is to reduce influenza-associated disease outcomes. Therefore, estimating the reduced burden of influenza as a result of vaccination over time and by age group would allow for a clear understanding of the value of influenza vaccines in the US, and of areas where improvements could lead to greatest benefits.

Objective

To estimate the direct effect of influenza vaccination in the US in terms of averted number of cases, medically-attended cases, and hospitalizations over six recent influenza seasons.

Design

Using existing surveillance data, we present a method for assessing the impact of influenza vaccination where impact is defined as either the number of averted outcomes or as the prevented disease fraction (the number of cases estimated to have been averted relative to the number of cases that would have occurred in the absence of vaccination).

Results

We estimated that during our 6-year study period, the number of influenza illnesses averted by vaccination ranged from a low of approximately 1.1 million (95% confidence interval (CI) 0.6–1.7 million) during the 2006–2007 season to a high of 5 million (CI 2.9–8.6 million) during the 2010–2011 season while the number of averted hospitalizations ranged from a low of 7,700 (CI 3,700–14,100) in 2009–2010 to a high of 40,400 (CI 20,800–73,000) in 2010–2011. Prevented fractions varied across age groups and over time. The highest prevented fraction in the study period was observed in 2010–2011, reflecting the post-pandemic expansion of vaccination coverage.

Conclusions

Influenza vaccination programs in the US produce a substantial health benefit in terms of averted cases, clinic visits and hospitalizations. Our results underscore the potential for additional disease prevention through increased vaccination coverage, particularly among nonelderly adults, and increased vaccine effectiveness, particularly among the elderly.

Introduction

Since 2010, all persons 6 months of age and older in the United States have been recommended to receive annual influenza vaccination, making the U.S the only country with universal influenza vaccine recommendations [1]. The recommendation for universal vaccination was made after more than a decade of incremental expansions in the recommendations to include individuals at high risk for severe influenza or influenza-associated complications, or those who might spread infection to high-risk persons [2]. The health and economic benefits of influenza vaccination have traditionally been evaluated using vaccine coverage surveys, by observational studies of vaccine effectiveness or clinical trials of vaccine efficacy in specific populations [3][13], or by cost-effectiveness studies of influenza vaccination in certain groups of people or at certain times, based on data from sporadic studies [14][20]. These studies have been valuable tools in establishing the potential impact of influenza vaccines in specific populations or to monitor program operations. However, no studies have provided a mechanism for the replicable assessment of national numbers of cases and hospitalizations that are prevented by vaccination each year.

Since the ultimate justification for influenza vaccination programs is that they reduce influenza-associated disease outcomes, it is desirable to have an approach that describes with annual regularity the reduced national burden of influenza during each influenza season. Such an approach would allow for a clear understanding of the value of influenza vaccination in the U.S. and would enable us to trace vaccine program performance over time and within demographic groups. Such data would also identify areas where improvements would lead to greatest benefits. In this paper, we present a national model for estimating the annual direct impact of influenza vaccination in terms of averted morbidity in order to better understand the impact of influenza immunization programs in the United States and the factors that drive this impact. This method of estimation can be updated annually, and can be used by public health professionals to estimate and/or project averted burden using assumptions of vaccination coverage, effectiveness, and influenza clinical attack rates. These data can easily be communicated to stakeholders concerning the value of influenza vaccines.

Methods and Data

1. Methods Overview

1.1 Estimating averted burden.

In this paper, burden is defined in terms of influenza cases, medically attended illnesses, and hospitalizations (henceforth referred to as “outcomes”). We estimated the averted burden of influenza-related outcomes in several steps. First, we estimated the number of outcomes that occurred in each season using existing national surveillance data as a primary input. We then computed intermediary inputs such as the rates of influenza illness and influenza hospitalization among susceptible individuals for each month of each season while accounting for vaccination coverage, vaccine efficacy, and disease occurrence, and we used these rates to project the burden of influenza that would have occurred in the absence of vaccination. The difference between the estimated number of outcomes with vs. without vaccination equals the burden averted by vaccination. Each season’s model was stratified by month to accommodate time-sensitive patterns of vaccination coverage and disease occurrence, and was built to reflect the length of each season –7 months for seasons 2005–2006 through 2008–2009 and 2010–2011 (October through April), and 12 months during the 2009 H1N1 pandemic (May 2009 through April 2010). Averted burden was estimated for four age categories: 6 months-4 years old, 5–19 years old, 20–64 years old, and 65 years and older. This approach only estimates the direct effects of vaccination to vaccinated persons, and does not reflect how the underlying attack rates and disease transmission patterns would have changed in the complete absence of vaccination; the indirect impact of vaccination (the additional outcomes that may have been averted by decreasing the overall disease infectivity through vaccination) is therefore excluded from the estimates. A detailed methods description is available in Appendix S1.

Confidence intervals for the reported results were estimated using a Monte Carlo algorithm, drawing values from sampling distribution of the input variables used in the model. Additional details about these sampling distributions are given in Appendix S1.

1.2 Estimating the prevented fraction.

While the number of averted outcomes each season depends directly on vaccination coverage and vaccine effectiveness during that season, it also depends on the influenza attack rate – i.e., seasons with high attack rates will result in a higher number of averted outcomes assuming the same rate of vaccination coverage. Therefore, we present averted influenza burden not only in terms of absolute numbers, but also in terms of the prevented fraction. We define the prevented fraction as the proportion of averted outcomes out of potential outcomes in the absence of vaccination. During each influenza season, the prevented fraction is the same across outcomes (cases, medically-attended cases, and hospitalizations) because the number of cases and MA cases were calculated as proportions of the estimated number of hospitalizations each season.

2. Data Sources

2.1 Rates of influenza-associated hospitalization.

We used data on the rates of reported influenza-associated hospitalizations from CDC’s Emerging Infections Program (EIP) to estimate the annual number of influenza hospitalizations and illnesses from 2005 to 2011 (both summarized in Table 1). Although total annual estimates of influenza hospitalizations have been reported in the literature for multiple seasons prior to 2001 [21], the EIP is the only data source that provides timely real-time tracking of influenza hospitalizations in the U.S. as each season progresses, allowing us to reconstruct the baseline shapes of recent seasons’ epidemiological curves. The EIP conducts surveillance for laboratory-confirmed influenza-related hospitalizations in both children and adults in 60 counties covering 12 metropolitan areas of 10 states (approximately 22 million people). Using the EIP’s unique aspect of month-specific and age-specific hospitalization reporting, we obtained estimates of the reported rates of influenza hospitalization across 4 age groups for the six most recent seasons with complete EIP data.

thumbnail
Table 1. Summary of input variables, by age group (95% confidence intervals in parentheses).

https://doi.org/10.1371/journal.pone.0066312.t001

Since EIP records only hospitalizations confirmed by influenza laboratory test, we needed to account for underreporting. Underreporting occurs when a person truly hospitalized with influenza is not tested for influenza, or when the test does not detect influenza due to the sensitivity of the type of test used or its timing. To account for underreporting, we adjusted the EIP estimate by applying a hospitalization underreporting multiplier. Reed et al. (2009) estimated that during the 2009 H1N1 pandemic, every reported influenza hospitalization represented 2.7 total hospitalizations (95% confidence interval (CI) 1.7–4.5) [22]. Although no estimates of the hospitalization underreporting multiplier were available for seasonal influenza prior to 2009, recent evidence indicates that the disparity in hospitalization underreporting rates between pandemic and non-pandemic seasons was not very substantial [23]. We assumed that hospitalization under-ascertainment in the EIP system before the 2009 pandemic occurred at the same rate as it did during the 2009 pandemic, and adjusted the reported EIP hospitalization rates accordingly by a factor of 2.7 (CI 1.7–4.5) for all seasons.

The estimated number of influenza-associated hospitalizations derived in this study is comparable to previously reported estimates for earlier seasons. Thompson et al (2004) estimated that during 1979–2001 the average seasonal number of influenza-related pneumonia and influenza hospitalizations was 133,900 (CI 30,757–271,529). In this study, the estimated average seasonal number of influenza hospitalizations during 2005–2011 is 128,719 (CI 88,431–208,324) (Table 1). Although these estimates were obtained through different methodologies and for different time periods, their similarity illustrates the relative consistency in the results of the respective estimation approaches.

2.2 Rates of influenza illness.

We estimated the number of influenza illnesses in the US population by applying a ratio of cases to hospitalizations to the number of estimated influenza-associated hospitalizations. The case-hospitalization ratio is based on data from the 2009 season as described by Reed et al. (2009) and varies by age group (Table 1).

2.3 Rate of Medically-Attended (MA) illness.

Only a fraction of persons with influenza illness seek medical care. This fraction was estimated from two sources, depending on the season. For the 2009 H1N1 pandemic, we used age-specific estimates of the percentage of persons with influenza-like illness (ILI) who reported receiving medical attention for their illness [24]. For all other seasons, we used data from an earlier study which found that 42% (CI 37.9%–48.5%) of persons with ILI sought medical care during the 2006–2007 influenza season [25]. Although this pre-pandemic estimate is not age-specific and is based on a single season, it is the only such data point available before the 2009 pandemic. Because of the possible differences in public awareness and health-seeking behavior during the pandemic, we apply this estimate to the five non-pandemic seasons.

2.4 Influenza vaccination coverage.

We defined the monthly incremental vaccination coverage (IVC) for influenza as the proportion of the population that received influenza vaccination in each month. Monthly IVC estimates by age group were obtained from the National Health Interview Survey (NHIS) (Table 1).

2.5 Influenza vaccine effectiveness.

Vaccine effectiveness (VE) is the percentage reduction in risk of influenza illness that is attributable to vaccination. Seasonal VE is estimated through clinical trials or observational studies; since estimates of vaccine effectiveness can vary across different studies for the same season, we used an aggregate annual VE estimate based on the range of available VE estimates in the literature for each season [3][13] by averaging the range of available values and weighting by the inverse of the variance for each study. For all but the most recent season in this study, VE estimates that were specific to each age group were not available. However, there is evidence that the immunogenic response to the influenza vaccine is decreased among persons 65 years and older [26][31]. To reflect this, we made the assumption that VE in the elderly population was 70% of the VE estimates available for younger age groups (those under 65 years) during seasons when age-specific VE estimates were not available (2005–2006 through 2009–2010). To further reflect the uncertainty of this assumption we performed sensitivity analyses where the VE among persons 65 and older was assumed to be, alternatively, 40% or 80% of the VE among younger populations.

Results

Influenza vaccination averted approximately 13.6 (CI 8.0–22.8) million illnesses, 5.8 (CI 3.4–10.1) million medical visits, and 112,900 (CI 65,000–191,500) influenza-related hospitalizations during the 6-year period (Tables 2, 3, 4). The largest number of averted cases occurred during the most recent season of the study period, 2010–2011, when 5.0 (CI 2.9–8.6) million influenza cases, 2.1 (1.2–3.7) million medical visits, and 40,400 (CI 20,800–73,100) hospitalizations were prevented by vaccination, corresponding to a prevented fraction of 18.5% (CI 16.0%–20.3%). The season with the lowest number of averted outcomes was 2006–2007, when approximately 1.1 (CI 0.6–1.7) million cases were averted. The relatively low number of averted outcomes in 2006–2007 reflects the low intensity of the season, and the fact that fewer cases can be prevented when the underlying incidence is low; indeed, the 2006–2007 season had the lowest attack rate among persons under 65 of all seasons in our study, as shown by the hospitalization rates in Table 1. Despite having the lowest number of averted cases, the 2006–2007 season outperformed the previous season in terms of the prevented fraction, reflecting the season’s improvement in vaccine coverage and vaccine effectiveness (13.5% (CI 13.5%–13.6%) prevented fraction in 2006–2007 vs. 10.6% (CI 9.3%–11.6%) in 2005–2006, Table 2).

thumbnail
Table 2. Estimated number of influenza cases averted by vaccination and the associated prevented fraction, 2005/06–2010/11 influenza seasons (95% confidence interval in parentheses).

https://doi.org/10.1371/journal.pone.0066312.t002

thumbnail
Table 3. Estimated number of medically-attended (MA) influenza cases averted by vaccination, 2005/06–2010/11 influenza seasons (95% confidence interval in parentheses).

https://doi.org/10.1371/journal.pone.0066312.t003

thumbnail
Table 4. Estimated number of influenza hospitalizations averted by vaccination, 2005/06–2010/11 influenza seasons (95% confidence interval in parentheses).

https://doi.org/10.1371/journal.pone.0066312.t004

Before the 2009 pandemic, the prevented fraction increased over time from 10.6% (CI 9.3%–11.6%) in 2005–2006 to 15.2% (CI 15.1%–15.2%) in 2008–2009 (Figure 1) even as the number of averted outcomes fluctuated (Figure 2). The 2009 pandemic represented a break in this trend with a prevented fraction of 2.5% (CI 1.8%–3.0%). This decrease in the prevented fraction reflected the early timing of pandemic–associated disease relative to vaccine availability, despite a relatively high vaccine effectiveness conferred by the pandemic vaccine. Despite the lag in vaccination, the high attack rate associated with the 2009 H1N1 pandemic virus in younger populations resulted in an overall number of averted cases (1.3 (CI 0.6–2.5) million) that was comparable in magnitude relative to earlier seasons; in fact, the number of averted cases among adults aged 20–64 may have been higher during the pandemic than during the preceding season (Table 2).

thumbnail
Figure 1. Prevented fraction of influenza cases, by age group, 2005/06–2010/11 influenza seasons.

https://doi.org/10.1371/journal.pone.0066312.g001

thumbnail
Figure 2. Number of averted influenza cases, by age group, 2005/06–2010/11 influenza seasons.

https://doi.org/10.1371/journal.pone.0066312.g002

Over the study period, the largest total number of averted outcomes occurred among adults 20–64 years of age, the largest age group in the study. Nevertheless, the 6-year average prevented fraction in this age group tended to be among the lowest at 7.4% (CI 6.9%–7.7%), similar to that in children aged 5–19 (Table 2). Before the 2009 pandemic, the prevented fractions were highest for persons 65 and older. During the 2009 pandemic, the highest prevented fraction occurred among children under 4 at 5.8% (CI 4.0%–6.6%), and remained higher than all other age groups in the post-pandemic 2010–2011 season as well, at 29.2% (CI 28.6%–29.6%) (Figure 1).

When estimating the impact of vaccination among the elderly, we accounted for the reduced effectiveness of the vaccine among the elderly by assuming that in seasons for which age-specific VE estimates were not available (all seasons except 2010/11), the VE for the elderly was a fraction the non-elderly VE. We set this fraction to 70% in the main analysis, and reflected the uncertainty of this assumption by performing a sensitivity analysis where we assumed that the elderly VE was, alternatively, 40% and 80% of the non-elderly VE. The results of this sensitivity analysis are shown as supplementary material in Table S1. We found that while the number of averted outcomes among the elderly was indeed higher at higher levels of VE, the overall number of averted outcomes in the entire population (all ages) was not substantially sensitive to variations in the elderly VE (Table S1), reflecting the relatively small proportion of elderly in the population.

Discussion

While the vaccine produced benefits each season, the number of influenza-associated outcomes averted by vaccination fluctuated across age groups and seasons (Figure 2), reflecting the interplay of seasonal differences in vaccination coverage, vaccine effectiveness, and influenza attack rate. Of these impact determining factors, the attack rate is the only one not subject to human intervention, so from an impact evaluation standpoint it may be appropriate to assess impact net of its influence (seasons with higher attack rates could be associated with more averted cases simply because more people are susceptible to becoming ill, so that a greater number of illnesses could be prevented with the same level of vaccination and vaccine effectiveness). Calculating the prevented disease fraction instead of the number of averted cases can useful for describing the impact of vaccination programs because it controls for the relative severity of different seasons. The prevented fraction can also present a different pattern of impact over time than the number of averted outcomes alone – a pattern which more clearly reflects the benefits of increased vaccination coverage. The population-level benefits of increased vaccination become apparent when comparing the generally rising trend in vaccination coverage over time (Table 1) to the trend in the prevented fraction over time (Table 2) for each age group; this comparison shows that a greater fraction of disease was prevented as greater fractions of the population became vaccinated.

The prevented fraction during the 2009 pandemic was lower than during other seasons, highlighting the importance of the timing of vaccination relative to disease occurrence. While vaccination still prevented a considerable number of outcomes during the pandemic, the relatively late availability of the vaccine relative to the timing of pandemic disease in 2009–2010 resulted in a comparatively low prevented fraction during that year. Across age groups, the prevented fraction during the 2009 pandemic was highest among children aged 0–4, indicating that the priority schedule for vaccinating younger persons may have yielded a health benefit (Figure 1).

The increase in the prevented fraction during the 2010–2011 season relative to earlier seasons demonstrates how increases in vaccination coverage can drive substantial improvements in the impact of vaccination. Likely due to raised post-pandemic awareness about influenza, overall vaccination in 2010–2011 increased compared to both pandemic and pre-pandemic levels (Table 1). In 2010, a higher proportion of vaccinations also occurred earlier in time than during previous seasons, with relatively higher vaccination rates in the months of August and September [32]. The increases in vaccination coverage across all age groups that occurred in the season after the 2009 pandemic produced the largest vaccine impact observed over the 6-year study period both in terms of prevented fraction and number of averted cases (Figures 1 and 2).

Vaccination coverage tends to be lowest among adults aged 20–64, as many persons in this age group were not targeted for vaccination until the universal recommendations were issued in 2010. Because of the disproportionately large size of this population subgroup, increasing vaccination coverage among the nonelderly adults is likely to result in a large increase in the number of averted cases. While vaccination coverage among the elderly has been traditionally high (Table 1), the comparatively lower effectiveness of the influenza vaccine in this age group reduced the benefits that such high levels of vaccination could have otherwise produced. Improving vaccine effectiveness among the elderly would have an additional impact on averted influenza-associated outcomes, especially hospitalizations, which occur at much higher rates in this age group.

Our study is subject to a number of limitations, most of which are associated with the choice of input values used in the model. First, vaccine coverage data were obtained from NHIS and were based on self-report; some selection bias may remain even after weighting adjustments for survey nonresponse, and coverage data did not indicate the number of doses received. Second, due to lack of pre-pandemic data, we assumed that the hospitalization underreporting multiplier was the same during all nonpandemic seasons as during the 2009 pandemic. Since increased surveillance and awareness during the pandemic may have contributed to higher testing and higher hospitalization rates than during seasonal epidemics, using the underreporting multiplier calculated from 2009 data may result in conservatively low estimates of hospitalizations for non-pandemic seasons. However, recent studies have confirmed that these multipliers are similar between pandemic and non-pandemic periods [33]. Third, data on the variability of vaccine effectiveness among different age groups are limited. Similarly, data on the fraction of ILI that were medically attended in non-pandemic seasons were not available by season and age and thus a constant rate was assumed.

Vaccination against influenza has a substantial annual impact on the burden of disease in the United States. The study demonstrates that improvements in vaccination coverage among non-elderly persons and improvements in vaccine effectiveness among the elderly will lead to greater gains in program effectiveness. These data can be used to estimate the economic impact of vaccination programs on the national level. In addition, the model can estimate the effect of current policies on reducing disease among vulnerable groups such as pregnant women, and can be used to predict the impact of program improvements or alternative vaccination policies. Finally, because this study focuses on estimating the direct impact of vaccination only, further refinements that include estimation of the indirect impact of vaccination would yield a more complete estimate of the value of influenza vaccination programs in the United States.

Supporting Information

Table S1.

Total number of averted cases by influenza season: Sensitivity analysis on the assumption behind the elderly vaccine effectiveness adjustment.

https://doi.org/10.1371/journal.pone.0066312.s001

(DOCX)

Appendix S1.

Technical appendix: Methodology description.

https://doi.org/10.1371/journal.pone.0066312.s002

(DOCX)

Acknowledgments

The authors wish to thank Michael Haber, Lisa Prosser, Peter White, Jerome Tokars and Albert Jan Van Hoek for valuable comments, and Alejandro Perez for valuable data assistance. Disclaimer: The findings and conclusions in this article are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Author Contributions

Contributed reagents/materials/analysis tools: PMG DKS JAS PJL. Wrote the paper: DK. Reveiwed the manuscript: DK CR LF PYC PMG DKS JAS MIM PJL JSB. Edited the manuscript: DK CR LF PYC PMG DKS JAS MIM PJL JSB. Conceptualized the analysis: DK CR. Conceived the paper: LF JSB.

References

  1. 1. Advisory Committee on Immunization Practices (ACIP) (2010) Prevention and Control of Influenza with Vaccines. MMWR 59: 1–62.
  2. 2. Advisory Committee on Immunization Practices (ACIP) (2009) Prevention and Control of Influenza with Vaccines. MMWR 58: 1–52.
  3. 3. Belongia EA, Kieke BA, Donahue JG, Greenlee RT, Balish A, et al. (2009) Effectiveness of inactivated influenza vaccines varied substantially with antigenic match from the 2004–2005 season to the 2006–2007 season. J Infect Dis 199(2): 159–67.
  4. 4. Ohmit SE, Victor JC, Teich ER, Truscon RK, Rotthoff JR, et al. (2008) Prevention of symptomatic seasonal influenza in 2005–2006 by inactivated and live attenuated vaccines. J Infect Dis 198(3): 312–7.
  5. 5. Skowronski DM, Masaro C, Kwindt TL, Mak A, Petric M, et al. (2007) Estimating vaccine effectiveness against laboratory-confirmed influenza using a sentinel physician network: results from the 2005–2006 season of dual A and B vaccine mismatch in Canada. Vaccine 25(15): 2842–51.
  6. 6. Skowronski DM, De Serres G, Dickinson J, Petric M, Mak A, et al. (2009) Component-specific effectiveness of trivalent influenza vaccine as monitored through a sentinel surveillance network in Canada, 2006–2007. J Infect Dis 199(2): 168–79.
  7. 7. Monto AS, Ohmit SE, Petrie JG, Johnson E, Truscon R, et al. (2009) Comparative efficacy of inactivated and live attenuated influenza vaccines. N Engl J Med 361(13): 1260–7.
  8. 8. Belongia EA, Kieke BA, Donahue JG, Coleman LA, Irving SA, et al. (2011) Influenza vaccine effectiveness in Wisconsin during the 2007–08 season: Comparison of interim and final results. Vaccine 29(38): 6558–6563.
  9. 9. Frey S, Vesikari T, Szymczakiewicz-Multanowska A, Lattanzi M, Izu A, et al. (2010) Clinical efficacy of cell-culture-derived and egg-derived inactivated subunit influenza vaccines in healthy adults. Clin Infect Dis 51(9): 997–1004.
  10. 10. Skowronski DM, De Serres G, Crowcroft NS, Janjua NZ, Boulianne N, et al. (2010) Association between the 2008–09 seasonal influenza vaccine and pandemic H1N1 illness during Spring-Summer 2009: four observational studies from Canada. PLoS Med 6 7(4): e1000258.
  11. 11. Shay D (2011) Working Paper, Centers for Disease Control and Prevention, unpublished.
  12. 12. Griffin MR, Monto AS, Belongia EA, Treanor JJ, Chen Q, et al. (2011) Effectiveness of non-adjuvanted pandemic influenza A vaccines for preventing pandemic influenza acute respiratory illness visits in 4 U.S. communities. PLoS One 6(8): e23085.
  13. 13. Treanor J, Talbot HK, Ohmit SE, Coleman LA, Thompson MG, et al. (2012) Effectiveness of seasonal influenza vaccines in the United States during a season with circulation of all three vaccine strains. Clin Infect Dis 55(7): 951–959.
  14. 14. Prosser LA, Bridges CB, Uyeki TM, Hinrichsen VL, Meltzer MI, et al. (2006) Health benefits, risks, and cost-effectiveness of influenza vaccination of children. Emerg Infect Dis 12(10): 1548–58.
  15. 15. Bridges CA, Thompson WW, Meltzer MI, Reeve GR, Talamonti WJ, et al. (2000) Effectiveness and cost-benefit of influenza vaccination of healthy working adults: a randomized controlled trial. JAMA 284(13): 1655–63.
  16. 16. Maciosek MV, Solberg LI, Coffield AB, Edwards NM, Goodman MJ (2006) Influenza vaccination health impact and cost effectiveness among adults aged 50 to 64 and 65 and older. Am J Prev Med 31(1): 72–9.
  17. 17. Roberts S, Hollier LM, Sheffield J, Laibl V, Wendel GD (2006) Cost-effectiveness of universal influenza vaccination in a pregnant population. Obstet Gynecol 107(6): 1323–9.
  18. 18. Salo H, Kilpi T, Sintonen H, Linna M, Peltola V, et al. (2006) Cost-effectiveness of influenza vaccination of healthy children. Vaccine 24(23): 4934–41.
  19. 19. Nichol KL (2003) The efficacy, effectiveness and cost-effectiveness of inactivated influenza virus vaccines. Vaccine 21(16): 1769–75.
  20. 20. Meltzer MI, Neuzil KM, Griffin MR, Fukuda K (2005) An economic analysis of annual influenza vaccination in children. Vaccine 23(8): 1004–14.
  21. 21. Thompson WW, Shay DK, Weintraub E, Brammer L, Bridges CB, et al. (2004) Influenza-associated hospitalizations in the United States. JAMA 292(11): 1333–1340.
  22. 22. Reed C, Anjulo FJ, Swerdlow DL, Lipsitch M, Meltzer MI, et al. (2009) Estimates of the prevalence of pandemic (H1N1) 2009, United States, April-July 2009. Emerg Infect Dis 15(12): 2004–2007.
  23. 23. Reed C, Meltzer MI, Kirley PD, Emerson R, Aragon D, et al.. (2011) Progress toward routine estimation of the seasonal burden of influenza in the United States. Proceedings of the 49th Annual Meeting of the IDSA. October 19–23, 2011. Boston: Infectious Diseases Society of America.
  24. 24. Biggerstaff MS, Jhung M, Kamimoto L, Balluz L, Finelli L (2012) Self-reported influenza-like illness and receipt of influenza antiviral drugs during the 2009 pandemic, United States, 2009. Am J Public Health 102(10): 21–26.
  25. 25. Kamimoto L, Biggerstaff M, Finelli L. (2010) Self-reported Use of Antiviral Medications to Treat Influenza, 2007 and 2009. 27th Annual Behavioral Risk Factor Surveillance System Conference. March 20–24, 2010. San Diego, CA.
  26. 26. Barker WH, Mullooly JP (1982) Pneumonia and influenza deaths during epidemics: implications for prevention. Arch Intern Med 142: 85–89.
  27. 27. Barker WH, Mullooly JP (1980) Influenza vaccination of elderly persons, reduction in pneumonia and influenza hospitalization and deaths. JAMA 244: 2547–2549.
  28. 28. Barker WH, Mullooly JP (1980) Impact of epidemic type A influenza in a defined adult population. Am J Epidemiol 112: 798–811.
  29. 29. D’Alessio DJ, Cox PM, Dick EL (1969) Failure of inactivated influenza vaccine to protect aged population. JAMA 210: 485–489.
  30. 30. Keren G, Segev S, Morag A, Zakay Z, Barzilai A, et al. (1988) Failure of influenza vaccination in the aged. J Med Virol 25: 85–89.
  31. 31. Strassburg MA, Greenland S, Sorvillo FJ, Lieb LE, Habel LA (1986) Influenza in the elderly: report of an outbreak and a review of vaccine effectiveness reports. Vaccine 4: 38–44.
  32. 32. Singleton JA (2011) Influenza Vaccination Distribution and Coverage, United States, 2010–11 and 2011–12 Seasons. Meeting of the Advisory Committee on Immunization Practices (ACIP), October 26, 2011. http://www.cdc.gov/vaccines/recs/acip/downloads/mtg-slides-oct11/04-Singleton-Influenza.pdf, Accessed March 28, 2012.
  33. 33. Reed C, Meltzer MI, Kirley PD, Emerson R, Aragon D, et al.. (2011) Progress toward routine estimation of the seasonal burden of influenza in the United States. Proceedings of the 49th Annual Meeting of the IDSA. October 19–23, 2011. Boston: Infectious Diseases Society of America.