Influenza cohort studies, in which participants are monitored for infection over an epidemic period, are invaluable in assessing the effectiveness of control measures such as vaccination, antiviral prophylaxis and non-pharmaceutical interventions (NPIs). Influenza infections and illnesses can be identified through a number of approaches with different costs and logistical requirements.
Methodology and Principal Findings
In the context of a randomized controlled trial of an NPI with a constrained budget, we used a simulation approach to examine which approaches to measuring outcomes could provide greater statistical power to identify an effective intervention against confirmed influenza. We found that for a short epidemic season, the optimal design was to collect respiratory specimens at biweekly intervals, as well as following report of acute respiratory illness (ARI), for virologic testing by reverse transcription polymerase chain reaction (RT-PCR). Collection of respiratory specimens only from individuals reporting ARI was also an efficient design particularly for studies in settings with longer periods of influenza activity. Collection of specimens only from individuals reporting a febrile ARI was less efficient. Collection and testing of sera before and after influenza activity appeared to be inferior to collection of respiratory specimens for RT-PCR confirmation of acute infections. The performance of RT-PCR was robust to uncertainty in the costs and diagnostic performance of RT-PCR and serological tests.
Conclusions and Significance
Our results suggest that unless the sensitivity or specificity of serology can be increased RT-PCR will remain as the preferable outcome measure in NPI studies. Routine collection of specimens for RT-PCR testing even when study participants do not report acute respiratory illness appears to be the most cost efficient design under most scenarios.
Citation: Klick B, Nishiura H, Cowling BJ (2012) Optimal Design of Intervention Studies to Prevent Influenza in Healthy Cohorts. PLoS ONE 7(4): e35166. doi:10.1371/journal.pone.0035166
Editor: Gary P. Kobinger, Public Health Agency of Canada, Canada
Received: January 19, 2012; Accepted: March 13, 2012; Published: April 13, 2012
Copyright: © 2012 Klick et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work received financial support from the Harvard Center for Communicable Disease Dynamics from the National Institute of General Medical Sciences (grant no. U54 GM088558) and the Area of Excellence Scheme of the Hong Kong University Grants Committee (grant no. AoE/M-12/06). BK is supported by a Hong Kong PhD Fellowship from the Research Grants Council, Hong Kong. HN is supported by the JST PRESTO program. The funding bodies were not involved in the collection, analysis and interpretation of data, the writing of the manuscript, or the decision to submit for publication. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute of General Medical Sciences or the National Institutes of Health.
Competing interests: BJC has received study funding from MedImmune Inc., a manufacturer of influenza vaccines. The authors report no other potential conflicts of interest. This does not alter the authors' adherence to all the PLoS ONE policies on sharing data and materials.
Influenza is a major cause of mortality and morbidity worldwide . Field studies of influenza have been invaluable for understanding influenza epidemiology , . In a ‘healthy cohort’ study, participants are enrolled in a defined period, usually before the start of an influenza epidemic season, and are followed up to measure the incidence of influenza infections and illnesses usually through one or more entire epidemics. Many randomized controlled trials (RCTs) studying the efficacy of influenza vaccinations , , , , , , , , antiviral prophylaxis , , , , , , , , and non-pharmaceutical interventions , , , , ,  at preventing influenza infection and illness have followed healthy cohort study designs.
There are a variety of ways to identify influenza infections in cohorts (Table 1) , , , . Because acute upper respiratory tract infections (URTIs) associated with different pathogens can have similar clinical presentation, the sensitivity and specificity of syndromic classifications of influenza infection, or proxy measures such as absenteeism, tend to be poor when compared to laboratory-based outcomes . Respiratory specimens, such as nasal swabs or aspirates, can be collected from patients with acute URTI for virologic testing. These methods have high specificity and high sensitivity to correctly identify acute influenza virus infections and exclude other causes, with reverse transcription polymerase chain reaction (RT-PCR) recently superseding viral culture as the gold standard virologic approach , . However, due to the relatively short duration of influenza viral shedding during acute course of infection, respiratory specimens should be collected within 3–5 days of illness onset , , , although asymptomatic infections can also be identified by virologic testing , . Because collection and testing of respiratory specimens is costly, most cohort studies using virologic outcomes have collected respiratory specimens only following onset of illness in subjects , ,  although it could be feasible to arrange routine collection of specimens at regular intervals. Consequently, if RT-PCR is to be used as the main influenza diagnostic method in cohort studies, considerable resources must be devoted to the timely identification of illnesses in subjects and collection of respiratory specimens. In contrast, serologic testing of paired sera collected before and after epidemic periods of influenza activity can be easier to coordinate, and rises in antibody titers during the influenza season can indicate recent infection albeit with lower sensitivity and specificity than RT-PCR  and with specific limitations for identifying infections in recipients of influenza vaccine because of falling antibody titers after vaccination , .
Table 1. Approaches to identify influenza infection and illness or their correlates in community-based studies.doi:10.1371/journal.pone.0035166.t001
While timely collection of respiratory specimens allows sensitive identification of influenza infections, many acute URTIs are not caused by influenza virus infections , , . Therefore, when planning to collect specimens for RT-PCR testing following report of an acute URTI, it is important to consider the expected incidence rates of URTIs with various presentations in the fieldwork budget. Within a constrained budget, the costs of collection and testing of specimens has to be offset against the number of participants enrolled in the study, but this can be problematic given that the incidence of influenza and other respiratory diseases varies from year to year. If the incidence of influenza and other respiratory diseases is lower than expected and fewer specimens are collected, some funds for testing may remain unspent, while if activity is higher, funding may be insufficient to collect and test specimens from all illnesses.
It is unclear which laboratory approach – serology or RT-PCR – is the most cost effective and efficient for use in intervention studies based on healthy cohort designs. Selecting the best design to maximize study power given fixed available resources is part of Good Clinical Practice and suboptimal designs could waste valuable resources or inconvenience patients unnecessarily. Our objective here is to identify cohort study designs which can maximize statistical power to detect a difference between an intervention and a control arm in preventing influenza infections.
We simulated a comparative study for a ‘healthy cohort’ of participants that are not infected with influenza at recruitment. We assume that participants in the cohort are individually randomized in equal proportions between an intervention arm and a control arm (or between two intervention arms), as balanced studies tend to have greater statistical power than unbalanced studies. We proceed under the assumption that the intervention being considered is an NPI, such as wearing face masks or shields, or increasing their hand hygiene behaviors. We assume that all participants are recruited independently and are not members of the same households, schools, or otherwise clustered.
A range of syndromic definitions have been used as proxy outcomes in influenza studies, including definitions aiming at greater sensitivity such as “acute respiratory illness” (ARI) defined as any two of a range of respiratory and systemic symptoms (e.g. fever ≥37.8°C, cough, headache, sore throat, or myalgia) as well as definitions aiming at greater specificity by restricting to febrile ARI (FARI) for example the CDC surveillance definition of “influenza-like illness” as fever ≥37.8°C plus cough or sore throat , , , .
We consider seven alternative approaches to identification of influenza infections in the comparative study:
- Collection and testing by RT-PCR of respiratory specimens from participants reporting FARI.
- Collection and testing by RT-PCR of respiratory specimens from participants reporting ARI.
- Collection and testing by RT-PCR of respiratory specimens collected from all participants at biweekly intervals regardless of illness, as well as from any participants reporting ARI.
- Collection of paired serum from all participants plus collection and testing by RT-PCR of respiratory specimens from participants reporting FARI.
- Collection of paired serum from all participants plus collection and testing by RT-PCR of respiratory specimens from participants reporting ARI.
- Collection of paired serum from all participants plus collection and testing by RT-PCR of respiratory specimens collected from all participants at biweekly intervals regardless of illness, as well as from any participants reporting ARI.
- Collection of paired serum from all participants but no collection of respiratory specimens.
In these approaches, ARI and FARI trigger refers to collection of respiratory specimens within 1–3 days of onset of illness only if and when ARI or FARI are reported by a study participant. Because our interest is in studies that can demonstrate effectiveness of interventions against influenza specifically, we did not consider ARI or FARI as primary outcomes in our analysis and therefore of primary relevance to the present optimal design considerations, although they might be included as secondary outcomes. For analysis of paired sera a 4-fold or greater rise in antibody titers on hemagglutination inhibition (HI) assays is used to indicate infection . We did not consider proxy outcomes such as absenteeism, or clinical outcomes such as hospital admissions or outpatient visits because they were believed to have low power as study endpoints , .
Table 1 shows the parameter values used in our simulations. We assumed that the intervention could reduce the risk of influenza virus infections by 30%, with a consequent reduction in the rates of ARI and FARI episodes associated with influenza. Our simulations also allowed for an effect of the NPI on the rates of ARI and FARI episodes not associated with influenza , , , . For simplicity we assume that the risk of ARI and FARI associated with non-influenza infections is independent of the transmission dynamics of and infection with influenza virus and vice versa. For each study design variant, we used a Monte Carlo approach to randomly simulate a set of 2500 datasets. For each dataset we used chi-squared tests of the difference between arms in the proportion of laboratory confirmed infections. The proportion of datasets in which the null-hypothesis of no difference was rejected at the 0.05 significance level was defined as the statistical power , . Further technical details are provided in Text S1.
For each study budget, we calculated the number of participants per arm that can be recruited given the chosen diagnostic method and consequent costs of follow-up, as well as the anticipated ‘base case’ level of ARI and FARI incidence. We investigated the effect on study power to variability in the activity of influenza and other respiratory viruses during the study as a key sensitivity analysis. This was done because in the case of respiratory specimen collection triggered by ARI or FARI, the number of specimens collected could exceed the allotted budget if the activity of influenza and other non-influenza respiratory viruses was higher than anticipated. If that occurred in our simulation, only the number of specimens allowed by the study budget was tested. Simulations were performed assuming three different scenarios. In the first scenario (I) we assume that the cumulative incidence of ARI and FARI not associated with influenza in the control arm are 0.40 and 0.10 respectively and that these are correctly estimated in advance of the study. In the scenarios (II) and (III) the cumulative incidence of non-influenza ARI and FARI are again 0.40 or 0.10 but for purposes of study planning these are believed incorrectly to be 0.20 and 0.06 or 0.60 and 0.14 respectively. Scenarios II and III are used to illustrate how underestimation or over-estimation of ARI and FARI attack rates will reduce the power of detection methods relying on ARI or FARI report or trigger. Power, sample size, and cumulative incidence of infection in the control arm (i.e. proportion of control arm participants identified as having influenza) were plotted as a function of field budget for these three scenarios.
Due to uncertainties in model parameters, we performed several sensitivity analyses to examine how sensitive power estimates were to variations in model parameters (Table 2). Specifically, we examined the sensitivity of power estimates to differing influenza cumulative incidences, the effect of the NPI intervention on the rate of non-influenza ARI and FARI, the cost of RT-PCR testing, the cost of serological testing, the sensitivity of RT-PCR testing and the sensitivity and specificity of serology. In another sensitivity analysis, we assumed a longer, six-month influenza season with lower incidence rates but the same cumulative incidence of infection across the study as the base case.
Model results for the base case parameters are shown in Figure 1 for Scenarios I-III. A summary of the results is given in Table 3. In all scenarios, biweekly RT-PCR plus trigger yielded greater power than other study designs. In Scenario I in which expected rates of ARI and FARI noise matched actual rates, biweekly RT-PCR plus ARI trigger followed by RT-PCR upon ARI trigger were the most powerful study designs. The higher power of biweekly RT-PCR plus ARI trigger was robust to underestimation or overestimation of ARI and FARI rates (Scenarios II and III). Study design variants relying on RT-PCR generally had higher power than serological testing despite having much lower cumulative incidence of confirmed influenza (Figure 1) although in all scenarios RT-PCR upon FARI trigger performed worse or equal in terms of statistical power to serology or the combination of serology and RT-PCR. Cumulative incidence of confirmed influenza in the control arms were highest for study designs that involved serology, and lowest for the study design based on collection of specimens upon FARI trigger.
Figure 1. Comparison of alternative study designs.
In the plot, the three rows indicate: (A) power, (B) total sample size per arm, and (C) estimated cumulative incidence of influenza in the control arm. Scenario I assumes the unbiased control non-influenza attack ARI and FARI rates are 0.4 and 0.1 respectively which exactly correspond to estimates made in advance of the study. Scenario II assumes the unbiased control non-influenza attack ARI and FARI rates are 0.4 and 0.1 but are underestimated at 0.2 and 0.06 when planning the study. Scenario III assumes the unbiased control non-influenza attack ARI and FARI rates are 0.4 and 0.1 and but are overestimated at 0.6 and 0.14 when planning the study. Control arm cumulative incidence proportion refers to the expected proportion of participants identified as having influenza infection among the control arm. “Combined” refers to paired serology analyzed by HAI plus RT-PCR upon ARI trigger. Black lines are used to denote design variants using RT-PCR confirmation. Grey lines are used to denote design variants using serologic confirmation or serologic plus RT-PCR confirmation.doi:10.1371/journal.pone.0035166.g001
Table 3. Sample size per arm and total budget needed to achieve 80% power for differing methods of identification of influenza infections for both short (2 months) and long (6 months) influenza seasons.doi:10.1371/journal.pone.0035166.t003
Figure S1, Figure S2, Figure S3, Figure S4, Figure S5, and Figure S6 examine the sensitivity of observed statistical power to cumulative incidence of influenza infection, to the effectiveness of the intervention to reduce non-influenza ARI and FARI, the cost of RT-PCR, the cost of serology, the sensitivity of RT-PCR, and the sensitivity and specificity of serology respectively. Figure S7 shows the effect of increasing the follow-up time from 2 months to 6 months without changing the overall cumulative incidence of infection. In these illustrations, biweekly RT-PCR plus ARI trigger yielded the greatest power except for two cases: serology was similar to biweekly RT-PCR plus ARI trigger when the sensitivity and specificity of serological testing were increased, and RT-PCR upon ARI trigger performed the best for a longer six-month follow-up period. When the cost of serological testing was reduced, the cost of RT-PCR was increased or the sensitivity of RT-PCR was reduced, designs relying on RT-PCR still appeared to outperform serology indicating that RT-PCR is generally more efficient unless the sensitivity and specificity of serology can be increased.
We found that study design variants based on collection of respiratory specimens for RT-PCR testing almost always performed better than study design variants based on serology. Unless the duration of influenza activity was greater than two months, biweekly RT-PCR plus RT-PCR upon ARI trigger was not dominated by any other method. It should be noted that study design variants relying on serological testing had lower statistical power than RT-PCR despite being able to identify a greater proportion of influenza infections. This is consistent with several studies ,  which report higher cumulative incidence of influenza across a season based on serology than RT-PCR and is due to a number of factors: high specificity of RT-PCR, comparatively lower specificity of serology, the greater ability of serology to identify asymptomatic and subclinical infections, and underreporting of symptoms by participants. It is possible for the number of triggered RT-PCR tests required to exceed the number budgeted if more ARI or FARI cases are reported than expected. When this occurred in our simulations, we simulated the cessation of collection or analysis of specimens after the allotted field budget was exhausted. However, if an investigator were able to procure additional funds to collect and analyze the additional specimens required by circumstance this would further increase the power of a design relying on RT-PCR.
These results illustrate that careful planning is necessary when considering the design of cohort studies for influenza. We have purposely intended the present analysis to focus on the design of NPI studies. Our results might be applicable to studies of either vaccine or antiviral prophylaxis with some caveats. In vaccine trials, receipt of the vaccine usually results in higher initial antibody levels following vaccination, making interpretation of paired serology difficult , . However our observation that routine collection of respiratory specimens was more efficient than relying on illness trigger may still hold. Regarding antiviral prophylaxis, those receiving treatment could potentially have similar rates of infection as controls but have lower levels and duration of viral shedding and reduced severity of symptoms thus reducing the sensitivity of RT-PCR and clinical definitions .
While our results may serve as a broad guideline for investigators planning a cohort study, some limitations exist which may limit their use in practice. First, our models are somewhat sensitive to estimates of serology and RT-PCR costs and their sensitivity and specificity. It is likely that these estimates, especially of costs, would vary geographically. Therefore, we have presented a range of sensitivity analyses varying important model parameters. Second, it is important to note that our results apply only to naturally acquired influenza as opposed to volunteer challenge studies where participants are experimentally exposed to influenza virus , . Challenge studies could be more resource efficient than cohort studies in assessing the potential benefits of interventions at preventing infection, although the results may not be generalizable to the use or effectiveness of interventions in natural settings . Third, our results are also specifically based on viral shedding data of influenza A. Influenza B has slightly different epidemiologic characteristics including possibly a longer duration of infectiousness , . Finally, we did not consider cluster studies such as school or household-based studies, where optimal design may differ due to correlation in the risk of infection and potential differences in logistics and resources required for fieldwork.
While our study identified RT-PCR as an optimal design by comparing statistical power among different designs as a function of budget, it should be noted that other laboratory testing methods can still be optimal for other clinical or public health objectives. When influenza diagnosis is followed by treatment or public health intervention of potential contacts, testing methods are subject to other considerations. In such an instance, the objectives may be to improve clinical outcome by early treatment or to prevent secondary transmission and thus speed of diagnosis is of critical importance. While our results may not be applicable to this type of study, similar simulation approaches could be used to assess optimal design for other specific objectives under consideration.
In conclusion, large sample sizes are often needed in influenza intervention studies because of the low incidence of influenza and the moderate effects of many interventions. Our results show that a design using biweekly RT-PCR plus ARI trigger, a cumulative incidence of influenza infection of 15% and moderate intervention efficacy of 30%, approximately 1,400 participants (700 to 1800 depending on cumulative incidence of influenza infection) per arm would need to be recruited to achieve 80% power. Further research should continue to improve the accuracy of estimates of the sensitivity and specificity of laboratory methods which would help to improve study power, particularly when comparing serologic and virologic approaches to ascertainment of influenza infections. New laboratory methods may emerge which the accuracy or cost of current techniques and thus would allow for more efficient designs.
Supplemental Appendix with additional technical details.
Power of competing influenza diagnostic methods for Scenarios I–III. Sensitivity analysis (a) is when the control arm cumulative incidence is reduced to 0.1 and sensitivity analysis (b) is when the control arm cumulative incidence is reduced to 0.3.
Power of competing influenza diagnostic methods for Scenarios I–III. Sensitivity analysis (a) is when the NPI intervention has no effect on non-influenza ARI and FARI rate but we plan for a 15% reduction and sensitivity analysis (b) is when the NPI intervention reduces the non-influenza ARI and FARI rate by 30% but we plan for a 15% reduction.
Power of competing influenza diagnostic methods for Scenarios I–III. Sensitivity analysis (a) is when the cost of RT-PCR testing is small (US$35) and sensitivity analysis (b) when the cost is large (US$130).
Power of competing influenza diagnostic methods for Scenarios I–III. Sensitivity analysis (a) is when the cost of serology is small (US$130) and sensitivity analysis (b) is when the cost of serology is large (US$195).
Power of competing influenza diagnostic methods for Scenarios I–III. Sensitivity analysis (a) is when the sensitivity of RT-PCR is reduced by 20% (by AUC) and sensitivity analysis (b) is when the sensitivity of RT-PCR increased by 10% (by AUC).
Power of competing influenza diagnostic methods for Scenarios I–III. Sensitivity analysis (a) is when the sensitivity and specificity of serology is reduced to 0.76 and 0.80 respectively and sensitivity analysis (b) is when the sensitivity and specificity of serology is increased to 0.92 and 0.96 respectively.
Power of competing influenza diagnostic methods for Scenarios I–III. Sensitivity analysis is for a six month follow-up rather than two-months.
Conceived and designed the experiments: BK BJC. Performed the experiments: BK. Analyzed the data: BK. Wrote the paper: BK HN BJC.
- 1. Monto AS (2004) Global burden of influenza: what we know and what we need to know. International Congress Series 1263: 3–11.
- 2. Monto AS, Davenport FM, Napier JA, Francis T Jr (1969) Effect of vaccination of a school-age population upon the course of an A2-Hong Kong influenza epidemic. Bull World Health Organ 41: 537–542.
- 3. Monto AS, Koopman JS, Longini IM Jr (1985) Tecumseh study of illness. XIII. Influenza infection and disease, 1976–1981. Am J Epidemiol 121: 811–822.
- 4. Beran J, Wertzova V, Honegr K, Kaliskova E, Havlickova M, et al. (2009) Challenge of conducting a placebo-controlled randomized efficacy study for influenza vaccine in a season with low attack rate and a mismatched vaccine B strain: a concrete example. BMC Infect Dis 9: 2.
- 5. Loeb M, Russell ML, Moss L, Fonseca K, Fox J, et al. (2010) Effect of influenza vaccination of children on infection rates in Hutterite communities: a randomized trial. JAMA 303: 943–950.
- 6. Cowling BJ, Ng S, Ma ES, Cheng CK, Wai W, et al. (2010) Protective efficacy of seasonal influenza vaccination against seasonal and pandemic influenza virus infection during 2009 in Hong Kong. Clin Infect Dis 51: 1370–1379.
- 7. Beran J, Vesikari T, Wertzova V, Karvonen A, Honegr K, et al. (2009) Efficacy of inactivated split-virus influenza vaccine against culture-confirmed influenza in healthy adults: a prospective, randomized, placebo-controlled trial. J Infect Dis 200: 1861–1869.
- 8. Miller AE, Morgante LA, Buchwald LY, Nutile SM, Coyle PK, et al. (1997) A multicenter, randomized, double-blind, placebo-controlled trial of influenza immunization in multiple sclerosis. Neurology 48: 312–314.
- 9. Wilde JA, McMillan JA, Serwint J, Butta J, O'Riordan MA, et al. (1999) Effectiveness of influenza vaccine in health care professionals: a randomized trial. JAMA 281: 908–913.
- 10. Belshe RB, Mendelman PM, Treanor J, King J, Gruber WC, et al. (1998) The efficacy of live attenuated, cold-adapted, trivalent, intranasal influenzavirus vaccine in children. N Engl J Med 338: 1405–1412.
- 11. Belshe RB, Gruber WC, Mendelman PM, Cho I, Reisinger K, et al. (2000) Efficacy of vaccination with live attenuated, cold-adapted, trivalent, intranasal influenza virus vaccine against a variant (A/Sydney) not contained in the vaccine. J Pediatr 136: 168–175.
- 12. Monto AS, Robinson DP, Herlocher ML, Hinson JM Jr, Elliott MJ, et al. (1999) Zanamivir in the prevention of influenza among healthy adults: a randomized controlled trial. JAMA 282: 31–35.
- 13. Gravenstein S, Drinka P, Osterweil D, Schilling M, Krause P, et al. (2005) Inhaled zanamivir versus rimantadine for the control of influenza in a highly vaccinated long-term care population. J Am Med Dir Assoc 6: 359–366.
- 14. Dolin R, Reichman RC, Madore HP, Maynard R, Linton PN, et al. (1982) A controlled trial of amantadine and rimantadine in the prophylaxis of influenza A infection. N Engl J Med 307: 580–584.
- 15. Nafta I, AG TT, Braun I, Companetz W, Simionescu A, et al. (1970) Administration of amantadine for the prevention of Hong Kong influenza. Bull World Health Organ 42: 423–427.
- 16. Callmander E, Hellgren L (1968) Amantadine hydrochloride as a prophylactic in respiratory infections. A double-blind investigation of its clinical use and serology. J Clin Pharmacol J New Drugs 8: 186–189.
- 17. Dawkins AT Jr, Gallager LR, Togo Y, Hornick RB, Harris BA (1968) Studies on induced influenza in man. II. Double-blind study designed to assess the prophylactic efficacy of an analogue of amantadine hydrochloride. JAMA 203: 1095–1099.
- 18. Finklea JF, Hennessy AV, Davenport FM (1967) A field trial of amantadine prophylaxis in naturally-occurring acute respiratory illness. Am J Epidemiol 85: 403–412.
- 19. Pettersson RF, Hellstrom PE, Penttinen K, Pyhala R, Tokola O, et al. (1980) Evaluation of amantadine in the prophylaxis of influenza A (H1N1) virus infection: a controlled field trial among young adults and high-risk patients. J Infect Dis 142: 377–383.
- 20. Loeb M, Dafoe N, Mahony J, John M, Sarabia A, et al. (2009) Surgical mask vs N95 respirator for preventing influenza among health care workers: a randomized trial. JAMA 302: 1865–1871.
- 21. Sandora TJ, Shih MC, Goldmann DA (2008) Reducing absenteeism from gastrointestinal and respiratory illness in elementary school students: a randomized, controlled trial of an infection-control intervention. Pediatrics 121: e1555–1562.
- 22. Aiello AE, Murray GF, Perez V, Coulborn RM, Davis BM, et al. (2010) Mask use, hand hygiene, and seasonal influenza-like illness among young adults: a randomized intervention trial. J Infect Dis 201: 491–498.
- 23. Larson EL, Ferng YH, Wong-McLoughlin J, Wang S, Haber M, et al. (2010) Impact of non-pharmaceutical interventions on URIs and influenza in crowded, urban households. Public Health Rep 125: 178–191.
- 24. Longini IM Jr, Monto AS (1988) Efficacy of virucidal nasal tissues in interrupting familial transmission of respiratory agents. A field trial in Tecumseh, Michigan. Am J Epidemiol 128: 639–644.
- 25. MacIntyre CR, Wang Q, Cauchemez S, Seale H, Dwyer DE, et al. (2011) A cluster randomized clinical trial comparing fit-tested and non-fit-tested N95 respirators to medical masks to prevent respiratory virus infection in health care workers. Influenza Other Respi Viruses 5: 170–179.
- 26. Cowling BJ, Chan KH, Fang VJ, Lau LL, So HC, et al. (2010) Comparative epidemiology of pandemic and seasonal influenza A in households. N Engl J Med 362: 2175–2184.
- 27. Call SA, Vollenweider MA, Hornung CA, Simel DL, McKinney WP (2005) Does this patient have influenza? JAMA 293: 987–997.
- 28. Allwinn R, Preiser W, Rabenau H, Buxbaum S, Sturmer M, et al. (2002) Laboratory diagnosis of influenza–virology or serology? Med Microbiol Immunol 191: 157–160.
- 29. Zambon M, Hays J, Webster A, Newman R, Keene O (2001) Diagnosis of influenza in the community: relationship of clinical diagnosis to confirmed virological, serologic, or molecular detection of influenza. Arch Intern Med 161: 2116–2122.
- 30. Petrie JG, Ohmit SE, Johnson E, Cross RT, Monto AS (2011) Efficacy studies of influenza vaccines: effect of end points used and characteristics of vaccine failures. J Infect Dis 203: 1309–1315.
- 31. Carrat F, Vergu E, Ferguson NM, Lemaitre M, Cauchemez S, et al. (2008) Time lines of infection and disease in human influenza: a review of volunteer challenge studies. Am J Epidemiol 167: 775–785.
- 32. Lau LL, Cowling BJ, Fang VJ, Chan KH, Lau EH, et al. (2010) Viral shedding and clinical illness in naturally acquired influenza virus infections. J Infect Dis 201: 1509–1516.
- 33. Klick B, Leung GM, Cowling BJ (2011) Optimal design of studies of influenza transmission in households. I: Case-ascertained studies. Epidemiol Infect 1–9.
- 34. Osterholm MT, Kelley NS, Sommer A, Belongia EA (2011) Efficacy and effectiveness of influenza vaccines: a systematic review and meta-analysis. Lancet Infect Dis.
- 35. Higgins PB (1974) Viruses associated with acute respiratory infections 1961–71. J Hyg (Lond) 72: 425–432.
- 36. Bellei N, Carraro E, Perosa A, Watanabe A, Arruda E, et al. (2008) Acute respiratory infection and influenza-like illness viral etiologies in Brazilian adults. J Med Virol 80: 1824–1827.
- 37. Watanabe A, Carraro E, Kamikawa J, Leal E, Granato C, et al. (2010) Rhinovirus species and their clinical presentation among different risk groups of non-hospitalized patients. J Med Virol 82: 2110–2115.
- 38. Cowling BJ, Chan KH, Fang VJ, Cheng CK, Fung RO, et al. (2009) Facemasks and hand hygiene to prevent influenza transmission in households: a cluster randomized trial. Ann Intern Med 151: 437–446.
- 39. Turner RB, Fuls JL, Rodgers ND (2010) Effectiveness of hand sanitizers with and without organic acids for removal of rhinovirus from hands. Antimicrob Agents Chemother 54: 1363–1364.
- 40. MacIntyre CR, Cauchemez S, Dwyer DE, Seale H, Cheung P, et al. (2009) Face mask use and control of respiratory virus transmission in households. Emerg Infect Dis 15: 233–241.
- 41. Rabie T, Curtis V (2006) Handwashing and risk of respiratory infections: a quantitative systematic review. Trop Med Int Health 11: 258–267.
- 42. Sattar SA, Abebe M, Bueti AJ, Jampani H, Newman J, et al. (2000) Activity of an alcohol-based hand gel against human adeno-, rhino-, and rotaviruses using the fingerpad method. Infect Control Hosp Epidemiol 21: 516–519.
- 43. Lehmann EL (1986) Testing statistical hypotheses. New York: Wiley.
- 44. Madhi SA, Maskew M, Koen A, Kuwanda L, Besselaar TG, et al. (2011) Trivalent inactivated influenza vaccine in African adults infected with human immunodeficient virus: double blind, randomized clinical trial of efficacy, immunogenicity, and safety. Clin Infect Dis 52: 128–137.
- 45. McClellan K, Perry CM (2001) Oseltamivir: a review of its use in influenza. Drugs 61: 263–283.
- 46. Hayden FG, Treanor JJ, Fritz RS, Lobo M, Betts RF, et al. (1999) Use of the oral neuraminidase inhibitor oseltamivir in experimental human influenza: randomized controlled trials for prevention and treatment. JAMA 282: 1240–1246.
- 47. Killingley B, Enstone J, Booy R, Hayward A, Oxford J, et al. (2011) Potential role of human challenge studies for investigation of influenza transmission. Lancet Infect Dis 11: 879–886.
- 48. Ellis JS, Zambon MC (2002) Molecular diagnosis of influenza. Rev Med Virol 12: 375–389.
- 49. Suntarattiwong P, Jarman RG, Levy J, Baggett HC, Gibbons RV, et al. (2009) Clinical Performance of a Rapid Influenza Test and Comparison of Nasal Versus Throat Swabs to Detect 2009 Pandemic Influenza A (H1N1) Infection in Thai Children. Pediatr Infect Dis J.
- 50. Cheng PK, Wong KK, Mak GC, Wong AH, Ng AY, et al. (2010) Performance of laboratory diagnostics for the detection of influenza A(H1N1)v virus as correlated with the time after symptom onset and viral load. J Clin Virol 47: 182–185.
- 51. Cheng CK, Cowling BJ, Chan KH, Fang VJ, Seto WH, et al. (2009) Factors affecting QuickVue Influenza A + B rapid test performance in the community setting. Diagn Microbiol Infect Dis 65: 35–41.
- 52. Carter NJ, Curran MP (2011) Live attenuated influenza vaccine (FluMist(R); Fluenz): a review of its use in the prevention of seasonal influenza in children and adults. Drugs 71: 1591–1622.
- 53. Hammond GW, Smith SJ, Noble GR (1980) Sensitivity and specificity of enzyme immunoassay for serodiagnosis of influenza A virus infections. J Infect Dis 141: 644–651.