The R0 package: a toolbox to estimate reproduction numbers for epidemic outbreaks
© Obadia et al.; licensee BioMed Central Ltd. 2012
Received: 27 July 2012
Accepted: 4 December 2012
Published: 18 December 2012
Several generic methods have been proposed to estimate transmission parameters during an outbreak, especially the reproduction number. However, as of today, no dedicated software exists that implements these methods and allow comparisons.
A review of generic methods used to estimate transmissibility parameters during outbreaks was carried out. Most methods used the epidemic curve and the generation time distribution. Two categories of methods were available: those estimating the initial reproduction number, and those estimating a time dependent reproduction number. We implemented five methods as an R library, developed sensitivity analysis tools for each method and provided numerical illustrations of their use. A comparison of the performance of the different methods on simulated datasets is reported.
This software package allows a standardized and extensible approach to the estimation of the reproduction number and generation interval distribution from epidemic curves.
KeywordsEpidemics Software Reproduction number Estimation R package
In 2009, the new influenza virus A/H1N1 rapidly spread worldwide . In the World Health Organization guidance document  detailing the epidemiological parameters to quickly determine after identification of the disease were: the incubation period, i.e. time between infection and symptoms; the serial interval, i.e. time between symptoms onset in primary and secondary cases; and the initial reproduction ratio, i.e. the average number of secondary cases per primary case. In a systematic review of all articles presenting such estimates for the 2009 H1N1 influenza pandemic , we found high variability in the methods used to estimate the same parameters.
Numerical differences in the reported estimates were therefore due in part to the chosen method. Applying all methods on the same dataset would help to understand what variation is due to the method, and this will be encouraged if the required code is widely distributed. It is also worth noting that subtile variation arises from the actual implementation of the same methods. For example, the initial “exponential growth rate” of the epidemic curve, used in the method described by Wallinga & Lipsitch  has been estimated using linear regression on logged incidence , Poisson regression on incidence data  or renewal equations .
Authors may have provided code implementing their methods, but no effort has yet been made to provide end users with a unique framework, with standardized approach allowing easy comparisons. To allow comparisons and provide more standardized approaches, we developed an R package implementing five methods that were the most commonly used during the 2009 H1N1 influenza pandemic. These methods are “plug-in” methods, requiring only data that are commonly recorded during an outbreak (epidemic curve, serial interval), and have been applied in a variety of situations.
After briefly recalling the principle of these methods, we illustrate their use, propose some tools to critically examine results and finally discuss applicability and limitations.
We recall and describe the implementation of methods to estimate the serial interval distribution and reproduction numbers in epidemics. We also propose tools to explore the sensitivity of estimates to required assumptions.
Defining a generation time distribution
The generation time is the time lag between infection in a primary case and a secondary case. The generation time distribution should be obtained from the time lag between all infectee/infector pairs . As it cannot be observed directly, it is often substituted with the serial interval distribution that measures time between symptoms onset. In our software package, the ‘generation.time’ function is used to represent a discretized generation time distribution. Discretization is carried out on the grid [0,0.5), [0.5, 1.5), [1.5, 2.5), etc.… where the unit is a user chosen time interval (hour, day, week…). Several descriptions are supported: “empirical” requiring the full specification of the distribution, or parametric distributions taken among “gamma”, “lognormal” or “weibull”. In the latter case, the mean and standard deviation must be provided in the desired time units.
A function (‘est.GT’) is also provided to estimate the serial interval distribution from a sample of observed time intervals between symptom onsets in primary cases and secondary cases by maximum likelihood.
Estimation of initial reproduction numbers
Reproduction numbers may be estimated at different times during an epidemic. In the following, we recall methods for estimating the “initial” reproduction number, i.e. at the beginning of an outbreak, and for estimating the “time-dependent” reproduction number at any time during an outbreak, as well as the required hypotheses for the methods. Proposed extensions and options implemented in the software are also presented.
Attack rate (AR)
In the classical SIR model of disease transmission, the attack rate (AR : the percentage of the population eventually infected) is linked to the basic reproduction number , by where S 0 is the initial percentage of susceptible population. The required assumptions are homogeneous mixing, closed population, and no intervention during the outbreak.
Exponential growth (EG)
As summarized by Wallinga & Lipsitch , the exponential growth rate during the early phase of an outbreak can be linked to the initial reproduction ratio. The exponential growth rate, denoted by r, is defined by the per capita change in number of new cases per unit of time. As incidence data are integer valued, Poisson regression is indicated to estimate this parameter [6, 10], rather than linear regression of the logged incidence. The reproduction number is computed as where M is the moment generating function of the (discretized) generation time distribution. It is necessary to choose a period in the epidemic curve over which growth is exponential. We propose to use the deviance based R-squared statistic to guide this choice. No assumption is made on mixing in the population.
Maximum likelihood estimation (ML)
This model, proposed by White & Pagano , relies on the assumption that the number of secondary cases caused by an index case is Poisson distributed with expected value R. Given observation of (N 0, N 1, …, N T ) incident cases over consecutive time units, and a generation time distribution w, R is estimated by maximizing the log-likelihood where μ t = R ∑ i = 1 t N t − i w i . Here again, the likelihood must be calculated on a period of exponential growth, and the deviance R-squared measure may be used to select the best period. No assumption is made on mixing in the population.
The approach assumes that the epidemic curve is analysed from the first case on. If this is not the case, the initial reproduction number will be overestimated, as secondary cases will be assigned to too few index cases: we implemented a correction as described in Additional file 1: Supplementary material S1. It is also possible to account for importation of cases during the course of the epidemic.
Sequential bayesian method (SB)
This method, although introduced as “real-time bayesian” by its authors, more exactly allows sequential estimation of the initial reproduction number. It relies on an approximation to the SIR model, whereby incidence at time t + 1, N(t + 1) is approximately Poisson distributed with mean N(t)e (γ(R − 1)), where the average duration of the infectious period. The proposed algorithm, described in a Bayesian framework, starts with a non-informative prior on the distribution of the reproduction number R. The distribution is updated as new data is observed, using . In other words, the prior distribution for R used on each new day is the posterior distribution from the previous day. At each time, the mode of the posterior may be computed along with the highest probability density interval. As before, the method requires that the epidemic is in a period of exponential growth, i.e. it does not account for susceptible depletion; it implicitly uses an exponential distribution for the generation time; and assumes random mixing in the population.
Estimation of time dependent reproduction numbers (TD)
The time-dependant method, proposed by Wallinga & Teunis , computes reproduction numbers by averaging over all transmission networks compatible with observations. The probability p ij that case i with onset at time ti was infected by case j with onset at time tj is calculated as . The effective reproduction number for case j is therefore R j = ∑ i p ij , and is averaged as over all cases with the same date of onset. The confidence interval for Rt can be obtained by simulation. Correction for real time estimation, where not yet observed secondary cases are taken into account is possible . It is possible to account for importation cases during the course of the epidemic.
Vector of dates of onset. A list of dates in character or date format is required. An epicurve object from the Epitools package  (epitools::epicurve) may also be supplied.
Vector of incidence counts. In this case, the initial date and/or time step can be supplied separately.
We now illustrate the use of the package using an example dataset from the 1918 influenza pandemic , then use simulation to compare methods. The code used for this analysis is given in the Appendix.
Estimating reproduction numbers
The ‘estimate.R’ function applies the methods described above to a given epidemic curve. Several methods may be used at the same time by listing them in the “methods” argument. In the session code presented in the appendix, a generation time distribution typical of influenza is defined, using a Gamma distribution with mean 2.6 days and standard deviation 1 day . An example dataset (Germany.1918) is loaded from the package.
Estimation of initial reproduction number by four different methods over the same dataset
[ 95% CI ]
[ 95% CI ]
(optimal time window: 7:22)
[ 1.33 ; 1.36 ]
[ 1.50 ; 1.62 ]
(optimal time window: 11:22)
[ 1.16 ; 1.27 ]
[ 1.42 ; 1.66 ]
[ 1.11 ; 1.28 ]
[ 1.25 ; 1.51 ]
[ 1.09 ; 1.73 ]
[ 1.09 ; 1.73 ]
Comparison of methods
We conducted a simulation study to investigate how estimates of the reproduction number changed with the method of estimation, the role of over-dispersion in the secondary cases distribution and of epidemic curve aggregation at increasingly large time steps. Epidemics were simulated using a branching process, with no restriction on the number of susceptibles to allow exponential growth. For each case, the latent and infectious period were sampled in distributions typical of influenza (gamma distributions with mean+/−sd 1.6+/−0.3 days for latency and 1+/−1 days for infectious period ) yielding a generation time interval with mean 2.6 days. The epidemic was started with one incident case at time t=0, then for each incident case, the number of secondary cases was sampled from a negative binomial distribution with mean β I and variance k β I, where I was the individual’s duration of infectious period, β the effective contact rate, and k the overdispersion parameter. The actual time of infection of secondary cases was sampled uniformly during the infectious period of the index case. In this model, the reproduction number is R = β E(I), so that it was possible to calibrate β to obtain the desired value of R. We ran simulations with 3 values for R (1.5, 2 and 3) and overdispersion parameter k to 1 (no overdispersion) and 4 (large overdispersion).
All epidemics were simulated over a period corresponding to approximately the 6 first generations of cases (24 days). For each combination of R and k, 4000 epidemics with more than 20 cases were simulated. Epidemic data were then aggregated daily, by 3 days periods and by 6 days periods. Estimation of the reproduction ratio was made, and the bias and mean squared error were calculated.
Bias and MSE of initial reproduction number estimation methods
No overdispersion (k = 1)
Large overdispersion (k = 4)
We have described a package implementing several methods for estimating the reproduction number from epidemic curves, along with diagnostic tools and provided a comparison of the accuracy of these methods.
The reproduction number in an epidemic is of interest when the disease is actually transmitted between subjects, either directly or indirectly. This is for example the case for influenza, childhood diseases, vector borne diseases, but not in food-borne epidemics caused by environmental exposure to a pathogen. The methods implemented in the package will best be used for acute diseases with short serial intervals. The analysis of diseases with very long incubation times (e.g. HIV or HBV infection) requires more specialized methods, especially to account for censoring .
While several methods for estimating reproduction numbers exist, sometimes with code provided by their authors, no common framework was available to allow easy and direct comparison of the results. Developing an R package provide this framework and allow widespread distribution. It will complement package developed for epidemiological surveillance  and cost-effectiveness analyses . Furthermore, R packages are easily extensible, so that additional methods can be easily included in future releases.
Regarding the methods described here, we found that when the data was available on a time scale smaller than the mean generation time, all methods tended to be unbiased. Very small aggregation windows may lead to gaps, i.e. time periods with 0 observations. In this case, the SB method fails after the first gap (data not shown). Other methods are not affected, provided the maximum generation time is longer than the gap. When the data was aggregated in time periods up to twice the mean generation time, only the exponential growth method remained unbiased. Indeed, it has previously been reported that aggregation in time periods of 1 mean generation time width was ideal for estimation, and corrections proposed for larger time intervals . The results obtained from the methods described here when data are aggregated in time periods larger than the mean generation time should therefore be interpreted with caution, all the more than the exponential growth assumption is unlikely to be met on long time periods.
In a real situation, and especially for an emerging disease, several practical problems must be taken into account in the application of these methods. The attack rate method requires the least information, but is only usable when the epidemic is over, and furthermore requires that no intervention was set up during the whole course of an outbreak. Therefore its use is generally limited to particular settings like schools or army platoons, for example . All other methods require the epidemic curve and the generation time distribution, with the ‘initial’ reproduction ratio as an output. If one assumes that the population was totally susceptible at first, it may also be interpreted as the basic reproduction ratio (R0); a correction will be necessary in the case of a initial partial immunity.
With a truly emerging outbreak, prior knowledge on the generation time distribution may be unavailable. Allowing sensitivity analyses according to the mean generation time, as we described, is therefore important to help quantify uncertainty in this respect. In other cases, estimation of the generation time distribution is relatively straightforward from pairs of infectors/infectees if there is a marked separation between generations; it is more complicated when generations quickly overlap as with influenza . An additional issue is that symptom onset dates may be known only to an interval, requiring specialized methods for estimation . Joint-estimation of the generation time distribution and reproduction number is another possibility [11, 14].
A second step is to choose a time period that displays exponential growth. Too long a time period may depart from true exponential growth and bias estimation downwards, while too short a period may lead to large variance in the estimates. We implemented a method to select the optimal period displaying exponential growth based on the deviance R-squared, a commonly used method to measure goodness of fit of model to data. As shown in Figure 2A, the typical profile of the R-squared deviance presents a maximum that allows selecting the best period.
An implicit assumption in all methods is that all cases are recorded and are linked by a chain of transmission. However, the following issues will arise: missing first cases; under-reporting; unreported cases; reporting delays; importation cases.
If the epidemic is not observed from the first case on, overestimation of the initial reproduction number is likely since some initial cases are absent from the epidemic curve, and secondary cases will be imputed to too few index cases. A correction was implemented for missing generations at the beginning of the epidemic curve for the ML method, similar to that proposed by McBryde in a Bayesian setting  using the assumption of constant reproduction number. No obvious way exists to correct the TD method, as the reproduction ratio is allowed to change with time. The EG and SB methods are, by construction, not dependent on this issue.
No method explicitly accounts for under-reporting during the course of the epidemic. If the under-reporting rate is constant in time, no bias is expected. However, if it is known that under-reporting changed with time, this could be corrected before estimation proceeds, as was done in the US .
Non-reported cases during an outbreak the epidemic are neither accounted for. Treating missing cases as latent observations has been proposed, but requires the grouping of cases in successive generations rather than on a temporal basis .
Importation of cases during the course of the epidemic generally leads to overestimation of the reproduction ratio, since these cases are considered as “offspring” of cases present earlier in the outbreak. In all the methods presented here, only the TD and ML methods can satisfactorily correct for importation cases. The other methods are less easily modified in this respect, and this should be the object of further research.
A final issue is reporting delays, especially when analysis is done in real time. Reporting delays cause a downward bias in incidence in the last few days of observation. This will impact the most the ML and TD estimates, as these rely more heavily on the fit of the model to the observed incidence. In practice, one may wait for data consolidation before applying any method, but it would also be possible to correct for this bias before estimating the reproduction number if the reporting delay is known [14, 26].
In the simulation study, we identified that all methods would generally be biased downwards for a disease like flu, with bias increasing both with larger aggregation windows and increasing reproduction number. An exception was the EG method, with upward bias for small R values (R<2) and downwards bias for larger values. When incidence data was available on a daily basis, i.e. smaller than the generation time distribution, the characteristics of the four methods compared. The EG method was the least sensitive to changes in aggregation window, while the ML and TD methods were rapidly inconsistent. The SB method was generally not better than the EG method. Best practice in case of an emerging epidemic will likely depend on a combination of reproduction ratio magnitude, mean generation time duration and aggregation detail. We have provided the framework that would allow comparison and critic of these estimates.
Finally, we highlighted that the estimated reproduction ratio may depend on the method for estimation. This should be taken into account in comparisons, and also when calibrating predictive models as small differences can lead to large variation in attack rates and assessment of required efficacy in interventions.
Although many mathematical models have been developed to estimate several types of reproduction numbers during epidemic outbreaks, no unique workframe existed. We here provide a user-friendly R package that supports five of the most commonly used methods, and extend some approaches with sensitivity analysis or imputing censored data. This will allow for fast assessment of the transmissibility parameters in new outbreaks, as well as critical assessment of the reported values. The package is currently available from the CRAN repository.
Availability and requirements
Project name: R0 Package
Project home page: CRAN repository (http://cran.r-project.org/web/packages/R0/)
Operating system(s): Platform independent
Programming language: R
Other requirements: R v2.13 or higher
License: GPL (>= 2)Any restrictions to use by non-academics: None
Typical session code> library(R0) # loads library> # epidemic curve can be input as a list of dates> epid = c("2012-01-01", "2012-01-02", "2012-01-02", "2012-01-03")> # or as incidence counts> epid.count = c(1,2,4,8)> # create generation time : gamma distribution, with mean 2.6 time units and standard deviation 1 time unit> GT.flu <− generation.time("gamma", c(2.6,1))> # loads example dataset> data(Germany.1918)> res.R <− estimate.R(Germany.1918, GT=GT.flu, methods=c("EG","ML","SB","TD"))# applies methods EG, ML, SB, TD to the dataset> plot(res.R) # diplays results> plotfit(res.R) # displays fit to the epidemic curve# sensitivity analysis according to choice of time window for exponential growth> sensitivity.analysis(Germany.1918, GT.flu, begin=1:15, end=16:30, est.method="EG", sa.type="time")> # sensitivity analysis according to generation time> sensitivity.analysis(Germany.1918, GT.type="gamma", GT.mean=seq(1,5,1), GT.sd.range=1, begin=1, end=27, est.method="EG", sa.type="GT")
Partial funding from MOSAR network contract LSHP-CT-2007-037941; Institut National de Veille Sanitaire.
- Khan K, Arino J, Hu W, Raposo P, Sears J, Calderon F, Heidebrecht C, Macdonald M, Liauw J, Chan A, Gardam M: Spread of a Novel Influenza A (H1N1) Virus via Global Airline Transportation. N Engl J Med. 2009, 361: 212-214. 10.1056/NEJMc0904559.View ArticlePubMedGoogle Scholar
- World Health Organization: Global Surveillance during an Influenza Pandemic. 2009,http://www.who.int/csr/disease/swineflu/global_pandemic_influenza_surveilance_apr09.pdf,Google Scholar
- Boëlle P-Y, Ansart S, Cori A, Valleron A-J: Transmission parameters of the A/H1N1 (2009) influenza virus pandemic: a review. Influenza and Other Respiratory Viruses. 2011, 5: 306-316. 10.1111/j.1750-2659.2011.00234.x.View ArticlePubMedGoogle Scholar
- Wallinga J, Lipsitch M: How generation intervals shape the relationship between growth rates and reproductive numbers. Proceedings of the Royal Society B: Biological Sciences. 2007, 274: 599-10.1098/rspb.2006.3754.View ArticlePubMedGoogle Scholar
- Chowell G, Viboud C, Simonsen L, Miller MA, Acuna-Soto R, Díaz J, Martínez-Martín AF: The 1918–19 Influenza Pandemic in Boyacá. Colombia. Emerging infectious diseases. 2012, 18: 48-View ArticlePubMedGoogle Scholar
- Boëlle PY, Bernillon P, Desenclos JC: A preliminary estimation of the reproduction ratio for new influenza A(H1N1) from the outbreak in Mexico, March-April 2009. Euro Surveill. 2009, 14 (19): pii=19205Google Scholar
- Nishiura H, Wilson N, Baker M: Estimating the reproduction number of the novel influenza A virus (H1N1) in a Southern Hemisphere setting: preliminary estimate in New Zealand. N. Z. Med. J. 2009, 122: 73-77.PubMedGoogle Scholar
- Svensson Å: A note on generation times in epidemic models. Math Biosci. 2007, 208: 300-311. 10.1016/j.mbs.2006.10.010.View ArticlePubMedGoogle Scholar
- Dietz K: The estimation of the basic reproduction number for infectious diseases. Statistical Methods in Medical Research. 1993, 2: 23-41. 10.1177/096228029300200103.View ArticlePubMedGoogle Scholar
- Hens N, Van Ranst M, Aerts M, Robesyn E, Van Damme P, Beutels P: Estimating the effective reproduction number for pandemic influenza from notification data made publicly available in real time: a multi-country analysis for influenza A/H1N1v 2009. Vaccine. 2011, 29: 896-904. 10.1016/j.vaccine.2010.05.010.View ArticlePubMedGoogle Scholar
- Forsberg White L, Pagano M: A likelihood-based method for real-time estimation of the serial interval and reproductive number of an epidemic. Statist. Med. 2008, 27: 2999-3016. 10.1002/sim.3136.View ArticleGoogle Scholar
- Bettencourt LMA, Ribeiro RM: Real time bayesian estimation of the epidemic potential of emerging infectious diseases. PLoS One. 2008, 3: e2185-10.1371/journal.pone.0002185.View ArticlePubMedPubMed CentralGoogle Scholar
- Wallinga J, Teunis P: Different epidemic curves for severe acute respiratory syndrome reveal similar impacts of control measures. Am J Epidemiol. 2004, 160: 509-10.1093/aje/kwh255.View ArticlePubMedGoogle Scholar
- Cauchemez S, Boëlle P-Y, Donnelly CA, Ferguson NM, Thomas G, Leung GM, Hedley AJ, Anderson RM, Valleron A-J: Real-time estimates in early detection of SARS. Emerg Infect Dis. 2006, 12: 110-113.View ArticlePubMedPubMed CentralGoogle Scholar
- Tomas JA: epitools: epidemiology Tools. R package version 0.5-7. 2012,http://CRAN.R-project.org/package=epitools,Google Scholar
- Nishiura H: Time variations in the transmissibility of pandemic influenza in Prussia, Germany, from 1918–19. Theor Biol Med Model. 2007, 4: 20-10.1186/1742-4682-4-20.View ArticlePubMedPubMed CentralGoogle Scholar
- Carrat F, Vergu E, Ferguson NM, Lemaitre M, Cauchemez S, Leach S, Valleron A-J: Time lines of infection and disease in human influenza: a review of volunteer challenge studies. Am J Epidemiol. 2008, 167: 775-785. 10.1093/aje/kwm375.View ArticlePubMedGoogle Scholar
- Nishiura H, Castillo-Chavez C, Safan M, Chowell G: Transmission potential of the new influenza A (H1N1) virus and its age-specificity in Japan. Euro Surveill. 2009, 14: 19227-PubMedGoogle Scholar
- Cori A, Valleron AJ, Carrat F, Scalia Tomba G, Thomas G, Boëlle PY: Estimating influenza latency and infectious period durations using viral excretion data. Epidemics. 2012, 4: 132-138. 10.1016/j.epidem.2012.06.001.View ArticlePubMedGoogle Scholar
- Brookmeyer R, Gail MH: Minimum size of the acquired immunodeficiency syndrome (AIDS) epidemic in the United States. Lancet. 1986, 328: 1320-1322. 10.1016/S0140-6736(86)91444-3.View ArticleGoogle Scholar
- Nishiura H, Chowell G, Heesterbeek H, Wallinga J: The ideal reporting interval for an epidemic to objectively interpret the epidemiological time course. J. R. Soc. Interface. 2010, 7: 297-307. 10.1098/rsif.2009.0153.View ArticlePubMedGoogle Scholar
- Lessler J, Cummings DAT, Fishman S, Vora A, Burke DS: Transmissibility of swine flu at Fort Dix, 1976. J. R. Soc. Interface. 2007, 4: 755-762. 10.1098/rsif.2007.0228.View ArticlePubMedPubMed CentralGoogle Scholar
- Cauchemez S, Bhattarai A, Marchbanks TL, Fagan RP, Ostroff S, Ferguson NM, Swerdlow D, Sodha SV, Moll ME, Angulo FJ, Palekar R, Archer WR, Finelli L: Role of social networks in shaping disease transmission during a community outbreak of 2009 H1N1 pandemic influenza. PNAS. 2011, 108: 2825-2830. 10.1073/pnas.1008895108.View ArticlePubMedPubMed CentralGoogle Scholar
- Lessler J, Reich NG, Cummings DAT: Outbreak of 2009 pandemic influenza A (H1N1) at a New York City school. N Engl J Med. 2009, 361: 2628-2636. 10.1056/NEJMoa0906089.View ArticlePubMedGoogle Scholar
- McBryde ES, Bergeri I, van Gemert C, Rotty J, Headley EJ, Simpson K, Lester RA, Hellard M, Fielding JE: Early transmission characteristics of influenza A(H1N1)v in Australia: Victorian state. Euro Surveill. 16 May - 3 June 2009, 14 (42): pii=19363Google Scholar
- White LF, Wallinga J, Finelli L, Reed C, Riley S, Lipsitch M, Pagano M: Estimation of the reproductive number and the serial interval in early phase of the 2009 influenza A/H1N1 pandemic in the USA. Influenza and Other Respiratory Viruses. 2009, 3: 267-276. 10.1111/j.1750-2659.2009.00106.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Glass K, Becker N, Clements M: Predicting case numbers during infectious disease outbreaks when some cases are undiagnosed. Statistics in Medicine. 2007, 26: 171-183. 10.1002/sim.2523.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/12/147/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.