==== Front Bull Math Biol Bull Math Biol Bulletin of Mathematical Biology 0092-8240 1522-9602 Springer US New York 33289877 834 10.1007/s11538-020-00834-8 Methods Sequential Data Assimilation of the Stochastic SEIR Epidemic Model for Regional COVID-19 Dynamics http://orcid.org/0000-0002-2909-5811 Engbert Ralf ralf.engbert@uni-potsdam.de 1 http://orcid.org/0000-0002-2556-5644 Rabe Maximilian M. maximilian.rabe@uni-potsdam.de 1 http://orcid.org/0000-0002-0180-8488 Kliegl Reinhold reinhold.kliegl@uni-potsdam.de 2 http://orcid.org/0000-0002-5336-8904 Reich Sebastian sebastian.reich@uni-potsdam.de 3 1 grid.11348.3f 0000 0001 0942 1117 Department of Psychology, University of Potsdam, Potsdam, Germany 2 grid.11348.3f 0000 0001 0942 1117 Division of Training and Movement Sciences, University of Potsdam, Potsdam, Germany 3 grid.11348.3f 0000 0001 0942 1117 Institute of Mathematics, University of Potsdam, Potsdam, Germany 8 12 2020 8 12 2020 2021 83 1 113 7 2020 5 11 2020 © The Author(s) 2020 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. Newly emerging pandemics like COVID-19 call for predictive models to implement precisely tuned responses to limit their deep impact on society. Standard epidemic models provide a theoretically well-founded dynamical description of disease incidence. For COVID-19 with infectiousness peaking before and at symptom onset, the SEIR model explains the hidden build-up of exposed individuals which creates challenges for containment strategies. However, spatial heterogeneity raises questions about the adequacy of modeling epidemic outbreaks on the level of a whole country. Here, we show that by applying sequential data assimilation to the stochastic SEIR epidemic model, we can capture the dynamic behavior of outbreaks on a regional level. Regional modeling, with relatively low numbers of infected and demographic noise, accounts for both spatial heterogeneity and stochasticity. Based on adapted models, short-term predictions can be achieved. Thus, with the help of these sequential data assimilation methods, more realistic epidemic models are within reach. Electronic supplementary material The online version of this article (10.1007/s11538-020-00834-8) contains supplementary material, which is available to authorized users. Keywords Stochastic epidemic model Sequential data assimilation Ensemble Kalman filter COVID-19 DFGSFB 1294, project no. 318763901 Engbert Ralf issue-copyright-statement© Society for Mathematical Biology 2021 ==== Body Introduction The initial spread of the novel coronavirus in Germany (RKI 2020) resulted in containment measures based on reduced traveling and social distancing (Anderson et al. 2020). In epidemic standard models (Anderson et al. 1992; Kucharski et al. 2020), which provide a dynamical description of epidemic outbreaks (Bolker and Grenfell 1995; Schwartz and Smith 1983), containment measures aim at a reduction of the contact parameter. Since the contact parameter is one of the critical parameters that determine the speed of increase of the number of infectious individuals, estimating the contact parameter is a key basis for epidemic modeling (Lourenço et al. 2020). From early on, the situation of COVID-19 has been characterized by extreme spatial heterogeneity (RKI 2020). In the initial phase of the outbreak, spatial heterogeneity was caused by random travel-based imports of infectious cases and enhanced by local events with increased contacts; after introduction of non-pharmaceutical interventions, spatial heterogeneity was sustained. Therefore, over the full observation period, the assumption of homogeneous mixing must be relaxed (Grenfell et al. 1995), and coupled dynamics of regional models seem to be a more adequate description (Li et al. 2020). However, when modeling a relatively small region with a population size of N=105, compared to the country level with populations of N=107 to 109, one must address the problem of stochasticity (Engbert and Drepper 1994; Grenfell et al. 1995) (Sect. 2.2). The combination of dynamical modeling and substantial fluctuations calls for sequential data assimilation methods for parameter inference (Law et al. 2015; Reich and Cotter 2015) as widely used, for example, in numerical weather prediction (Bauer et al. 2015). We investigate how the stochastic SEIR epidemic model (Anderson et al. 1992) applies to regional data of COVID-19 incidence under non-pharmaceutical interventions, i.e., where epidemic dynamics were confined to regions and coupling between them could be neglected. The model assumes S, E, I, and R compartments representing susceptible, exposed, infectious, and recovered individuals (Fig. 1). This model is particularly important for the description of the spread of COVID-19, since infectiousness seems to peak on or before symptom onset (He et al. 2020b) and models without the exposed compartment cannot adequately address the time delay between the build-up of exposed and infectious individuals. Since we are interested in short-term modeling (weeks to months), we neglect birth and death processes as a first-order approximation for the dynamics of the model. The disease-related model parameters are the rate parameters a=1/Z (with an average latency period Z) and g=1/D (with a mean infectious period D), which can be estimated independently from the analysis of infected cases (He et al. 2020b; Li et al. 2020). Therefore, the time-dependent contact parameter β is the most critical parameter that needs to be determined via data assimilation (Reich and Cotter 2015). It is directly related to the basic reproductive number r in a SEIR-type model (Sect. 2.1), which is average number of secondary cases by each infected case in a population consisting of susceptible individuals only (Dietz 1993; He et al. 2020a). Therefore, non-pharmaceutical interventions that aim at r<1 translate into the relation β0 (for m=0 both E and I tend to zero with E⋆/I⋆≈g/a). The initial number of infected was disturbed by noise representing uncertainties in the initial model states. The initial number of susceptibles was set to N, which must be replaced by an estimate as the epidemics in unfolding more strongly, of course. Forward iterations with the estimated time-varying contact parameter show that the slope of the epidemic curve is approximately reproduced by the model (Fig. 5a,c; gray lines indicate the ensemble of simulated trajectories; blue points are observed data).Fig. 5 (Color figure online) Simulations of the stochastic SEIR model for two example regions. Simulations I indicate an ensemble of 100 runs of the model with initial conditions from the first epidemic day with number of cases greater than or equal to 30 (gray: ensemble of trajectories; blue: observations). Simulations II start at March 26, using an ensemble size of 100 after data assimilation (gray: ensemble of trajectories; red: observations). a Cumulative cases of infected individuals over time for LK Köln. b Daily reported new cases for Köln. c Cumulative cases for LK Münster. d Daily new cases for Münster. Date refers to report of case at RKI Simulation II starts at March 26 and exploits the full potential of sequential data assimilation. The sequential data assimilation approach via the ensemble Kalman filter (Sect. 2.3.1) is based on the forward modeling of an ensemble of trajectories. After each time step (1 day), the ensemble of trajectories is compared to the next observation and adjusted via a linear regression step. Thus, we obtained an adapted ensemble of internal model states for each epidemic day. Here, we exploit this fact to run a forward simulation with initial conditions from the assimilated ensemble of internal model states. The corresponding forward simulations are close to the real time-evolution of the epidemics in the two example regions (Fig. 5a,c; gray lines indicate the ensemble of simulated trajectories; blue points are observed data). A related plot of the daily reported new cases indicates an approximately constant level of numbers of new cases for Köln (Fig. 5b) and slowly decreasing daily new cases for Münster (Fig. 5d); both predictions are in agreement with empirical observations. Predictions for Two Different Scenarios The forward simulations discussed in the previous section demonstrated the predictive power of the SEIR model when using sequential data assimilation. In the next step, we generated simulations under two different scenarios. In scenario I, we started with the adapted ensemble of internal model states after data assimilation (April 16) and iterated the model forward with the mean contact parameter estimated from the period of April 14 to April 16, that is well after interventions were implemented (Fig. 6, green area). The simulations continue to match the time course of infected cases for both example regions (Fig. 6a,b). Daily reported case numbers show a decline for both regions (Fig. 6c,d). In scenario II, we assumed that all governmental intervention measures had been terminated. Therefore, we used the estimated contact parameters from the period of March 17 to March 19. Again, we started simulations with the adapted ensemble of internal states after sequential data assimilation (Fig. 6, red area). For both example regions, we observe a strong increase in infected cases under scenario II (Fig. 6c,d). This dramatic increase can be seen most clearly in the plot of daily numbers of new cases (for more examples, see section A).Fig. 6 (Color figure online) Model predictions for COVID-19 after data assimilation in comparison to data (black lines). In scenario I (green area), an assimilated ensemble of internal model states starts the forecast with contact parameter βpost (continuation of social distancing interventions). In scenario II (red area), the equivalent forecast is generated with contact parameter βpre (termination of interventions). a Predictions for cumulative case numbers in Heinsberg. b Predictions of daily new cases in Heinsberg. c Predictions of cumulative cases for Warendorf. d Predictions of daily new cases for Warendorf. Date refers to report of case at RKI Discussion The ongoing worldwide spread of the new coronavirus exerts enormous pressure on healthcare systems, societies and governments. Therefore, predicting the epidemic dynamics under the influence of non-pharmaceutical interventions (NPI) is an important problem from a data science and mathematical modeling perspective (Maier and Brockmann 2020). The motivation of the current work was to explore the potential of sequential data assimilation (Law et al. 2015; Reich and Cotter 2015) to create a regional epidemic model as a forecasting tool. The standard epidemic SEIR-type models implement a compartmental description under the assumption of homogeneous mixing of individuals (Anderson et al. 1992). More realistic modeling approaches must account for spatial heterogeneity due to time-varying disease onset times, regionally different contact rates, and the time dependence of the contact rates due to the implementation of containment strategies. However, these regional descriptions require models that include the effects of demographic stochasticity due to the limited size of populations and the low number of cases in the region considered (Bittihn and Golestanian 2020). The effects of such statistical fluctuations are inherently reproduced via stochastic versions of the standard epidemic models (Engbert and Drepper 1994; Grenfell et al. 1995). We have demonstrated the potential of sequential data assimilation to reproduce COVID-19 dynamics at the level of a regional, stochastic model. With the help of the ensemble Kalman filter (Evensen 2006), we successfully recovered the contact parameter from the simulated data and obtained reliable estimates from the empirical data. The contact parameter is the most critical free parameter in the stochastic SEIR model, since the other parameters (mean exposed and infectious duration) can be estimated independently from observed time series (He et al. 2020b; Li et al. 2020). Moreover, the contact parameter of the SEIR model is directly related to the basic reproductive number r (Liu et al. 2020). Therefore, our approach could also be framed as a model-based method for statistical inference of the basic reproductive number. Next, we ran a time-resolved data assimilation that generated estimates of the time dependence of the contact parameter. The drop in mean contact rates from an early (βpre, March 17 to 19) to a later period (βpost, March 31 to April 2) indicates the effect of non-pharmaceutical interventions. We also generated model prediction for two different scenarios. In scenario I, simulations produce forecasts with start date April 16. The previously assimilated ensemble provide the initial conditions and the contact parameter is set to the value estimated for the post-intervention period from April 14 to April 16. In scenario II, we replaced the post-intervention contact parameter with its pre-intervention value, estimated from the data for the period March 17 to March 19. As a result, the two scenarios predict rather different temporal developments (decline of daily new cases for scenario I and strong increase for scenario II). Therefore, our model predictions suggest that lifting of the non-pharmaceutical interventions could potentially turn the epidemic dynamics back to the exponential increase from before their implementation. Such predictions can easily be scaled up to the federal state level (Bundesländer) or to the country level; a corresponding predictive model will be potentially quite robust due to its explicit modeling of spatial and temporal heterogeneities, captured by a separate time course of the contact parameter for each region. A recent simulation study by Li et al. (2020) used a similar approach of sequential data assimilation for dynamic epidemic models. However, they implemented a deterministic SEIR model and extended it with additional noise assumptions. We proposed the usage of the stochastic SEIR model in the formulation of a master equation (Engbert and Drepper 1994) which can be simulated exactly and numerically efficiently using Gillespie’s algorithm (Gillespie 1976). A more complex spatiotemporal stochastic model has been considered in Arenas et al. (2020). Furthermore, the state-parameter estimation in Li et al. (2020) utilizes the ensemble Kalman filter directly on an augmented state space (Reich and Cotter 2015). Contrary to that study, we found a direct application of the ensemble Kalman filter to the augmented state space (X,β) not suitable because of the strongly nonlinear interaction between the model states X and the contact parameter β. This led us to consider a two stage approach which combines the ensemble Kalman filter for state estimation with a likelihood-based inference of the contact parameter β (Reich and Cotter 2015). The proposed two-stage approach can be extended to the estimation of multiple model parameters including the generally unknown initial states of the stochastic SEIR model. However, the computational complexity will increase exponentially with the number of parameters to be estimated and more refined Monte Carlo methods for combined state and parameter estimation will be required if the total number of parameters exceeds three or four (Reich and Cotter 2015). Our current study was mainly motivated by the methodological problem of a possible contribution from data assimilation to epidemics modeling based on a stochastic SEIR model. There are obvious limitations within our current modeling framework, which we did not address because of our methodological focus. Longer-term predictions (∼ months) are important, but they critically depend on an estimation of undocumented infections (see Li et al. 2020). Such hidden infections create, after recovery, an unknown reduction in the number of susceptibles, which slows down the epidemic dynamics; such an effect is currently not included in our current model. However, it seems compatible with our framework to extend the SEIR model by an additional class of undocumented infected individuals (Li et al. 2020). Another important limitation of these results comes from the simplifying assumption that there is no coupling to neighboring regions. As a consequence, the regional differences in the contact parameter could be at least partly due to differences in the contacts between the regions. Couplings between the regions (Li et al. 2020) could also be integrated into our modeling framework. However, the non-coupling approximation might be realistic in the situation of social distancing and travel bans during the period investigated here. Electronic supplementary material Below is the link to the electronic supplementary material.Supplementary material 1 (pdf 10 KB) Supplementary material 2 (pdf 11 KB) Supplementary material 3 (pdf 11 KB) Supplementary material 4 (pdf 10 KB) Supplementary material 5 (pdf 10 KB) Supplementary material 6 (pdf 10 KB) Supplementary material 7 (pdf 10 KB) Supplementary material 8 (docx 10 KB) Acknowledgements We thank Klaus Dietz, Tübingen, for comments on the manuscript. This work was supported by a grant from Deutsche Forschungsgemeinschaft, Germany (SFB 1294, Project No. 318763901). Funding Open Access funding enabled and organized by Projekt DEAL. Data Availability Statement Data and source code for simulations, analyses, and figures are available via Open Science Framework (OSF) at https://osf.io/7dshm/ Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. ==== Refs References Anderson RM Anderson B May RM Infectious diseases of humans: dynamics and control 1992 Oxford Oxford University Press Anderson RM Heesterbeek H Klinkenberg D Hollingsworth TD How will country-based mitigation measures influence the course of the COVID-19 epidemic? Lancet 2020 395 10228 931 934 10.1016/S0140-6736(20)30567-5 32164834 Arenas A, Cota W, Gomez-Gardenes J, Gómez S, Granell C, Matamalas JT, Soriano-Panos D, Steinegger B (2020) A mathematical model for the spatiotemporal epidemic spreading of COVID19. medRxiv:2020.03.21.20040022 Bauer P Thorpe A Brunet G The quiet revolution of numerical weather prediction Nature 2015 525 7567 47 55 10.1038/nature14956 26333465 Bittihn P, Golestanian R (2020) Containment strategy for an epidemic based on fluctuations in the sir model. preprint arXiv:2003.08784 Bolker B Grenfell BT Space, persistence and dynamics of measles epidemics Philos Trans R Soc Lond B Biol Sci 1995 348 1325 309 320 10.1098/rstb.1995.0070 8577828 Dietz K The estimation of the basic reproduction number for infectious diseases Stat Methods Med Res 1993 2 1 23 41 10.1177/096228029300200103 8261248 Engbert R Drepper F Chance and chaos in population biology-models of recurrent epidemics and food chain dynamics Chaos Solitons Fract 1994 4 7 1147 1169 10.1016/0960-0779(94)90028-0 Evensen G (2006) Data assimilation. Springer, New York Gillespie DT A general method for numerically simulating the stochastic time evolution of coupled chemical reactions J Comput Phys 1976 22 4 403 434 10.1016/0021-9991(76)90041-3 Grenfell BT Kleczkowski A Gilligan C Bolker B Spatial heterogeneity, nonlinear dynamics and chaos in infectious diseases Stat Methods Med Res 1995 4 2 160 183 10.1177/096228029500400205 7582203 He D Zhao S Li Y Cao P Gao D Lou Y Yang L Comparing COVID-19 and the 1918–1919 influenza pandemics in the United Kingdom Int J Infect Dis 2020 98 67 70 10.1016/j.ijid.2020.06.075 32599281 He X Lau EH Wu P Deng X Wang J Hao X Lau YC Wong JY Guan Y Tan X Temporal dynamics in viral shedding and transmissibility of COVID-19 Nat Med 2020 26 5 672 675 10.1038/s41591-020-0869-5 32296168 Kucharski AJ Russell TW Diamond C Liu Y Edmunds J Funk S Eggo RM Sun F Jit M Munday JD Early dynamics of transmission and control of COVID-19: a mathematical modelling study Lancet Infect Dis 2020 20 5 553 558 10.1016/S1473-3099(20)30144-4 32171059 Law K Stuart A Zygalakis K Data assimilation: a mathematical introduction 2015 New York Springer Li R Pei S Chen B Song Y Zhang T Yang W Shaman J Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV2) Science 2020 368 6490 489 493 10.1126/science.abb3221 32179701 Liu Y, Gayle AA, Wilder-Smith A, Rocklöv J (2020) The reproductive number of covid-19 is higher compared to sars coronavirus. J Travel Med, 27 Lourenço J, Paton R, Ghafari M, Kraemer M, Thompson C, Simmonds P, Klenerman P, Gupta S (2020) Fundamental principles of epidemic spread highlight the immediate need for large-scale serological surveys to assess the stage of the sars-cov-2 epidemic. medRxiv:2020.03.24.20042291 Maier BF Brockmann D Effective containment explains subexponential growth in recent confirmed COVID-19 cases in China Science 2020 368 6492 742 746 10.1126/science.abb4557 32269067 Reich S Cotter C Probabilistic forecasting and Bayesian data assimilation 2015 Cambridge Cambridge University Press RKI (2020) Robert Koch Institute (RKI): COVID-19 Data for Germany. https://npgeo-corona-npgeo-de.hub.arcgis.com/. Accessed 08 April 2020 Sakov P Oke P A deterministic formulation of the ensemble Kalman filter: an alternative to ensemble square root filters Tellus 2008 60A 361 371 10.1111/j.1600-0870.2007.00299.x Schwartz IB Smith H Infinite subharmonic bifurcation in an SEIR epidemic model J Math Biol 1983 18 3 233 253 10.1007/BF00276090 6663207