Literature DB >> 33079036

Nowcasting (Short-Term Forecasting) of Influenza Epidemics in Local Settings, Sweden, 2008-2019.

Armin Spreco, Olle Eriksson, Örjan Dahlström, Benjamin John Cowling, Matthew Biggerstaff, Gunnar Ljunggren, Anna Jöud, Emanuel Istefan, Toomas Timpka.   

Abstract

The timing of influenza case incidence during epidemics can differ between regions within nations and states. We conducted a prospective 10-year evaluation (January 2008-February 2019) of a local influenza nowcasting (short-term forecasting) method in 3 urban counties in Sweden with independent public health administrations by using routine health information system data. Detection-of-epidemic-start (detection), peak timing, and peak intensity were nowcasted. Detection displayed satisfactory performance in 2 of the 3 counties for all nonpandemic influenza seasons and in 6 of 9 seasons for the third county. Peak-timing prediction showed satisfactory performance from the influenza season 2011-12 onward. Peak-intensity prediction also was satisfactory for influenza seasons in 2 of the counties but poor in 1 county. Local influenza nowcasting was satisfactory for seasonal influenza in 2 of 3 counties. The less satisfactory performance in 1 of the study counties might be attributable to population mixing with a neighboring metropolitan area.

Entities:  

Keywords:  Sweden; epidemiology; evaluation research; human influenza; infectious disease; influenza; modelling; respiratory diseases; respiratory infections; signal detection analysis; surveillance; vaccine-preventable diseases; viruses

Mesh:

Year:  2020        PMID: 33079036      PMCID: PMC7588521          DOI: 10.3201/eid2611.200448

Source DB:  PubMed          Journal:  Emerg Infect Dis        ISSN: 1080-6040            Impact factor:   6.883


Reliable forecasts of the timing and spatial spread of influenza during seasons and pandemics can meaningfully advance the timing of public health communication campaigns and implementation of resource allocation in healthcare (). Different types of influenza forecast methods have been developed and applied to support public health response (). However, although modelers have shown considerable interest in developing infectious disease forecasts, the readiness in the public health community for applying these predictions has been lacking (). One reason for this discrepancy might be that national public health policies for response to infectious disease outbreaks often assign the responsibility for healthcare resource allocation to local health authorities (i.e., county and municipality governments). For geographic and infrastructural reasons, the timing of the spatial spread of influenza can differ substantially between these administrative units within nations and states. Therefore, a need exists for influenza forecasting methods that harmonize with policy-making responsibilities at local government levels and that are more relevant for public health practitioners. Another reason for the poor uptake of forecasting methods might be a lack of prospective evaluations of their reliability. To address this issue, the US Centers for Disease Control and Prevention (CDC) has run the Forecast the Influenza Season Collaborative Challenge (FluSight) since the 2013–14 influenza season to prospectively evaluate different methods and data sources for influenza forecasting at the national, regional, and (starting in the 2017–18 influenza season) state level (). At the local (county and municipality) level, however, few corresponding prospective evaluations based on routine health system data have been reported. Short-term forecasting is denoted as nowcasting (). Recently, a prospective 5-year appraisal of a local nowcasting method () in a county in Sweden (county population ≈460,000) indicated promising results with regard to detection of the local start of the epidemic, prediction of peak timing, and prediction of peak intensity (). The appraisal concluded that a longer prospective evaluation was needed to ascertain the validity of the results and that data from larger urban counties were required to draw reliable conclusions about generalizability. In this article, we describe a prospective 10-year evaluation of this local influenza nowcasting method in 3 urban counties (population 1.3–2.2 million) in Sweden. The evaluation period included 1 pandemic (2009) and 9 seasonal influenza epidemics.

Methods

Study Design

We used an open cohort design based on the total population in 3 urban counties: Stockholm County (population 2,231,000), West Gothia County (population 1,649,000), and Scania County (population 1,304,000) (Figure 1). We used retrospective data from January 1, 2008, through June 30, 2009, and prospective data from July 1 through February 28, 2019, from 2 sources in the countywide health information system: daily numbers of clinically diagnosed influenza cases (Figure 2) and daily syndromic chief complaint data from a telenursing service (Figure 3) (,). The clinical influenza case data were used for detection of the local start of the epidemic and prediction of its peak intensity, and the syndromic data were used to detect the peak timing. Existing evidence of to predict strong association between the clinical influenza case data and syndromic chief complaint data from the telenursing service was used in this nowcasting method (,). Because of a change of system, no syndromic chief complaint data were available for Stockholm County. Syndromic data from West Gothia County were therefore used to predict of the peak timing for Stockholm County.
Figure 1

Three regions analyzed in study of nowcasting for influenza epidemics in local settings, Sweden. Black indicates Stockholm County, red West Gothia County, gray Scania County. Included in the map is the island Zeeland (Sjaelland) (which is neighboring to Scania County). Blue indicates the city of Copenhagen (population 2 million) (on the island in the left lower corner of the figure).

Figure 2

Daily numbers of influenza-diagnosis cases per 100,000 population, January 1, 2008–February 28, 2019, in Stockholm County (upper graph), West Gothia County (middle graph), and Scania County (lower graph), Sweden.

Figure 3

Daily numbers of telenursing calls attributable to fever (among children and adults) per 100,000 population, January 1, 2008–February 28, 2019, in West Gothia County (upper graph) and Scania County (lower graph), Sweden.

Three regions analyzed in study of nowcasting for influenza epidemics in local settings, Sweden. Black indicates Stockholm County, red West Gothia County, gray Scania County. Included in the map is the island Zeeland (Sjaelland) (which is neighboring to Scania County). Blue indicates the city of Copenhagen (population 2 million) (on the island in the left lower corner of the figure). Daily numbers of influenza-diagnosis cases per 100,000 population, January 1, 2008–February 28, 2019, in Stockholm County (upper graph), West Gothia County (middle graph), and Scania County (lower graph), Sweden. Daily numbers of telenursing calls attributable to fever (among children and adults) per 100,000 population, January 1, 2008–February 28, 2019, in West Gothia County (upper graph) and Scania County (lower graph), Sweden. Timeliness was used as a performance metric for detection of the local start of the epidemic and the peak-timing prediction; the correct identification of intensity category on a 5-grade scale (i.e., nonepidemic, low, medium, high, and very high) was used for peak-intensity prediction. The study design was approved by the Regional Research Ethics Board in Linköping (approval no. 2012/104-31).

Definitions

Influenza cases were identified by using codes from the International Classification of Diseases, 10th Revision, for influenza (J10.0, J10.1, J10.8, J11.0, J11.1, J11.8) () as recorded in the local electronic health data repository. Only influenza diagnoses in the first coding position were used. Influenza-related telenursing call cases were identified by using the chief complaint codes associated with influenza symptoms. The symptoms used were fever, cough, and headache. These data were downloaded from the electronic patient record systems to the electronic health data repository twice daily. The intensity level defining the start of a local epidemic (i.e., the intensity that determines the endpoint for the detection function) was set to 6.3 influenza-diagnosis cases/100,000 population recorded during a floating 7-day period in the countywide health information system (). This level was chosen by inspecting the epidemic curves of previous local influenza epidemics. A recent comparison of influenza intensity levels in Europe estimated a similar level (6.4 influenza-diagnosis cases/week/100,000 population) for the 2008–09 seasonal influenza in Sweden (). The optimal alerting threshold before each epidemic was decided by calculating the sensitivity and the specificity for the previous nonpandemic influenza seasons and studying them on a receiver operating characteristic curve (). The calculation of the specificity was based on all days in the nonepidemic period (i.e., before the limit of 6.3 influenza-diagnosis cases/100,000 during a floating 7-day period occur), and the calculation of the sensitivity was based on the days in the epidemic period (i.e., from when the limit of 6.3 influenza-diagnosis cases/100,000 during a floating 7-day period has occurred). Peak timing was defined as the day when the highest number of influenza-diagnosis cases were documented in the countywide electronic patient record. Peak intensity was defined as the number of influenza-diagnosis cases that had been documented at peak timing.

Method Application

Technical details concerning the 3 functions of nowcasting have been described previously (; Appendix). The functions are detecting the start of the influenza season or pandemic and forecasting the peak day and peak intensity. Once the epidemic has been detected using the clinical influenza data, the syndromic telenursing data are used to detect when it decreases, that being the indication for the peak. Because changes in clinical influenza data have been found to occur 14 days after corresponding changes in syndromic data, the peak timing in the clinical influenza data are forecasted to occur 14 days after the peak in the syndromic data. Finally, the peak intensity is forecasted by using the clinical influenza data. Syndromic data have a higher amplitude, and the relationship between syndromic data and clinical influenza data are not necessarily constant between seasons. Therefore, the clinical data were used to predict the intensity once the peak day is predicted with the help of syndromic data. To calibrate the detection component of the nowcasting method, we retrospectively determined weekday effects on recording of influenza-diagnosis cases and a baseline alert threshold by using the retrospective data. These data were collected from January 1, 2008, through June 30, 2009, including 2 nonpandemic influenza seasons (2007–08 and 2008–09). To determine weekday effects, data from the entire retrospective data collection period were used. To determine the initial alert threshold, only data from the seasonal influenza in 2008–09 were used. The 2007–08 seasonal influenza could not be used for this purpose because the season had started before January 1, 2008. Throughout the study period, the calibration data were updated after every seasonal influenza (i.e., no updates of the threshold after the 2009 pandemic outbreak). The detection algorithm was thus applied to the next epidemic by using the revised threshold determined in the updated retrospective dataset. Before the 2010–11 seasonal influenza, no updates were performed because the set of retrospective data remained the same (i.e., it contained data from the 2008–09 seasonal influenza but excluded pandemic data). For the 2011–12 seasonal influenza, the threshold was updated by using retrospective data from the 2008–09 and 2010–11 seasonal influenza. For the 2012–13 seasonal influenza, the threshold was updated by using retrospective data from the 2008–09, 2010–11, and 2011–12 seasonal influenza, and so on. The weekday effects were assumed to be relatively constant over time in the local detection analyses and were therefore not updated after every seasonal influenza. The set of retrospective data from the seasonal influenza in 2007–08 and in 2008–09 were also used to initially calibrate peak-timing prediction for West Gothia County and Scania County. The dataset was used to decide the grouping of chief complaints with the largest correlation strength and longest lead time from telenursing data to influenza-diagnosis data (,). For both counties, the best performing telenursing chief complaint was fever (among children and adults), and the most favorable lead time was 14 days. When the peak timing had been determined, the second component of the local prediction module was applied to influenza-diagnosis data from the corresponding epidemics to find the peak intensity on the predicted peak day (). Regarding weekday effects on local prediction, the same calculation was applied and the same grouping of chief complaints and lead time were used throughout the study.

Metrics and Interpretations

On the basis of the utility of the nowcasting method in local healthcare settings, the maximum tolerable timeliness error for detection and peak-timing predictions was set to 11 days (»1.5 weeks). Method performance was defined to be excellent if the absolute value of the timeliness error was <3 days, good if it was 4–7 days, tolerable if it was 8–11 days, and poor if it was >12 days. For the interpretation of peak intensity predictions, the intensity level categories (nonepidemic <0.9, low 0.9, medium 2.4, high 5.5, and very high intensity level 7.9 cases/day/100,000 population) identified using the moving epidemic method for the reference influenza season 2008–09 in Sweden () were used. If the predicted peak intensity fell into the same category as the recorded peak intensity, the prediction was considered excellent. If the predicted peak intensity did not fall into the same intensity category, the predicted peak was considered good if it was up to 10% above or below the threshold for the recorded peak intensity category, tolerable if the predicted peak was 10%–20% above or below the threshold for the recorded peak intensity category, and poor otherwise. When assessing series of nowcasts, the performance of a sequence of nowcasts was considered satisfactory if all separate forecasts were assessed as excellent, good, or tolerable, and poor otherwise.

Results

Local Detection

The date of the actual start of the epidemic phase for the 10 influenza epidemics differed by 2–27 days between the 3 counties (Table 1). The detection component of the local nowcasting method showed good or excellent performance in all counties under surveillance for 6 of the 9 nonpandemic influenza seasons and in 2 out of 3 counties under surveillance for the 3 remaining seasons. Twice the poor alerts were issued too soon and once belatedly. The detection performance was good during the 2009 influenza A(H1N1) pandemic in 2 of 3 counties (Stockholm and West Gothia) and poor in 1 county (Scania).
Table 1

Performance of the detection algorithm displayed with alert thresholds updated by using data from previous nonpandemic influenza seasons in evaluation of nowcasting for detection and prediction of local influenza epidemics, Sweden, 2008–2019

Influenza virus activityUpdated* alert threshold,
cases/day/100,000 population†Timeliness‡Start according to methodActual start§Interpretation
2008–09 A(H3N2), initial retrospective data
Stockholm0.63
West Gothia0.73
Scania
0.25




2009 A(H1N1)
Stockholm0.63−52009 Aug 242009 Aug 19Good
West Gothia0.73−62009 Sep 32009 Aug 28Good
Scania
0.25
18
2009 Aug 13
2009 Aug 31
Poor
2010–11 A(H1N1) and B¶
Stockholm0.63−72010 Dec 302010 Dec 23Good
West Gothia0.73−122011 Jan 92010 Dec 28Poor
Scania
0.25
2
2010 Dec 23
2010 Dec 25
Excellent
2011–12 A(H3N2)
Stockholm0.5922012 Jan 222012 Jan 24Excellent
West Gothia0.4312012 Jan 312012 Feb 1Excellent
Scania
0.27
23
2012 Jan 9
2012 Feb 1
Poor
2012–13 A(H3N2), A(H1N1), and B
Stockholm0.51−62013 Jan 32012 Dec 28Good
West Gothia0.4402012 Dec 292012 Dec 29Excellent
Scania
0.28
0
2012 Dec 27
2012 Dec 27
Excellent
2013–14 A(H3N2), A(H1N1), and B
Stockholm0.5202014 Jan 302014 Jan 30Excellent
West Gothia0.3712014 Jan 272014 Jan 28Excellent
Scania
0.35
0
2014 Jan 28
2014 Jan 28
Excellent
2014–15 A(H3N2) and B
Stockholm0.52−62015 Jan 132015 Jan 7Good
West Gothia0.3902015 Jan 172015 Jan 17Excellent
Scania
0.35
7
2015 Jan 16
2015 Jan 23
Good
2015–16 A(pH1N1) and B
Stockholm0.5202016 Jan 22016 Jan 2Excellent
West Gothia0.47162015 Dec 282016 Jan 13Poor
Scania
0.34
0
2015 Dec 16
2015 Dec 16
Excellent
2016–17 A(H3N2)
Stockholm0.34−22016 Dec 12016 Nov 29Excellent
West Gothia0.31−22016 Dec 172016 Dec 15Excellent
Scania
0.31
0
2016 Dec 10
2016 Dec 10
Excellent
2017–18 A(H3N2) and B
Stockholm0.3802017 Dec 122017 Dec 12Excellent
West Gothia0.4442017 Dec 302018 Jan 3Good
Scania
0.34
5
2017 Dec 22
2017 Dec 27
Good
2018–19 A(pH1N1)
Stockholm0.36−72018 Dec 182018 Dec 5Good
West Gothia0.40−62018 Dec 282018 Dec 22Good
Scania0.3452018 Dec 272019 Jan 1Good

*Threshold updated after every seasonal influenza (i.e., no updates after pandemic outbreaks).
†Threshold determined using clinical influenza-diagnosis data.
‡Positive value means that the algorithm issued an alarm before the local epidemic had started; negative value means that the alarm was raised after the start of the epidemic.
§Actual start is the date when the retrospectively calculated intensity level reached the predefined threshold for start of an epidemic (6.3 influenza-diagnosis cases/100,000 population recorded during a floating 7-day period) (,).
¶No update of threshold before this seasonal influenza because the previous outbreak was a pandemic.

*Threshold updated after every seasonal influenza (i.e., no updates after pandemic outbreaks).
†Threshold determined using clinical influenza-diagnosis data.
‡Positive value means that the algorithm issued an alarm before the local epidemic had started; negative value means that the alarm was raised after the start of the epidemic.
§Actual start is the date when the retrospectively calculated intensity level reached the predefined threshold for start of an epidemic (6.3 influenza-diagnosis cases/100,000 population recorded during a floating 7-day period) (,).
¶No update of threshold before this seasonal influenza because the previous outbreak was a pandemic.

Local Prediction

For the 2009 influenza pandemic, the performance of the peak-timing prediction was poor in all 3 study counties (Table 2). The peak-timing prediction was also poor for the 2010–11 seasonal, when influenza A(H1N1) and B viruses were circulating. Thereafter, the predictions were tolerable for the 2011–12 seasonal influenza, when influenza A(H3N2) virus was circulating, and good to excellent for the remaining influenza seasons, with the exception of the poor peak-timing predictions for Scania County for the 2016–17 and 2017–18 influenza seasons, with influenza A(H3N2) virus circulating in 2016–17 and influenza A(H3N2) and B in 2017–18.
Table 2

Performance of peak-timing and peak-intensity predictions from evaluation of nowcasting for detection and prediction of local influenza epidemics, Sweden, 2008–2019

Influenza virus activityTime-to-peak*
Peak-intensity category, cases/day/100,000 population†§
Prediction datePredictedErrorInterpretationPredictedFactualInterpretation
2009 A(H1N1)
Stockholm2009 Sep 13856PoorMedium (5.0)Very high (12.4)Poor
West Gothia2009 Sep 13856PoorLow (2.2)Very high (13.7)Poor
Scania
2009 Sep 25
10
42
Poor

Low (1.4)
High (6.4)
Poor
2010–11 A(H1N1) and B
Stockholm2011 Jan 141028PoorMedium (3.4)Medium (3.5)Excellent
West Gothia2011 Jan 141014PoorMedium (4.3)High (6.1)Tolerable
Scania
2011 Jan 10
11
22
Poor

Medium (2.9)
High (5.5)
Poor
2011–12 A(H3N2)
Stockholm2012 Feb 278−8TolerableHigh (7.4)Very high (9.4)Good
West Gothia2012 Feb 278−8TolerableHigh (7.8)Very high (9.6)Good
Scania
2012 Feb 27
8
−8
Tolerable

Medium (4.0)
High (6.8)
Poor
2012–13 A(H3N2), A(H1N1), and B
Stockholm2013 Feb 108−7GoodVery high (10.3)Very high (12.2)Excellent
West Gothia2013 Feb 108−7GoodVery high (10.3)Very high (11.9)Excellent
Scania
2019 Feb 8
10
−7
Good

High (7.3)
Very high (10.7)
Good
2013–14 A(H3N2), A(H1N1), and B
Stockholm2014 Feb 168−7GoodMedium (2.7)Medium (3.0)Excellent
West Gothia2014 Feb 168−7GoodMedium (3.5)Medium (2.9)Excellent
Scania
2014 Feb 17
8
−1
Excellent

Medium (3.2)
Medium (4.2)
Excellent
2014–15 A(H3N2) and B
Stockholm2015 Feb 2286GoodMedium (4.5)High (6.5)Tolerable
West Gothia2015 Feb 2286GoodVery high (7.9)Very high (8.3)Excellent
Scania
2015 Feb 14
9
0
Excellent

Medium (3.9)
Very high (8.1)
Poor
2015–16 A(H1N1) and B
Stockholm2016 Feb 780ExcellentHigh (6.7)Very high (8.2)Tolerable
West Gothia2016 Feb 787GoodHigh (7.6)Very high (11.6)Good
Scania
2016 Feb 6
9
7
Good

Medium (4.3)
Very high (10.4)
Poor
2016–17 A(H3N2)
Stockholm2017 Jan 18−7GoodVery high (8.2)High (6.8)Good
West Gothia2017 Feb 1287GoodMedium (3.3)Medium (3.7)Excellent
Scania
2017 Feb 5
8
14
Poor

Medium (4.2)
Medium (5.1)
Excellent
2017–18 A(H3N2) and B
Stockholm2018 Feb 188−7GoodVery high (14.4)Very high (11.6)Excellent
West Gothia2018 Feb 1880ExcellentMedium (5.2)High (5.9)Good
Scania
2018 Feb 4
8
14
Poor

Medium (4.2)
Very high (14.0)
Poor
2018–19 A(H1N1)
Stockholm2019 Feb 380ExcellentVery high (14.4)High (6.2)Poor
West Gothia2019 Feb 387GoodMedium (4.0)Medium (3.4)Excellent
Scania2019 Feb 38−7GoodMedium (2.8)Medium (5.2)Excellent

*Time-to-peak (days) determined using syndromic telenursing data. Positive value means that the peak was predicted to be reached before the actual peak occurs, whereas negative value means that the peak is predicted after the actual peak occurs.
†Peak-intensity category determined using clinical influenza-diagnosis data.
§Using clinical influenza data (Table 1), the start of the epidemic was detected on December 27. On February 1, using syndromic data, the peak in clinical influenza data was forecasted to occur 8 days later (February 9), but the peak actually occurred on February 2 (7 days earlier than forecasted). Also, on February 1, the clinical influenza data intensity was forecasted to be high.

*Time-to-peak (days) determined using syndromic telenursing data. Positive value means that the peak was predicted to be reached before the actual peak occurs, whereas negative value means that the peak is predicted after the actual peak occurs.
†Peak-intensity category determined using clinical influenza-diagnosis data.
§Using clinical influenza data (Table 1), the start of the epidemic was detected on December 27. On February 1, using syndromic data, the peak in clinical influenza data was forecasted to occur 8 days later (February 9), but the peak actually occurred on February 2 (7 days earlier than forecasted). Also, on February 1, the clinical influenza data intensity was forecasted to be high. The prediction of the peak-intensity level was poor for the 2009 influenza pandemic in all 3 study counties (Table 2). For seasonal influenza, in 2 of the study counties (Stockholm and West Gothia) the predictions were tolerable to excellent for all seasons, except for the 2018–19 season with influenza A(H1N1) in Stockholm. In 1 county (Scania), the peak-intensity predictions were poor for 5 of the 9 influenza seasons: 2010–11 with influenza A(H1N1) and B, 2011–12 with influenza A(H3N2), 2014–15 with influenza A(H3N2) and B, 2015–16 with influenza A(H1N1) and B, and 2017–18 with influenza A(H3N2) and B circulating.

Discussion

Epidemic forecasts for large administrative areas (e.g., nations or states) might not be sufficiently informative for local response to epidemics if sizable variations in disease transmission patterns exist between the smaller administrative areas (e.g., counties) with independent local healthcare governance that they contain (). The importance of taking the local context into regard in epidemic forecasting has been further emphasized during the current coronavirus pandemic (). In our prospective 10-year evaluation of local nowcasting in 3 urban counties, the start of the influenza seasons included differed by up to 27 days and the peak intensity by >1 intensity level among the counties, whereas the time-of-peak differences were small. The purpose of the evaluated local detection function was to allow hospitals and primary healthcare centers time to prepare for management of influenza patients (e.g., by preparing intensive care unit resources or postponing some elective procedures). This component showed satisfactory performance in all 3 counties. The peak-timing prediction function was aimed at informing the local authorities when the peak has occurred and that health service routines soon can be permitted to return to normal. This component showed satisfactory performance from the 2011–12 influenza season onward. Predictions of peak timing were made 8–10 days before the peak and were +7 days accurate in most cases. This finding contrasts with the current practices in the study counties, where the peak of an influenza season is retrospectively determined from surveillance data »10–14 days after it has occurred. The nowcasting of peak-intensity level was aimed at warning the local authorities about high-intensity influenza transmission and the potential need for social distancing measures (e.g., closure of kindergartens). This component provided satisfactory information for influenza seasons in 2 out of 3 study counties (Stockholm and West Gothia). Although the evaluated nowcasting method is automated to run on routinely collected healthcare data, the accuracy of the nowcasts depends on the stability of the data supply and information infrastructure over time. The method does not require influenza cases to be confirmed by a laboratory as long as data recording remains relatively stable. Nonetheless, some observations can be made about the sensitivity of the local nowcasts to contextual factors. In Sweden, vaccination adapted to the current circulating strains is made available free-of-cost to the elderly and risk groups before every influenza season. However, in the case of the 2009 influenza A(H1N1) pandemic, a national vaccination campaign was implemented, covering the entire population. This intervention probably influenced the nowcasting performance during the corresponding period. Looking only at the performance for seasonal influenza, we observed outcomes in 1 of the 3 study counties (Scania) the raise concerns about vulnerability of the nowcasts to sociodemographic dynamics (). Malmö (population 450,000; capital of Scania County, Sweden) and Copenhagen (population 2 million; capital of Denmark) are connected by a bridge providing for daily commuting between the metropolitan areas, and their labor markets are closely integrated. The epidemic situation in the highly cosmopolitan Copenhagen region might have had a stronger influence on influenza epidemics in Scania County than the epidemic situation in the neighboring regions had on the other study counties. By structured introduction, evaluation, and modification of prediction models that use additional data sources and statistical methods, local nowcasting can be adapted also to communities with unusual characteristics (,). This evidence-based strategy means that, our method can be incrementally adapted to modeling of, for instance, local rural or semirural communities in which residents commute extensively to a neighboring city that is not included in the model. Some possible limitations exist in terms of the design of this prospective evaluation that require attention. First and foremost, whether the framework used to interpret the nowcasting performance is adequate from the local health authority perspective should be assessed. Regarding the time-of-peak predictions, the ongoing FluSight study uses weekly data (), thus accepting forecasts made at a weekly resolution. The evaluation framework used to classify forecasts as excellent was at a higher temporal resolution (less than one half week). This boundary was defined from a county government perspective, where the attention is on local resource allocation (e.g., intensive-care unit facilities and hospital beds) for the care of influenza patients. In this situation, nowcasts that are off by days to weeks might have severe consequences for patients in need of these resources. Categories that are suitable for evaluation of usefulness in local response preparations might not be suitable for interpretation of utility in national or international response planning. These observations suggest that the requirements on the accuracy of peak-timing predictions are context-dependent and warrant further research. Concerning the predictions of peak intensity, evaluation of the peak-intensity forecasts indicated that 22% (6 of 27) of the seasonal influenza nowcasts were poor. Retrospectively documenting baseline and threshold values for influenza epidemics helps define whether an influenza epidemic has been different in intensity compared with previous seasons and thereby contributes to future preparedness planning (,). For the evaluation of intensity predictions in this study, we used the thresholds established using the moving epidemic method from the reference 2008–09 seasonal influenza season. To improve the validity of the assessments, annual updates of the threshold values using county-level data from previous seasons should be considered for future evaluations of local influenza nowcasting. Longitudinal prospective evaluations might be needed to draw valid conclusions concerning the performance of local epidemic nowcasting, and inclusion of data from urban counties might be required for generalizability (). We found in our study that the performance of seasonal influenza nowcasting was satisfactory during a 10-year period in 3 urban counties regarding local detection and peak-timing prediction performance. The predictions of the local peak-intensity level were satisfactory in 2 of the study counties but poorer in 1 county, possibly because of sudden sociodemographic changes. We conclude that the performance of the local nowcasting method was satisfactory for seasonal influenza. The results are of general interest for local healthcare planning during epidemics because the precision by which healthcare systems can adapt its resources to the management of infected patients in these situations affects the resource availability for all other patient groups.

Appendix

Additional information about nowcasting (short-term forecasting) of influenza epidemics in local settings, Sweden, 2008–2019.
  16 in total

1.  Population-based simulations of influenza pandemics: validity and significance for public health policy.

Authors:  Toomas Timpka; Henrik Eriksson; Elin A Gursky; James M Nyce; Magnus Morin; Johan Jenvald; Magnus Strömgren; Einar Holm; Joakim Ekberg
Journal:  Bull World Health Organ       Date:  2009-04       Impact factor: 9.408

2.  Complementing the power of deep learning with statistical model fusion: Probabilistic forecasting of influenza in Dallas County, Texas, USA.

Authors:  Marwah Soliman; Vyacheslav Lyubchich; Yulia R Gel
Journal:  Epidemics       Date:  2019-06-08       Impact factor: 4.396

3.  Reporting of artificial intelligence prediction models.

Authors:  Gary S Collins; Karel G M Moons
Journal:  Lancet       Date:  2019-04-20       Impact factor: 79.321

4.  Influenza surveillance in Europe: comparing intensity levels calculated using the moving epidemic method.

Authors:  Tomás Vega; José E Lozano; Tamara Meerhoff; René Snacken; Julien Beauté; Pernille Jorgensen; Raúl Ortiz de Lejarazu; Lisa Domegan; Joël Mossong; Jens Nielsen; Rita Born; Amparo Larrauri; Caroline Brown
Journal:  Influenza Other Respir Viruses       Date:  2015-09       Impact factor: 4.380

5.  Integrated Detection and Prediction of Influenza Activity for Real-Time Surveillance: Algorithm Design.

Authors:  Armin Spreco; Olle Eriksson; Örjan Dahlström; Benjamin John Cowling; Toomas Timpka
Journal:  J Med Internet Res       Date:  2017-06-15       Impact factor: 5.428

6.  Performance of eHealth data sources in local influenza surveillance: a 5-year open cohort study.

Authors:  Toomas Timpka; Armin Spreco; Örjan Dahlström; Olle Eriksson; Elin Gursky; Joakim Ekberg; Eva Blomqvist; Magnus Strömgren; David Karlsson; Henrik Eriksson; James Nyce; Jorma Hinkula; Einar Holm
Journal:  J Med Internet Res       Date:  2014-04-28       Impact factor: 5.428

Review 7.  A systematic review of studies on forecasting the dynamics of influenza outbreaks.

Authors:  Elaine O Nsoesie; John S Brownstein; Naren Ramakrishnan; Madhav V Marathe
Journal:  Influenza Other Respir Viruses       Date:  2013-12-23       Impact factor: 4.380

8.  Evaluation of Nowcasting for Detecting and Predicting Local Influenza Epidemics, Sweden, 2009-2014.

Authors:  Armin Spreco; Olle Eriksson; Örjan Dahlström; Benjamin John Cowling; Toomas Timpka
Journal:  Emerg Infect Dis       Date:  2018-10       Impact factor: 6.883

9.  A collaborative multiyear, multimodel assessment of seasonal influenza forecasting in the United States.

Authors:  Nicholas G Reich; Logan C Brooks; Spencer J Fox; Sasikiran Kandula; Craig J McGowan; Evan Moore; Dave Osthus; Evan L Ray; Abhinav Tushar; Teresa K Yamana; Matthew Biggerstaff; Michael A Johansson; Roni Rosenfeld; Jeffrey Shaman
Journal:  Proc Natl Acad Sci U S A       Date:  2019-01-15       Impact factor: 11.205

10.  Monitoring the COVID-19 epidemic in the context of widespread local transmission.

Authors:  Alberto L García-Basteiro; Carlos Chaccour; Caterina Guinovart; Anna Llupià; Joe Brew; Antoni Trilla; Antoni Plasencia
Journal:  Lancet Respir Med       Date:  2020-04-02       Impact factor: 30.700

View more
  1 in total

1.  Nowcasting (Short-Term Forecasting) of COVID-19 Hospitalizations Using Syndromic Healthcare Data, Sweden, 2020.

Authors:  Armin Spreco; Anna Jöud; Olle Eriksson; Kristian Soltesz; Reidar Källström; Örjan Dahlström; Henrik Eriksson; Joakim Ekberg; Carl-Oscar Jonson; Carl-Johan Fraenkel; Torbjörn Lundh; Philip Gerlee; Fredrik Gustafsson; Toomas Timpka
Journal:  Emerg Infect Dis       Date:  2022-03       Impact factor: 6.883

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.