| Literature DB >> 34404718 |
Sebastian Walsh1, Avirup Chowdhury2, Vickie Braithwaite2, Simon Russell3, Jack Michael Birch2, Joseph L Ward3, Claire Waddington4, Carol Brayne5, Chris Bonell6, Russell M Viner3, Oliver T Mytton2.
Abstract
OBJECTIVES: To systematically reivew the observational evidence of the effect of school closures and school reopenings on SARS-CoV-2 community transmission.Entities:
Keywords: COVID-19; epidemiology; public health
Mesh:
Year: 2021 PMID: 34404718 PMCID: PMC8375447 DOI: 10.1136/bmjopen-2021-053371
Source DB: PubMed Journal: BMJ Open ISSN: 2044-6055 Impact factor: 2.692
Figure 1Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram.
Characteristics of included studies, stratified by study design
| Study | Country | Study period | Setting type | Unit of exposure | Confounders/Co-interventions adjusted for | Other NPI measures | Analysis type |
| Auger | USA | Study period: 13 March 2020 to 23 March 2020 | Primary and secondary schools | US state | Variable | Negative binomial regression to estimate effect of school closures on the changes in incidence and mortality rates, as calculated by interrupted time series analysis. | |
| Banholzer | USA, Canada, Australia, Norway, Switzerland and EU-15 countries | Study period: n=100 cases until 15 April 2020 | Primary school closure data used to determine exposure date | Country | Border closure, event ban, gathering ban, venue closure, lockdown, work ban, day-of-the-week effects | Variable | Bayesian hierarchical model assuming negative binomial distribution of new cases. |
| Brauner | 34 European and 7 non-European countries | Study period: 22 January 2020 to 30 May 2020 | Primary and secondary schools | Regional data where available, otherwise country | Mass gathering bans, business closures, university closures, stay-at-home orders | Variable | Bayesian hierarchical model to estimate effectiveness of individual NPIs on the reproduction number |
| Chernozhukov | USA | Study period: 7 March 2020 to 3 June 2020 | Primary and secondary schools | US state | Business closures, stay-at-home orders, hospitality closures, mask mandates, mobility data, national case/mortality trends | Variable | Regression model with autoregressive strucutres to allow for dynamic effects of other NPIs and mobility data. |
| Courtemanche | USA | Study period: | Not specified | US counties, or county equivalents | Other NPIs (stay-at-home orders, hospitality closure, limiting gathering size), total daily tests done in that state | Variable | Fixed effects regression to estimate the effect of school closure on the growth rate of cases (% change). |
| Dreher | USA | Study period: | Not specified | US state | Data collected on: demography (population density, population size, GDP, state-wide health and healthcare capacity) and on NPIs (stay-at-home orders, mass gathering bans and business closures). However, covariables with a p>0.1 in univariate analysis and collinear variables were excluded. Full details are not available of which covariables were included | Variable |
Univariate linear regression of NPI implementation and average Rt after the 500th case. Cox proportional hazards regression of the association between NPI implementation and time for cases to double from 500th to 1000th case. Cox proportional hazards regression of the association between NPI implementation and time for deaths to double from 50 to 100. |
| Garchitorena | 32 European countries | Study period: 1 February 2020 to 16 September 2020 | Early years settings, primary schools and secondary schools | Country | Stay-at-home orders, university closures, mass gathering bans, mask mandates, work-from-home orders, public space closures, business and retail closures | Variable | Used incidence data, supplemented by a capture-recapture method using mortality data to infer undiagnosed cases. Compared this with a counterfactual age-structured Susceptible-Exposed-Infectious-Removed (SEIR) model coupled with Monte Carlo Markov Chain to estimate effectiveness of NPI combinations—then estimated their disentangled effects (considering each individual NPI over the duration of their implementation). |
| Hsiang | Italy, France, USA | Study period: | Not specified | Provincial/Regional level (Italy and France), state level (USA) | Other NPIs (travel ban and quarantine, work-from-home order, no social gatherings, social distancing rules, business and religious closures, home isolation), test regimes | Variable | Reduced-form econometric (regression) analysis to estimate the effect of school closures on the continuous growth rate (log scale). |
| Jamison | 13 European countries | Study period: until 16 May 2020 | Not specified | Country | Workplace closures, public event cancellations, restricting gathering sizes, closing public transport, stay-at-home orders, internal movement restrictions and international travel, mobility data, population >65 years, population density, number of acute care beds per population, starting date of epidemic, day of the epidemic | Variable | Linear regression model reporting the percentage point reduction in the daily change of deaths measured as a 5-day rolling average. |
| Kilmek-Tulwin and Tulwin | 15 European countries; Argentina, Brazil and Japan | Study period: not specified | Not specified | Country | None | Not specified | Wilcoxon signed rank test to determinethe significance of differences between pairs of incidence rates from different time points. Time points considered: 16th day, 30th day, 60th day since 100th case. Cases/million population compared following implementation of school closures. |
| Krishnamachari | USA | Study period: not specified | Not specified | US state | State analysis: days for preparation, population density, % urban, % black, % aged >65 years, % female | Variable | Negative binomial regression comparing states/cities above and below median value for days to implement school closures, on rate ratio of cumulative incidence on days 14, 21, 28, 35 and 42 following the area’s 50th case. All variables in analysis classified a 1 if above median value for dataset, and 0 if below. |
| Li | Worldwide (167 geopolitical areas) | Study period: 1 January 2020 to 19 May 2020 | Not specified | Country, province or state | None specified | School closures only considered in the context of travel and work restrictions, and mass gathering bans already being in place | Validate a novel SEIR model ('DELPHI') in the 167 countries between 28 April 2020 and 12 May 2020. Then elicit the effect of each day an NPI was in place on the DELPHI-derived changes to the infection rate at each time point. |
| Li | Worldwide (131 countries) | Study period: 1 January 2020 to 20 July 2020 | Not specified | Country | Other NPIs (international travel bans, internal travel bans, stay-at-home requirements, public transport closures, mass gathering bans, public event bans, workplace closures) | Variable | Defined a time period as a period in which the NPIs in a given country were the same. Calculated the R ratio as the ratio between the daily R of each period and the R from the last day of the previous period. Pooled countries using log-linear regression with the introduction and relaxation of each NPI as independent variables for the first 28 days after introduction/relaxation of the NPI. |
| Liu | Worldwide (130 countries) | Study period: 1 January 2020 to 22 June 2020 | Not specified | Mostly country, although lags were examined at the World Region level | Various parsimonious models. Variables considered: workplace closure, cancellation of public events, gathering size restrictions, public transport closures, stay-at-home requirements, internal movement restrictions, international travel restrictions, income support for households, public information campaigns, testing policy and contact tracing policy | Variable | Parsimonious linear fixed effects panel regression, using stepwise backwards variable selection. Accounted for collinearity of interventions by conducting hierarchical cluster analysis with multiscale bootstrapping to test the statistical significance of identified clusters. |
| Papadopoulos | Worldwide (150 countries) | Study period: 1 January 2020 to 29 April 2020 | Not specified | Country | NPIs (workplace closure, public event cancellations, gathering size restrictions, public transport closures, stay-at-home restrictions, internal travel restrictions, international travel restrictions, public information campaigns, testing systems and contact tracing systems), timing of each NPI in days since first case, overall stringency index and sociodemographics (population, life expectancy, purchasing power, longitude, date of first death, average household size) | Variable | Univariate regression model for effect of school closures on total log cases and total log deaths. Multivariate regression model for effect of timing of school closures (relative to first case) on log total cases and log total deaths. |
| Piovani | 37 OECD Member Countries | Study period: 1 January 2020 to 30 June 2020 | Not specified | Country | Timing of mass gathering bans, time from first death to peak mortality, cumulative incidence at first death, log population size, hospital beds per population, % population aged 15–64 years, % urban, annual air passengers and population density | Variable | Multivariable negative binomial regression with panel data. |
| Rauscher | USA | Study period: until 27 April 2020 | Not specified | US state | Population density, number of schools, public school enrolment, stay-at-home order date, whether school closures were mandated or recommended | Variable | Regression analyses of time between the state’s 100th cases and day of school closures and the daily cumulative cases and deaths, measured on the log scale per 100 000 residents. |
| Stokes | Worldwide (130 countries) | Exposure: time before first death; and first 14 days after first death | Not specified | Country | An overall average strictness and timeliness of NPI measures (as a whole) derived from data on school closures, workplace closures, public event bans, gathering bans, public transport closures, stay-at-home orders, internal movement restrictions, international travel restrictions and public information campaigns. Also adjusted for days since NPI implementation, population density, % over 65, % male, life expectancy, hospital beds, GDP, health expenditure, international tourism, governance, region, testing policy, contact tracing policy | Variable | Multivariable linear regression to estimate the effect of NPIs (including school closures) as lagged variables on the daily mortality rate per 1 million 0–24 days after the first death, 14–38 days after the first death. |
| Wu | USA | Study period: until 28 May 2020 | Not specified | US counties | Stay-at-home orders, mass gathering bans, restaurant closures, hospitality and gym closures, federal guidelines, foreign travel ban | Variable | Grouped together demographically and socioeconomically similar counties into five clusters, then developed a model of R for each cluster applying a Bayesian mechanistic model to excess mortality data. |
| Yang | USA | Study period: 21 January 2020 to 5 June 2020 | Early years, and ‘schools’ (presumed primary and secondary) | US counties | County-level demographic characteristics, NPIs (school closures, leisure activity closure, stay-at-home orders, face mask mandates, daycare closures, nursing home visiting bans, medical service suspension) and previous week log R | Variable, but school closures generally implemented before other measures | Mechanistic transmission models fitted to lab-confirmed cases, applying lag times from the literature. Used generalised estimating equations with autoregression of confounders. |
| Yehya | USA | Study period: 21 January 2020 to 29 April 2020 | Primary and secondary schools | US state | Population size, population density, % aged <18 years, % aged >65 years, % black, % Hispanic, % in poverty, geographical region | Variable | Multivariable negative binomial regression to estimate mortality rate ratios associated with each day of delaying school closure. |
| Zeilinger | Worldwide (176 countries) | Study period: until 17 August 2020 | Not specified | Country | NPIs (mass gathering bans, social distancing rules, business closures, curfews, declaration of emergencies, border restrictions, lockdown); % population >65, % population urban, GDP, % exposed to high PM2.5 air pollution; day of the year, and days since 25th cumulative case | Variable | Non-parametric machine learning model applied to each country, before pooling the estimated NPI effects across countries. Including only the 90 days after the 25th cumulative case. |
| Gandini | Italy | Study period: 7 August 2020 to 2 December 2020 | Early years, primary and secondary schools | Italian province | None specified | Variable | Created a model of R from data on new cases, parameters estimated using data from the first wave in Italy (serial interval 6.6) and Bayesian methodology to account for the epidemiological uncertainty. Reported as the median for the 7-day posterior moment. Compared neighbouring provinces that reopened or reclosed schools at different times. |
| Iwata | Japan | Study period: 27 January 2020 to 31 March 2020 | Primary and secondary schools | Country | None specified | Not specified | Time series analysis using Bayesian inference to estimate effect of school closures on the incidence rate of COVID-19. |
| Matzinger and Skinner | USA | Study period: | Primary and secondary schools | US state | None specified | Not specified | Calculated changes to the doubling time of new cases, hospitalisations and deaths by plotting log2 of cases, hospitalisations and deaths against time, and using segmented regression to analyse changes in the trends in response to NPI implementation. |
| Neidhofer and Neidhofer | Argentina, Italy, South Korea | Study period: not specified | Not specified | Country | Indirectly adjusted for in derivation of counterfactual, based on most comparable countries for: population size and density, median age, % aged >65 years, GDP per capita, hospital beds per 100 000 inhabitants, public health expenditures, average number of reported COVID-19 deaths before day zero, growth rate of reported COVID-19 cases with respect to the day before and mobility patterns retrieved from Google Mobility Reports | All three countries: banning of public events, restriction of international flights, contact tracing, public information campaign. Other unspecified interventions in place in each country | Difference-in-differences comparison to a synthetic control unit (derived from the weighted average of the epidemic curves from comparable countries that closed schools later), to estimate the % reduction in deaths in the 18 days postschool closure. |
| Shah | Australia, Belgium, Italy, UK, USA | Study period: 1 February 2020 to 30 June 2020 | Not specified | Country | Other NPIs (workplace closures, public event cancellations, restrictions on mass gatherings, public transport closure, stay-at-home orders, internal movement restrictions) and mobility data from Apple | Not specified | Poisson regression to estimate the effect of NPIs on mortality (outcome measure not fully explained). |
| Sruthi | Switzerland | Study period: 9 March 2020 to 13 September 2020 | Secondary schools used as exposure date | Swiss Canton (region) | Closures of hairdressers, bars, nightclubs, restaurants and retail. Travel restrictions. Mask mandates. Number of hotel rooms within the Canton. Results stratified by Cantons with and without mask mandates in place within secondary schools | Variable | Artificial intelligence model to disentangle the effect of individual NPIs on Rt. R estimated exclusively from incidence data. |
| Stage | Denmark, Germany, Norway | Study period: March–June 2020 | Early years, primary and secondary schools | Country | None specified but timing of other NPIs, and changes to testing capacity outlined within analysis | Variable | Closures: observed data compared against counterfactual unmitigated simulation using an epidemic model fitted by Approximate Bayesian Computation, with a Poisson Gaussian process regression model. Response dates measured as a change in growth rate occurring at least 5 days after the intervention, exceeding the 75th centile of the modelled data, and where the deviation persists for at least 5 days. |
| Juni | Worldwide (144 countries) | Study period: | Not specified | Country | Country-specific factors (GDP per capita, health expenditure as % of GDP, life expectancy, % aged ≥65 years, Infectious Disease Vulnerability Index, urban population density), geography factors (flight passengers per capita, closest distance to a geopolitical area with an already established epidemic, geogrpahical region) and climatic factors (temperature, humidity) | Variable | Weighted random-effects regression analysis to estimate the effect of school closures on the changes to the incidence rate (measured as the ratio of rate ratios, dividing cumulative cases up to 28 March 2020, by cumulative cases until 21 March 2020, for each area). |
| Walach and Hockertz | 34 European countries, Brazil, Canada, China, India, Iran, Japan and USA | Study period: until 15 May 2020 | Not specified | Country | Days of pandemic, life expectancy, smoking prevalence | Variable | First examined correlations between multiple individual variables and cases/deaths in non-parametric analysis. Then incorporated those with an r>0.3 into generalised linear models, starting with the best correlated variables and adding in only those that improved model fit. |
| Wong | Worldwide (139 countries) | Analysis period: | Not specified | Country | Stringency index (workplace closure, public event cancellation, restrictions on gathering size, public transport closure, stay-at-home orders, restrictions on internal movement and international travel, public information campaigns), GDP, population density | Variable | Multivariable linear regression to estimate the effect of school closures on the rate of increase in cumulative incidence of COVID-19. |
| Beesley | Worldwide (24 countries) | Study period: until 1 September 2020 | Mostly all schools, but in the Netherlands noted that primary schools were reopened first | Country | None | Not specified | Naked eye analysis of 7-day rolling average of new cases. |
| Ehrhardt | Germany | Study period: 25 February 2020 to 4 August 20202 | Early years settings, primary and secondary schools | Baden-Wurttemberg (region of Germany) | None specified | Not specified | Presentation of an epidemic curve showing daily new cases in Baden-Wurttemberg from 25 February 2020 to 7 August 2020 with key school dates labelled. |
| Gandini | See description in school closure section above | ||||||
| Garchitorena | See description in school closure section above | ||||||
| Harris | USA | Study period: January–October 2020 | Not specified | US counties | Adjusted for NPIs (stay-at-home orders, non-essential business closures, non-essential business reopening, restaurant closures, restaurant reopenings, mask mandates and resumption of religious gatherings), with state, county and calendar week fixed effects | Variable | Difference-in-differences event study model with propensity score matching comparing exposure data (codified as: virtual only 0, hybrid model 0.5, in-person teaching only 1) with inpatient hospitalisations with diagnoses of COVID-19 or COVID-19-related symptoms from insurance data. |
| Ingelbeen | Belgium | Study period: 1 August 2020 to 30 November 2020 | Primary and secondary schools | Brussels, Belgium | None specified | Cafes, restaurants and sports facilities had already been reopened in a limited way from June, and five close contacts were permitted from July | Plotted R using data from the national contact tracing system. Also used the contact tracing data to examine age-specific trends in cases/contacts following school reopenings. |
| Isphording | Germany | Study period: 1 July 2020 to 5 October 2020 | Not specified | German counties | Adjusted for mobility data from a private company which have data on one-third of German mobile phone users, and Google mobility reports. Fixed effects used to control for demographic differences | Not specified | Regression model comparing changes in new cases between counties that reopen schools after the summer holidays, with counties that have not yet reopened schools. Considered data from 2 weeks before reopening to 3 weeks after. |
| Li | See description in school closure section above | ||||||
| Sruthi | See description in school closure section above | ||||||
| Stein-Zamir | Germany | Study period: 1 July 2020 to 5 October 2020 | Not specified | German counties | Adjusted for mobility data from a private company which have data on one-third of German mobile phone users, and Google mobility reports. Fixed effects used to control for demographic differences | Not specified | Regression model comparing changes in new cases between counties that reopen schools after the summer holidays, with counties that have not yet reopened schools. Considered data from 2 weeks before reopening to 3 weeks after. |
| Stage | See description in school closure section above | ||||||
| Beesley | See description in school reopening section above | ||||||
| Bjork | 11 European countries | Study period: 30 March 2020 to 7 June 2020 | Not specified | Region | Population density, age distribution, country | Variable | Variance-weighted least squares linear regression comparing timing of February/March half-term with excess mortality (compared with 2015–2019 data for each region). |
| Pluemper and Neumayer | Germany | Study period: 10 June 2020 to 23 September 2020 | Not specified | School holiday timing: state (n=16) | Average taxable income and proportion of residents who are foreigners | Not specified | Multivariable regression model comparing incident growth rate 2 weeks before summer holidays up to 2 weeks afterwards, with fixed effects to account for for interdistrict differences, and a lagged dependent variable to account for background natioinal trends in the data. |
n/a, not available; NPI, non-pharmaceutical intervention; OECD, Organisation for Economic Co-operation and Development.
Findings from the risk of bias assessment using the ROBINS-I tool, stratified by study design
| Study | Confounding or | Selection | Misclassification | Deviation bias | Missing data bias | Outcome measurement bias | Outcome reporting bias | Overall judgement | Likely direction |
|
| |||||||||
| Auger | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Banholzer | Moderate | Low | Low | Low | Low | Moderate | Low |
|
|
| Brauner | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Chernozhukov | Moderate | Low | Moderate | Low | Low | Low | Low |
|
|
| Courtemanche | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Garchitorena | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Hsiang | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Jamison | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Li | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Liu | Moderate | Low | Low | Low | Low | Low | Moderate |
|
|
| Stokes | Moderate | Low | Low | Low | Low | Low | Moderate |
|
|
| Wu | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Yang | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Krishnamachari | Moderate | Low | Serious | Low | Low | Low | Low |
|
|
| Dreher | Serious | Low | Moderate | Low | Low | Moderate | Low |
|
|
| Li | Moderate | Low | Serious | Low | Low | Low | Low |
|
|
| Papadopoulos | Moderate | Low | Moderate | Low | Low | Serious | Low |
|
|
| Rauscher | Serious | Low | Low | Low | Low | Low | Low |
|
|
| Yehya | Serious | Low | Low | Low | Low | Moderate | Low |
|
|
| Zeilinger | Moderate | Low | Low | Low | Low | Serious | Low |
|
|
| Kilmek-Tulwin and Tulwin | Critical | Moderate | Low | Low | Low | Moderate | Low |
|
|
| Piovani | Critical | Low | Low | Low | Low | Serious | Low |
|
|
|
| |||||||||
| Matzinger and Skinner | Moderate | Low | Low | Low | Low | Moderate | Low |
|
|
| Gandini | Serious | Moderate | Low | Moderate | Low | Moderate | Low |
|
|
| Iwata | Serious | Low | Low | Low | Low | Moderate | Low |
|
|
| Neidhofer and Neidhofer | Serious | Serious | Low | Low | Low | Low | Moderate |
|
|
| Shah | Serious | Low | Moderate | Low | Low | Moderate | Low |
|
|
| Sruthi | Serious | Low | Low | Low | Low | Moderate | Low |
|
|
| Stage—closures | Critical | Low | Low | Low | Low | Moderate | Low |
|
|
|
| |||||||||
| Juni | Serious | Low | Low | Low | Low | Low | Low |
|
|
| Wong | Serious | Low | Low | Low | Low | Low | Low |
|
|
| Walach and Hockertz | Critical | Low | Serious | Low | Low | Serious | Low |
|
|
|
| |||||||||
| Garchitorena | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Harris | Moderate | Moderate | Low | Moderate | Low | Low | Moderate |
|
|
| Isphording | Moderate | Low | Low | Low | Low | Moderate | Low |
|
|
| Li | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Gandini | Serious | Moderate | Low | Moderate | Low | Moderate | Low |
|
|
| Ingelbeen | Serious | Low | Low | Low | Low | Moderate | Low |
|
|
| Sruthi | Serious | Low | Low | Low | Low | Moderate | Low |
|
|
| Stage—opening | Serious | Low | Low | Low | Low | Moderate | Low |
|
|
| Beesley | Critical | Low | Moderate | Moderate | Low | Serious | Low |
|
|
| Ehrhardt | Critical | Low | Low | Moderate | Low | Low | Low |
|
|
| Stein-Zamir | Critical | Low | Low | Low | Low | Serious | Low |
|
|
|
| |||||||||
| Pluemper and Neumayer | Moderate | Low | Low | Low | Low | Low | Low |
|
|
| Bjork | Low | Low | Low | Serious | Low | Low | Low |
|
|
| Beesley | Critical | Low | Moderate | Moderate | Low | Serious | Low |
|
|
Scale applied: low, moderate, serious or critical.
‘Favours experimental’ indicates that the bias likely resulted in an exaggeration of the reduction in community transmission associated with school closures.
ROBINS-I, Cochrane Risk of Bias In Non-randomised Studies of Interventions.
Findings from included studies, stratified by study design
| Study | Main finding | Outcome measure | Detailed results | Other comments |
| Auger | Regression coefficient estimating effect of school closures on changes to weekly incidence and mortality rates | Adjusted model: | Sensitivity analysis of shorter and longer lag periods did not significantly alter the findings. | |
| Banholzer | Relative reduction in new cases compared with cumulative incidence rate prior to NPI implementation | 8% (95% CrI 0% to 23%) | Sensitivity analyses for altering n=100 cases start point, and 7-day lag, did not significantly change the findings. | |
| Brauner | % reduction in Rt with 95% Bayesian CrI | 8.6% (95% CrI −13.3% to 30.5%) | Authors report close collinearity with university closures making independent estimates difficult. | |
| Chernozhukov | Regression coefficient estimating the change in weekly incidence rate and weekly mortality rate, measured on the log scale | Incidence rate: 0.019 (SE 0.101) | The authors report more precise estimates for other NPIs due to considerable variation in their timing between states, whereas there was very little variation in the timing of school closures across the country, with 80% of states closing schools within a couple of days of 15 March 2020. | |
| Courtemanche | Regression coefficient estimating effect of school closures on the growth rate of cases (% change) | Applying a 10-day lag: 1.71% (95% CI −0.38% to 3.79%) | ||
| Dreher | Regression coefficients from the linear and cox proportional hazards regressions. The first analysis is stratified into the first 7 days after iimplementation, and the second 7 days |
First week: −0.17 (95% CI −0.30 to –0.05). Second week: −0.12 (-0.21 to –0.04) 0.63 (0.25 to 1.63) Null effect but numbers not reported | In adjusted models using Google mobility data, a 10% increase in time spent at home was reported in the week following school closures. | |
| Garchitorena | Ratio of transmission rates with and without implementation of the NPI (assessed over the duration of the NPI being in place) Presented as a forest plot so the reported results here are estimated | EY settings: 9% reduction | ||
| Hsiang | Regression coefficient estimating effect of school closures on the continuous growth rate (log scale) | Italy: −0.11 (95% CI −0.25 to 0.03) | Sensitivity analysis applying a lag to NPI measures on data from China did not significantly alter the findings. | |
| Jamison | Percentage point change to the 5-day rolling average of COVID-19 mortality | −2.8 (95% CI −6.7 to 1.0), p=0.150 | ||
| Kilmek-Tulwin and Tulwin | Change in incidence rate on the 16th, 30th and 60th day post 100th cases between countries ranked by the cases/million population at school closure | 16th day: r=0.647, p=0.004 | ||
| Krishnamachari | Rate ratio of cumulative incidence between areas that below the median time from state-of-emergency declaration to closure and those above the median time, at days 14, 21, 28, 35 and 42 following the area’s 50th case | US states: | Secondary analysis comparing results in cities of low and high population density at 35 days post-50th case in the state. In low-density cities, they report a non-significant trend towards early school closures reducing cumulative incidence rate, in high-density cities they report the opposite—a non-significant trend towards late school closures reducing cumulative incidence rate. | |
| Li | Reported the additional benefit of every day that school closures were added to travel and work restrictions, and mass gathering bans | 17.3 (SD 6.6) percentage point reduction in infection rate | ||
| Li | Ratio between R while NPI in place, and R on the last day of the previous time period. Reported at 7, 14 and 28 days (as well as visual representation of each individual day to demonstrate trend) | Day 7: 0.89 (95% CI 0.82 to 0.97) | ||
| Liu | ‘Strong’ evidence for NPI effectiveness if statistically significant across multiple parsimonious models varying the follow-up period, the lag time and the classification of the NPI. 'Moderate' evidence if significant in some models; ‘weak' if not | ‘Strong' evidence of effectiveness for school closures. Effect sizes in individual models between 0.0 and −0.1 | ||
| Papadopoulos | Regression coefficient estimating the effect of school closures, and timing of school closures relative to first death, on log total cases and log total deaths | Univariate analysis of school closure policy showed no statistically significant association with log total cases (−0.03 (95% CI −0.256 to 0.218) or log total deaths (−0.025 (95% CI −0.246 to 0.211), p=0.776) | ||
| Piovani | Regression coefficient estimating % change in cumulative mortality for every day school closures delayed | Every 1 day delay in school closures was associated with an increase of 4.37% (95% CI 1.58 to 7.17), p=0.002 in cumulative COVID-19 mortality over the study period | ||
| Rauscher | Percentage point increase in the number of new cases and deaths for every day school closures were delayed (not clear over what period the outcome measure represents, assumed until end of study period on 27 April 2020 | Each day a state delayed school closures was associated with 0.3% higher cases (p<0.01) and 1.3% higher mortality (p<0.01) | Sensitivity analysis removing the seven states that only recommended school closures, but did not mandate them, did not significantly alter the findings. | |
| Stokes | Regression coefficient estimating effect of school closure timeliness and stringency on the daily mortality rate per 1 000 000 population | 0–24 days: | Sensitivity analyses for lab-confirmed COVID-19 versus clinical diagnosis; and for using negative binomial regression analayses did not alter the findings. | |
| Wu | Output from Bayesian mechanistic model in the format: learnt weight (95% CI) Estimating effect of school closures on R | School closures not statistically significantly associated with Rt in any of the clusters, or when data are aggregated without clustering | ||
| Yang | % reduction in R | School closure associated with 37% reduction in R (95% CI 33% to 40%) | Sensitivity analysis using mortality data to derive Reff did not significantly alter findings | |
| Yehya | Regression coefficient estimating increase in mortality at 28 days associated with each day school closures were delayed | 5% (Mortality Rate Ratio 1.05, 95% CI 1.01 to 1.09) | Sensitivity analyses for starting exposure from first COVID-19 death, or for excluding New York/New Jersey from analysis, did not significantly change the findings. | |
| Zeilinger | Growth rate calculated as the ratio of cumulative cases from 1 day to the next, applying a 7-day moving mean to smooth out weekday effects | School closures associated with drop in predicted growth rate between 10 and 40 days after implementation, median drop 0.010 (not clear what this value equates to but relatively large compared with other NPIs) | ||
| Gandini | Plotting Rt over time with school reclosure timings noted Analysed the effect of reclosing schools on Rt, which was done proactively before national lockdown in two large provinces | Lombardy and Campania closed schools before the national school closures in November. In both cases, they find that Rt started to decline around 2 weeks before school closures, and the rate of decline did not change after school closures | Mitigation measures in place in reopened schools included: temperature checks, hand hygiene, increased cleaning and ventilation, one-way systems, mask mandates, social distancing and bans on school sports/music. | |
| Iwata | Time series analysis coefficient estimating effect of school closures on the change in daily incidence rate | 0.08 (95% CI −0.36 to 0.65) | Sensitivity analysis for different lag times did not change the general finding of null effect. | |
| Matzinger and Skinner | Changes to the doubling time of the epidemic in each state, following school closures | Georgia: 7 days after school closures the doubling time slowed from 2.1 to 3.4 days | Only included Georgia, Tennessee and Mississippi in their explicit analysis of school closure effect because these were the only states where the authors felt there was a long enough gap between implementation of school closures and other NPI measures. However, they show several figures of other states that initiated school closures at the same time as other lockdown measures. In these states (Arizona, Florida, Ilinois, Maryland, Massachussetts, New Jersey, New York and Texas), a similar pattern is observed for doubling time of cases, with time lags varying between 1 and 2 weeks. Patterns appeared to be similar for hospitalisations and deaths, although these data were not always reported, and more difficult to interpret. | |
| Neidhofer and Neidhofer | % Reduction in deaths in the 18 days postschool closure, compared with synthetic control unit | Argentina: 63%–90% reduction, Italy: 21%–35% reduction, South Korea: 72%–96% reduction in daily average COVID-19 deaths over the 18 days following school closures, compared with the counterfactual | Sensitivity analysis using only excess mortality in Italy reached similar conclusion large (protective) effect in Switzerland, the Netherlands, Indonesia and Canada; no effect of closures in Germany, Brazil, France and Spain; large (harmful) effect in the UK. | |
| Shah | Regression coefficient for effect of school closures on mortality (not explained in any greater detail) | Italy 0.81 (95% CI 0.68 to 0.97) | ||
| Sruthi | Changes to time-varying reproductive number R, estimated from data on new cases. Assumed to be in an infectious state for 14 days from diagnosis | Secondary school closures associated with an average reduction of Rt around 1.0 | ||
| Stage | % reduction in growth rate of new cases (Germany only—in Denmark and Norway the graph is drawn without formal statistical analysis) | 26%–65% reduction in growth rate of cases across the different states of Germany. No quantitative estimate for Norway or Denmark but authors report a ‘clear drop’ in new cases after school closures | ||
| Juni | Regression coefficient estimating effect of school closures on changes to the incidence rate | Adjusted model: | Sensitivity analyses of seperating out high income countries did not significantly effect the results. | |
| Walach and Hockertz | Regression coefficient estimating effect of school closures on the COVID-19 mortality rate | Cases: school closures not associated with cases in univariate analysis so not considered for modelling | ||
| Wong | Regression coefficient estimating effect of school closures on the rate of increase in cumulative incidence | −0.53 (95% CI −1.00 to –0.06), p=0.027 | Report no collinearity or interactions between different covariables in the model. | |
| Beesley | Change in 7-day rolling average of new cases | China saw no change. Austria, Canada, France, Germany, Israel, Japan, the Netherlands, Singapore, Spain, Switzerland and the UK saw increases after 24–47 days; with longer lag times attributed to these countries opening schools in a limited to staggered way | Primary versus secondary: in the Netherlands, it was noted that the rise in cases 24 days after primary schools opened was much smaller than the rise 40 days after secondary schools reopened. | |
| Ehrhardt | Presentation of an epidemic curve showing daily confirmed new cases, with school reopening date labelled | Daily new cases peaked at 1400/day and dropped to around 100/day at the time of staggered school reopening. Daily new cases remained at, or generally below, this level throughout the following 3 months until after schools broke up for summer holidays | Range of comprehensive infection prevention and control measures were in place in schools at the time of school reopening. | |
| Gandini | Plotting R over time with school reopening timings noted. Pairing geographically neighbouring and socioeconomically similar provinces who reopened schools at different times. Comparing time between school reopening and subsequent increases in R—measured as the start of 3 consecutive weeks of increasing R | Bolzano opened schools a week earlier than Trento, but Trento saw a sustained rise in R 1 week ealier than Bolzano. In Abruzzo and Marche; Sicily and Calabria; and Veneto and Apulia; one province reopened schools a week before the other, but Rt increases occured at the same time | Mitigation measures in place in reopened schools included: temperature checks, hand hygiene, increased cleaning and ventilation, one-way systems, mask mandates, social distancing and bans on school sports/music. | |
| Garchitorena | Ratio of transmission rates with and without implementation of the NPI (assessed over the duration of the NPI being in place) Presented as a forest plot so the reported results here are estimated | EY settings: 0% | ||
| Harris | Regression coefficient reported for both hospitalisations per 100 000 population, and log total hospitalisations | Hospitalisations per 100 000 population: | Post hoc stratified analysis showed a statistically significant increase in hospitalisations for those counties in the top 25% of hospitalisation preschool reopenings, but no effects for those <75th centile. | |
| Ingelbeen | Plotted R compared against the changes to the NPIs in place during the study period | R started to increase from approximately 1 week before schools reopened (from 0.9 to 1 at reopening), and then increase more sharply to 1.5 over the next fortnight | Also used the national contact tracing data to examine age-specific trends in number of contacts per case, and number of transmission events between age groups. The increase in Rt after school reopening did not appear to be driven by school-aged children, but by general increases in social mixing across all age groups. | |
| Isphording | Regression coefficient estimating change in number of new cases per 100 000 in the 3 weeks postschool reopenings | Reduction of 0.55 cases per 100 000 associated with first 3 weeks of reopening schools. CIs reported only graphically, but upper estimate just crosses 0 (ie, reopening schools led to non-sginificant reduction in transmission of COVID-19) | Sensitivity analysis showed this to be true for all age groups. West German counties drove the non-significant reduction in transmission associated with reopening of schools, while in East Germany the rate of new cases remained constant. | |
| Li | Ratio between R while NPI in place, and R on the last day of the previous time period. Reported at 7, 14 and 28 days (as well as visual representation of each individual day to demonstrate trend) | Day 7: 1.05 (95% CI 0.96 to 1.14) | ||
| Sruthi | Changes to time-varying reproductive number R, estimated from data on new cases. Assumed to be in an infectious state for 14 days from diagnosis | Secondary schools reopened with mask mandates in place associated with no change in the R, compared with secondary schools being closed | ||
| Stein-Zamir | Presentation of an age-stratified epidemic curve showing confirmed cases of COVID-19 in Jerusalem, by date, and comparing to dates of school closure/reopening | Difficult to elicit exact effect sizes from the epidemic curve, but approximately 2 weeks after schools started to reopen, the number of new cases started to increase | Increases in cases after school reopening was more pronounced in younger age groups, | |
| Stage | Changes to the incidence rate and changes to instantaneous growth rate in hospitalisations (Denmark) and cases (Denmark, Germany and Norway) | In Germany, the growth rate of cases remained stable throughout and after the staggered reopening of schools. In Denmark and Norway, the growth rate of cases (and hospitalisations for Denmark) remained stable and negative, meaning that incidence continued to reduce despite school reopening | ||
| Beesley | Change in 7-day rolling average of new cases | In Austria, France, Germany and Switzerland, it was noted that school holidays ‘exacerbated’ the resurgence in incidence rate (not commented on for other countries) | ||
| Bjork | All-cause weekly excess mortality per million residents, between 30 March 2020 and 7 June 2020 compared with 2015–2019 mortality rates, compared with regions with no winter holiday or a holiday in the week before the exposure period | Winter holiday in weeks 7, 8, 9 and 10 associated with weekly excess mortality of 13.4 (95% CI 9.7 to 17.0), 5.9 (95% CI 2.3 to 9.5), 13.1 (95% CI 9.7 to 16.5) and 6.2 (95% CI 1.0 to 11.4) per million residents, respectively | The comparator group included those holidaying in week 6 or not at all, and was itself associated with excess mortality of 8.6 (95% CI 6.9 to 10.3). | |
| Pluemper and Neumayer | Percentage point increase in the incident growth rate associated with each week of the summer holiday | Each week of summer school holidays increased the incident growth rate by an average of 0.72 percentage points (95% 0.41 to 1.03). The effect of individual weeks increased during the holidays, such that the first 3 weeks were not indpendently statistically significant, but the sixth week of holidays was associated with an average 1.91 (95% CI 1.47 to 2.42) percentage points increase, which accounts for 49% of the national average growth rate that week | Larger effect sizes for richer regions, and regions with more foreigners, suggesting these regions had a higher proportion of travellers going abroad (the baseline rate in Germany was low at the start of the summer holidays). | |
CrI, credible interval; NPI, non-pharmaceutical intervention.
Figure 2Main findings, stratified by risk of bias. (A) The studies’ response to the question: Did school closures reduced community transmission? (Yes, No, Mixed). (B) The studies’ response to the question: Did school reopenings increase community transmission? (Yes, No, Mixed).