Alexander Karaivanov1, Shih En Lu2, Hitoshi Shigeoka3, Cong Chen4, Stephanie Pamplona4. 1. Department of Economics, Simon Fraser University, Canada. Electronic address: akaraiva@sfu.ca. 2. Department of Economics, Simon Fraser University, Canada. Electronic address: shihenl@sfu.ca. 3. Department of Economics, Simon Fraser University, Canada; NBER, USA. Electronic address: hitoshi_shigeoka@sfu.ca. 4. Department of Economics, Simon Fraser University, Canada.
Abstract
We estimate the impact of indoor face mask mandates and other non-pharmaceutical interventions (NPI) on COVID-19 case growth in Canada. Mask mandate introduction was staggered from mid-June to mid-August 2020 in the 34 public health regions in Ontario, Canada's largest province by population. Using this variation, we find that mask mandates are associated with a 22 percent weekly reduction in new COVID-19 cases, relative to the trend in absence of mandate. Province-level data provide corroborating evidence. We control for mobility behaviour using Google geo-location data and for lagged case totals and case growth as information variables. Our analysis of additional survey data shows that mask mandates led to an increase of about 27 percentage points in self-reported mask wearing in public. Counterfactual policy simulations suggest that adopting a nationwide mask mandate in June could have reduced the total number of diagnosed COVID-19 cases in Canada by over 50,000 over the period July-November 2020. Jointly, our results indicate that mandating mask wearing in indoor public places can be a powerful policy tool to slow the spread of COVID-19.
We estimate the impact of indoor face mask mandates and other non-pharmaceutical interventions (NPI) on COVID-19 case growth in Canada. Mask mandate introduction was staggered from mid-June to mid-August 2020 in the 34 public health regions in Ontario, Canada's largest province by population. Using this variation, we find that mask mandates are associated with a 22 percent weekly reduction in new COVID-19 cases, relative to the trend in absence of mandate. Province-level data provide corroborating evidence. We control for mobility behaviour using Google geo-location data and for lagged case totals and case growth as information variables. Our analysis of additional survey data shows that mask mandates led to an increase of about 27 percentage points in self-reported mask wearing in public. Counterfactual policy simulations suggest that adopting a nationwide mask mandate in June could have reduced the total number of diagnosed COVID-19 cases in Canada by over 50,000 over the period July-November 2020. Jointly, our results indicate that mandating mask wearing in indoor public places can be a powerful policy tool to slow the spread of COVID-19.
When government policies to stem the spread of COVID-19 were introduced in early 2020, the best available supporting evidence came from research on previous epidemics, epidemiological modeling and case studies (OECD). Even when the efficacy of a given intervention in reducing viral transmission has been established, doubts regarding its usefulness may persist, because of uncertainty about adherence to the rules and other behavioural responses. For example, even though there is significant agreement in the medical literature that respiratory transmission of COVID-19 is the dominant vector (Meyerowitz et al., 2020), and many clinical studies have shown that face masks reduce the spread of COVID-19 and similar diseases (Chu, Akl, Duda, Solo, Yaacoub, Schünemann, 2020, Greenhalgh, Schmid, Czypionka, Bassler, Gruer, 2020, Leung, Chu, Shiu, Chan, McDevitt, Hau, Yen, Li, Ip, Peiris, Seto, Leung, Milton, Cowling, 2020, Prather, Wang, Schooley, 2020), a mask mandate may not be effective in practice if it fails to increase the prevalence of mask wearing (compliance) or if it leads to increased contacts because of a false sense of security.The low economic cost of mask mandates relative to other COVID-19 containment measures has generated keen interest worldwide for studying their effectiveness.1
This interest has been compounded by the substantial variation in official advice regarding mask use, especially early in the pandemic, with national health authorities and the World Health Organization giving inconsistent or contradictory recommendations over time, ranging from ‘not recommended’ to ‘mandatory’.2
Fig. C1 in the Appendix plots self-reported mask usage in select countries (Canada, USA, Germany and Australia) and across Canadian provinces. The figure shows large differences in mask usage, both across countries and within Canada.3
Fig. C1
Self-reported mask usage in selected countries and Canadian provinces. Notes: The data source is YouGov. The figure plots the average self-reported mask usage by week (the fraction of respondents that answered “Always” to the survey question “Thinking about the last 7 days, how often have you worn a face mask outside your home?”). Sample weights are used to compute the national and provincial averages.
An added challenge is to disentangle the impact of mask mandates from that of other policies, behavioural responses, or third factors (Chernozhukov, Kasahara, Schrimpf, 2021, Mitze, Kosfeld, Rode, Wlde, 2020). Given the absence of large-scale randomized controlled trials on mask mandates (Howard et al., 2020), observational studies like ours are essential for informing health policy and public opinion, by formally analyzing the relationship between policy measures and the rate of propagation of COVID-19.We estimate and quantify the impact of mask mandates and other non-pharmaceutical interventions (NPI), including regulations on businesses and gatherings, school closures, travel and self-isolation, and long-term care homes, on the growth of new COVID-19 cases in Canada. The Canadian data have the advantage of allowing two complementary approaches to address our objective. First, we estimate the effect of mandates by exploiting within-province variation in the timing of indoor face mask mandates in the 34 public health regions (Public Health Units4
or PHUs) in Ontario, Canada’s most populous province with roughly 40% (15 mln) of the country’s population (Statistics Canada, 2020). The advantage of this approach is that it uses variation over a relatively small geographic scale (PHU), holding all province-level policies and factors constant. The adoption of indoor face mask mandates in the 34 public health regions was staggered over approximately two months (June to August 2020), creating sufficient intertemporal variation.Second, we evaluate the impact of NPIs in Canada as a whole, using the variation in the timing of mask mandates and other policies in the country’s ten provinces. We construct time series for the intensity and timing of COVID-relevant policy measures from official public health orders and government announcements. By studying inter-provincial variation in the policy measures, we can analyze the impact of not only mask mandates, but also other NPIs, for which there is little or no variation across Ontario’s PHUs. In addition, our data include the initial “closing” period (March–April), the gradual “re-opening” period (May–August), and the Fall period of new restrictions, providing variation from both the imposition and the relaxation of policies.Our panel-data estimation strategy broadly follows the approach of Chernozhukov et al. (2021), which we modify and adapt to the Canadian context. We account for observed behavioural changes and trends (using Google Community Mobility Reports geo-location data as proxy), as well as for lagged outcome responses to policy and behavioural changes. Our empirical approach also allows past epidemiological outcomes to impact current outcomes, either as information variables affecting unmeasured behaviour and policy, and/or directly, as in the SIR epidemiological model (Kermack and McKendrick, 1927).We find that, after two weeks from implementation, mask mandates are associated, on average, with a reduction of nearly 25 log points in the weekly case growth rate in Ontario, which can be interpreted as a 22% weekly reduction in new diagnosed COVID-19 cases relative to the trend in absence of mask mandate. We find corroborating evidence in the province-level analysis: a 20% weekly reduction in cases relative to the no-mandate trend in our baseline empirical specification. Furthermore, using additional survey data (Jones, 2021), we show that mask mandates increased self-reported mask usage in Canada by about 27 percentage points on average after implementation, confirming that the mandates had a significant impact on masking behaviour. Jointly, our results suggest that mandating mask wearing in indoor public places can be a powerful policy tool to slow the spread of COVID-19.Counterfactual policy simulations using our empirical estimates further suggest that mandating indoor masks Canada-wide in mid-June could have reduced new COVID-19 cases in the country by more than 50,000 cases in total over the period July–November 2020 relative to the actually observed numbers.In addition, we find that the most stringent policy restrictions on businesses and gatherings observed in the provincial data are associated with a 44% weekly decrease of new cases, relative to the trend in absence of restrictions. The business/gathering estimates are, however, noisier than our estimates for mask mandates and do not retain statistical significance in all specifications. Travel and long-term care restrictions are associated with a sharp decrease in weekly case growth in the initial closing period (March–April). These results suggest that relaxed restrictions and the associated increase in business and workplace activity and gatherings (including retail, restaurants and bars) can offset, in whole or in part, the estimated impact of mask mandates on COVID-19 case growth. We also find statistically significantly negative association between current case growth and information (log of past weekly cases), which is consistent with a behavioural feedback effect, e.g., people changing their contact rate based on observed case totals.Our paper relates most closely to Chernozhukov et al. (2021), Lyu and Wehby (2020) and Mitze et al. (2020), which are recent studies on mask mandates using observational data, but adds to them in several ways.5
First, we use regional variation within the same jurisdiction (similar to Mitze et al., but with a larger sample of treated regions that obviates the need for synthetic controls). This mitigates concerns about omitted variables, e.g., provincial or other factors. Second, we additionally use variation over a different geographic and administrative level, across provinces (similar to Chernozhukov et al. and Lyu and Wehby for U.S. states), and obtain very similar results as in our main analysis. Third, we estimate the increase in self-reported mask usage following mask mandates, which can help in understanding and predicting how the effect of mask mandates on COVID-19 spread may differ in other contexts. Our finding that mask mandates led to a significant increase in mask usage corroborates the large estimated mask mandate effect on COVID-19 case growth. Fourth, an important difference between our paper and Chernozhukov et al. (2021), possibly explaining our larger estimates for the effect of mask mandates, is that we evaluate universal mandatory indoor mask wearing for the public, instead of mandatory mask wearing for employees only. While other factors such as differences in mask-wear compliance between Canada and the U.S. may also contribute to the different estimates of the policy impact, our results suggest that broader in scope mask policies can be more effective in reducing the spread of COVID-19.6In the medical literature, Meyerowitz et al. (2020), a comprehensive review on COVID-19 transmission, conclude that there is strong evidence, from case and cluster reports, that respiratory transmission is dominant, with proximity and ventilation being the key determinants of transmission risk, as opposed to direct contact or fomite transmission. Numerous other studies, e.g., Prather et al. (2020), Howard et al. (2020), Greenhalgh et al. (2020) and Leung et al. (2020), among others, argue that face masks can reduce the spread of COVID-19. Our paper also complements recent work on COVID-19 non-pharmaceutical interventions in various countries, e.g., Hsiang et al. (2020), Dergiades et al. (2020), Abouk and Heydari (2020) and in Canada, Mohammed et al. (2020), Yuksel et al. (2020), Armstrong et al. (2020), Stevens et al. (2021).
Data
We use three main data sources, respectively for epidemiological variables, NPIs and mask mandates, and behavioural responses. The analyzed time period is from the start of detected community transmission in Canada in March 2020 to the end of November 2020.We located and accessed the original official data sources to compile a complete set of COVID-19 case, death, and test counts in all ten Canadian provinces over time.7
In addition, we collected data on cases and weekly tests for each of the 34 public health units (PHUs) in Ontario. A detailed description is provided in the data files shared at the project’s Github repository.Implementation dates of NPIs and other public policies were collected from the official government websites, announcements, public health orders, and staged re-opening plans. In the national data, the raw policy measures data contain the dates or enactment and relaxation (if applicable) of 17 policy indicators including: mandatory mask wear; closure and re-opening of retail and non-essential businesses, restaurants, recreation facilities, and places of worship; school closures; limits on events and gatherings; international and domestic travel restrictions and self-isolation requirements; restrictions on visits and staff movement in long-term care homes. All policy indicators are defined in Table D1 in the Appendix.8
Since many of these indicators are highly correlated with each other, we combine them into five policy aggregates in the empirical analysis (see Table B18 and Section 3.2). In the Ontario PHU data, the implementation dates of mask mandates and the intensity of restrictions for businesses and gatherings vary across PHUs.9
Table D1
Policy indicators and aggregates.
Non-Essential Travel
restrictions - international
1: travellers that are neither citizens nor residents
0.5: same as 1, but U.S. citizens allowed
restrictions - inter-provincial
1: residents of all other provinces
0.5: residents of some other provinces
self-isolation - international
1: required (by provincial or federal government)
0.5: recommended (by provincial or federal government)
self-isolation - inter-provincial
1: required of residents of all other provinces
0.5: required of residents of some other provinces,
or recommended
Primary and Secondary Schools
schools closed
1: no classes (includes Spring and Summer breaks)
0.5: part-time classes; 0: classes in session
Business and Gathering Regulations
non-essential and retail business personal services business restaurants bars and nightclubs places of worship events and gatherings recreation, gyms and parks
0: no or lowest restrictions; 1: strictest restrictions; values between 0 and 1: partial restrictions
indoor gatherings maximum
1: no gathering allowed; x∈[0.5,1]: limit of 100(1−x)
x∈[0,0.5]: limit of 25/x
Long-Term Care (LTC) Regulations
visiting restrictions
1: no visits (with limited exceptions such as end of life)
0.5: number of visitors restricted
single-site work requirement1
1: requirement in effect
0.5: requirement with explicit later implementation deadline
Mandatory Masks
indoor public places2
1: mask mandate in effect; 0: no mandate
provincial declaration of emergency3
1: in effect; 0: not in effect
Notes: 1. We do not consider recommendations or requirements limited to outbreaks. 2. We do not consider limited mask mandates, e.g., applying only to transit or personal service establishments. 3. We do not use provincial declarations of emergency in the analysis as they are mostly legal tools enabling other restrictions.
Table B18
Canada - correlations between the policy indicators.
Policy
indicator
P1
P2
P3
P4
P5
P6
P7
P8
P9
P10
P11
P12
P13
P14
P15
P16
P17
Mask
P1. mandatory indoor masks
1
Business/ gathering
P2. non-essential business/retail
-0.24
1
P3. personal services
-0.34
0.74
1
P4. restaurants
-0.33
0.65
0.81
1
P5. bars/nightclubs
-0.24
0.58
0.74
0.84
1
P6. religious worship
-0.28
0.67
0.78
0.81
0.79
1
P7. events gathering
-0.27
0.65
0.78
0.82
0.81
0.77
1
P8. recreation/parks/gyms
-0.24
0.76
0.83
0.81
0.76
0.78
0.79
1
P9. gathering maximum index
-0.19
0.53
0.65
0.73
0.76
0.73
0.82
0.63
1
School
P10. no school
-0.42
0.31
0.44
0.33
0.39
0.40
0.41
0.34
0.37
1
Travel
P11. travel ban international
0.18
0.13
0.21
0.25
0.48
0.31
0.48
0.16
0.58
0.32
1
P12. travel ban domestic
-0.11
0.12
0.11
0.03
0.18
0.07
0.07
0.07
0.17
0.11
0.17
1
P13. self-isolation international
0.18
0.13
0.20
0.24
0.47
0.29
0.48
0.15
0.57
0.32
0.95
0.17
1
P14. self-isolation domestic
-0.14
0.19
0.29
0.13
0.24
0.23
0.15
0.14
0.24
0.24
0.25
0.65
0.25
1
LTC
P15. LTC visits
-0.36
0.49
0.66
0.66
0.70
0.64
0.72
0.59
0.72
0.50
0.43
0.20
0.44
0.35
1
P16. LTC single site
-0.07
0.18
-0.15
0.00
-0.04
-0.05
0.09
-0.19
0.20
0.06
0.32
-0.13
0.32
-0.22
0.10
1
P17. provincial emergency
-0.21
0.22
0.33
0.37
0.57
0.36
0.40
0.28
0.40
0.33
0.58
0.26
0.57
0.39
0.38
-0.05
1
Notes: Time period – February 26, to November 16, 2020 (two weeks before the March 11, - November 30, sample period). Daily province-level data.
Regarding behavioural responses, we use the Google COVID-19 Community Mobility Reports, which summarize daily cellphone geo-location data by region as indices calculated relative to the median value for the same day of the week in the five-week baseline period January 3, to February 6, 2020.10
In Ontario, these location data are available for each of the 51 first-level administrative divisions (counties, regional municipalities, single-tier municipalities and districts).11
Empirical method
We follow the approach of Chernozhukov et al. (2021), but modify and adapt it to the Canadian context. The empirical strategy uses the panel structure of the outcome, policy and behavioural proxy variables, and includes lags of outcomes, as information or following the causal paths suggested by the epidemiological SIR model (Kermack and McKendrick, 1927). Specifically, we estimate the effect of policy interventions on COVID-19 outcomes while controlling for information and behaviour. In contrast to Chernozhukov et al. (2021) and Hsiang et al. (2020), who study variation in NPIs across U.S. states or across countries, our identification strategy exploits policy variation at the sub-provincial level (Ontario’s PHUs) in addition to cross-province variation, and our data captures both the closing down and re-opening stages of the epidemic.
Estimation strategy
The data used in the empirical analysis are summarized below; Section 3.2 describes the variables in detail. Everywhere denotes health region (PHU) for the Ontario analysis or province for the national analysis, and denotes time measured in days (date).Outcomes, – the growth rate of weekly cases or deaths.Policy/NPIs, – for the Ontario analysis, four policy aggregates by PHU and date; for the national analysis, five policy aggregates by province and date.Behavioural responses, – proxied by Google mobility data capturing changes in people’s geo-location relative to a baseline period in January-February 2020.Information, – lagged outcomes, i.e., level or growth rate of cases (or deaths). We also consider a specification that includes past cases (deaths) and case (deaths) growth at the provincial or national level as additional information variables.Controls – PHU or province fixed effects, week fixed effects, the growth rate of weekly new COVID-19 tests and other possible confounders (e.g., news or weather).To assess and disentangle the impact of mask mandates and other NPIs and behavioural responses on COVID-19 outcomes, we estimate:where denotes time lag in days, is the weekly growth rate of tests (defined below), and are confounders, including fixed effects. Eq. (1) models the relationship between COVID-19 outcomes, and lagged policy measures, , lagged behaviour, , and information (lagged outcomes), . For case growth as the outcome variable, we use a 14-day lag, . For deaths growth as the outcome, we use . The arguments for choosing these lags are discussed in detail in Appendix E. Alternative lags are explored in Section 4.4.Estimation Eq. (1) is based on the structural model of Chernozhukov et al. (2021), who propose the following causal mechanism and identification strategy. First, information and confounders are determined at . Second, policies or NPIs, are set, given the information and confounders. Third, behaviour is realized, given the policies, information and confounders in place at that time. It is assumed that behaviour reacts to the information without a significant lag. Finally, the outcome is realized (with lag ) given the policies, behaviour, information and confounders.By including lagged outcomes, the proposed estimation approach allows for possible endogeneity of the policy interventions , that is, the introduction or relaxation of NPIs based on information about the level or the growth rate of cases or deaths. Also, past cases may be correlated with (lagged) government policies or behaviours that are not fully captured by the included policy and behaviour variables.In Section 4.3 and in Table B19, we also estimate the relationship between policies , information, (weekly levels or growth of cases or deaths) and behaviour, .We find strong correlation between policy measures and the Google mobility behavioural proxy in Table B19.
Table B19
Canada – Location behaviour and policies.
Outcome: location behaviour
Retail
Grocery
Workplaces
Behaviour proxy, Bit
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Mask
-4.166 *
-4.019
-2.603
-2.558
-1.772 **
-1.631 **
-2.847 *
-2.736 *
[0.077]
[0.111]
[0.178]
[0.170]
[0.018]
[0.042]
[0.064]
[0.060]
Business/gathering
-21.18 ***
-20.14 **
-6.515
-5.672
-13.12 ***
-12.04 ***
-13.60 **
-12.62 **
[0.004]
[0.013]
[0.185]
[0.282]
[0.000]
[0.007]
[0.016]
[0.028]
School
0.416
1.599
-0.663
0.188
-6.268 ***
-5.058 ***
-2.172
-1.090
[0.859]
[0.477]
[0.756]
[0.914]
[0.000]
[0.000]
[0.265]
[0.538]
Travel
-9.850
-7.243
-7.403
-5.837
-2.080
0.537
-6.445
-4.181
[0.549]
[0.633]
[0.234]
[0.334]
[0.740]
[0.916]
[0.441]
[0.620]
Long-term care
-0.196
-0.065
-3.163
-3.189 *
-4.448
-4.332
-2.602
-2.529
[0.951]
[0.971]
[0.118]
[0.080]
[0.138]
[0.146]
[0.326]
[0.381]
Δlog(ΔC)
1.121 *
1.093 *
0.950 **
0.831 **
0.457
0.413
0.843 ***
0.779 ***
[0.064]
[0.068]
[0.022]
[0.016]
[0.197]
[0.213]
[0.000]
[0.006]
log(ΔC)
-1.780 ***
-1.729 ***
-1.215 ***
-1.220 ***
-0.794 ***
-0.748 ***
-1.263 ***
-1.232 ***
[0.002]
[0.005]
[0.004]
[0.004]
[0.000]
[0.000]
[0.006]
[0.006]
Δlog(ΔNC)
3.813 *
11.69 ***
5.293 ***
6.933 ***
[0.080]
[0.000]
[0.003]
[0.000]
log(ΔNC)
-6.293 **
-1.963
-6.035 ***
-4.764 ***
[0.016]
[0.225]
[0.000]
[0.007]
R-squared
0.943
0.945
0.901
0.908
0.954
0.957
0.947
0.950
N
2650
2650
2650
2650
2650
2650
2650
2650
province fixed effects
X
X
X
X
X
X
X
X
week fixed effects
X
X
X
X
X
X
X
X
Notes: Time period – March 11, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. The behaviour proxy in columns (7) and (8) is the arithmetic average of the “retail”, “grocery” and “workplaces” Google mobility indices. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Eq. (1) separates the direct effect of policies on outcomes, with the appropriate lag, from the potential indirect effect on outcomes of changes in behaviour captured by the geo-location trends proxy, . In Appendix Table B20, we report estimates without including the behavioural proxy, that is, capturing the total effect of policies on outcomes. Since our estimates of the coefficient in Eq. (1) are not significantly different from zero, the results without controlling for the behavioural variable are very similar to those from estimating Eq. (1).
Table B20
Policies and information only.
Outcome: weekly case growth, Yit=Δlog(ΔCit)
Ontario
Canada
p-values in [ ]
(1)
(2)
(3)
(4)
Mask_14
-0.234 **
-0.240 **
-0.204 ***
-0.210 ***
[0.014]
[0.013]
[0.000]
[0.000]
Business/gathering_14
0.084
0.158
-0.525 *
-0.548 *
[0.862]
[0.721]
[0.088]
[0.096]
School_14
-0.529 *
-0.475
-0.134
-0.152
[0.058]
[0.200]
[0.309]
[0.229]
Travel_14
n.a.
n.a.
0.227
0.175
n.a.
n.a.
[0.646]
[0.733]
Long-term care_14
-0.439
-1.052
-0.082
-0.087
[0.706]
[0.415]
[0.742]
[0.742]
Δlog(ΔC)_14
0.049
0.047
-0.052
-0.054
[0.156]
[0.171]
[0.432]
[0.422]
log(ΔC)_14
-0.167 ***
-0.167 ***
-0.163 **
-0.166 **
[0.000]
[0.000]
[0.028]
[0.028]
Δlog(ΔTC)_14
0.379 **
0.207
[0.038]
[0.396]
log(ΔTC)_14
0.007
0.197 ***
[0.982]
[0.008]
Δlog(ΔT)
0.339 **
0.345 **
0.296 ***
0.298 ***
[0.047]
[0.044]
[0.000]
[0.000]
R-squared
0.095
0.096
0.336
0.338
N
6800
6800
2650
2650
PHU fixed effects
X
X
province fixed effects
X
X
week fixed effects
X
X
X
X
Notes: Time period – May 15, to November 30, 2020 for Ontario and March 11, to November 30, 2020 for Canada. P-values from wild bootstrap (cgmwildboot) standard errors clustered by PHU or province with 5000 repetitions are reported in the square brackets. TC denotes total cases for Ontario or Canada respectively. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Data and descriptive analysis
Outcomes. Our main outcome of interest is the weekly growth rate of new positive COVID-19 cases, defined below.12
We use weekly outcome data to correct for the strong day-of-the-week effect present in COVID-19 data, with markedly lower numbers reported on weekends or holidays. Weekly case growth is a metric that is helpful in assessing trends in the spread of COVID-19, and it has been highlighted in WHO’s weekly epidemiological reports (World Health Organization, 2020).Specifically, let denote the cumulative case count up to day and define as the weekly COVID-19 cases reported for the 7-day period ending at day :The (log) weekly case growth rate, is defined as:that is, the week-over-week growth in cases in region ending on day .13
The weekly test growth rate is defined analogously.Policy. In the Ontario analysis, we exploit regional variation in the timing of indoor mask mandates staggered over two months in the province’s 34 PHUs. Fig. 1
displays the gradual introduction of mandates. The exact implementation dates are reported in Table D2. Mandatory indoor masks were introduced first in the Wellington-Dufferin-Guelph PHU on June 12, 2020 and last in the Northwestern PHU on August 17, 2020.14
Fig. 1
Ontario – mask mandates over time Notes: There are 34 public health units (PHU) in Ontario. See Table D2 for the exact date of mask mandate implementation in each PHU.
Table D2
Ontario public health regions – date of mask mandate.
1
Algoma Public Health Unit
July 17, 2020
2
Brant County Health Unit
July 20, 2020
3
Chatham-Kent Health Unit
August 14, 2020
4
Durham Region Health Department
July 10, 2020
5
Eastern Ontario Health Unit
July 7, 2020
6
Grey Bruce Health Unit
July 17, 2020
7
Haldimand-Norfolk Health Unit
August 1, 2020
8
Haliburton, Kawartha, Pine Ridge District Health Unit
July 13, 2020
9
Halton Region Health Department
July 22, 2020
10
Hamilton Public Health Services
July 20, 2020
11
Hastings and Prince Edward Counties Health Unit
July 10, 2020
12
Huron Perth District Health Unit
July 17, 2020
13
Kingston, Frontenac and Lennox & Addington Public Health
June 27, 2020
14
Lambton Public Health
July 31, 2020*
15
Leeds, Grenville and Lanark District Health Unit
July 7, 2020
16
Middlesex-London Health Unit
July 18, 2020
17
Niagara Region Public Health Department
July 31, 2020
18
North Bay Parry Sound District Health Unit
July 24, 2020
19
Northwestern Health Unit
August 17, 2020
20
Ottawa Public Health
July 7, 2020
21
Peel Public Health
July 10, 2020
22
Peterborough Public Health
August 1, 2020
23
Porcupine Health Unit
July 23, 2020
24
Region of Waterloo, Public Health
July 13, 2020
25
Renfrew County and District Health Unit
July 14, 2020
26
Simcoe Muskoka District Health Unit
July 13, 2020
27
Southwestern Public Health
July 31, 2020
28
Sudbury & District Health Unit
July 17, 2020
29
Thunder Bay District Health Unit
July 24, 2020
30
Timiskaming Health Unit
July 24, 2020
31
Toronto Public Health
July 7, 2020
32
Wellington-Dufferin-Guelph Public Health
June 12, 2020
33
Windsor-Essex County Health Unit
June 26, 2020
34
York Region Public Health Services
July 17, 2020
*Lambton Public Health did not enact a region-wide mask mandate until the provincial mandate on October 3. However, the City of Sarnia, with 58% of Lambton’s population (2016 Census), enacted a mask mandate on July 31. The mask variable for Lambton is coded as 0.5 from July 31, to October 2, 2020.
Ontario – mask mandates over time Notes: There are 34 public health units (PHU) in Ontario. See Table D2 for the exact date of mask mandate implementation in each PHU.We assign numerical values to each of 17 policy indicators, listed and defined in Table D1. The policy variables take values on the interval [0,1], with 0 meaning absence or lowest level of restrictions and 1 meaning most stringent restrictions. A policy value between 0 and 1 indicates partial restrictions, either in intensity (see Table D1 for details and definitions) or in geographical coverage (in large provinces). The policy values are assigned at the daily level for each region, while maintaining comparability across regions. Most non-mask policy indicators are available at the province level only.Many NPIs were implemented at the same time, both relative to each other and across regions, especially during the March 2020 initial closing-down period.15
This causes many of the policy indicators to be highly correlated with each other (see Appendix Table B4). To avoid multi-collinearity problems, we therefore group, via arithmetic averaging, the 17 policy indicators into 5 policy aggregates: (i) Mask, which takes value 1 if an indoor mask mandate has been introduced, 0 if not, or value between 0 and 1 if only part of a province has enacted the policy; (ii) Business/gathering, which comprises regulations and restrictions on non-essential businesses and retail, personal businesses, restaurants, bars and nightclubs, places of worship, events, gyms and recreation, and limits on gathering; (iii) School, which is an indicator of provincial school closure (including Spring and Summer breaks); (iv) Travel, which includes international and domestic travel restrictions and self-isolation rules and (v) Long-term care (LTC), which includes NPIs governing the operation of long-term care homes (visitor rules and whether staff are required to work on a single site).
Table B4
Canada – correlations between policies and location behaviour.
Behaviour
Mask
Business/
School
Travel
LTC
New weekly
proxy
gathering
tests ΔT
Behaviour proxy
1
Mask
0.19
1
Business/gathering
-0.84
-0.33
1
School
-0.35
-0.53
0.37
1
Travel
-0.05
-0.06
0.22
0.22
1
Long-term care (LTC)
-0.16
-0.31
0.28
0.24
0.09
1
New weekly tests ΔT
0.11
0.51
-0.02
-0.24
-0.32
0.10
1
Notes: Time period – March 11, to November 30, 2020 (). Province-level, 7-day moving averages.
The five policy aggregates are constructed at the daily level and capture both policy restrictions (an increase in the numerical value from 0 toward 1) and policy relaxations (decrease in the numerical value toward zero). In comparison, the policy indicators compiled by Raifman et al. (2020) for the U.S. used in Chernozhukov et al. (2021) are binary “on (1)”/“off (0)” variables.16
For consistency with the weekly outcome and information variables and the empirical model timing, we construct the policy aggregates used in the regressions (where denotes policy type) by taking a weekly moving average of the daily policy values, from date to date .Fig. 2 plots the values of the five policy aggregates over time for each of the 10 provinces. Travel restrictions, school closures and business closures were initially implemented in a relatively short period in the middle of March 2020. There is variation in the Travel aggregate since some Canadian provinces (the Atlantic provinces) implemented strict inter-provincial domestic travel and self-isolation restrictions in addition to the federal regulations regarding international travel. Restrictions on long-term care facilities were introduced more gradually, with large variation across the provinces. In the period May-November 2020, there is more policy intensity variation, especially in the business and gatherings category, as the different provinces implemented their own “re-opening” plans and strategies. Mask mandates were introduced in Ontario starting from June in a few smaller PHUs and in early July in the most populous PHUs, Toronto, Ottawa and Peel (see Table D2). In Quebec, indoor masks were mandated province-wide on July 18, while other provinces such as British Columbia and Prince Edward Island did not introduce mask mandates until November (see Table D3 for the complete list of dates).
Fig. 2
Policy aggregates – Canada. Notes: The figure plots the numerical values of the five policy aggregates (Mask, Business/gathering, School, Travel and Long-term care, LTC) over time, for each of the 10 provinces. The mask policy values for Ontario (ON) reflect the gradual adoption of mandates (see Fig. 1) and the respective PHU. population sizes.
Table D3
Canadian provinces – date of mask mandate.
1
Alberta1
August 1, 2020
2
British Columbia
November 19, 2020
3
Manitoba2
September 28, 2020
4
New Brunswick
October 9, 2020
5
Newfoundland and Labrador
August 24, 2020
6
Nova Scotia
July 31, 2020
7
Ontario3
see Table D2
8
Prince Edward Island
November 20, 2020
9
Quebec
July 18, 2020
10
Saskatchewan4
November 6, 2020
Notes: 1. Regional mandates: Calgary, Edmonton and surroundings (coded as 0.75), provincial mandate as of Dec. 8. 2. Regional mandates: Aug. 24–Sep. 17 (coded as 0.25), Sep. 28–Nov. 1 (coded as 0.5) and Nov. 2–Nov. 11 (coded as 0.75); provincial mandate as of Nov. 12. 3. Regional (PHU) mandates: see Table D2; provincial mandate as of Oct. 3. 4. Regional mandates: Nov. 6–Nov. 18 (coded as 0.75 and 0.95), provincial mandate as of Nov. 19.
Policy aggregates – Canada. Notes: The figure plots the numerical values of the five policy aggregates (Mask, Business/gathering, School, Travel and Long-term care, LTC) over time, for each of the 10 provinces. The mask policy values for Ontario (ON) reflect the gradual adoption of mandates (see Fig. 1) and the respective PHU. population sizes.There are two empirical challenges specific to the Canadian context and data. The first is the presence of small provinces or sub-regions with very few COVID-19 cases or deaths. In Section 4.4, we perform robustness checks using different ways of handling the observations with very few cases (in particular zero cases). The second data limitation is that there are only 10 provinces in Canada and 34 public health units in Ontario, compared to 51 U.S. states in Chernozhukov et al. (2021). To account for the resulting small number of clusters in the estimation, we compute and report wild bootstrap standard errors and p-values, as proposed by Cameron et al. (2008).17
On the other hand, our data has the advantage of a longer time horizon (March to November) and non-binary, more detailed policy variables compared to Raifman et al. (2020).Behaviour proxy. We follow Chernozhukov et al. (2021) and other authors in interpreting the location change indices from the Google Community Mobility reports as proxies for changes in people’s behaviour during the pandemic, keeping in mind that location is only one aspect of behaviour relevant to the spread of COVID-19. The general pattern in the data (see Fig. C3) shows sharply reduced frequency of recorded geo-locations in shops, workplaces and transit early in the pandemic (March), with a subsequent gradual increase back toward the baseline (except for transit), a flattening out in July and August, and a relatively small decline in the Fall months.
Fig. C3
Canada – Behaviour proxy, . Notes: The Behaviour proxy is the arithmetic average of the “retail”, “grocery and pharmacy”, and “workplaces” Google mobility indicators. Province-level 7-day moving averages are plotted.
Several of the six available location indicators (retail, grocery and pharmacy, workplaces, transit, parks and residential) are highly correlated with each other (see Tables B1 and B2) and/or contain many missing observations for the smaller PHUs and provinces. To address these data limitations and the possible impact of collinearity on the estimation results, we use as proxy for behavioural changes the arithmetic average of three mobility indicators: “retail”, “grocery and pharmacy” and “workplaces”.18
To be consistent with the weekly outcome variables and to mitigate day-of-the-week geo-location variation, we construct the Behaviour proxy by taking a weekly moving average of the (retail + grocery and pharmacy + workplaces) data, from date to date .19
As a result, our empirical analysis uses weekly totals (for cases, tests and deaths) or weekly moving averages (for policies and the behaviour proxy) for all variables recorded on daily basis.
Table B1
Ontario – correlations between the Google mobility indicators.
category
retail
grocery
workplaces
transit
residential
parks
N
retail
1
6672
grocery
0.78
1
6735
workplaces
0.48
0.34
1
6788
transit
0.55
0.44
0.62
1
5040
residential
-0.59
-0.39
-0.91
-0.68
1
6232
parks
0.32
0.23
0.23
0.39
-0.34
1
3014
Notes: Time period – May 1, to November 16, 2020 (two weeks before the May 15, - November 30, sample period). Daily PHU-level data.
Table B2
Canada – Correlations between the Google mobility indicators.
category
retail
grocery
workplaces
transit
residential
parks
N
retail
1
2650
grocery
0.81
1
2650
workplaces
0.65
0.49
1
2650
transit
0.77
0.53
0.81
1
2306
residential
-0.79
-0.57
-0.89
-0.81
1
2592
parks
0.50
0.41
0.15
0.25
-0.46
1
2168
Notes: Time period – February 26, to November 16, 2020 (two weeks before the March 11, - November 30, sample period). Daily province-level data.
Tables B3 and B4 display the correlation between the behaviour proxy and the five policy aggregates . The behaviour proxy and mask mandate variable are not highly correlated, suggesting that the effect of mask mandates on COVID-19 outcomes is likely not dependent on location behaviour changes.
Table B3
Ontario – Correlations between policies and location behaviour.
Behaviour
Mask
Business/
School
LTC
New weekly
proxy
gathering
tests ΔT
Behaviour proxy
1
Mask
0.24
1
Business/gathering
-0.50
-0.70
1
School
-0.43
-0.62
0.89
1
Long-term care (LTC)
-0.31
-0.88
0.73
0.70
1
New weekly tests ΔT
-0.44
0.19
-0.02
-0.08
-0.14
1
Notes: Time period – May 15, to November 30, 2020 (). Each variable is a 7-day moving average. All variables are at the PHU level, except School and LTC, which are measured at the province level.
Information. We use the weekly cases and case growth variables defined above, and , to construct the information variables used in estimation Eq. (1). Specifically, we use as information the lagged weekly case growth rate, and the log of past weekly cases, . We also use the lagged provincial (in the Ontario analysis) or national (in the Canada analysis) case growth rate and the log of weekly cases as additional information variables in some specifications. A two-week information lag, , is used in the baseline analysis. In the supplementary analysis using the death growth rate as the outcome, we use information on past deaths and a four-week lag (see Appendix A).Control variables. In all regressions, we control for region fixed effects (PHU or province) and the weekly COVID-19 tests growth rate , where denotes cumulative tests in region until date and is defined analogously to .20
Our baseline specification includes week fixed effects, and we also report results with no time trend and with cubic trend in days in Appendix B. In robustness checks, we also include news or weather variables as controls (see Section 4.4).Time period. We use the period May 15, to November 30, 2020 for our analysis with Ontario PHU data and the period March 11, to November 30, 2020 for the analysis with provincial data. The start date for the Ontario sample (May 15) is chosen as approximately two weeks after the last Spring restrictions were implemented and four weeks before the first PHU mask mandate was introduced. Sensitivity checks with different initial dates (May 1, June 1, and June 15) are reported in Section 4.4, with our main results remaining robust. The initial date for the Canada sample (March 11) was chosen as the first date on which each province reported at least one COVID-19 test (so that cases could be registered). Alternative initial dates are also considered in Section 4.4. We chose November 30, as the end date to avoid possible confounding effects from the holidays season and, given that the main focus of the paper is mask mandates, because by November mask usage was already very high in both jurisdictions with and without mandates (see Fig. C2).
Fig. C2
Canada – mask mandates and self-reported mask usage. Notes: The data source is YouGov. The figure plots the average self-reported mask usage by week (the fraction of respondents that answered “Always” to the survey question “Thinking about the last 7 days, how often have you worn a face mask outside your home?”) in the provinces with and without mask mandates. Sample weights are used to compute the averages.
Results
Mask mandates in Ontario public health regions
Fig. 3 displays results from an event study analysis of PHU mask mandates and the change in case growth rate in Ontario from six weeks before to five weeks after the mask mandate, where is the mandate implementation date and the reference point is one week before the implementation of the mask mandate ().
Fig. 3
Ontario – Event study of weekly case growth Notes: Time period – May 15, to November 30, 2020. The outcome variable is the weekly case growth rate . The figure plots the estimates from a version of Eq. (1) where the mask policy variable is replaced by the interaction of being in the “treatment” group (imposed mask mandate) with a series of dummies for each week, ranging from exactly 6 weeks before () to exactly 5 weeks after the mandate (), where is the mandate implementation date. The reference point is 1 week before the implementation (). Wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are used to construct the confidence intervals.
Ontario – Event study of weekly case growth Notes: Time period – May 15, to November 30, 2020. The outcome variable is the weekly case growth rate . The figure plots the estimates from a version of Eq. (1) where the mask policy variable is replaced by the interaction of being in the “treatment” group (imposed mask mandate) with a series of dummies for each week, ranging from exactly 6 weeks before () to exactly 5 weeks after the mandate (), where is the mandate implementation date. The reference point is 1 week before the implementation (). Wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are used to construct the confidence intervals.We first note that Fig. 3 does not exhibit a pre-trend – the estimates are close to and statistically indistinguishable from zero before the PHU mask mandates are implemented. This helps address the potential concern that PHUs that implemented mask mandates at different times may have had a different trend in case growth. Second, we see a slight uptick at (day 0 to 6), which may suggest that (some) mask mandates were implemented when case growth was high, a potential endogeneity concern. However, the estimate is economically small and not statistically different from zero. Third, we confirm that the effect of mask mandates on case growth entails a time lag: we first observe a decrease in case growth at (day 7 to 13), while a larger and statistically significant decrease occurs at (day 14 to 20) justifying the 14-day lag used in our main specification (1). Fourth, the mask mandate effect appears persistent rather than transitory, since the reduction in case growth after does not revert to its level from before .Table 1 shows the estimates of Eq. (1), in which we control for other policies, behaviour and information, as explained in Section 3.1.21
We report wild bootstrap p-values clustered at the PHU level to account for the small number of clusters.22
Column (1) in Table 1 uses lagged cases and lagged case growth at the PHU level as information; column (2) also includes lagged cases and lagged case growth at the province level as additional information variables.23
We also include week fixed effects as a flexible way to control for additional province-wide factors possibly affecting the spread of COVID-19, e.g., income support policies, adaptation to the pandemic over time, so-called “COVID fatigue”, etc. All robustness checks use this specification. In Appendix Table B5, we also estimate (1) without a time trend or using a cubic time trend in days from the beginning of the sample.
Table 1
Ontario – main results.
Outcome: weekly case growth Yit=Δlog(ΔCit)
p-values in [ ]
(1)
(2)
Mask_14
-0.244 **
-0.248 **
[0.012]
[0.011]
Business/gathering_14
0.042
0.120
[0.937]
[0.789]
School_14
-0.545*
-0.499
[0.051]
[0.168]
Long-term care_14
-0.468
-1.067
[0.696]
[0.410]
Behaviour proxy_14
-0.005
-0.004
[0.280]
[0.335]
Δlog(ΔC)_14
0.049
0.047
[0.152]
[0.167]
log(ΔC)_14
-0.168 ***
-0.168 ***
[0.000]
[0.000]
Δlog(ΔPC)_14
0.375 **
[0.038]
log(ΔPC)_14
-0.004
[0.967]
Δlog(ΔT)
0.345 **
0.350 **
[0.042]
[0.040]
R-squared
0.096
0.096
N
6800
6800
PHU fixed effects
X
X
week fixed effects
X
X
Notes: Time period – May 15, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by public health unit (PHU) with 5000 repetitions are reported in the square brackets. Mask_14, Business/gathering_14, Behaviour proxy_14, C)_14, C)_14 and T) are measured at the PHU level; School_14, Long-term care_14, PC)_14, and PC)_14 are measured at the province level. PC denotes provincial total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively. Missing values (1% of all observations) for Behaviour proxy_14 are imputed via linear interpolation.
Table B5
Alternative time controls.
Outcome: weekly case growth, Yit=Δlog(ΔCit)
Ontario
Ontario
Canada
Canada
no time trend
cubic trend in days
no time trend
cubic trend in days
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Mask_14
-0.142
-0.161 *
-0.307 ***
-0.294 ***
-0.162 ***
-0.229 ***
-0.230 ***
-0.239 ***
[0.114]
[0.061]
[0.004]
[0.006]
[0.000]
[0.000]
[0.010]
[0.002]
Business/
-0.151
-0.331 *
-0.317
-0.536
-0.489 *
-0.554 **
-0.652 **
-0.725 **
gathering_14
[0.421]
[0.093]
[0.441]
[0.263]
[0.066]
[0.034]
[0.041]
[0.024]
School_14
-0.341 ***
-0.038
0.145
0.337
-0.466 ***
-0.340 ***
-0.233 *
-0.200
[0.000]
[0.801]
[0.259]
[0.114]
[0.000]
[0.000]
[0.086]
[0.156]
Travel_14
n.a.
n.a.
n.a.
n.a.
-0.150
-0.332
-0.127
-0.136
n.a.
n.a.
n.a.
n.a.
[0.534]
[0.306]
[0.769]
[0.749]
Long-term care_14
-0.747
-0.943 **
0.600
0.654
-0.161
-0.202
-0.146
-0.140
[0.108]
[0.039]
[0.310]
[0.281]
[0.492]
[0.394]
[0.556]
[0.580]
Behaviours_14
-0.004
-0.003
0.002
0.001
-0.003
0.000
-0.002
0.002
[0.357]
[0.526]
[0.758]
[0.794]
[0.694]
[0.986]
[0.829]
[0.964]
Δlog(ΔC)_14
0.027
0.031
0.033
0.035
-0.063
-0.066
-0.067
-0.073
[0.431]
[0.345]
[0.336]
[0.290]
[0.288]
[0.309]
[0.386]
[0.352]
log(ΔC)_14
-0.154 ***
-0.169 ***
-0.165 ***
-0.167 ***
-0.149 ***
-0.169 ***
-0.162 *
-0.164 *
[0.000]
[0.000]
[0.000]
[0.000]
[0.007]
[0.022]
[0.060]
[0.070]
Δlog(ΔTC)_14
0.026
-0.164
0.088
0.014
[0.816]
[0.198]
[0.343]
[0.919]
log(ΔTC)_14
0.179 *
0.191
0.107
0.082
[0.055]
[0.220]
[0.161]
[0.340]
Δlog(ΔT)
0.135
0.096
0.121
0.127
0.244 ***
0.298 ***
0.235 **
0.271 ***
[0.186]
[0.412]
[0.250]
[0.272]
[0.004]
[0.002]
[0.016]
[0.006]
R-squared
0.035
0.037
0.046
0.047
0.303
0.306
0.309
0.310
N
6800
6800
6800
6800
2650
2650
2650
2650
PHU fixed effects
X
X
X
X
province fixed effects
X
X
X
X
Notes: Time period – May 15, to Nov. 30, 2020 for Ontario and March 11, to Nov. 30 for Canada. P-values from wild bootstrap (cgmwildboot) standard errors clustered by PHU or province with 5000 repetitions are reported in the square brackets. TC denotes total cases for Ontario or Canada respectively. ***, ** and * denote 10%, 5% and 1% significance level respectively.
The estimates in Table 1
imply that, controlling for other policies, information, testing, and geo-location behaviour, mandatory indoor face masks are associated with a decrease of 24–25 log points () in the weekly case growth rate, two weeks after implementation. This result can be interpreted as a 22% weekly reduction in new cases, relative to the trend without mask mandate.24
The magnitude of the mask policy estimates is not very sensitive to whether lagged province-level data are included as additional information. We do not find a consistent statistically significant effect of the other NPIs in the Ontario sample.Ontario – main results.Notes: Time period – May 15, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by public health unit (PHU) with 5000 repetitions are reported in the square brackets. Mask_14, Business/gathering_14, Behaviour proxy_14, C)_14, C)_14 and T) are measured at the PHU level; School_14, Long-term care_14, PC)_14, and PC)_14 are measured at the province level. PC denotes provincial total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively. Missing values (1% of all observations) for Behaviour proxy_14 are imputed via linear interpolation.The results in Table 1 indicate that indoor mask mandates have been a powerful preventive measure in the COVID-19 context. Our estimates of the mandates’ impact in Ontario’s PHUs are larger than the 10 percentage point reduction in case growth estimated by Chernozhukov et al. (2021) for the U.S. A possible explanation is that Ontario’s mask mandates are more comprehensive: we evaluate the effect of universal indoor mask-wearing for the public at large rather than the effect of mask-wearing for employees only in Chernozhukov et al. (2021). Differences in the compliance rate may also be a factor; we discuss this potential mechanism in Section 4.3.Table 1 also shows a statistically significant negative association between information (log of past cases, C)_14), and current weekly case growth ( in all specifications). This indicates that a higher (lower) level of cases two weeks prior is associated with lower (higher) current case growth, which is consistent with a possible behavioural feedback. Therefore, while the location-based proxy allows for certain behavioural responses, it may not capture other important aspects of behaviour (e.g., frequent hand-washing, physical distancing or the rate of social interactions) that can be influenced by the observed case counts. In fact, our coefficient estimate on the behaviour proxy is not statistically significantly different from zero (both in Table 1 and in the province-level Table 2
below), unlike in Chernozhukov et al. (2021). In Table B19, we find strong contemporaneous correlations between policy measures, log cases, and the Google mobility behavioural proxy from estimating Eq. (2). This suggests that the information (lagged cases) and the lagged policy variables in (1) may absorb lagged behavioural responses proxied by or other latent behavioural changes not captured by . Finally, as expected, the weekly growth rate of COVID cases is positively correlated with the weekly tests growth rate.
Table 2
Canada – main results.
Outcome: weekly case growth Yit=Δlog(ΔCit)
p-values in [ ]
(1)
(2)
Mask_14
-0.219 **
-0.223 **
[0.028]
[0.025]
Business/gathering_14
-0.580 *
-0.594 *
[0.068]
[0.076]
School_14
-0.148
-0.162
[0.242]
[0.182]
Travel_14
0.206
0.161
[0.705]
[0.764]
Long-term care_14
-0.093
-0.097
[0.672]
[0.665]
Behaviour proxy_14
-0.005
-0.004
[0.763]
[0.788]
Δlog(ΔC)_14
-0.047
-0.050
[0.527]
[0.519]
log(ΔC)_14
-0.170 **
-0.172 **
[0.043]
[0.040]
Δlog(ΔNC)_14
0.224
[0.327]
log(ΔNC)_14
0.184 **
[0.046]
Δlog(ΔT)
0.295 ***
0.297 ***
[0.000]
[0.000]
R-squared
0.338
0.339
N
2650
2650
province fixed effects
X
X
week fixed effects
X
X
Notes: Time period – March 11, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Canada – main results.Notes: Time period – March 11, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.Fig. 4 displays the estimates on the mask mandate variable Mask_14 from Eq. (1) for different sample end dates, compared to the baseline results for November 30, in Table 1. The results show that the estimated mandate effect is stable over these dates, as all PHU-level mandates were implemented by August 17.
Fig. 4
Ontario – Mask mandate estimate by date Notes: The figure plots the coefficient estimates on Mask_14, with 95% confidence intervals, from equation (1) for different end dates of the sample. The baseline specifications (Table 1) use November 30. The left panel corresponds to column (1) in Table 1; the right panel corresponds to column (2) in Table 1.
Ontario – Mask mandate estimate by date Notes: The figure plots the coefficient estimates on Mask_14, with 95% confidence intervals, from equation (1) for different end dates of the sample. The baseline specifications (Table 1) use November 30. The left panel corresponds to column (1) in Table 1; the right panel corresponds to column (2) in Table 1.
Province-level results
We next evaluate the impact of NPIs on COVID-19 case growth in Canada as a whole, by using variation in the timing of policy interventions across the 10 provinces. We also examine NPIs for which there is no data variation across Ontario’s PHUs (e.g., travel or long-term care regulations), in addition to mask mandates.Table 2 displays the estimates of Eq. (1) for weekly case growth, along with wild bootstrap p-values, clustered at the province level (see Table B10 for other methods of computing the standard errors). Column (1) uses lagged cases and lagged case growth at the province level as information while column (2) additionally includes lagged cases and case growth at the national level. Both specifications include province and week fixed effects (see Table B5 for different time controls).
Table B10
Canada – Robustness (standard errors).
Outcome: weekly case growth, Yit=Δlog(ΔCit)
(1)
(2)
Mask_14
-0.219
-0.223
(0.034)
**
(0.032)
**
[0.028]
**
[0.025]
**
{0.024}
**
{0.017}
**
Business/gathering_14
-0.580
-0.594
(0.063)
*
(0.065)
*
[0.068]
*
[0.076]
*
{0.060}
*
{0.056}
*
School_14
-0.148
-0.162
(0.301)
(0.252)
[0.242]
[0.182]
{0.210}
{0.152}
Travel_14
0.206
0.161
(0.660)
(0.733)
[0.705]
[0.764]
{0.714}
{0.761}
Long-term care_14
-0.093
-0.097
(0.655)
(0.647)
[0.672]
[0.665]
{0.672}
{0.627}
Behaviour proxy_14
-0.005
-0.004
(0.713)
(0.738)
[0.763]
[0.788]
{0.760}
{0.782}
R-squared
0.338
0.339
N
2650
2650
Δlog(ΔC)_14
X
X
log(ΔC)_14
X
X
Δlog(ΔNC)_14
X
log(ΔNC)_14
X
Δlog(ΔT)
X
X
province fixed effects
X
X
week fixed effects
X
X
Notes: Time period – March 11, to November 30. P-values from standard clustering by province in the () parentheses, wild bootstrap with one-way clustering by province and 5000 repetitions in the [ ] square brackets, and wild bootstrap with two-way clustering by province and day with 5000 repetitions in the { } curly braces. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
The most robust result in Table 2 is the estimate on mask mandates (Mask_14). We find that mask mandates are associated with a significant reduction in weekly case growth of 22 log points (p-values 0.03), which corresponds to a 20% weekly reduction in new cases, relative to the trend in absence of mandate. It is reassuring that these province-level results are very close in magnitude and consistent with our results using Ontario PHU data.Table 2 further suggests that restrictions on businesses and gatherings are associated with a reduction in weekly case growth of 58–59 log points or, vice versa, that relaxing business/gathering restrictions is associated with higher case growth. These estimates correspond to a 44–45% weekly decrease in new cases, relative to the trend in absence of mandate. We obtain similar results in robustness Tables B5, B12 and B16. Note, however, that the business/gathering estimates are noisier than our estimates for mask mandates (p-values ) and lose statistical significance in some robustness checks (Table B9). Still, these results suggest that relaxed restrictions and the associated increase in business and workplace activity or gatherings (including restaurants, bars and retail) may be an important offsetting factor for the estimated impact of mask mandates on COVID-19 case growth.
Table B12
Canada – robustness (news and weather).
Outcome: weekly case growth, Yit=Δlog(ΔCit)
baseline
add weather
add news
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
Mask_14
-0.219 **
-0.223 **
-0.186 **
-0.189 **
-0.217 **
-0.217 **
[0.028]
[0.025]
[0.028]
[0.025]
[0.036]
[0.029]
Business/gathering_14
-0.580 *
-0.594 *
-0.605 *
-0.623 *
-0.574 *
-0.573 *
[0.068]
[0.076]
[0.095]
[0.090]
[0.075]
[0.076]
School_14
-0.148
-0.162
-0.105
-0.120
-0.140
-0.126
[0.242]
[0.182]
[0.503]
[0.416]
[0.256]
[0.294]
Travel_14
0.206
0.161
0.149
0.091
0.217
0.184
[0.705]
[0.764]
[0.773]
[0.846]
[0.693]
[0.732]
Long-term care_14
-0.093
-0.097
-0.084
-0.087
-0.091
-0.089
[0.672]
[0.665]
[0.711]
[0.711]
[0.684]
[0.690]
Behaviour proxy_14
-0.005
-0.004
-0.003
-0.003
-0.005
-0.002
[0.763]
[0.788]
[0.807]
[0.842]
[0.769]
[0.873]
Δlog(ΔC)_14
-0.047
-0.050
-0.048
-0.051
-0.047
-0.052
[0.527]
[0.519]
[0.497]
[0.487]
[0.527]
[0.500]
log(ΔC)_14
-0.170 **
-0.172 **
-0.171 **
-0.174 **
-0.169 **
-0.168 **
[0.043]
[0.040]
[0.035]
[0.031]
[0.048]
[0.045]
Δlog(ΔNC)_14
0.224
0.207
0.381
[0.327]
[0.356]
[0.109]
log(ΔNC)_14
0.184 **
0.209 **
0.412 ***
[0.046]
[0.020]
[0.009]
Δlog(ΔT)
0.295 ***
0.297 ***
0.316 ***
0.318 ***
0.295 ***
0.293 ***
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
Rain_14
0.019
0.019
[0.461]
[0.478]
Max temp_14
0.034
0.035
[0.333]
[0.336]
Min temp_14
-0.043
-0.045
[0.270]
[0.260]
News_14
-0.002
-0.014 *
[0.680]
[0.068]
R-squared
0.338
0.339
0.340
0.342
0.337
0.340
N
2650
2650
2650
2650
2650
2650
province fixed effects
X
X
X
X
X
X
week fixed effects
X
X
X
X
X
X
weather
X
X
news
X
X
Notes: Time period – March 11, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. Columns (1) and (2) repeat columns (1) and (2) from Table 2. Columns (3) and (4) report estimates with lagged weather variables as additional controls. Columns (5) and (6) add a “newsǥ variable to the baseline specification (see Appendix D for more details). NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Table B16
Canada – initial closing sub-period.
Outcome: weekly case growth, Yit=Δlog(ΔCit)
Baseline
Initial closing
Mar. 11 - Nov. 30
Mar. 11 - May 14
p-values in [ ]
(1)
(2)
(3)
(4)
Mask_14
-0.219 **
-0.223 **
n.a.
n.a.
[0.028]
[0.025]
n.a.
n.a.
Business/gathering_14
-0.580 *
-0.594 *
-0.141
-0.227
[0.068]
[0.076]
[0.852]
[0.775]
School_14
-0.148
-0.162
-0.543
-0.698
[0.242]
[0.182]
[0.221]
[0.160]
Travel_14
0.206
0.161
-1.876 ***
-2.315 ***
[0.705]
[0.764]
[0.000]
[0.000]
Long-term care_14
-0.093
-0.097
-0.647 ***
-0.864 ***
[0.672]
[0.665]
[0.000]
[0.000]
Behaviour proxy_14
-0.005
-0.004
-0.031 **
-0.031 **
[0.763]
[0.788]
[0.010]
[0.040]
Δlog(ΔC)_14
-0.047
-0.050
0.075
0.074
[0.527]
[0.519]
[0.295]
[0.268]
log(ΔC)_14
-0.170 **
-0.172 **
-0.350 ***
-0.394 ***
[0.043]
[0.040]
[0.000]
[0.000]
Δlog(ΔNC)_14
0.224
0.238
[0.327]
[0.347]
log(ΔNC)_14
0.184 **
0.457 ***
[0.046]
[0.000]
Δlog(ΔT)
0.295 ***
0.297 ***
0.198 **
0.197 **
[0.000]
[0.000]
[0.019]
[0.031]
R-squared
0.338
0.339
0.673
0.684
N
2650
2650
650
650
province fixed effects
X
X
X
X
week fixed effects
X
X
X
X
Notes: P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively. No mask mandates are present in the initial closing period.
Table B9
Canada - Robustness (treatment of zero weekly cases).
Outcome: weekly case growth, Yit=Δlog(ΔCit)
Baseline
Alternative 1
Alternative 2
Alternative 3
replace log(0) by -1
replace log(0) by 0
add 1 before taking log
weighted by population
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Mask_14
-0.219 **
-0.223 **
-0.203 **
-0.206 **
-0.200 **
-0.203 **
-0.286 ***
-0.295 ***
[0.028]
[0.025]
[0.026]
[0.026]
[0.017]
[0.012]
[0.000]
[0.000]
Business /
-0.580 *
-0.594 *
-0.549
-0.561
-0.477
-0.487
-0.432
-0.443
gathering_14
[0.068]
[0.076]
[0.119]
[0.117]
[0.103]
[0.108]
[0.138]
[0.166]
School_14
-0.148
-0.162
-0.098
-0.113
-0.116
-0.128
0.026
0.015
[0.242]
[0.182]
[0.483]
[0.391]
[0.390]
[0.320]
[0.803]
[0.873]
Travel_14
0.206
0.161
0.210
0.174
0.346
0.313
-0.346
-0.478
[0.705]
[0.764]
[0.718]
[0.758]
[0.457]
[0.508]
[0.371]
[0.305]
LTC_14
-0.093
-0.097
-0.023
-0.025
-0.031
-0.033
-0.089
-0.084
[0.672]
[0.665]
[0.914]
[0.912]
[0.862]
[0.858]
[0.140]
[0.199]
Behaviour_14
-0.005
-0.004
-0.006
-0.006
-0.003
-0.003
-0.019 ***
-0.017 ***
[0.763]
[0.788]
[0.614]
[0.646]
[0.788]
[0.812]
[0.000]
[0.000]
Δlog(ΔC)_14
-0.047
-0.050
-0.021
-0.022
-0.023
-0.024
0.030
0.027
[0.527]
[0.519]
[0.717]
[0.700]
[0.686]
[0.682]
[0.480]
[0.528]
log(ΔC)_14
-0.170 **
-0.172 **
-0.169 **
-0.170 **
-0.152 **
-0.153 **
-0.201 ***
-0.206 ***
[0.043]
[0.040]
[0.038]
[0.038]
[0.028]
[0.028]
[0.000]
[0.000]
Δlog(ΔNC)_14
0.224
0.083
0.125
0.075
[0.327]
[0.669]
[0.494]
[0.768]
log(ΔNC)_14
0.184 **
0.135
0.131 *
0.138
[0.046]
[0.102]
[0.051]
[0.150]
Δlog(ΔT)
0.295 ***
0.297 ***
0.207 ***
0.209 ***
0.235 ***
0.236 ***
0.442 ***
0.439 ***
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
R-squared
0.338
0.339
0.394
0.394
0.390
0.391
0.593
0.594
N
2650
2650
2650
2650
2650
2650
2650
2650
province fixed effects
X
X
X
X
X
X
X
X
week fixed effects
X
X
X
X
X
X
X
X
weighted
X
X
Notes: Time period – March 11, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions in the square brackets. Columns (1) and (2) repeat columns (1) and (2) from Table 2 where we replace with -1. Columns (3) and (4) replace with 0, and columns (5) and (6) add 1 to all observations. Columns (7) and (8) report estimates from a weighted least squares regression with weights equal to provincial populations. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
As in Table 1, we again find that weekly case growth is negatively associated with weekly cases two weeks prior (C)_14 in Table 2) and positively associated with the weekly tests growth, (p-value ).25Fig. 5 displays the estimates of the coefficient on the mask mandate variable Mask_14 in Eq. (1) for different sample end dates, compared to the baseline results for November 30, in Table 2. The figure shows that the estimated mask mandate effect slowly diminishes over time, from -0.35 until Sep. 15 to -0.17 until Dec. 31. A possible explanation is the steady increase in self-reported mask usage in the provinces without mandates over this period (see Fig. C2), which is also consistent with the declining estimate of the effect of mask mandates on mask usage over time shown in Fig. 7 in Section 4.3.
Fig. 5
Canada – Mask mandate estimate by date. Notes: The figure plots the coefficient estimates on Mask_14, with 95% confidence intervals, from Eq. (1) for different end dates of the sample. The baseline specifications (Table 2) use November 30. The left panel corresponds to column (1) in Table 2; the right panel corresponds to column (2) in Table 2.
Fig. 7
Mask usage estimate by date. Notes: The figure plots the coefficient estimates on Mask, with 95% confidence intervals, from Eq. (2) for different end dates of the sample. The baseline specifications (Table 3) use November 30. The left panel corresponds to column (2) in Table 3; the right panel corresponds to column (4) in Table 3.
Canada – Mask mandate estimate by date. Notes: The figure plots the coefficient estimates on Mask_14, with 95% confidence intervals, from Eq. (1) for different end dates of the sample. The baseline specifications (Table 2) use November 30. The left panel corresponds to column (1) in Table 2; the right panel corresponds to column (2) in Table 2.
Mask usage
The effectiveness of any public policy critically depends on whether and how it affects people’s behaviour. In this section, we use self-reported survey data on mask usage to examine whether mask mandates increased mask use in Canada (“first-stage” analysis).We use data from the YouGov COVID-19 Public Monitor (Jones, 2021), which consists of multiple waves of public opinion surveys fielded regularly since early April 2020 in many countries.26
Here, we focus on inter-provincial comparisons within Canada. Our main variable of interest is the response to the question “Thinking about the last 7 days, how often have you worn a face mask outside your home (e.g. when on public transport, going to a supermarket, going to a main road)?” The possible answers are “Always”, “Frequently”, “Sometimes”, “Rarely”, and “Not at all”. We create a binary variable taking value 1 if the response is “Always” and 0 otherwise, and another variable taking value of 1 if the respondent answered either “Always” or “Frequently” and 0 otherwise.We begin with an illustration of self-reported mask usage in Canada from April to November 2020. Fig. C2 plots the average self-reported mask usage (response “Always”) in the provinces with and without mask mandates.27
The figure shows that self-reported mask usage is higher, by up to 50 percentage points in early August, in the provinces with a mask mandate compared to the provinces without a mandate. Since Fig. C2 does not account for compositional changes in the data and other factors, we formally estimate Eq. (2), using self-reported mask usage as the behavioural outcome.28Fig. 6 displays the results from an event study analysis of mask mandates and the change in mask usage, ranging from 6 weeks before the mask mandate to 5 weeks after the mask mandate ( to +5, where is the implementation date of the mask mandate). The reference point is one week before the implementation of the mask mandate (). The left and right panels of Fig. 6 present results for the “Always” and “Always” or “Frequently” mask usage responses, respectively.
Fig. 6
Event study of self-reported mask usage in Canada. Notes: Time period – April 2, to November 30, 2020. The data source is YouGov. The binary outcome variable takes value 1 if the respondent answered “Always” (in the left panel) or “Always” or “Frequently” (in the right panel) to “Thinking about the last seven days, how often have you worn a face mask outside your home?” The figure plots the estimates from a version of equation (2) where the mask policy variable is replaced by the interaction of a variable denoting being in the ‘treatment group’ (imposed mask mandate) with a series of dummies for each week, ranging from exactly 6 weeks before the mask mandate () to exactly 5 weeks after the mandate (), where is the mandate implementation date. The reference point is 1 week before the implementation (). Wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are used to construct the confidence intervals. Sample weights are used.
Event study of self-reported mask usage in Canada. Notes: Time period – April 2, to November 30, 2020. The data source is YouGov. The binary outcome variable takes value 1 if the respondent answered “Always” (in the left panel) or “Always” or “Frequently” (in the right panel) to “Thinking about the last seven days, how often have you worn a face mask outside your home?” The figure plots the estimates from a version of equation (2) where the mask policy variable is replaced by the interaction of a variable denoting being in the ‘treatment group’ (imposed mask mandate) with a series of dummies for each week, ranging from exactly 6 weeks before the mask mandate () to exactly 5 weeks after the mandate (), where is the mandate implementation date. The reference point is 1 week before the implementation (). Wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are used to construct the confidence intervals. Sample weights are used.We make several observations. First, neither panel shows a pre-trend – the estimates are statistically indistinguishable from zero before the mask mandates are implemented. This addresses the potential concern that provinces that implemented mask mandates may have had a different trend in mask usage than provinces that did not. Second, the effect of mask mandates on mask usage is immediate: an increase of roughly 11 percentage points on average, as soon as the mask policy is implemented (). Third, the effect appears persistent rather than transitory, since mask usage does not revert to its level before .Table 3 displays the estimates on self-reported mask usage in Eq. (2) along with wild bootstrap p-values clustered at the province level. As in Tables 1 and 2, our baseline specification uses week fixed effects.29
The results show that mask mandates are associated with 27 percentage point increase in self-reported mask usage, for the response “Always” (), from a base of self-reported mask usage without mask mandate of 33.2%. Similarly, “Always” or “Frequent” mask usage increases by 16 percentage points.30
31
Table 3
Canada – self-reported mask usage.
Outcome: Wear mask
“Always”
“Always” or “Frequently”
p-values in [ ]
(1)
(2)
(3)
(4)
Mask
0.273 ***
0.274 ***
0.158 ***
0.158 ***
[0.000]
[0.000]
[0.000]
[0.000]
Δlog(ΔC)
-0.005
-0.007
-0.016
-0.018
[0.680]
[0.599]
[0.183]
[0.170]
log(ΔC)
0.004
0.005
0.015 **
0.015 **
[0.585]
[0.561]
[0.010]
[0.019]
Δlog(ΔNC)
0.129
0.137
[0.356]
[0.372]
log(ΔNC)
-0.073
0.033
[0.298]
[0.663]
R-squared
0.274
0.274
0.254
0.255
N
15,808
15,808
15,808
15,808
mean w/o mask mandate
0.332
0.332
0.507
0.507
individual characteristics
X
X
X
X
province fixed effects
X
X
X
X
week fixed effects
X
X
X
X
Notes: Time period – April 2, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions reported in the square brackets. The data source is YouGov. The binary outcome variable takes value 1 if the respondent answered “Always” (columns 1 and 2) or “Always” or “Frequently” (columns 3 and 4) to the survey question “Thinking about the last 7 days, how often have you worn a face mask outside your home?” Sample weights are used. Individual characteristics include gender dummy, age dummy, dummies for each household size, dummies for each number of children, and dummies for each employment status. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Canada – self-reported mask usage.Notes: Time period – April 2, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions reported in the square brackets. The data source is YouGov. The binary outcome variable takes value 1 if the respondent answered “Always” (columns 1 and 2) or “Always” or “Frequently” (columns 3 and 4) to the survey question “Thinking about the last 7 days, how often have you worn a face mask outside your home?” Sample weights are used. Individual characteristics include gender dummy, age dummy, dummies for each household size, dummies for each number of children, and dummies for each employment status. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.These results show that mask mandates exhibit broad compliance in Canada and establish a possible mechanism for the significant impact of the mandates on the spread of COVID-19 that we find. That said, given that mask mandates do not change everyone’s behaviour, our estimates in Tables 1 and 2 represent intent-to-treat effects. The full effect of the entire population shifting from not wearing to wearing masks is likely larger.32There has been a heated debate on whether mask wearing may create a false sense of security and reduce adherence to other preventive measures. We investigate this question using the YouGov survey data. As Tables B14 and Tables B15 in the Appendix indicate, we find no evidence that mask mandates in Canada had an offsetting effect on other preventive measures such as hand washing, using sanitizer, avoiding gatherings, and avoiding touching objects in public during the period we study.33
Table B14
Self-reported precautions – Canada.
Outcome: “Always” response
wash hands
use sanitizer
avoid going out in general
avoid small gatherings
avoid medium gatherings
avoid large gatherings
avoid crowded areas
avoid touching objects
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Mask
0.001
-0.001
0.004
0.046 *
0.043
0.065
0.047
0.027
[0.955]
[0.972]
[0.636]
[0.056]
[0.238]
[0.118]
[0.174]
[0.340]
Δlog(ΔC)
-0.001
-0.003
-0.005
-0.007
-0.006
-0.006
0.005
0.001
[0.368]
[0.622]
[0.340]
[0.386]
[0.548]
[0.529]
[0.645]
[0.905]
log(ΔC)
-0.004
0.002
0.019 ***
0.024 ***
0.025 ***
0.022 **
0.011
0.007 *
[0.421]
[0.567]
[0.000]
[0.000]
[0.005]
[0.029]
[0.160]
[0.076]
Δlog(ΔNC)
-0.108
0.080
0.026
0.053
0.103
0.080
0.122 ***
0.020
[0.202]
[0.528]
[0.664]
[0.389]
[0.279]
[0.209]
[0.000]
[0.731]
log(ΔNC)
0.125
0.108
-0.037
0.067
0.064
0.109
0.009
0.056
[0.101]
[0.246]
[0.340]
[0.363]
[0.394]
[0.200]
[0.788]
[0.204]
R-squared
0.037
0.049
0.039
0.101
0.112
0.103
0.069
0.034
N
15,808
15,808
15,808
15,808
15,808
15,808
15,808
15,808
individual characteristics
X
X
X
X
X
X
X
X
province fixed effects
X
X
X
X
X
X
X
X
week fixed effects
X
X
X
X
X
X
X
X
average w/o mask mandate
0.721
0.489
0.259
0.444
0.575
0.755
0.640
0.476
survey item # (i12_)
health_2
health_3
health_6
health_12
health_13
health_14
health_15
health_20
Notes: Time period – April 2, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. The data source is YouGov. The outcome is a dummy that takes value 1 if the respondent answered “Always” to each survey question in Table D5. Sample weights are used. Individual characteristics include a gender dummy, and dummies for each age (in years), each household size, each number of children and each employment status. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Table B15
Self-reported precautions – Canada (continued).
Outcome: “Always” or “Frequently” response
wash hands
use sanitizer
avoid going out in general
avoid small gatherings
avoid medium gatherings
avoid large gatherings
avoid crowded areas
avoid touching objects
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Mask
0.007
-0.003
0.029
0.030
0.027
0.045
0.029
0.009
[0.682]
[0.860]
[0.178]
[0.240]
[0.266]
[0.178]
[0.291]
[0.758]
Δlog(ΔC)
-0.008 *
-0.002
-0.019 **
-0.020 ***
-0.011 ***
-0.010
-0.004
-0.008
[0.066]
[0.592]
[0.031]
[0.000]
[0.000]
[0.182]
[0.547]
[0.452]
log(ΔC)
0.004
0.001
0.027 ***
0.023 ***
0.022 ***
0.012 **
0.010
0.002
[0.126]
[0.807]
[0.000]
[0.000]
[0.000]
[0.012]
[0.120]
[0.777]
Δlog(ΔNC)
-0.062
0.045
-0.085
0.036
0.055
0.039
0.001
-0.004
[0.187]
[0.680]
[0.193]
[0.431]
[0.275]
[0.426]
[0.970]
[0.990]
log(ΔNC)
0.065 ***
0.077
0.065 ***
0.083 *
0.099 **
0.069
0.018
0.052
[0.000]
[0.470]
[0.000]
[0.094]
[0.040]
[0.443]
[0.775]
[0.483]
R-squared
0.058
0.053
0.061
0.083
0.077
0.070
0.060
0.038
N
15,808
15,808
15,808
15,808
15,808
15,808
15,808
15,808
individual characteristics
X
X
X
X
X
X
X
X
province fixed effects
X
X
X
X
X
X
X
X
week fixed effects
X
X
X
X
X
X
X
X
average w/o mask mandate
0.930
0.768
0.606
0.674
0.761
0.863
0.854
0.786
survey item # (i12_)
health_2
health_3
health_6
health_12
health_13
health_14
health_15
health_20
Notes: Time period – April 2, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. The data source is YouGov. The outcome is a dummy that takes value 1 if the respondent answered “Always” or “Frequently” to each survey question in Table D5. Sample weights are used. Individual characteristics include a gender dummy, and dummies for each age (in years), each household size, each number of children and each employment status. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Finally, in Fig. 7
, we plot the estimates for the mask mandate variable from Table 3 for different dates. The estimates slightly decrease over time, which is consistent with the slowly diminishing effect of the mask mandates on case growth in Canada shown in Fig. 5.Mask usage estimate by date. Notes: The figure plots the coefficient estimates on Mask, with 95% confidence intervals, from Eq. (2) for different end dates of the sample. The baseline specifications (Table 3) use November 30. The left panel corresponds to column (2) in Table 3; the right panel corresponds to column (4) in Table 3.
Robustness
Zero weekly cases. A possible concern may be that the dependent variable is not well defined when the weekly case totals or equal zero. As in Chernozhukov et al. (2021), we replace with -1 in our baseline specification.34
We check the robustness of our estimates to alternative treatments of zero weekly cases in Appendix Tables B6 and B9 – replacing with 0, adding 1 to before taking logs, or population-weighted least squares. Our main results on mask mandates in Ontario PHUs and Canadian provinces are robust to these alternative specifications, with the single exception of columns (7) and (8) in Table B6 where the mask mandate estimate loses statistical significance at the 10% level due to reduced power.
Table B6
Ontario – robustness (treatment of zero weekly cases).
Outcome: weekly case growth, Yit=Δlog(ΔCit)
Baseline
Alternative 1
Alternative 2
Alternative 3
replace log(0) by -1
replace log(0) by 0
add 1 before taking log
weighted by population
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Mask_14
-0.244 **
-0.248 **
-0.194 **
-0.198 **
-0.181 **
-0.185 **
-0.171
-0.179
[0.012]
[0.011]
[0.024]
[0.022]
[0.020]
[0.020]
[0.170]
[0.165]
Business/
0.042
0.120
-0.003
0.063
-0.005
0.052
0.313
0.320
gathering_14
[0.937]
[0.789]
[0.993]
[0.837]
[0.981]
[0.868]
[0.279]
[0.269]
School_14
-0.545 *
-0.499
-0.494 **
-0.498 *
-0.410 **
-0.340
-0.179
-0.019
[0.051]
[0.168]
[0.017]
[0.074]
[0.042]
[0.198]
[0.293]
[0.916]
Long-term care_14
-0.468
-1.067
-0.729
-1.199
-0.345
-0.819
-0.677
-1.131
[0.696]
[0.410]
[0.445]
[0.229]
[0.690]
[0.406]
[0.364]
[0.153]
Behaviours_14
-0.005
-0.004
-0.007
-0.006
-0.005
-0.005
0.000
0.001
[0.280]
[0.335]
[0.105]
[0.125]
[0.191]
[0.229]
[0.949]
[0.848]
Δlog(ΔC)_14
0.049
0.047
0.063 **
0.062 **
0.048 *
0.046 *
0.053
0.050
[0.152]
[0.167]
[0.021]
[0.023]
[0.062]
[0.068]
[0.132]
[0.158]
log(ΔC)_14
-0.168 ***
-0.168 ***
-0.155 ***
-0.155 ***
-0.140 ***
-0.140 ***
-0.180 ***
-0.181 ***
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
Δlog(ΔPC)_14
0.375 **
0.314 **
0.281 *
0.232
[0.038]
[0.046]
[0.055]
[0.112]
log(ΔPC)_14
-0.004
-0.053
0.039
0.156
[0.967]
[0.723]
[0.788]
[0.125]
Δlog(ΔT)
0.345 **
0.350 **
0.235 *
0.238 *
0.268 **
0.272 **
0.276 **
0.282 **
[0.042]
[0.040]
[0.088]
[0.080]
[0.041]
[0.034]
[0.040]
[0.036]
R-squared
0.096
0.096
0.098
0.099
0.104
0.105
0.128
0.129
N
6800
6800
6800
6800
6800
6800
6800
6800
PHU fixed effects
X
X
X
X
X
X
X
X
week fixed effects
X
X
X
X
X
X
X
X
weighted
X
X
Notes: Time period – May 15, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by public health unit (PHU) with 5000 repetitions are reported in the square brackets. Columns (1) and (2) repeat columns (1) and (2) from Table 1 where we replace with -1. Columns (3) and (4) replace with 0, and columns (5) and (6) add 1 to all observations. Columns (7) and (8) report estimates from a weighted least squares regression with weights equal to PHU populations. PC denotes provincial total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Policy collinearity. A possible concern is that some NPIs (e.g., international travel restrictions or school closures) were implemented within a very short time interval. Thus, we may lack sufficient regional variation to distinguish and identify the separate effect of each policy.35
Collinearity in the policy aggregates could also affect the standard errors and the signs of the estimated coefficients. Table B8 for Ontario and Table B11 for Canada in the Appendix report the estimates from our baseline specification when omitting one policy at a time or when including the mask mandate policy only. Our mask mandate estimates remain largely robust, with the exception of the last columns in Table B11 where the estimates’ statistical significance is affected. This confirms the importance of controlling for all NPIs.
Table B8
Ontario – robustness (policy collinearity).
Outcome: weekly case growth, Yit=Δlog(ΔCit)
Baseline
drop Mask_14
drop Business /gathering_14
drop School_14
drop LTC_14
Mask_14 only
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
Mask_14
-0.244 **
-0.248 **
-0.244 **
-0.250 **
-0.243 **
-0.247 **
-0.241 **
-0.242 **
-0.241 **
-0.242 **
[0.012]
[0.011]
[0.014]
[0.012]
[0.012]
[0.012]
[0.011]
[0.010]
[0.012]
[0.012]
Business/
0.042
0.120
0.098
0.172
0.066
0.116
0.033
0.088
gathering_14
[0.937]
[0.789]
[0.838]
[0.697]
[0.892]
[0.795]
[0.956]
[0.852]
School_14
-0.545 *
-0.499
-0.540 *
-0.486
-0.547 **
-0.497
-0.546 *
-0.498
[0.051]
[0.168]
[0.051]
[0.184]
[0.049]
[0.171]
[0.050]
[0.170]
LTC_14
-0.468
-1.067
-0.261
-0.834
-0.460
-1.031
-0.481
-1.065
[0.696]
[0.410]
[0.824]
[0.501]
[0.700]
[0.416]
[0.689]
[0.410]
Behav. proxy_14
-0.005
-0.004
-0.004
-0.003
-0.005
-0.005
-0.005
-0.004
-0.005
-0.004
-0.005
-0.004
[0.280]
[0.335]
[0.408]
[0.470]
[0.266]
[0.308]
[0.314]
[0.366]
[0.278]
[0.341]
[0.292]
[0.349]
Δlog(ΔC)_14
0.049
0.047
0.050
0.049
0.048
0.047
0.048
0.047
0.049
0.047
0.048
0.047
[0.152]
[0.167]
[0.133]
[0.142]
[0.160]
[0.174]
[0.154]
[0.169]
[0.154]
[0.166]
[0.163]
[0.172]
log(ΔC)_14
-0.168 ***
-0.168 ***
-0.167 ***
-0.167 ***
-0.168 ***
-0.167 ***
-0.167 ***
-0.168 ***
-0.167 ***
-0.167 ***
-0.166 ***
-0.167 ***
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
Δlog(ΔPC)_14
0.375 **
0.357 **
0.363 *
0.308 *
0.324 *
0.249
[0.038]
[0.046]
[0.064]
[0.077]
[0.073]
[0.162]
log(ΔPC)_14
-0.004
0.008
0.007
0.156
0.009
0.175
[0.967]
[0.984]
[0.984]
[0.229]
[0.980]
[0.142]
Δlog(ΔT)
0.345 **
0.350 **
0.347 **
0.353 **
0.345 **
0.350 **
0.336 **
0.345 **
0.347 **
0.355 **
0.339 **
0.351 **
[0.042]
[0.040]
[0.044]
[0.040]
[0.043]
[0.041]
[0.048]
[0.042]
[0.038]
[0.034]
[0.044]
[0.038]
R-squared
0.096
0.096
0.094
0.095
0.096
0.096
0.095
0.096
0.095
0.096
0.095
0.096
N
6800
6800
6800
6800
6800
6800
6800
6800
6800
6800
6800
6800
PHU fixed effects
X
X
X
X
X
X
X
X
X
X
X
X
week fixed effects
X
X
X
X
X
X
X
X
X
X
X
X
Notes: Time period – May 15, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by public health unit (PHU) with 5000 repetitions are reported in the square brackets. Columns (1) and (2) repeat columns (1) and (2) from Table 1. We drop each policy at a time in columns (3)-(10). PC denotes provincial total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Table B11
Canada - robustness (policy collinearity).
Outcome: weekly case growth, Yit=Δlog(ΔCit)
drop Mask_14
drop Business /gathering_14
drop School_14
drop Travel_14
drop LTC_14
Mask_14 only
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
Mask_14
-0.173 ***
-0.176 ***
-0.215 **
-0.219 **
-0.215 ***
-0.220 **
-0.202 *
-0.205 *
-0.135
-0.137 *
[0.000]
[0.000]
[0.027]
[0.022]
[0.032]
[0.026]
[0.081]
[0.076]
[0.102]
[0.100]
Business/
-0.472
-0.484
-0.594 *
-0.609 *
-0.558 *
-0.578 *
-0.599 *
-0.614 *
gathering_14
[0.116]
[0.124]
[0.067]
[0.063]
[0.070]
[0.070]
[0.059]
[0.069]
School_14
-0.127
-0.141
-0.186
-0.198
-0.132
-0.151
-0.160
-0.176
[0.346]
[0.278]
[0.180]
[0.149]
[0.232]
[0.168]
[0.241]
[0.177]
Travel_14
0.158
0.113
0.098
0.057
0.176
0.132
0.208
0.163
[0.754]
[0.827]
[0.874]
[0.928]
[0.734]
[0.793]
[0.702]
[0.764]
LTC_14
-0.001
-0.003
-0.137
-0.142
-0.104
-0.109
-0.094
-0.097
[1.000]
[0.994]
[0.508]
[0.502]
[0.638]
[0.622]
[0.674]
[0.670]
Beh. proxy_14
-0.002
-0.001
0.000
0.001
-0.004
-0.004
-0.005
-0.005
-0.004
-0.004
0.002
0.002
[0.889]
[0.911]
[1.000]
[1.000]
[0.782]
[0.804]
[0.735]
[0.769]
[0.786]
[0.810]
[0.944]
[0.934]
Δlog(ΔC)_14
-0.047
-0.049
-0.038
-0.041
-0.048
-0.051
-0.044
-0.048
-0.047
-0.050
-0.038
-0.041
[0.526]
[0.499]
[0.600]
[0.584]
[0.526]
[0.512]
[0.510]
[0.498]
[0.532]
[0.517]
[0.578]
[0.554]
log(ΔC)_14
-0.164 *
-0.166 *
-0.177 **
-0.180 **
-0.169 **
-0.171 **
-0.173 **
-0.175 **
-0.171 **
-0.173 **
-0.179 **
-0.180 **
[0.051]
[0.053]
[0.034]
[0.034]
[0.043]
[0.038]
[0.021]
[0.021]
[0.040]
[0.040]
[0.012]
[0.012]
Δlog(ΔNC)_14
0.216
0.236
0.235
0.221
0.221
0.246
[0.336]
[0.310]
[0.302]
[0.319]
[0.334]
[0.266]
log(ΔNC)_14
0.179 *
0.165 **
0.173 *
0.192 *
0.184 *
0.148 *
[0.064]
[0.024]
[0.062]
[0.051]
[0.051]
[0.076]
Δlog(ΔT)
0.294 ***
0.296 ***
0.298 ***
0.299 ***
0.293 ***
0.295 ***
0.288 ***
0.291 ***
0.292 ***
0.294 ***
0.288 ***
0.290 ***
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
R-squared
0.334
0.335
0.334
0.335
0.336
0.338
0.336
0.338
0.336
0.338
0.333
0.334
N
2650
2650
2650
2650
2650
2650
2650
2650
2650
2650
2650
2650
province FE
X
X
X
X
X
X
X
X
X
X
X
X
week FE
X
X
X
X
X
X
X
X
X
X
X
X
Notes: Time period – March 11, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. We drop each policy one at a time in columns (3)-(12). NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Alternative initial dates.Figs. C4 and C5 show that our estimates and confidence intervals for the effect of mask mandates on case growth in Ontario and Canada do not vary much with the initial date of the respective samples.
Fig. C4
Ontario – different initial dates. Notes: The figure plots the coefficient estimates on Mask_14, with 95% confidence intervals, from Eq. (1) for different initial dates of the sample. The baseline specifications (Table 1) use May 15. The left panel corresponds to column (1) in Table 1; the right panel corresponds to column (2) in Table 1.
Fig. C5
Canada – different initial dates. Notes: The figure plots the coefficient estimates on Mask_14, with 95% confidence intervals, from Eq. (1) for different initial dates of the sample. The baseline specifications (Table 2) use March 11. The left panel corresponds to column (1) in Table 2; the right panel corresponds to column (2) in Table 2.
Alternative lags. We also check alternative time lags, of either shorter or longer duration, centered around the baseline value of 14 days. Fig. C6 for Ontario and Fig. C7 for Canada plot the estimates and 95% confidence intervals. The mask mandate estimates for Canada remain fairly consistent for the different plausible lag values while the Ontario sample estimates are a bit more sensitive to the lag length, with our baseline estimates being in the middle in terms of magnitude.
Fig. C6
Ontario – different lag lengths. Notes: The figure plots the coefficient estimates on Mask_lag, with 95% confidence intervals, from Eq. (1) for different lag values. The baseline specifications (Table 1) use a lag of 14 days. The left panel corresponds to column (1) in Table 1; the right panel corresponds to column (2) in Table 1.
Fig. C7
Canada – different lag lengths. Notes: The figure plots the coefficient estimates on Mask_lag, with 95% confidence intervals, from Eq. (1) for different lag values. The baseline specifications (Table 2) use a lag of 14 days. The left panels correspond to column (1) in Table 2; the right panels correspond to column (2) in Table 2.
Omitted variables. The Google mobility behaviour proxy variable likely misses some aspects of people’s behaviour that could be relevant for COVID-19 transmission. One such factor could be weather. For example, good weather may cause more people to spend time outside and lower the chance of viral transmission. Columns (3) and (4) in Table B12 report estimates for Canada including lagged weather variables (daily maximum and minimum temperatures and precipitation for the largest city in each province36
) as additional controls. The estimates on mask mandates remain statistically significantly negative (p-value ) but are slightly reduced compared to the baseline values in columns (1)–(2). While we find no effect of weather on case growth, we note that any possible effect of seasonal change would be absorbed by the week fixed effects, and any possible effect of day-to-day weather may be obscured by the stochastic lag between transmission and detection.Another possible concern is that the information variables (lagged cases and lagged case growth) may not fully capture the actual information based on which people react or adjust their behaviour, possibly affecting the observed case growth. Columns (5) and (6) in Table B12 add a national-level “News” variable to our baseline specification, defined as the number of daily search results for “coronavirus” or “COVID-19” from the ProQuest Canadian Newsstream news aggregator service (see Appendix D for more details). In column (6), the news variable is statistically significant at the 10% level. Our estimates on mask mandates and business/gathering remain very close to those in the baseline.Heterogeneous treatment effects. We address the possibility of heterogeneous treatment effects in two ways. First, several recent papers point out that the two-way fixed effects estimator (week and PHU/province fixed effects in our case) is a weighted average of treatment effects, where some of the weights can be negative if the treatment effect is not constant across groups and over time.37
In particular, de Chaisemartin and D'Haultfoeuille (2020) develop an estimator that is valid under these conditions. We apply their estimator to our main analysis, regarding case growth in Ontario.38
We obtain a mask mandate estimate of -0.236 (s.e. 0.415), which is very close in magnitude to our two-way fixed effect estimates (-0.244 and -0.248) in Table 1.39Second, we also compute and compare mask the mandate estimates for ‘early’ vs. ‘late’ PHU adopters in Ontario. Specifically, we define as ‘early’ adopters the PHUs that implemented mask mandates before July 15, (nearly half of the PHUs adopted mask mandates by then), and ‘late’ adopters as the PHUs that implemented mandates after July 15. We obtain similar estimates for the early and late adopters (-0.266 and -0.255).40
Jointly, these results suggest that the effects of mask mandates on case growth are unlikely to be heterogeneous across regions and time in a way that affects our estimates, which is also consistent with the estimates’ stability over different dates on Fig. 4.
Counterfactuals
We use our estimates from Tables 1 and 2 to evaluate several counterfactuals in which the actual mask policy is replaced by an alternative hypothetical policy. Letting be the implementation date of a counterfactual policy, we set the counterfactual weekly case count, , equal to for all . For each date , using the definition of in (3), we compute and the counterfactual weekly case growth rate, , as follows:where is the regression-fitted value of weekly case growth; is the coefficient estimate (-0.248 or -0.223) on the mask mandate variable Mask_14 in baseline specification, column (2) in Table 1 or 2, depending on the counterfactual; Mask_14 is the counterfactual policy (e.g., different implementation date, wider geographic coverage or absence of mask mandate); and is the coefficient estimate (-0.168 or -0.172) on lagged cases in Table 1 or 2, column (2). The coefficient adjusts the counterfactual case growth rate for the negative statistically significant association between the weekly case total two weeks prior and time- case growth. This feedback effect may be due to people being more careful when they perceive the risk of infection to be higher.Figs. 8 and 9
show results from two counterfactual policy evaluations. The first counterfactual, depicted in the left panels, assumes that masks are adopted everywhere at the earliest date observed in the data (June 12, 2020). Fig. 8 shows that if mask mandates were implemented in all Ontario PHUs at the earliest observed date, this could have led to an average reduction of 770 cases per week over the simulation period Jun. 26 to Nov. 30, holding all else equal. The estimated reduction is in the range 70 to 500 cases per week early on, in July–August, peaks at about 2200 cases per week in mid-October, and decreases to under 1000 cases per week by the end of November. For Canada as a whole, a country-wide adoption of mask mandates in June is estimated to reduce new weekly COVID-19 cases by 22% on average over the simulation period, which amounts to a total reduction of over 50,000 cases. The estimated average weekly reduction is by about 680 cases for July–August and peaks at 9600 cases per week in November. In both simulations, the feedback effect via (lagged cases as information) starts moderating the decrease in cases two weeks after the initial impact of the counterfactual policy.
Fig. 8
Ontario – counterfactuals. Notes: The left panel assumes that mask mandates were adopted in all PHUs on June 12, 2020 (date of the earliest mask mandate in Ontario). The right panel assumes that mask mandates were not adopted in any PHU. We use the estimates from column (2) of Table 1. The diamonds plot observed weekly cases from to , the dotted lines plot the 7-day moving average of the counterfactual mean value, and the shaded areas are 5–95 percentile confidence bands.
Fig. 9
Canada – counterfactuals. Notes: The left panel assumes that mask mandates were adopted in all provinces on June 12, 2020 (date of the earliest mask mandate in Ontario). The right panel assumes that mask mandates were not adopted in any province. We use the estimates from column (2) of Table 2. The diamonds plot observed weekly cases from to , the dotted lines plot the 7-day moving average of the counterfactual mean value, and the shaded areas are 5–95 percentile confidence bands.
Ontario – counterfactuals. Notes: The left panel assumes that mask mandates were adopted in all PHUs on June 12, 2020 (date of the earliest mask mandate in Ontario). The right panel assumes that mask mandates were not adopted in any PHU. We use the estimates from column (2) of Table 1. The diamonds plot observed weekly cases from to , the dotted lines plot the 7-day moving average of the counterfactual mean value, and the shaded areas are 5–95 percentile confidence bands.Canada – counterfactuals. Notes: The left panel assumes that mask mandates were adopted in all provinces on June 12, 2020 (date of the earliest mask mandate in Ontario). The right panel assumes that mask mandates were not adopted in any province. We use the estimates from column (2) of Table 2. The diamonds plot observed weekly cases from to , the dotted lines plot the 7-day moving average of the counterfactual mean value, and the shaded areas are 5–95 percentile confidence bands.In the right side panels of Figs. 8 and 9, we instead assume that mask mandates were not adopted in any Ontario PHU or in any Canadian province. Our estimates imply that such counterfactual absence of mask mandates, holding all else equal, would have led to a large and growing over time increase in new cases, both in Ontario (estimated 5400 additional weekly cases at the end of September and 33,000 additional cases per week as of Nov. 30) and Canada-wide (estimated 10,700 additional weekly cases at the end of September and over 100,000 additional cases per week as of Nov. 30).In Fig. C10 in the Appendix, we also simulate a counterfactual in which British Columbia (BC) and Alberta, the third and fourth largest Canadian provinces by population, adopt province-wide mask mandates on June 12. The results indicate an average reduction of about 1000 cases per week for BC and 550 cases for Alberta over the simulation period. The estimated effect is smaller for Alberta, despite its larger case totals, since Alberta adopted mask mandates in its main cities on Aug. 1 while BC had no mask mandate until November.
Fig. C10
Counterfactuals – earlier mask mandates in Alberta and British Columbia. Notes: The figure assumes indoor mask mandate implementation on June 12, (date of the earliest mask mandate in Ontario) for the third and fourth largest provinces by population, specifically British Columbia (BC, left panel) and Alberta (AB, right panel). We use the estimates from column (2) of Table 2. The diamonds plot observed weekly cases from to , the dotted lines plot the 7-day moving average of the counterfactual mean value, and the shaded areas are 5–95 percentile confidence bands.
The counterfactual simulations discussed above assume that behaviour, policies and all other variables (except mask policy and 14 case counts) remain fixed at their values observed in the data. This is a strong assumption which may be more plausible over a relatively short period (e.g., focusing on July/August). In addition, all counterfactuals assume that regions without a mask mandate by a given date would react to a mandate in similar way, on average, as the regions that have already imposed a mandate. Therefore, these simulation results should be interpreted with caution and only as a rough illustration of the estimated impact of mask mandates on COVID-19 cases.
Conclusion
We estimate the impact of indoor face mask mandates and other public policy measures on the spread of COVID-19 in Canada. We use both within-province variation from Ontario and cross-province variation in the timing of mandates. We find robust and consistent significantly negative association between mask mandates and subsequent COVID-19 case growth – a 20 to 22% average weekly reduction in new cases. These results are supported by our analysis of survey data, which shows that the mandates led to a significant increase of 27 percentage points in the proportion of people reporting always wearing a mask in public. We show that the impact of mask mandates on COVID-19 case growth persists as long as they are necessary to achieve near universal mask wearing in indoor public spaces.The earlier mask mandates in Canada were introduced in Summer 2020 when other policy measures were relaxed, as part of the economy’s re-opening. We find that reduced restrictions on businesses or gatherings are associated with subsequent COVID-19 case growth – a factor that can offset and obscure the public health benefits of mask mandates. Past case totals were also found to matter for subsequent COVID-19 outcomes, suggesting that riskier behaviour may follow prior information perceived as favourable. This feedback mechanism may limit how low the number of new cases can be pushed by mask mandates or other restrictions short of a lockdown. On the other hand, we find no evidence that mask mandates reduce adherence to other precautions against COVID-19. Indeed, they could potentially serve as an important behavioural anchor, especially in periods of plateauing or declining transmission.Importantly, the effect of mask mandates that we estimate is relative to the absence of mandates and not absolute. In unfavourable conditions, such as during seasons when people gather indoors (fall, winter and early spring in most of Canada) and before widespread vaccination, a mask mandate appears insufficient to prevent an increase in new infections on its own and should be considered in conjunction with other policy measures.We conclude that mandating mask wearing in indoor public spaces is a powerful policy tool to limit COVID-19 transmission, especially given its relatively low cost to the economy. As long as it remains doubtful that a sufficient fraction of the population has been immunized to achieve herd immunity – a concern particularly relevant in the face of more contagious COVID-19 variants and before vaccines are administered to children – it appears prudent to keep mask mandates in place even while lifting other restrictions.We have deliberately refrained from studying direct economic impacts of COVID-19, focusing instead on unique features of the Canadian data for identifying the effect of mask mandates and other NPIs on COVID-19 case growth. Future research, jointly considering the epidemiological impact and the economic benefits and costs of the various public policies and restrictions, would enrich the ongoing debate and provide further guidance.
Table B7
Ontario – robustness (standard errors).
Outcome: weekly case growth, Yit=Δlog(ΔCit)
(1)
(2)
Mask_14
-0.244
-0.248
(0.017)
**
(0.016)
**
[0.012]
**
[0.011]
**
{0.023}
**
{0.020}
**
Business/gathering_14
0.042
0.120
(0.921)
(0.777)
[0.937]
[0.789]
{0.945}
{0.814}
School_14
-0.545
-0.499
(0.054)
*
(0.187)
[0.051]
*
[0.168]
{0.084}
*
{0.203}
Long-term care_14
-0.468
-1.067
(0.710)
(0.405)
[0.696]
[0.410]
{0.690}
{0.422}
Behaviour proxy_14
-0.005
-0.004
(0.288)
(0.335)
[0.280]
[0.335]
{0.301}
{0.327}
R-squared
0.096
0.096
N
6800
6800
Δlog(ΔC)_14
X
X
log(ΔC)_14
X
X
Δlog(ΔPC)_14
X
log(ΔPC)_14
X
Δlog(ΔT)
X
X
PHU fixed effects
X
X
week fixed effects
X
X
Notes: Time period – May 15, to November 30. P-values from standard clustering by PHU (Stata command ‘cluster’) in the () parentheses, wild bootstrap with one-way clustering by PHU and 5000 repetitions in the [ ] square brackets, and wild bootstrap with two-way clustering by PHU and day with 5000 repetitions in the { } curly braces. PC denotes provincial total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Table B13
Self-reported mask usage – alternative time controls.
Outcome: wear mask “Always”
Outcome: wear mask “Always” or “Frequently”
no time trend
cubic trend in days
no time trend
cubic trend in days
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Mask
0.496 ***
0.513 ***
0.278 ***
0.276 ***
0.437 ***
0.475 ***
0.185 ***
0.185 ***
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
Δlog(ΔC)
-0.027
-0.008
-0.015
-0.007
-0.042
-0.019
-0.022 *
-0.018
[0.250]
[0.577]
[0.335]
[0.634]
[0.210]
[0.149]
[0.068]
[0.156]
log(ΔC)
0.029
0.038
0.008
0.004
0.021
0.057 *
0.018 ***
0.017 ***
[0.125]
[0.138]
[0.247]
[0.584]
[0.402]
[0.067]
[0.000]
[0.000]
Δlog(ΔNC)
-0.100
-0.051
-0.153 **
-0.034
[0.173]
[0.282]
[0.020]
[0.163]
log(ΔNC)
-0.009
0.017
-0.052 ***
0.000
[0.723]
[0.428]
[0.000]
[0.978]
R-squared
0.251
0.253
0.272
0.273
0.206
0.215
0.252
0.252
N
15,808
15,808
15,808
15,808
15,808
15,808
15,808
15,808
individual characteristics
X
X
X
X
X
X
X
X
province fixed effects
X
X
X
X
X
X
X
X
mean w/o mask mandate
0.332
0.332
0.332
0.332
0.507
0.507
0.507
0.507
Notes: Time period – April 2, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. The data source is YouGov. The outcome is a dummy that takes value 1 if the respondent answered “Always”, or “Always” or “Frequently”, to the survey question “Thinking about the last 7 days, how often have you worn a face mask outside your home?” Sample weights are used. Individual characteristics include a gender dummy and dummies for each age (in years), each household size, each number of children and each employment status. NC denotes national total cases. ***, ** and * denote 10%, 5% and 1% significance level respectively.
Table B17
Canada – deaths growth rate.
Outcome: weekly deaths growth, Yit=Δlog(ΔDit)
Baseline
Alternative 1
Alternative 2
Alternative 3
replace log(0) by -1
replace log(0) by 0
add 1 before taking log
weighted by population
p-values in [ ]
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Mask_28
-0.142
-0.139
-0.158
-0.156
-0.112
-0.110
-0.389 **
-0.390 **
[0.195]
[0.195]
[0.172]
[0.176]
[0.239]
[0.245]
[0.012]
[0.015]
Business/gathering_28
0.109
0.137
-0.169
-0.151
-0.008
0.014
-0.572 *
-0.569 *
[0.784]
[0.740]
[0.467]
[0.534]
[0.926]
[0.974]
[0.064]
[0.087]
School_28
0.131
0.126
0.190
0.180
0.104
0.101
0.085
0.066
[0.597]
[0.620]
[0.270]
[0.327]
[0.533]
[0.542]
[0.560]
[0.612]
Travel_28
0.525
0.578
0.607
0.641
0.514
0.556
0.917 **
0.969 ***
[0.339]
[0.340]
[0.225]
[0.246]
[0.278]
[0.282]
[0.024]
[0.006]
Long-term care_28
0.244
0.247
0.206
0.209
0.231
0.233
0.217
0.229
[0.164]
[0.156]
[0.170]
[0.164]
[0.110]
[0.105]
[0.302]
[0.252]
Behaviour proxy_28
0.002
0.002
0.000
0.000
0.001
0.001
0.009
0.009
[0.675]
[0.738]
[0.911]
[0.933]
[0.776]
[0.847]
[0.290]
[0.207]
Δlog(ΔD)_28
0.108
0.111
0.086
0.089
0.092
0.094
0.086
0.091
[0.368]
[0.352]
[0.334]
[0.335]
[0.276]
[0.260]
[0.234]
[0.234]
log(ΔD)_28
-0.172 ***
-0.169 ***
-0.164 ***
-0.162 ***
-0.151 ***
-0.149 ***
-0.168 ***
-0.166 ***
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
[0.000]
Δlog(ΔND)_28
-0.072
-0.089
-0.042
-0.146 *
[0.435]
[0.464]
[0.556]
[0.052]
log(ΔND)_28
-0.147
-0.099
-0.115
-0.047
[0.170]
[0.293]
[0.170]
[0.510]
Δlog(ΔT)
0.021
0.018
-0.020
-0.024
0.029
0.027
0.236 **
0.223
[0.826]
[0.845]
[0.858]
[0.833]
[0.712]
[0.728]
[0.027]
[0.130]
R-squared
0.218
0.220
0.279
0.282
0.270
0.272
0.454
0.456
N
2560
2560
2560
2560
2560
2560
2560
2560
province fixed effects
X
X
X
X
X
X
X
X
week fixed effects
X
X
X
X
X
X
X
X
Notes: Time period – March 11, to November 30, 2020. P-values from wild bootstrap (cgmwildboot) standard errors clustered by province with 5000 repetitions are reported in the square brackets. Log(0) was replaced by -1 in columns (7) and (8). ND denotes national total deaths. ***, ** and * denote 10%, 5% and 1% significance level respectively. Variable_28 denotes the Variable lagged by 28 days. 322 out of the 2560 observations (12.6%) had log(0) replaced.
Table D4
Canada COVID-19 official data sources.
Province
Cases
Deaths
Tests
Alberta (AB)
link
link
link
British Columbia (BC)
link
link
link
Ontario (ON)
link
link
link
Quebec (QC)
link
link
link
Saskatchewan (SK)
link1
link
link
Nova Scotia (NS)
link
link
link
Manitoba (MB)
link
link
link2
Newfoundland and Labrador (NL)
link1
link
link
New Brunswick (NB)
link
link
link
Prince Edward Island (PE)
link
link
link
Notes: 1. Saskatchewan and Newfoundland and Labrador do not revise their posted data series. We made manual data adjustments based on subsequent revisions announced in government bulletins. 2. The Manitoba testing numbers were manually collected from the provincial government's COVID-19 bulletins.
Table D5
YouGov Survey Questions.
Survey item
Question
i12_health_2
Washed hands with soap and water
i12_health_3
Used hand sanitizer
i12_health_6
Avoided going out in general
i12_health_12
Avoided small social gatherings (not more than 2 people)
i12_health_13
Avoided medium-sized social gatherings (between 3 and 10 people)
i12_health_14
Avoided large-sized social gatherings (more than 10 people)
i12_health_15
Avoided crowded areas
i12_health_20
Avoided touching objects in public (e.g., elevator buttons or doors)
Notes: The data source is YouGov. Possible responses to each survey item are “Always”, “Frequently”, “Sometimes”, “Rarely”, and “Not at all”. For Table B14, we create a binary variable taking value 1 if the response is “Always” and 0 otherwise. For Table B15, we create a binary variable taking value of 1 if the respondent answered either “Always” or “Frequently” and 0 otherwise.
Authors: Jan M Stratil; Renke L Biallas; Jacob Burns; Laura Arnold; Karin Geffert; Angela M Kunzler; Ina Monsef; Julia Stadelmaier; Katharina Wabnitz; Tim Litwin; Clemens Kreutz; Anna Helen Boger; Saskia Lindner; Ben Verboom; Stephan Voss; Ani Movsisyan Journal: Cochrane Database Syst Rev Date: 2021-09-15
Authors: Rowland Pettit; Bo Peng; Patrick Yu; Peter G Matos; Alexander L Greninger; Julie McCashin; Christopher Ian Amos Journal: medRxiv Date: 2021-09-21
Authors: Florian Dorn; Sahamoddin Khailaie; Marc Stoeckli; Sebastian C Binder; Tanmay Mitra; Berit Lange; Stefan Lautenbacher; Andreas Peichl; Patrizio Vanella; Timo Wollmershäuser; Clemens Fuest; Michael Meyer-Hermann Journal: Eur J Health Econ Date: 2022-03-19
Authors: Mark A Tully; Laura McMaw; Deepti Adlakha; Neale Blair; Jonny McAneney; Helen McAneney; Christina Carmichael; Conor Cunningham; Nicola C Armstrong; Lee Smith Journal: PLoS One Date: 2021-12-08 Impact factor: 3.240