Literature DB >> 35759352

When and how do business shutdowns work? Evidence from Italy's first COVID-19 wave.

Gabriele Ciminelli1, Sílvia Garcia-Mandicó2.   

Abstract

Governments around the world have adopted unprecedented policies to deal with COVID-19. This paper zooms in on business shutdowns and investigates their effectiveness in reducing mortality. We leverage highly granular death registry data for almost 5000 Italian municipalities in a diff-in-diff approach that allows us to mitigate endogeneity concerns credibly. Our results, which are robust to controlling for a host of co-factors, offer strong evidence that business shutdowns effectively curb mortality. We calculate that they may have reduced the death toll from the first wave of COVID-19 in Italy by about 40%. Our findings also highlight that timeliness is key - by acting 1 week earlier, their effectiveness could have been increased by an additional 5%. Finally, shutdowns should be targeted. Closing service activities with a high degree of interpersonal contact saves the most lives. Shutting down production activities, while substantially reducing mobility, only has mild effects on mortality.
© 2022 OECD. Health Economics © 2022 John Wiley & Sons Ltd.

Entities:  

Keywords:  COVID-19; Italy; business shutdowns; mortality

Mesh:

Year:  2022        PMID: 35759352      PMCID: PMC9349832          DOI: 10.1002/hec.4502

Source DB:  PubMed          Journal:  Health Econ        ISSN: 1057-9230            Impact factor:   2.395


INTRODUCTION

The sudden appearance of COVID‐19 in early 2020 has forced governments worldwide to implement hastily arranged policies to limit the death toll from the virus, including travel restrictions, lockdowns, and business shutdowns. These measures aim to save lives by reducing the rate of new infections – “flattening the curve” – thus preventing the congestion of the health care system and ensuring that there is enough capacity to admit everyone in need (Ferguson, et al., 2020). In this paper, we investigate the effectiveness of business shutdowns, focusing on three issues in particular. First, we quantify their overall effects in reducing mortality. Second, we focus on the importance of timing – that is, when in the epidemic curve they are most effective (the when). Third, we explore how the effectiveness of business shutdowns varies depending on which particular sector of the economy is closed down (the how). To carry out the analysis, we focus on the first wave of COVID‐19 in Italy, for long one of the world's worst affected areas. Focusing on Italy has two main advantages. The first is that the Italian government implemented a stringent business shutdown policy, affecting nearly every aspect of economic activity. This allows us to investigate the effectiveness of shutdowns in the service sector as well as in production activities. The second key advantage is the availability of highly granular daily death registry data, as well as data on socio‐demographic, labor market and territorial characteristics, for thousands of municipalities. We use these data in a diff‐in‐diff approach, exploiting a peculiarity in the implementation of the business shutdowns policy that allows us to mitigate endogeneity concerns credibly. Rather than targeting specific firms in communities with high infection rates, the government ordered the closure – throughout the country and at the same time – of all firms not operating in essential sectors. By calculating the employment share in non‐essential sectors, we isolate variation in how different communities were affected by the shutdowns. Because the government's list of essential sectors was valid at the national level, such variation is exogenous to the policy itself. Our first set of results offers strong evidence that business shutdowns can effectively curb COVID‐19 mortality and, more generally, the spread of infectious diseases. We estimate that a 10% point higher share of employment in shutdown sectors is associated with about 0.4 fewer excess deaths per day per 100,000 inhabitants. To put this number in context, we perform a back‐of‐the‐envelope calculation on the number of lives saved through business shutdowns. We estimate that business shutdowns may have reduced the death toll of the first wave of the COVID‐19 epidemic in Italy by about 40%. Our second set of results highlights the importance of timeliness. Exploiting the fact that communities were at different stages in the epidemic curve when business shutdowns were implemented – some had a high number of infections, while others had just a few – we estimate that “early” implementation increases the effectiveness of shutdowns. According to these results, up to an additional 5% of fatalities could have been prevented in just the first 2 weeks of policy implementation if shutdowns had been ordered 1 week earlier. Our third finding is that closing down the hospitality and food service sector has the largest effects in reducing mortality. Instead, shutting down manufacturing and other production activities, while substantially reducing mobility, has only limited effects on mortality rates. These results, which are consistent with the notion that a higher degree of interpersonal contact at the workplace can facilitate the spread of infectious diseases (Lewandowski, 2020; Markowitz et al., 2019), are related to those of Magnusson et al. (2020) and Aron and Muellbauer (2020). The former match COVID‐19 infection with occupational and demographic data for the full sample of the Norwegian working‐age population to find that nurses, physicians, dentists, physiotherapists, bus/tram/taxi drivers, bartenders, waiters, food service attendants and stewards – who typically have close contact with other people – had 1.5–4 times the odds of catching COVID‐19 when compared to everyone in their working age group. Instead, Aron and Muellbauer (2020) summarize excess deaths by occupation in England, highlighting that most of COVID‐19 deaths were among people employed in the consumer‐facing service sector. Our findings and those of the studies reviewed above speak to a quickly growing literature assessing the effectiveness of non‐pharmaceutical interventions (NPIs) on COVID‐19 infections and mortality. We describe this literature in detail in the following section. The rest of the paper is organized as follows: Section 2 describes the dataset and presents the empirical methodology. Section 3 presents the results, while Section 4 concludes.

Literature review: The effectiveness of NPI

Early literature on the effectiveness of NPIs has borrowed from epidemiological models (such as SIR and SEIR) to solve the trade‐off between minimizing the burden on the economy while reducing the number of fatalities (Atkeson, 2020; Barlow et al., 2021; Chinazzi, et al., 2020; Eichenbaum et al., 2020; Jones et al., 2020; Pedersen & Meneghini, 2020). SIR and SEIR models typically assume an equal number of contacts for each individual (Khain, 2020). Our results suggest that this assumption may be problematic when determining optimal business shutdown policies, and thus highlight the advantage of using alternative methods, such as cross‐country regressions, synthetic controls methods, or quasi‐experimental approaches. Cross‐country variation in the type and timing of NPIs adopted across countries has allowed some studies to identify effective characteristics in reducing contagion (Alfano & Ercolano, 2021; Brauner et al., 2021; Égert et al., 2020). In line with our results, Brauner et al. (2021) find that business shutdowns, and particularly those of businesses with high infection risk, such as bars, restaurants, and nightclubs, have been effective at reducing COVID‐19 transmission. Cross‐country regressions have some inherent caveats: they need to be cautiously interpreted within the context of implementation, such as the presence of other NPIs, country demographics, and specific implementation details. Most researchers have quantified the effectiveness of NPIs on slowing the spread of infectious diseases, and ultimately on mortality, by performing single country analyses. Some literature, like our paper, exploits within‐country variation in the implementation of NPIs through differences‐in‐differences approaches or event studies (Alfano et al., 2021; Becchetti et al., 2020; Borri et al., 2021; Courtemanche et al., 2020; Fang et al., 2020; Schuppert et al., 2021). Other studies use synthetic control approaches to evaluate the effectiveness of NPIs in a single country (Bayham & Fenichel, 2020; Born et al., 2021; Cho, 2020; Juranek & Zoutman, 2020). Both approaches lead to studies that coincide on the effectiveness of school closures and restrictions of the movement of people in limiting the spread of COVID‐19. Among the studies just mentioned, only Courtemanche et al. (2020) assess the effectiveness of business shutdowns. The authors estimate the impact of government‐imposed closures of some non‐essential businesses on the spread of COVID‐19 in the US. Their focus is on restaurants, bars, and entertainment‐related businesses. Our focus is on the effects of generalized businesses shutdowns, a relatively strict and isolated approach taken by the Italian government to curb COVID‐19 infections. The case of Italy is also studied by Bongaerts et al. (2020). Their paper aligns with our first set of findings, as they conclude that business shutdowns effectively reduce mortality. They do not explore sectoral heterogeneity, however, a key point of this paper. They also consider a much shorter timeframe than ours and conduct the analysis at the municipality‐rather than at the local‐labor‐market level. As we show, this may be problematic since many people in Italy work in a different municipality from the one in which they reside, which complicates the measurement of how many people were affected by the shutdowns at that level of disaggregation.

METHODS

The sample spans from 1st January to May 15, 2020, thus covering the entire period of the first wave of the COVID‐19 epidemic in Italy (see also Alicandro et al., 2020). Since this mostly affected the northern part of the country, while leaving the central and southern parts largely unscathed, the focus is on 10 most northern regions (Emilia‐Romagna, Friuli‐Venezia Giulia, Liguria, Lombardy, Marche, Piedmont, Tuscany, Trentino‐Alto Adige, Valle d'Aosta, and Veneto). Together these make up almost 60% of Italy's population and 95% of its fatalities during the first wave of COVID‐19. Appendix Table A1 provides descriptive statistics on the sample coverage, while the rest of this section continues by describing how we (i) construct a business shutdown variable, (ii) measure COVID‐19 mortality, (iii) complement the dataset with co‐factors of COVID‐19 mortality, and (iv) carry out the empirical analysis.
TABLE A1

Data coverage

Region# municipalities# local labor marketsPopulation (in 1000)
Emilia‐Romagna340394615.82
Friuli Venezia Giulia213111310.69
Liguria244141649.38
Lombardy15065110,665.40
Marche229251611.51
Piedmont1180364715.71
Tuscany285261180.36
Trentino‐Alto Adige270483803.21
Valle d'Aosta745147.93
Veneto554435051.35
Total489529834,751.36

Note: the columns “# municipalities” and “# local labor markets” report the number of municipalities and local labor markets covered in the analysis. The columns “population (in 1000)” report the population covered (in thousands).

Business shutdowns

Figure 1 provides a chronology of the unprecedented measures taken by the Italian government to fight the first wave of the COVID‐19 epidemic in 2020. Our focus is on business shutdowns, implemented on 11th and 22nd March. Did they contribute to reducing mortality? If so, by how much?
FIGURE 1

Measures adopted by the Italian government to fight the COVID‐19 epidemic in early 2020. 13 days after the first community case was identified, the government ordered all educational institutions to close down and switch to online learning (5th March). Less than a week later, it introduced a nationwide lockdown and ordered the closure of all non‐essential commercial activities, such as shops, bars and restaurants (11th March). Eleven days later, it compounded those measures by shutting down all non‐essential production activities (22nd March). Restaurants could offer delivery, while non‐essential production activities could operate if they were supplying goods to firms in essential sectors. As the situation gradually improved, the government lifted the lockdown and allowed most businesses to reopen after almost 2 months of restrictions (fourth May)

Measures adopted by the Italian government to fight the COVID‐19 epidemic in early 2020. 13 days after the first community case was identified, the government ordered all educational institutions to close down and switch to online learning (5th March). Less than a week later, it introduced a nationwide lockdown and ordered the closure of all non‐essential commercial activities, such as shops, bars and restaurants (11th March). Eleven days later, it compounded those measures by shutting down all non‐essential production activities (22nd March). Restaurants could offer delivery, while non‐essential production activities could operate if they were supplying goods to firms in essential sectors. As the situation gradually improved, the government lifted the lockdown and allowed most businesses to reopen after almost 2 months of restrictions (fourth May) To answer these questions, we exploit variation across communities in the employment share of firms forced to shut down, which, crucially, is exogenous to the government policies. Exogeneity follows from the fact that, rather than targeting specific firms in specific communities, the government uniformly ordered the closure of all firms in certain specific sectors throughout the country. To do so, it issued a list of essential sectors valid countrywide: firms operating in those sectors could stay open, while all the others had to close down. Our prior is that business shutdowns were more binding in labor markets with a higher employment share in non‐essential sectors (those in which firms had to shut down). We therefore construct a variable measuring the employment share in firms affected by the shutdowns by matching the government's list of essential sectors to data on the number of workers in each non‐farm private sector. To do so, we source municipality‐level data on the number of workers (both employees and self‐employed) in each 3‐digit sector from ISTAT (2017). Following common practice in spatial and urban economics studies (Acemoglu & Restrepo, 2020; Allcott & Keniston, 2018; Autor et al., 2013; Moretti, 2010), we pool municipalities into local labor markets. Local labor markets are areas whose borders are defined to minimize external commuting (commuting outside borders). Since in Italy many people work or study in a different municipality than the one in which they reside, carrying out the analysis at the local‐labor‐market‐level limits possible mismatches between the extent to which individuals are affected by the government policies and the municipality where COVID‐19 deaths are recorded. Overall, we follow 298 local labor markets, each with about 115,000 inhabitants on average. Next, for each sector, we calculate the number of workers affected by the government policies and construct our business shutdowns variable, BS , according to the following formula: where () measures the number of workers in commercial (production) firms affected by the shutdown of non‐essential activities in local labor market i; E is total employment; and C (P ) is a commercial (production) activities shutdown policy dummy that takes value equal to 1 from 15 days after the introduction of the policy to 15 days after its expiration, where the 15‐day lag is to account for the well‐known lag between COVID‐19 infection and death (Lauer, et al., 2020; Linton, et al., 2020; SARS‐CoV‐2 Surveillance Group, 2020). Our business shutdowns variable accounts for the fact that commercial and production activities were affected at different times and thus it is time‐varying. When both non‐essential commercial and production activities were shut, about 50% of all non‐farm private sector workers were forced to stay home, on average. Importantly, there is large variation across local labor markets, with the standard deviation of the employment share in shutdown firms being about 10%. Appendix Table A2 further divides the economy into 19 broad sectors according to the NACE Rev 2 classification and lists the share of suspended employment in each.
TABLE A2

Descriptive statistics on business shutdowns by sector

NACEEmploymentAffectedShare affectedDigital
Code Share YES/NO Mean s.d. Min Max Labor
Mining & QuarryingB0.13YES99.870.8989.20100.001
ManufacturingC27.88YES59.5117.332.1097.043,5
Electricity and GasD0.53NO//0.000.004
Water supply & waste managementE0.91NO//0.000.00/
ConstructionF9.36YES64.187.8539.9284.702
Sales of motorveichles452.13YES19.4110.470.0046.69/
Wholesale trade465.48YES64.9810.2026.7193.304
Retail trade4711.00YES40.823.9227.4053.741
Transportation & storageH4.69NO//0.000.002
HospitalityI11.68YES94.704.2582.03100.001
Information & communicationJ1.48NO//0.000.006
Financial & insurance activitiesK0.84NO//0.000.005
Real estate activitiesL2.12YES100.000.00100.00100.002
Professional activitiesM5.62YES2.571.690.009.185
Administrative & support activitiesN4.56YES19.7813.142.3566.855
EducationP0.51NO//0.000.003
HealthQ4.15NO//0.000.002
Entertainment & recreationR0.95YES100.000.00100.00100.001
Other service activitiesS2.68YES81.851.0278.2783.463

Note: This table divides non‐farm private employment in 20 broad sectors. The first and second columns report the name and code, according to the NACE Rev 2 classification, of each sector. The third column states whether a sector is affected by the shutdowns or not. The fourth, fifth, sixth and seventh columns report the mean, standard deviation, minimum and maximum of the employment share in shutdown firms. The eight column reports the score from the digital labor index of Manyika et al. (Digital America: A tale of the haves and have‐mores, 2015). Among the manufacturing sector, 20, 21, 254, 26, 27, 28, 29, 30 and 325 industries (high‐tech manufacturing) receive a score of 5, while all others (low‐tech) receive a score of 3.

Measurement of COVID‐19 mortality

Although other outcome variables, such as the incidence of COVID‐19 infections and hospitalisations, are also important, our aim is to investigate the effectiveness of business shutdowns in reducing mortality, which was the ultimate objective of the policy. To measure COVID‐19 mortality, we rely on the concept of excess deaths – that is, the difference between deaths for all causes during the COVID‐19 epidemic and deaths that would be expected under normal circumstances (see, among others, Aron & Muellbauer, 2020 and Ciminelli & Garcia‐Mandicó, 2020a). We start by sourcing death registry data from ISTAT (2020). The data provide municipality‐level information on daily deaths for the 1st January‐15th May period, from 2015 to 2020 and cover 4895 municipalities, accounting for the whole population in the 10 regions that we consider. Appendix Figure A1 plots total daily deaths for the full sample of municipalities. Next, we construct a daily mortality series (deaths per 100,000 inhabitants) at the local‐labor‐market‐level using census population data from ISTAT. We then calculate excess mortality by subtracting 2016 daily deaths per 100,000 inhabitants from those in 2020. The choice of 2016 as counterfactual stems from a visual inspection of the raw death data (Appendix Figure A1) and the daily mortality series (Appendix Figure A2). We confirm this choice when using the synthetic control group method of Abadie et al. (2020) and Abadie et al. (2010), which assigns unit weight to the year 2016.
FIGURE A1

Fatalities in 2020 compared to the five previous years. The figure compares daily fatalities in 2020 (solid red line) to daily fatalities in each of the five preceding years in the 10 regions considered. The blue dashed line denotes deaths in 2016, which we use as counterfactual to estimate the effects of COVID‐19 on mortality (see Sections 2.2 and 2.4). The vertical maroon line denotes the day on which the first COVID‐19 community case was detected, on 21st February)

FIGURE A2

Daily mortality trends. This figure plots mortality trends in 2020 and 2016. Taking differences between these two trends gives us a measure of excess deaths from COVID‐19. The validity of our measure relies on the parallel trends assumption in mortality in 2020 and 2016 before the first locally transmitted COVID‐19 case, which is confirmed in this figure. The choice of using mortality in 2016 as counterfactual is also confirmed when using the synthetic control group method of Abadie et al (2020) and Abadie et al. (2010), which assigns unit weight to the year 2016

Additional data

The dataset is complemented with other variables capturing slow‐moving labor market, territorial and socio‐demographic characteristics that we use to control for potential co‐factors of COVID‐19 mortality. We also construct a digital labor index measuring how much work can be done remotely in firms not affected by shutdowns. Moreover, since the government also ordered the closure of all educational institutions, we collect data on the number of residents enrolled at university. For variables updated at a regular frequency, we compute their means over the 2015–2019 period and treat them as time‐invariant factors. For those not updated at a regular frequency, we use the most recent data available. Appendix Table A3 provides the complete list of covariates and more details on when they are measured.
TABLE A3

Variables sources and descriptive statistics

VariableMeanStd. Dev.MinMaxPeriodSource
Mortality rate3.870.861.767.772015–2020Own calculations from ISTAT, dataset con i decessi giornalieri
Business shutdowns50.699.0024.7178.722017Own calculations from ISTAT, Atlante Statistico dei Comuni
Share working age females49.700.8146.3951.482015–2019Own calculations from ISTAT, Indicatori Demografici
Share high school graduates58.125.9933.3471.262015Own calculations from ISTAT, Condizioni socio‐Economico
Population density2323.59790.26798.615788.942017Own calculations from ISTAT, a Misura di Comune
Days PM10 above limit37.2426.810.1690.002015–2016Own calculations from ISTAT, Dati Ambientali nelle Citta
Digital labor in active firms0.470.060.240.682017Own calculations from ISTAT, Atlante Statistico dei Comuni
University closure27.946.832.1951.152017Own calculations from ISTAT, a Misura di Comune
Internal commuting index33.8313.630.2466.112011ISTAT, Sistemi Locali del Lavoro, 2011
Share of 80+7.831.504.5712.652015–2019Own calculations from ISTAT, Indicatori Demografici
Mean income14,100.951612.837630.7818,745.392015–2017Own calculations from ISTAT, a Misura di Comune
Transits mobility−55.725.05−71.63−43.532020Own calculations from Google mobility reports
Retail & recreation mobility−59.852.18−66.18−54.702020Own calculations from Google mobility reports
Workplace mobility−43.382.51−52.57−38.862020Own calculations from Google mobility reports
Residential mobility20.771.2418.2124.572020Own calculations from Google mobility reports

Note: Except if otherwise specified, all the variables that we collect are at the municipality‐level. We compute their local labor market equivalent using the categorization by ISTAT. Mortality rate measures daily deaths per 100,000 inhabitants. Business shutdowns measure the employment share in shutdown firms (in %), population density measures population over inhabited land. Days PM10 above limit measures the number of days in a year in which PM10 averages above 50 mg/mq3. Digital labor in active firms measure the weighted sum of employment across industries using digital labor scores as a share of total employment. University closures measures the share of people enrolled at university over the 18–25 population. Internal commuting index measures the flows across different municipalities in the same local labor market over total flows. Share 80+ measures the share of people aged 80 and above over the total population (in %). Transits, retail & recreation, workplace and residential mobility measure the percent change in visits to each of these locations relative to the baseline 3rd January‐6th February 2020 period.

Finally, to run an extension estimating the effect of business shutdowns on mobility, we source Google mobility report data. These data measure daily percent changes in mobility in different areas (workplaces, transit places, retail and recreation, as well as residential places) from February 15, 2020 onwards relative to a baseline 3rd January‐6th February 2020 period, for each Italian province. We construct local‐labor‐market‐level variables using the share of people living in different provinces within each local labor market as weights.

Empirical specification

Using excess deaths, and the previously defined business shutdowns variable, we estimate the effects of business shutdowns on COVID‐19 mortality in a diff‐in‐diff approach in the spirit of Rajan and Zingales (1998), exploiting differences across local labor markets in the exposure to the business shutdown policy. Differently from diff‐in‐diff approaches where one group receives the full treatment (treated group) and another one does not (control group), which are usually estimated through a dummy variable, our specification hinges on differences in treatment intensity across different local labor markets and is estimated through a continuous variable (the employment share in shutdown businesses). We verify the validity of the parallel trend assumption by comparing developments in excess mortality in the average local labor markets in the lower and upper half of the treatment intensity variable (Appendix Figure A3): excess mortality was following similar trends in local labor markets with a low and a high employment share in business affected by the shutdown before, and up to 15 days after, the policy implementation.
FIGURE A3

Trends in excess mortality in local labor markets with a low and high employment share in shutdown businesses. This figure plots excess mortality trends in local labor markets with a low and a high employment share in businesses affected by the shutdown policy, defined as those in the lower and upper half of the business shutdown variable distribution (calculated as SiCEi + SiPEi, where SiC and SiP measure the number of workers in commercial and production firms affected by the business shutdown policy in local labor market i and Ei is total employment). The x‐axis reports the days after the discovery of the first locally transmitted COVID‐19 case. The blue vertical line reports the implementation date of the first business shutdown policy. The validity of our diff‐in‐diff approach relies on the parallel trends assumption of excess mortality before, and up to 15 days after, the implementation of the shutdown policy, which is confirmed in this figure

Next, we proceed by estimating the following equation: where y measures excess daily deaths per 100,000 inhabitants in local labor market i, at time t; BS is the treatment intensity variable, measuring the employment share in shutdown activities (defined in Equation (1)); T is a COVID‐19 dummy, taking value equal to 1 in the period after the detection of the first community case (21st February) and 0 in the period before; the X s are (time‐invariant) local labor market characteristics included as controls; μ are local labor markets fixed effects; τ are time fixed effects; and ε is an idiosyncratic error, clustered at the local labor market level. The λ coefficient measures the effect of having a higher employment share in shutdown firms on the excess mortality rate. We estimate Equation (2) through OLS with analytical population weights and standard errors clustered at the local labor market level.

RESULTS

Overall effectiveness of business shutdowns in reducing mortality

Table 1 reports the results on the effect of business shutdowns in reducing COVID‐19 mortality. Column 1 shows estimates from a parsimonious model without control variables. Columns 2–6 show estimates from extended specifications in which we gradually add other demographic, labor market and territorial characteristics as additional controls. The reported coefficients measure the changes in daily deaths per 100,000 inhabitants associated with a standard deviation increase in the variable considered, which is about 10% points for business shutdowns.
TABLE 1

The effects of business shutdowns on COVID‐19 mortality

 (1)(2)(3)(4)(5)(6)
Business shutdowns−0.29***−0.40***−0.43***−0.37***−0.35***−0.37***
(0.08)(0.09)(0.12)(0.11)(0.11)(0.11)
Share working age females−0.82***−0.74***−0.79***−0.72***−0.73***
(0.17)(0.17)(0.16)(0.16)(0.15)
Share high school graduates−0.12−0.31*−0.29−0.23
(0.16)(0.18)(0.18)(0.18)
Population density0.30***0.25***0.32***
(0.08)(0.09)(0.09)
Days PM10 above limit0.23***0.35***
(0.08)(0.09)
Digital labor in active firms−0.39***
(0.13)
Observations40,39240,39240,39240,39240,39240,392
Between R‐squared0.010.030.040.070.100.11

Note: The first row reports the effects of having a one‐standard‐deviation higher employment share in non‐essential activities (about 10% for business shutdowns). This is measured by the λ coefficient from Equation (2). Rows two to six reports the coefficients associated to the control variables, normalized to measure the effect of a one standard deviation increase in the variable. The dependent variable is daily excess deaths per 100,000 inhabitants. All specifications include local labor market fixed effects and are estimated using least squares with analytical population weights. Standard errors are clustered at the local labor market level.

Significance levels: *p < 0.1, **p < 0.05, ***p < 0.01.

The effects of business shutdowns on COVID‐19 mortality Note: The first row reports the effects of having a one‐standard‐deviation higher employment share in non‐essential activities (about 10% for business shutdowns). This is measured by the λ coefficient from Equation (2). Rows two to six reports the coefficients associated to the control variables, normalized to measure the effect of a one standard deviation increase in the variable. The dependent variable is daily excess deaths per 100,000 inhabitants. All specifications include local labor market fixed effects and are estimated using least squares with analytical population weights. Standard errors are clustered at the local labor market level. Significance levels: *p < 0.1, **p < 0.05, ***p < 0.01. We estimate a negative and highly statistically significant coefficient for our business shutdowns variable across all specifications. A 10% points higher employment share in shutdown firms is associated with about 0.3–0.4 fewer excess deaths per day per 100,000 inhabitants, depending on the specification considered. The coefficient is −0.4 in the most comprehensive specification, including all controls, which we use as the baseline in the rest of the analysis (Column 6). Compared with an average daily excess death toll of about 1.5 deaths per 100,000 inhabitants, these results indicate that business shutdowns have meaningful effects in reducing mortality. Turning to the control variables, they all enter with the expected sign and, except in one case, they are also highly statistically significant. A deeper discussion on the control variables is provided in Appendix B, alongside a battery of robustness of checks and alternative specifications. In short, we verify the robustness of our results to (i) relying on different methodologies for the construction of the business shutdown variable, (ii) the inclusion of other variables that could affect the extent of COVID‐19 infections and deaths, (iii) the usage of mean 2015–2019 rather than 2016 mortality rate as counterfactual, and (iv) running the estimation on the full sample of Italian local labor markets rather than those in the 10 most northern regions. We also run two placebo tests as well as (i) an alternative specification in which the business shutdown variable (Equation (1)) is replaced with a dummy taking value 1 when the employment share in non‐essential businesses is above 50%, and (ii) a dynamic specification in which the effect of the business shutdown policy is allowed to vary over time. Estimates from all these robustness checks and alternative specifications confirm the robustness of our baseline results and formally validate the parallel trend assumption. Finally, in Annex B we also show that carrying out the analysis at the municipality‐rather than the local‐labor‐market‐level leads to substantial measurement error in the treatment variable, thus underestimating the effectiveness of business shutdowns in reducing mortality.

Back‐of‐the‐envelope calculations on prevented deaths

How many deaths can be ascribed to COVID‐19? And how many deaths have been prevented by shutting non‐essential businesses down? We answer these questions through some simple back‐of‐the‐envelope calculations. We start by using the coefficients estimated through Equation (2) to calculate the number of excess deaths, in each day of the epidemic and each local labor market, according to the following formula: where is the predicted number of excess deaths due to COVID‐19 in local labor market i in day t; the , , , and are the coefficients estimated from Equation (2); BS is the employment share in shutdown firms; the are the control variables; pop is population (in 100,000). We calculate using the coefficients reported in Column 6 of Table 1 and then sum each over the entire period of the first wave of the COVID‐19 epidemic in Italy (21st February to 15th May), and across all local labor markets. This back‐of‐the‐envelope calculation indicates that COVID‐19 resulted in slightly more than 48,000 excess deaths – equal to almost 0.14% of the local population – during the first wave of the epidemic in the 10 regions of Italy's north. Next, to get a rough sense of the efficacy of business shutdown policies in reducing mortality, we calculate the number of excess deaths that would have occurred in a hypothetical scenario of no business shutdowns. To do so, we artificially set the variable BS  in Equation (3) equal to 0 and find that deaths would have been more than 78,000. Hence, our results suggest that business shutdowns might have reduced COVID‐19 mortality by about 40%. This estimate is in line with previous work analyzing the effectiveness of non‐pharmaceutical interventions (NPIs). In their seminal study, Ferguson, et al. (2020) estimate that NPIs could reduce mortality by 15%–30% in the UK, depending on the basic reproduction number and occupancy of ICU beds. Jones et al. (2020) estimate a 30% reduction in the cumulative death rate by introducing early mitigation policies and work‐from‐home orders, while Dave et al. (2021) find that Shelter‐in‐Place Orders in the United States reduced cumulative deaths by about 50% in the first 3 weeks since adoption. Two caveats to our estimates, which also apply to previous work, are in order. First, in Italy business shutdowns coincided with the lockdown period. Hence, our results are conditional on a lockdown being in place and should not be generalized to cases in which business shutdowns are disjoint from lockdown policies. We believe, however, that our results remain relevant: over the past 2 years of the pandemic, business shutdowns have generally been implemented together with lockdowns, curfews, or other restrictions of people's movements. A second caveat may be that some non‐essential businesses would have closed even in the absence of government‐mandated policies. If this were to be the case, we would be overestimating the deaths prevented through government policies. On the other hand, our back‐of‐the‐envelope calculations assume that COVID‐19 has linear effects on mortality. However, when infections are left unchecked and the healthcare system is overwhelmed, the fatality rate of COVID‐19 increases (Ciminelli & Garcia‐Mandicó, 2020b; Favero, 2020). In this sense, our calculation of 30,000 prevented deaths may be a lower bound of the real effects of business shutdowns on mortality.

The importance of timely interventions

Given that infections grow exponentially and feed in within households (Song et al., 2021), the effects of mitigation and suppression policies should be stronger if implemented earlier in the epidemic curve. Dave et al. (2020) and Friedson et al. (2020) show that this is indeed true for the case of lockdowns. In this section, we investigate to what extent this is valid for business shutdowns. We exploit the fact that, while the government applied the business shutdowns policy at the same time throughout the entire country, communities were at different stages in their epidemic curve when the policy was implemented – those close to the epidemic epicenter (usually defined as the towns of Codogno and Alzano Lombardo in the Lombardy region) displayed much higher COVID‐19 caseloads relative to those far from it (Appendix Figure A4). Hence, the variation across local labor markets in the timing of the policy implementation relative to the stage of the epidemic can be considered exogenous to the policy itself.
FIGURE A4

Number of cases at the time of business shutdowns. The figure shows the number of confirmed COVID‐19 cases, relative to the population, at the provincial level at the time in which the business shutdowns were implemented by the government

We proceed by constructing a variable measuring the differences across local labor markets in the relative “timing” of the policy implementation. To do so, we calculate the cumulative number of cases reported up to the day of the adoption of the policies as a share of the local population. On average, detected cases were about 120 per 100,000 people when business shutdowns were adopted. However, there was great heterogeneity across local labor markets. Some had recorded as little as 1 case per 100,000 people, while others had almost 1700. The relative timing of business shutdowns should be more important for the short‐run effectiveness of the policy since the longer the policy is implemented, the more differences in infection rates at the time of implementation are washed out. Hence, we focus on the first two weeks of the policy implementation and restrict the sample to the 1st January‐11th April period. We then estimate the following specification: where are two dummy variables taking value 1 for, respectively, each of the first 2 weeks of the business shutdown policy and 0 otherwise, the subscript p denotes province; Z  measures cumulative cases up to the day in which the policy is implemented; pop is population size; and the rest is as in Equation (2). We use data on cases at the provincial‐level (rather than at the local‐labor‐market‐level) since official data on detected cases are only available at this level of disaggregation. Table 2 shows the results. Column 1 reports the results from a parsimonious specification that does not include the timing interaction terms. Column 2 reports results estimated from the full Equation (4) above, where the coefficient of the timing interaction terms is normalized to show the change in policy effectiveness associated with 100 more detected cases per 100,000 people at the time of implementation. Both specifications also include the baseline control variables, but for brevity their coefficients are not reported. The new estimates suggest that the short‐run effectiveness of business shutdowns decreases with higher infection rates. In the first week of implementation, business shutdowns were about 40% less effective in local labor markets with 100 more cumulative reported cases per 100,000. In the second week, the effectiveness of the policy was still reduced in communities with higher infection rates at the time of implementation, albeit by a considerably smaller margin.
TABLE 2

The effects of business shutdowns accounting for timing

(1)(2)
Business shutdowns (week 1)−0.62***−0.83***
(0.21)(0.24)
Business shutdowns (week 2)−0.56***−0.59***
(0.17)(0.16)
Business shutdowns*timing (week 1)0.33***
(0.07)
Business shutdowns*timing (week 2)0.03**
(0.01)
Observations29,10629,106
Between R‐squared0.100.16

Note: Column (1) report results from a variation of Equation (4), not including the timing interaction terms. Column (2) reports results obtained estimating the full Equation (4). Both specifications include baseline control variables (as in Column 6 of Table 1), but their coefficients are not reported. Both specifications include local labor market fixed effects and are estimated using least squares with analytical population weights. Standard errors are clustered at the local labor market level.

Significance levels: *p < 0.1, **p < 0.05, ***p < 0.01.

The effects of business shutdowns accounting for timing Note: Column (1) report results from a variation of Equation (4), not including the timing interaction terms. Column (2) reports results obtained estimating the full Equation (4). Both specifications include baseline control variables (as in Column 6 of Table 1), but their coefficients are not reported. Both specifications include local labor market fixed effects and are estimated using least squares with analytical population weights. Standard errors are clustered at the local labor market level. Significance levels: *p < 0.1, **p < 0.05, ***p < 0.01. These results beg the natural question of how many more lives could have been saved had the government intervened earlier in the epidemic curve. To answer this question, we use the estimates from Column 2 of Table 2 to perform a back‐of‐the‐envelope calculation, similarly to what done in Section 3.1. We find that intervening 7 days earlier, when cumulative cases per 100,000 inhabitants were around 20 on average, could have resulted in an additional 5% more lives saved during the first two weeks of policy implementation.

Heterogeneity in the effectiveness of business shutdowns across sectors

The analysis carried out so far suggests that business shutdowns are generally effective in reducing COVID‐19 mortality. However, there may exist heterogeneities depending on which sectors are affected. Consumer‐facing service activities can amplify contagion due to the high degree of interpersonal contact between workers and customers (Lewandowski, 2020; Markowitz et al., 2019). In this section, we extend the analysis to explore such heterogeneities, focusing in particular on four broad sectors, which were also those most impacted by the shutdowns: (i) retail trade, (ii) hospitality (food services and accommodation activities), (iii) manufacturing and construction, and (iv) office and support activities (real estate, professional and administrative and support activities). Together, these account for about 60% of overall non‐farm private employment and make up for almost 80% of employment in shutdown firms (Appendix Table A2) and an even larger share of GDP (Navaretti, et al., 2020). Understanding whether there exist heterogeneities in the effectiveness of business shutdowns across these sectors would help policymakers implement targeted interventions that minimize the trade‐off between the number of lives saved and the economic costs. For the estimation, we twist Equation (2) and replace the variable BS with sector‐specific variables measuring, within each sector, the employment share in firms that are closed down. Table 3 reports the results. Columns 1–4 show estimates when considering each sector separately one at a time, while Column 5 reports estimates from a comprehensive specification including all four sectors. The coefficients report the change in daily excess deaths per 100,000 inhabitants associated with a 10% points increase in the employment share in shutdown firms within each respective sector. All specifications also include our baseline control variables (as in Column 6 of Table 1), but their coefficients are not reported for brevity.
TABLE 3

Sector‐specific effects of business shutdowns

 (1)(2)(3)(4)(5)
Retail trade−0.24−0.22
(0.28)(0.25)
Hospitality−0.45*−0.42*
(0.25)(0.25)
Manufacturing & construction−0.03−0.02
(0.11)(0.10)
Office and support activities−0.23−0.06
(0.14)(0.12)
Observations40,39240,39240,39240,39240,392
Between R‐squared0.090.090.090.100.09

Note: the table reports results for the sector‐specific effects of business shutdowns in reducing mortality. Columns (1)‐(4) report coefficients when each sector is considered one at a time. Column (5) considers all sectors at the same time. The coefficients are estimated using the employment share, within each sector, in shutdown firms in place of the variable BS in Equation (2).

Significance levels: *p < 0.1, **p < 0.05, ***p < 0.01.

Sector‐specific effects of business shutdowns Note: the table reports results for the sector‐specific effects of business shutdowns in reducing mortality. Columns (1)‐(4) report coefficients when each sector is considered one at a time. Column (5) considers all sectors at the same time. The coefficients are estimated using the employment share, within each sector, in shutdown firms in place of the variable BS in Equation (2). Significance levels: *p < 0.1, **p < 0.05, ***p < 0.01. Our results suggest that closing down hospitality effectively reduces mortality while shutting down manufacturing and construction does not. We estimate a negative (−0.4) and statistically significant coefficient from shutting down the hospitality sector in the restricted (Column 2) and extended specifications (Column 5). In contrast, the coefficients estimated for manufacturing and construction activities are close to zero and statistically insignificant. The evidence on the effectiveness of shutting down retail trade and office and support activities is mixed. The coefficients estimated for retail trade are negative and meaningful but not statistically significant at standard confidence levels (Columns 1 and 5). The coefficient for office and support activities, instead, is negative but not statistically significant when the variable enters the regression independently (Column 4), whereas it is close to zero in the extended specification (Column 5). The lack of statistical significance for the retail trade shutdown coefficient might be due to the low variation of shutdown employment in the retail trade sector across local labor markets (see Appendix Table A2). The fact that the office and support activities shutdown variable lose importance in the extended specification may be because the share of employment in shutdown firms in this sector displays a fairly high correlation with the hospitality shutdown variable across local labor markets (0.46). What could explain the effectiveness of shutting down the hospitality sector and the lack of effect from shutting down the manufacturing and construction sectors? One possibility is that the shutdowns of manufacturing and construction activities did not bind, meaning that workers still went to the workplace, notwithstanding the government's order. In this case, the variable measuring the share of workers that stayed at home would be measured with an error. We rule out this explanation in Appendix C, where we explore the mobility effects of business shutdowns and find that the shutdown of manufacturing and construction activities substantially decreased workplace mobility and increased the time that people spent at home. Hence, the lower effectiveness of production activities shutdowns does not seem to be due to low compliance rates. The fact that we found the shutdown of services and production activities to have similar effects in decreasing mobility but different effects in reducing mortality also suggests that the drop in mobility was not the main channel for the overall effectiveness of the policy. If it were to be the main channel, we would have found the shutdown of different sectors to have similar effects on mobility and mortality. Instead, taken together, our results offer suggestive evidence that an important channel behind the effectiveness of business shutdowns is the reduction in interpersonal contact at the workplace. Indeed, the differential degree of occupational exposure by sector is likely to play an important factor in the spread of COVID‐19. While workers in the service sector interact among themselves and with customers every day – the opposite of social distancing – for the most part, factory and office workers only interact with other workers in the same unit, and the opportunities to contract or spread the virus appear to be more limited than in the consumer‐facing service sector. This can explain why we find that communities with a higher share of employment in shutdown production activities did not experience lower rates of COVID‐19 mortality. These results are in line with the findings on occupational exposure to COVID‐19 of Lewandowski (2020) and Aron and Muellbauer (2020). In particular, the latter uses excess mortality data for England to find that most COVID‐19 deaths in the working‐age population were concentrated among people employed in the consumer‐facing service sector.

DISCUSSION

The sudden appearance of COVID‐19 in early 2020 has brought about large human losses in most countries worldwide, often forcing governments to implement hastily arranged policies to limit the death toll from the virus. The closure of non‐essential activities (commonly referred to as business shutdowns) has been one such policy. This paper investigated its effectiveness in reducing COVID‐19 mortality, focusing on the importance of acting early, and of targeting the right sectors. Our results offer strong evidence that business shutdowns can be very effective in curbing COVID‐19 mortality: we calculated that they may have reduced the death toll of COVID‐19 during the first wave of the epidemic in Italy by about 40%. Implementing shutdowns early on in the epidemic curve is key to increase their effectiveness. If the policy had been introduced 7 days earlier, the death toll might have been reduced by an additional 5%. The effectiveness of shutdowns is heterogeneous across sectors. Consistent with the notion that sectors with a higher degree of interpersonal contact can facilitate the spread of infectious diseases, closing down the hospitality sector has the largest effects in reducing mortality. Shutting down the construction and manufacturing sectors – in which interpersonal contact is limited to workers in the same unit – only has mild effects. Our analysis carries clear policy implications. From a public health perspective, governments should not hesitate to act early on and decide the closure of non‐essential businesses to save lives when new outbreaks of COVID‐19 and other pathogens materialize. However, since business shutdowns carry large economic costs, they should be targeted, prioritizing the closure of sectors with a high degree of interpersonal contact between workers and customers and a low propensity toward digital labor. Our results and related policy implications should be interpreted in the context of the first wave of COVID‐19 in Italy, in which strict restrictions on people's movement were in place, but where other protective measures, such as mask‐wearing, frequent disinfection, and social distancing measures in public places, were not widespread (Égert et al., 2020). As these measures become the norm, the contribution of business shutdowns to reducing COVID‐19 mortality may become smaller. Moreover, our study did not cover other important aspects when assessing the appropriateness of business shutdowns, including those related to the depreciation of human capital and increased mental health problems for workers forced to stay home. More research is needed to understand these costs to have a complete picture for policymakers when deciding whether to implement business shutdowns.

CONFLICT OF INTEREST

The authors have no conflict of interest to declare.
TABLE B1

Robustness checks and additional estimates on the effects of business shutdowns on COVID‐19 mortality

 (1)(2)(3)(4)(5)(6)(7)(8)(9)
Business shutdowns−0.37***−0.38***0.11−0.67−0.38***−0.42***−0.55**−0.35***−0.15***
(0.11)(0.13)(0.15)(0.52)(0.14)(0.11)(0.25)(0.09)(0.04)
Share working age females−0.73***−0.73***−0.76***−0.75***−0.64***−0.70***−0.81***−0.77***−0.55***
(0.15)(0.16)(0.16)(0.16)(0.16)(0.16)(0.16)(0.12)(0.11)
Share high school graduates−0.23−0.25−0.11−0.14−0.35*−0.26−0.240.04−0.12
(0.18)(0.19)(0.15)(0.16)(0.18)(0.18)(0.21)(0.10)(0.09)
Population density0.32***0.31***0.34***0.34***0.31***0.33***0.53***−0.030.07
(0.09)(0.09)(0.09)(0.09)(0.11)(0.09)(0.14)(0.06)(0.05)
Days PM10 above limit0.35***0.34***0.37***0.36***0.29***0.37***0.32***0.31***0.35***
(0.09)(0.09)(0.09)(0.09)(0.10)(0.10)(0.09)(0.06)(0.06)
Digital labor in active firms−0.39***−0.32**−0.35***−0.33**−0.41**−0.41***−0.31***0.17*−0.09
(0.13)(0.13)(0.13)(0.13)(0.18)(0.15)(0.11)(0.09)(0.08)
University closures−0.01
(0.02)
Employment rate0.07
(0.18)
Internal commuting index0.24
(0.14)
Share of 80+0.21
(0.15)
Mean income0.12
(0.15)
Observations40,39240,39240,39240,39240,39240,39240,39280,376598,264
Between R‐squared0.110.100.090.090.080.140.090.020.02

Note: the table reports results from a battery of robustness checks and alternative specifications. Column (1) reports the baseline specification (Column 6 in Table 1). Column (2) excludes the accommodation sector, Columns (3) and (4) perform placebo tests, Column (5) reports the results from including additional controls, Column (6) reports results when using average 2015–2019 mortality as counterfactual, Column (7) report estimates obtained from a standard diff‐in‐diff specification in which local labor markets are divided in two groups (treated and untreated) depending on whether the share of employment in non‐essential businesses is above/below 50%, Column (8) reports results estimated on the unrestricted sample of all 20 Italian regions, while Column (9) reports results obtained carrying out the analysis at the municipality‐rather than the local‐labor‐market‐level.

Significance levels: *p < 0.1, **p < 0.05, ***p < 0.01.

TABLE B2

Mobility and mortality trends before the lockdown

 Local labor markets with low share of non‐essential employmentLocal labor markets with high share of non‐essential employment p‐value
Workplace−11.43−10.760.09
Transits−20.19−18.990.20
Retail−14.15−13.760.48

Note: the table shows the average daily percent change in mobility during the period between the detection of the first community case (February 21, 2020) and the implementation of business shutdowns (March 11, 2020) relative to the baseline 3rd January‐6th February 2020 period in local labor markets with a low (below the 50th percentile of the business shutdown variable distribution) versus a high share of workers employed in firms affected by the business shutdowns (above the 50th percentile). The column p‐value reports the p‐value associated with a test for equality in the means.

TABLE C1

Effects of business shutdowns on mobility

 (1)(2)(3)(4)(5)(6)(7)(8)
 WorkplaceWorkplaceRetail & recreationRetail & recreationTransit hubsTransit hubsResidentialResidential
Business shutdowns−1.24***−1.32**−1.49**0.57***
(0.19)(0.53)(0.64)(0.09)
Retail trade−0.741.100.180.64*
(0.80)(0.97)(1.39)(0.33)
Hospitality−0.21−2.72***−3.79***0.12
(0.33)(0.99)(1.16)(0.18)
Manufact. & construction−1.27***−0.41−0.530.59***
(0.18)(0.32)(0.40)(0.09)
Office activities−0.72**−0.17−0.170.22*
(0.29)(0.25)(0.40)(0.11)
Observations22,49622,49622,49622,49622,49622,49622,40622,406
Between R‐squared0.180.180.160.180.210.210.240.25

Note: The table reports the effects of business shutdowns on mobility. Dependent variables measure daily percentage change in mobility relative to the 3rd January‐6th February 2020 period. In Columns (1) and (2), (3) and (4), (5) and (6) and (7) and (8) the dependent variable measures, respectively, workplace mobility, retail and recreational mobility, transit places mobility and residential mobility. The explanatory variables are the overall and sector specific business shutdowns variables, in which the employment share in shutdown sectors is interacted with 0/1 policy dummies taking value 1 during the business shutdown period and 0 otherwise. The estimation sample goes from 15th February to May 15, 2020. The estimating equation includes time and local labor market fixed effects.

Significance levels: *p < 0.1, **p < 0.05, ***p < 0.01.

  25 in total

1.  Two-level modeling of quarantine.

Authors:  Evgeniy Khain
Journal:  Phys Rev E       Date:  2020-08       Impact factor: 2.529

2.  Incubation Period and Other Epidemiological Characteristics of 2019 Novel Coronavirus Infections with Right Truncation: A Statistical Analysis of Publicly Available Case Data.

Authors:  Natalie M Linton; Tetsuro Kobayashi; Yichi Yang; Katsuma Hayashi; Andrei R Akhmetzhanov; Sung-Mok Jung; Baoyin Yuan; Ryo Kinoshita; Hiroshi Nishiura
Journal:  J Clin Med       Date:  2020-02-17       Impact factor: 4.241

3.  The lockdown effect: A counterfactual for Sweden.

Authors:  Benjamin Born; Alexander M Dietrich; Gernot J Müller
Journal:  PLoS One       Date:  2021-04-08       Impact factor: 3.240

4.  Inferring the effectiveness of government interventions against COVID-19.

Authors:  Jan M Brauner; Sören Mindermann; Mrinank Sharma; Leonid Chindelevitch; Yarin Gal; Jan Kulveit; David Johnston; John Salvatier; Tomáš Gavenčiak; Anna B Stephenson; Gavin Leech; George Altman; Vladimir Mikulik; Alexander John Norman; Joshua Teperowski Monrad; Tamay Besiroglu; Hong Ge; Meghan A Hartwick; Yee Whye Teh
Journal:  Science       Date:  2020-12-15       Impact factor: 47.728

5.  Effectiveness of extended shutdown measures during the ´Bundesnotbremse´ introduced in the third SARS-CoV-2 wave in Germany.

Authors:  Andreas Schuppert; Katja Polotzek; Jens Karschau; Christian Karagiannidis
Journal:  Infection       Date:  2021-10-20       Impact factor: 3.553

6.  When and how do business shutdowns work? Evidence from Italy's first COVID-19 wave.

Authors:  Gabriele Ciminelli; Sílvia Garcia-Mandicó
Journal:  Health Econ       Date:  2022-06-27       Impact factor: 2.395

7.  The impact of the non-essential business closure policy on Covid-19 infection rates.

Authors:  Hummy Song; Ryan McKenna; Angela T Chen; Guy David; Aaron Smith-McLallen
Journal:  Int J Health Econ Manag       Date:  2021-04-01

8.  School openings and the COVID-19 outbreak in Italy. A provincial-level analysis using the synthetic control method.

Authors:  Vincenzo Alfano; Salvatore Ercolano; Lorenzo Cicatiello
Journal:  Health Policy       Date:  2021-07-02       Impact factor: 2.980

9.  The "Great Lockdown": Inactive workers and mortality by Covid-19.

Authors:  Nicola Borri; Francesco Drago; Chiara Santantonio; Francesco Sobbrio
Journal:  Health Econ       Date:  2021-07-11       Impact factor: 2.395

View more
  1 in total

1.  When and how do business shutdowns work? Evidence from Italy's first COVID-19 wave.

Authors:  Gabriele Ciminelli; Sílvia Garcia-Mandicó
Journal:  Health Econ       Date:  2022-06-27       Impact factor: 2.395

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.