Literature DB >> 32951804

The association of voter turnout with county-level coronavirus disease 2019 occurrence early in the pandemic.

W Dana Flanders1, William D Flanders2, Michael Goodman3.   

Abstract

PURPOSE: The ongoing coronavirus disease 2019 (COVID-19) severely impacted both health and the economy. Absent an effective vaccine, preventive measures used, some of which are being relaxed, have included school closures, restriction of movement, and banning of large gatherings. Our goal was to estimate the association of voter turnout with county-level COVID-19 risks.
METHODS: We used publicly available data on voter turnout in the March 10 primary in three states, COVID-19 confirmed cases by day and county, and county-level census data. We used zero-inflated negative binomial regression to estimate the association of voter turnout with COVID-19 incidence, adjusted for county-level population density and proportions: over age 65 years, female, Black, with college education, with high school education, poor, obese, and smokers.
RESULTS: COVID-19 risk was associated with voter turnout, most strongly in Michigan during the week starting 3 days postelection (risk ratio, 1.24; 95% confidence interval, 1.16-1.33). For longer periods, the association was progressively weaker (risk ratio 0.98-1.03).
CONCLUSIONS: Despite increased absentee-ballot voting in the primary, our results suggest an association of voter turnout in at least one state with a detectable increase in risks associated with and perhaps due to greater exposures related to the primary.
Copyright © 2020 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  COVID-19; Risk factors; Social distancing; Voting

Mesh:

Year:  2020        PMID: 32951804      PMCID: PMC7328545          DOI: 10.1016/j.annepidem.2020.06.011

Source DB:  PubMed          Journal:  Ann Epidemiol        ISSN: 1047-2797            Impact factor:   3.797


Introduction

Although coronavirus-induced epidemics occur periodically [1], the coronavirus disease 2019 (COVID-19) has had especially severe public health impact [2,3]. Compared with earlier coronavirus epidemics, such as those caused by severe acute respiratory syndrome (SARS) and the Middle East respiratory syndrome, a greater proportion of COVID-19 cases are infectious while still asymptomatic [4,5]. As the result, unlike SARS and Middle East respiratory syndrome, which were mainly associated with nosocomial spread, the Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), which causes COVID-19, is more easily transmitted in the community [6,7]. Based on experience with other infectious disease epidemics, community transmission typically displays pronounced spatial heterogeneity that depends on two key factors: where people live and how they move or gather [8,9]. The latter consideration is the main justification for social distancing measures, such as school and university closures, cancellation of planned events, and restriction of movement [[10], [11], [12], [13]]. Despite these measures, population gatherings, including family events such as funerals and birthdays, facilitate SARS-CoV-2 transmission in various settings [14,15]. Although the current wave of the COVID-19 pandemic is expected to subside, lower level transmission will likely continue, and a second wave in the fall is possible [16]. If so, it could directly affect the presidential elections, scheduled for November 3, 2020 [17]. In planning for the November election, it may be helpful to consider the recent experience in the states that held primary elections on March 10, 2020, as planned. Data from these states offer an opportunity to investigate the potential impact of the reduction in social distancing that might be caused by in-person voting. The impact, if any, may inform the administrative and logistical measures that need to be considered for November. To estimate the impact of elections on county-level COVID-19 incidence, we considered voter turnout differences in the March 10 primary, by county, across the three states for which the required information was available. The purpose of the current analysis is to investigate whether the increase in cases that was seen in all states after the election was greater in counties with higher voter turnout after accounting for other relevant county-level population characteristics.

Methods

Cases

We obtained information on confirmed COVID-19 cases by county from two sources—USAFacts [18] (Table 1 ) and the Johns Hopkins University Center for Science and Engineering project [19] (JHU-CSSE; Table 1). Both sources report confirmed case counts by county and day, using data from the U.S. Centers for Disease Control and Prevention (CDC) and from state and local governments. (More recently, CDC began reporting both confirmed and probable cases, but these changes do not affect the present report.) Although numbers from USAFacts and JHU-CSSE differ (see Table 3, Table 4, Table 5, Table 6 ), the results using either source led to the same conclusions, and therefore, the main analyses use the JHU-CSSE data.
Table 1

Sources of data (publicly available)

VariableSourceData
Outcome: COVID Case/Death CountJohn Hopkins University, the Center for Systems Science and Engineering https://coronavirus.jhu.edu/map.htmlDaily death and case counts at the county level
Outcome: COVID Case/Death CountUSA Facts Corona Virus Live Map https://usafacts.org/visualizations/coronavirus-covid-19-spread-map/Daily death and case counts at the county level
Independent Variable: Turnout MichiganCNN Michigan Primary 2020 https://www.cnn.com/election/2020/state/michigan?xid=ec_state_michigan_dPrimary election results for the Democratic and Republican Presidential primaries at the county level
Independent Variable: Turnout MississippiCNN Mississippi Primary 2020 https://www.cnn.com/election/2020/state/mississippiPrimary election results for the Democratic and Republican Presidential primaries at the county level
Independent Variable: Turnout WashingtonCNN Washington Primary 2020 https://www.cnn.com/election/2020/state/washingtonPrimary election results for the Democratic and Republican Presidential primaries at the county level
Independent Variable: Turnout MissouriCNN Missouri Primary 2020 https://www.cnn.com/election/2020/state/missouriPrimary election results for the Democratic and Republican Presidential primaries at the county level.
Controls: Demographic DataUnited States Census Bureau Quick Facts https://www.census.gov/quickfacts/fact/table/US/PST045219Poverty, race, density, female variables (2019 census estimates)
Controls: Health DataCDC Behavioral Risk Surveillance System Surveys https://www.cdc.gov/brfss/index.htmlSmoking and obesity data at the county level (BRFSS 2018)
Table 3

RRs for all states combined, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density and state‡)

At-risk period used to define the case countAnalyses using COVID-19 case counts from USAFacts∗Analyses using COVID-19 case counts from JHU-CSSE
March 13 to March 17n = 48; RR, 1.06; CI, 0.97–1.16; P = .20n = 90; RR, 1.10; CI, 1.02–1.19; P = .01
March 13 to March 18n = 71; RR, 1.05; CI, 0.97–1.14; P = .20n = 164; RR, 1.05; CI, 0.99–1.14; P = .22
March 13 to March 19n = 158; RR, 1.06; CI, 0.98–1.15; P = .13n = 319; RR, 1.07; CI, 1.01–1.15; P = .09
March 13 to March 20n = 271; RR, 1.07; CI, 1.01–1.15; P = .03n = 523; RR, 1.08; CI, 1.01–1.16; P = .02
March 13 to March 21n = 402; RR, 1.05; CI, 1.00–1.10; P = .05n = 687; RR, 1.07; CI, 1.01–1.14; P = .01
March 13 to March 22n = 554; RR, 1.05; CI, 1.00–1.10; P = .05n = 1304; RR, 1.06; CI, 1.01–1.12; P = .02
March 13 to March 23n = 704; RR, 1.04; CI, 0.99–1.08; P = .11n = 1668; RR, 1.05; CI, 1.00–1.09; P = .05
March 13 to March 24n = 932; RR, 1.01; CI, 0.97–1.05; P = .59n = 2234; RR, 1.02; CI, 0.98–1.07; P = .37
March 13 to March 25n = 1202; RR, 1.01; CI, 0.98–1.05; P = .46n = 2287; RR, 1.02; CI, 0.98–1.06; P = .24
April 3 to April 7n = 3804; RR, 1.02; CI, 0.99–1.06; P = .12n = 9305; RR, 1.01; CI, 0.98–1.05; P = .39
April 3 to April 8n = 4645; RR, 1.02; CI, 0.99–1.06; P = .15n = 10,885; RR, 1.01; CI, 0.98–1.05; P = .38
April 3 to April 9n = 5463; RR, 1.02; CI, 0.99–1.05; P = .18n = 12,401; RR, 1.01; CI, 0.98–1.04; P = .36
April 3 to April 10n = 6312; RR, 1.01; CI, 0.99–1.05; P = .36n = 14,036; RR, 1.01; CI, 0.98–1.04; P = .65
April 3 to April 11n = 7119; RR, 1.02; CI, 0.99–1.05; P = .32n = 12,815; RR, 1.01; CI, 0.98–1.04; P = .70

∗,†Counts of confirmed COVID-19 cases downloaded from USAFacts and from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text).

Adjusted for logarithm of population density and state; the zero-inflation part of the model included the intercept only.

Table 4

RRs in Michigan, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different risk periods and adjusted for population density‡)

At-risk period used to define the case countAnalyses using COVID-19 case counts from USAFacts∗Analyses using COVID-19 case counts from JHU-CSSE
March 13 to March 17n = 24; RR, 1.11; CI–1.03,1.21); P = .01n = 61; RR, 1.18; CI, 1.08–1.30); P < .01
March 13 to March 18n = 26; RR, 1.13; CI, 1.03–1.23; P = .01n = 117; RR, 1.21; CI, 1.04–1.41); P < .01
March 13 to March 19n = 92; RR, 1.15; CI, 0.97–1.37); P = .10n = 247; RR, 1.20; CI, 1.06–1.36; P < .01
March 13 to March 20n = 140; RR, 1.19; CI, 0.98–1.45; P = .08n = 400; RR, 1.22; CI, 1.07–1.39; P < 0.01
March 13 to March 21n = 200; RR, 1.14; CI, 1.06–1.23; P < .01n = 538; RR, 1.17; CI, 1.07–1.27; P < .01
March 13 to March 22n = 271; RR, 1.11; CI, 1.03–1.19; P < .01n = 1033; RR, 1.12; CI, 1.06–1.20; P < .01
March 13 to March 23n = 349; RR, 1.05; CI, 0.99–1.11; P = .08n = 1323; RR, 1.06; CI, 1.00–1.11; P = .03
March 13 to March 24n = 473; RR, 1.01; CI, 0.96–1.07; P = .66n = 1785; RR, 1.02; CI, 0.97–1.08; P = .45
March 13 to March 25n = 609; RR, 1.01; CI, 0.95–1.07; P = .70n = 2287; RR, 1.02; CI, 0.96–1.08; P = .46
April 3 to April 7n = 2350; RR, 0.99; CI, 0.94–1.04; P = .61n = 7878; RR, 0.99; CI, 0.94–1.05; P = .79
April 3 to April 8n = 2911; RR, 0.98; CI, 0.94–1.03; P = .53n = 9291; RR, 0.99; CI, 0.94–1.04; P = .67
April 3 to April 9n = 3353; RR, 0.98; CI, 0.94–1.03; P = .41n = 10,440; RR, 0.98; CI, 0.94–1.03; P = .52
April 3 to April 10n = 3850; RR, 0.98; CI, 0.94–1.02; P = .38n = 11,648; RR, 0.98; CI, 0.94–1.03; P = .48
April 3 to April 11n = 4315; RR, 0.98; CI, 0.94–1.02; P = .33n = 12,815; RR, 0.98; CI, 0.94–1.03; P = .44

∗,†Counts of confirmed COVID-19 cases downloaded from USAFacts and from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text).

Adjusted for logarithm of population density; the zero-inflation part of the model included the intercept only.

Table 5

RRs in Missouri, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density‡)

At-risk period used to define the case countAnalyses using COVID-19 case counts from USAFacts∗Analyses using COVID-19 case counts from JHU-CSSE
March 13 to March 17n = 4; RR, 1.62; CI, 0.49–5.42; P = .43n = 9; RR, 1.11; CI, 0.93–1.34; P = .25
March 13 to March 18n = 12; RR, 1.13; CI, 1.00–1.27; P = .05n = 14; RR, 1.05; CI, 0.85–1.32); P = .64
March 13 to March 19n = 17; RR, 1.10; CI, 0.90–1.35; P = .36n = 23; RR, 1.06; CI, 0.89–1.25; P = .52
March 13 to March 20n = 52; RR, 1.03; CI, 0.88–1.21; P = .73n = 44; RR, 1.02; CI, 0.85–1.23; P = .83
March 13 to March 21n = 63; RR, 1.03; CI, 0.89–1.19; P = .74n = 52; RR, 1.04; CI, 0.88–1.22; P = .64
March 13 to March 22n = 77; RR, 1.02; CI, 0.90–1.16; P = .72n = 65; RR, 1.07; CI, 0.92–1.23; P = .39
March 13 to March 23n = 107; RR, 1.07; CI, 0.97–1.17; P = .16n = 97; RR, 1.09; CI, 0.99–1.19; P = .07
March 13 to March 24n = 146; RR, 1.03; CI, 0.94–1.13; P = .54n = 130, RR, 1.05; CI, 0.96–1.15; P = .26
March 13 to March 25n = 218; RR, 1.03; CI, 0.95–1.11; P = .51n = 182; RR, 1.06; CI, 0.99–1.14; P = .12
April 3 to April 7n = 715; RR, 1.00; CI, 0.93–1.08; P = .97n = 689; RR, 1.00; CI, 0; RR, 1.18; CI, 1.04,1.3); P < .0192, 1.08; P=.90
April 3 to April 8n = 907; RR, 0.98; CI, 0.91–1.07; P = .70n = 768; RR, 0.99; CI, 0.91–1.08; P = .81
April 3 to April 9n = 1028; RR, 0.98; CI, 0.91,1.06; P = .62n= 878; RR, 0.99; CI, 0.91–1.07; P = .79
April 3 to April 10n = 1173; RR, 0.97; CI, 0.89–1.05; P = .43n = 1096; RR, 0.97; CI, 0.89–1.06; P = .50
April 3 to April 11n = 1338; RR, 0.97; CI, 0.89–1.05; P = .42n = 1237; RR, 0.97; CI, 0.88–1.05; P = .41

∗,†Counts of confirmed COVID-19 cases downloaded from USAFacts and from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text).

Adjusted for logarithm of population density; the zero-inflation part of the model included the intercept only.

Table 6

RRs in Mississippi, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density‡)

At-risk period used to define the case countAnalyses using COVID-19 case counts from USAFacts∗Analyses using COVID-19 case counts from JHU-CSSE
March 13 to March 17n = 20; RR, 1.10; CI, 0.90–1.33; P = .35n = 20; RR, 1.09; CI, 0.89–1.33; P = .35
March 13 to March 18n = 33; RR, 0.93; CI, 0.78–1.10; P = .39n = 33; RR, 0.99; CI, 0.88,–1.10; P = .79
March 13 to March 19n = 49; RR, 0.95;CI, 0.84–1.08; P = .45n = 49; RR, 0.96; CI, 0.85–1.09; P = .51
March 13 to March 20n = 79; RR, 1.00; CI, 0.91–1.09; P = .95n = 79; RR, 1.00; CI, 0.91–1.09; P = .95
March 13 to March 21n = 139; RR, 0.98; CI, 0.92–1.04; P = .53n = 97; RR, 1.00; CI, 0.91–1.09; P = .97
March 13 to March 22n = 206; RR = 0.99; CI, 0.93–1.05; P = .71n = 206; RR, 0.99; CI, .93–1.05; P = .64
March 13 to March 23n = 248; RR, 0.98; CI, 0.92–1.04; P = .49n = 248; RR, 0.98; CI, 0.92–1.04; P = .49
March 13 to March 24n = 313; RR, 0.96; CI, 0.91–1.02; P = .18n = 319; RR, 0.96; CI, 0.91–1.02; P = .17
March 13 to March 25n = 375; RR, 0.97; CI, 0.92–1.03; P = .33n = 376; RR, 0.97; CI, 0.92–1.03; P = .32
April 3 to April 7n = 739; RR, 1.00; CI, 0.96–1.04; P = .90n = 738; RR, 1.00; CI, 0.96–1.04; P = .86
April 3 to April 8n = 827; RR, 1.00; CI, 0.96–1.04; P = .97n= 826; RR, 1.00; CI, 0.96–1.04; P = .99
April 3 to April 9n = 1082; RR, 1.00; CI, 0.97–1.04; P = .85n = 1083; RR, 1.00; CI, 0.97–1.04; P = .82
April 3 to April 10n = 1289; RR = 1.00; CI, 0.96–1.04; P = .89n = 1292; RR, 1.00; CI, 0.97–1.04; P = .87
April 3 to April 11n = 1466; RR, 1.00; CI, 0.97–1.04; P = .82n = 1465; RR = 1.00; CI, 0.96–1.04; P = .85

∗,†Counts of confirmed COVID-19 cases downloaded from USAFacts and from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text).

Adjusted for logarithm of population density; the zero-inflation part of the model included the intercept only.

Sources of data (publicly available) Summary statistics of key variables∗ Prevalence of “Obesity” represents the proportion of county residents who are obese, “Age” the proportion who are aged ≥65 y, “Poverty” represents the proportion who are below the federal poverty line, and “Prevalence of Smoking” represent the proportion of adults who smoke in the county. “Density” represents the number of people per square mile in the county. Postvote cases are confirmed covid-19 cases, listed for dates between March 13 and March 23, by either Johns Hopkins University Center for Systems Science and Engineering or by USAFacts (denoted “USA” in the table) or on their respective websites [18,19] of main text. Excludes one county (JHU-CSSE) or three counties (USAFacts) with reported prevote cases. RRs for all states combined, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density and state‡) ∗,†Counts of confirmed COVID-19 cases downloaded from USAFacts and from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text). Adjusted for logarithm of population density and state; the zero-inflation part of the model included the intercept only. RRs in Michigan, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different risk periods and adjusted for population density‡) ∗,†Counts of confirmed COVID-19 cases downloaded from USAFacts and from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text). Adjusted for logarithm of population density; the zero-inflation part of the model included the intercept only. RRs in Missouri, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density‡) ∗,†Counts of confirmed COVID-19 cases downloaded from USAFacts and from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text). Adjusted for logarithm of population density; the zero-inflation part of the model included the intercept only. RRs in Mississippi, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density‡) ∗,†Counts of confirmed COVID-19 cases downloaded from USAFacts and from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text). Adjusted for logarithm of population density; the zero-inflation part of the model included the intercept only. We restricted analyses to the three states with primary elections on March 10, 2020, and with the required information as of May 05, 2020: Michigan, Mississippi, and Missouri. Although they also held a primary on March 10, we excluded Idaho because not all counties had completed tallies; Washington because voters cast ballots by mail; and North Dakota because it has caucuses, not primary elections.

Voter turnout and covariates

Information on voter turnout, used as a surrogate of in-person voting in Missouri and Mississippi, was gathered from CNN's Election 2020 Primary database. CNN provides the results of the Republican and Democratic primaries at the county level. County-level turnout in Missouri and Mississippi is used as a surrogate, albeit imperfect, measure of in-person voting and the potential for increased exposure to COVID-19. In Michigan, we had counts of cases by mail and in-person voting by county that we obtained from the Michigan Bureau of Elections. Most of the demographic covariates were gathered from county-level U.S. Census data. County-specific obesity and smoking prevalence estimates were obtained from the CDC Behavioral Risk Factor Surveillance Survey (Table 1).

Statistical analyses

To estimate the association between voter turnout on March 10 and county-level COVID-19 infection risk, we considered the period during which excess cases, if any, would be expected to occur. Therefore, we considered published estimates concerning the incubation period, time from infection to symptom onset and the interval from onset of symptoms to the development of dyspnea or hospitalization. These estimates are relevant because CDC, the main information source for JHU-CSSE (and USAFacts), linked some cases with date reported, not necessarily with symptom onset date. The estimates of the median incubation period range from about 5 [[20], [21], [22], [23], [24]] to 6.5 or more days [25,26]. Lauer et al. [22] estimated that only 2.5% of people would develop symptoms sooner than 2.6 days after infection, and 97.5% of people would develop symptoms within 11.5 days of infection. In a study by Wu et al. [25], the 97.5 percentile of the COVID-19 incubation-period distribution was about 12.5 days. Zhou et al. estimated a median time of 7 days (interquartile range [IQR] 4–9) from symptom onset to dyspnea and 11 (IQR 8–14) days [27] to hospital admission, and Chen reported a median time from symptom onset until the presentation of 4 days (IQR 4–7). Based on this information, in the main analyses, we considered COVID-19 cases reported through March 10 to be “prevote,” and considered cases reported on March 13 and after as “postvote.” We calculated case counts for each of a series of risk periods, ranging in length from 5 to 12 days, as indicated in Table 3, Table 4, Table 5, Table 6, Table 7, Table 8, Table 9, Table 10 . We chose these risk periods to allow for the development of symptoms (incubation period) plus time for obtaining and reporting a test result after symptom onset. Collectively, the risk periods considered (Table 3, Table 4, Table 5, Table 6, Table 7, Table 8, Table 9, Table 10) could include poll-associated cases that were tested as soon as 3–4 days and as long as 15 days after voting. These periods allow for the median incubation period (5–6 days) plus up to an additional 10 days for testing and reporting, because, for part of this time, CDC apparently reported counts by reported date (not necessarily the symptom onset date) [28]. Cases reported on March 11 and March 12 were not included in the analyses because they could have become infected prevote. In sensitivity analyses, we considered alternative risk periods to define “postvote” cases as described under “alternative” outcomes.
Table 7

RRs for all states measuring the association of voter turnout with COVID-19 risk (We defined the outcome [case-count] using different at-risk periods and adjusted for population density and state and demographic covariates†)

At-risk period used to define the case countAnalyses using COVID-19 case counts from JHU-CSSE
March 13 to March 18RR = 1.0595% CI, 0.97–1.15; P = .25
March 13 to March 19RR = 1.0695% CI, 0.98–1.14; P = .12
March 13 to March 20RR = 1.0895% CI, 1.01–1.15; P = .03
March 13 to March 21RR = 1.0795% CI, 1.01–1.14; P = .02
March 13 to March 22RR = 1.0695% CI, 1.01–1.12; P = .03
March 13 to March 23RR = 1.0495% CI, 1.00–1.09; P = .07
March 13 to March 24RR = 1.0295% CI, 0.98–1.07; P = .31
March 13 to March 25RR = 1.0295% CI, 0.98–1.07; P = .26
Alternative Outcomes
 April 3 to April 8RR = 1.0095% CI, 0.97–1.04; P = .84
 April 3 to April 9RR = 1.0095% CI, 0.97–1.04; P = .82
 April 3 to April 10RR = 1.0095% CI, 0.97–1.04; P = .82
 April 3 to April 11RR = 1.0095% CI, 0.97–1.03; P = .84
 April 3 to April 12RR = 1.0095% CI, 0.97–1.03; P = .81

Counts of confirmed covid-19 cases from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text).

Adjusted for state, logarithm of population density, proportion female, proportion aged ≥65 y, proportion Black and proportion living below the poverty line, in count model. The zero-inflation model included the intercept only.

Table 8

RRs in Michigan, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density, state and demographic covariates†)

At-risk period used to define the case countAnalyses using COVID-19 case counts from JHU-CSSE
March 13 to March 18RR = 1.2395% CI, 1.13–1.35; P < .01
March 13 to March 19RR = 1.2495% CI, 1.16–1.33; P < .01
March 13 to March 20RR = 1.2495% CI, 1.16–1.33; P < .01
March 13 to March 21RR = 1.2195% CI, 1.16–1.27; P < .01
March 13 to March 22RR = 1.1595% CI, 1.11–1.20; P < .01
March 13 to March 23RR = 1.1495% CI, 1.10–1.18; P < .01
March 13 to March 24RR = 1.0395% CI, 0.98–1.08; P = .23
March 13 to March 25RR = 1.0395% CI, 0.97–1.08; P = .33
Alternative outcomes
 April 3 to April 8RR = 0.9995% CI, 0.94–1.04; P = .68
 April 3 to April 9RR = 0.9995% CI, 0.94–1.04; P = .59
 April 3 to April 10RR = 0.9895% CI, 0.94–1.03; P = .45
 April 3 to April 11RR = 0.9895% CI, 0.94–1.03; P = .45
 April 3 to April 11RR = 0.9895% CI, 0.94–1.03; P = .40

Counts of confirmed COVID-19 cases from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text).

Adjusted for logarithm of population density, proportion female, proportion ages ≥65 y, proportion Black and proportion living below the poverty line, in count model. The zero-inflation model included the intercept only.

Table 9

RRs in Missouri, measuring the association of voter turnout with covid-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density, state and demographic covariates†)

At-risk period used to define the case countAnalyses using COVID-19 case counts from JHU-CSSE
March 13 to March 18RR = 1.1495% CI, 0.96, 1.35; P = .13
March 13 to March 19RR = 1.0495% CI, 0.93, 1.16; P = .49
March 13 to March 20RR = 1.0295% CI, 0.94–1.10; P = .71
March 13 to March 21RR = 1.0595% CI, 0.97–1.12; P = .19
March 13 to March 22RR = 1.0795% CI, 1.00–1.14; P = .03
March 13 to March 23RR = 1.0895% CI, 0.99–1.18; P = .09
March 13 to March 24RR = 1.0795% CI, 0.99–1.16; P = .09
March 13 to March 25RR = 1.0895% CI, 1.00–1.16; P = .04
Alternative outcomes
 April 3 to April 8RR = 0.9795% CI, 0.91–1.04; P = .36
 April 3 to April 9RR = 0.9695% CI, 0.90–1.03; P = .26
 April 3 to April 10RR = 0.9695% CI, 0.90–1.03; P = .27
 April 3 to April 11RR = 0.9795% CI, 0.91–1.04; P = .30
 April 3 to April 12RR = 0.9795% CI, 0.91–1.03; P = .38

Counts of confirmed covid-19 cases downloaded from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text).

Adjusted for logarithm of population density, proportion female, proportion aged ≥65 y, proportion Black and proportion living below the poverty line, in count model. The zero-inflation model included the intercept only.

Table 10

RRs in Mississippi, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density, state and demographic covariates†)

At-risk period used to define the case countAnalyses using COVID-19 case counts from JHU-CSSE
March 13 to March 18Estimation error
March 13 to March 19RR = 0.9595% CI, 0.85–1.06; P = .37
March 13 to March 20RR = 0.9695% CI, 0.89–1.05; P = .38
March 13 to March 21RR = 0.9695% CI, 0.85–1.07; P = .46
March 13 to March 22RR = 0.9795% CI, 0.91–1.03; P = .38
March 13 to March 23RR = 0.9795% CI, 0.91–1.03; P = .31
March 13 to March 24RR = 0.9595% CI, 0.90–1.01; P = .12
March 13 to March 25RR = 0.9695% CI, 0.90–1.01; P = .12
Alternative Outcomes
 April 3 to April 9RR = 0.9795% CI, 0.91, 1.04; P = .37
 April 3 to April 10RR = 0.9695% CI, 0.97, 1.03; P = .26
 April 3 to April 11RR = 0.9695% CI, 0.90, 1.03; P = .27
 April 3 to April 12RR = 0.9795% CI, 0.91–1.03; P = .30

Counts of confirmed COVID-19 cases from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text).

Adjusted for logarithm of population density, proportion female, proportion aged ≥ 65 y, proportion Black and proportion living below the poverty line, in the count model. The zero-inflation model included the intercept only.

RRs for all states measuring the association of voter turnout with COVID-19 risk (We defined the outcome [case-count] using different at-risk periods and adjusted for population density and state and demographic covariates†) Counts of confirmed covid-19 cases from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text). Adjusted for state, logarithm of population density, proportion female, proportion aged ≥65 y, proportion Black and proportion living below the poverty line, in count model. The zero-inflation model included the intercept only. RRs in Michigan, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density, state and demographic covariates†) Counts of confirmed COVID-19 cases from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text). Adjusted for logarithm of population density, proportion female, proportion ages ≥65 y, proportion Black and proportion living below the poverty line, in count model. The zero-inflation model included the intercept only. RRs in Missouri, measuring the association of voter turnout with covid-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density, state and demographic covariates†) Counts of confirmed covid-19 cases downloaded from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text). Adjusted for logarithm of population density, proportion female, proportion aged ≥65 y, proportion Black and proportion living below the poverty line, in count model. The zero-inflation model included the intercept only. RRs in Mississippi, measuring the association of voter turnout with COVID-19 risk (we defined the outcome [case-count] using different at-risk periods and adjusted for population density, state and demographic covariates†) Counts of confirmed COVID-19 cases from GitHub managed by Johns Hopkins University Center for Systems Science and Engineering (see main text). Adjusted for logarithm of population density, proportion female, proportion aged ≥ 65 y, proportion Black and proportion living below the poverty line, in the count model. The zero-inflation model included the intercept only. To control for potential confounding of the voter turnout-COVID-19 association, we generated a list of variables that were suspected risk factors for COVID-19 infection. The list included state and 10 county-level population characteristics: density, prevote COVID-19 risk, percent female, percent Black, percent older than 65 years, percent “poor” (living below the federal poverty line), percent obese, percent smokers, percent with a college education, and percent with a high school education. From this list, we selected a priori, the most important risk factors for COVID-19 that may also influence county-level voter turnout; these were, in addition to state, county population density, percent female, percent Black, percent older than 65 years, and percent poor. Descriptive statistics were computed to characterize the distributions of the counts of postpolling cases, voter turnout, and covariates. Simple linear regression was used to describe the association of voter turnout with the postvote COVID-19 risk (Fig. 1 ). The primary analyses used a zero-inflated negative binomial regression model to account for a more-than-expected number of counties with a 0 count and because of improved fit compared with Poisson models (based on corrected Akaike Information Criterion and Pearson's χ2). The logarithm of the population size was an offset in all models.
Fig. 1

Graph of county-specific turnout and case rate1. 1Line fit by least squares, descriptive only.

Graph of county-specific turnout and case rate1. 1Line fit by least squares, descriptive only.

Alternative outcomes

We reasoned that if the association of voter turnout with COVID-19 occurrence in the postvote period was attributable to uncontrolled confounding, then that association should persist even if we redefined the outcome as cases occurring in risk periods (e.g., in early April) that did not overlap substantially with the time interval of interest (the incubation period plus some allowance for testing and reporting). That is, if confounding (e.g., behavioral patterns, pre-existing disease, and other risk factors) explained the observed association, we would expect the association to persist, likely not substantially weaker, even long after the polling. In contrast, if the association were causal, we would expect a meaningfully weaker or no association for intervals that started well after the incubation period. The Online Supplement further discusses “alternative” outcomes, their similarity to and relationship with negative control outcomes that motivates them [29]. Events during the alternative risk periods are “alternative outcomes” rather than “negative control outcomes” because these “alternative outcomes” could still be weakly affected by voting patterns. These alternative outcomes are the COVID-19 counts during each of six periods beginning April 3, more than 3 weeks after the elections. In Michigan, we use the by-mail voter turnout as a negative control exposure, as discussed in the Online Supplement [[29], [30], [31]]. Zero-inflated models allow for the possibility that a separate statistical process can account for an excess of counties with no cases—more than expected under a negative binomial distribution alone. In the JHU-CSSE data, only one county (Missouri) reported prevote cases, and it also had postvote cases, making prevote cases a strong predictor of not being in the zero-class (part of the zero-inflated model). Therefore, we excluded that county from the main analyses, although when it was included in supplemental analyses, the results were much like those obtained without it (Supplemental Table 3C). The results of each analysis are expressed as a risk ratio (RR) representing the average difference in postelection COVID-19 risk per 1% difference in voter turnout. RRs are accompanied by 95% confidence intervals (CIs) and corresponding P values. Regression diagnostics include assessing the correlation between the independent variables, residual analyses, sensitivity analyses, and identification of potentially influential points. Analyses were done using SAS version 9.4 (SAS Institute, Cary, NC) and R version 4.0. To assess the sensitivity of results to model specification and residual confounding, we conducted two main types of sensitivity analyses (see Online Supplement). First, we used a different model in which we defined ordinal outcomes by grouping county-specific COVID-19 risks and assumed a multinomial distribution with a cumulative logit link. Second, we allowed for within-state correlation of county rates and controlled for additional covariates using a random-effects, zero-inflated negative binomial model.

Results

COVID-19 counts obtained from the two sources, JHU-CSSE and USAFacts, were highly correlated (e.g., r > 0.99) but not identical. For example, from March 13 to March 23, 1668 cases were reported using JHU-CSSE data, and 704 cases were reported using USAFacts data. Our results are similar regardless of the data source, so we primarily focus on the JHU-CSSE data. Only St. Louis County, MO, had reported cases COVID-19 cases before March 10 in the JHU-CSSE data. In the postelection risk periods (e.g., March 13 to March 23), Michigan had more cases than Missouri and Mississippi, averaging more than 15 per county. States had different county-level population densities (Table 2). Michigan counties have, on average, about 190 people per square mile, whereas Mississippi counties average about 62 people per square mile. Voter turnout also varied noticeably across counties (Table 2), often higher in Michigan and Mississippi counties than in Missouri counties.
Table 2

Summary statistics of key variables∗

Michigan (n = 83)
VariablePostvote casesPostvote cases (USA)Cases per 100,000Cases per 100,000 (USA)TurnoutAgeBlackFemaleDensityPovertyPrevalence of smokingPrevalence of obesity
Mean15.934.302.431.640.150.220.040.50189.160.140.180.34
SD80.1320.125.643.170.040.050.060.02409.550.040.020.04
Median
0.00
0.00
0.00
0.00
0.14
0.20
0.01
0.50
59.60
0.14
0.18
0.34
Missouri (n = 115)
Variable
Postvote cases
Postvote cases (USA facts)
Cases per 100,000
Cases per 100,000 (USA)
Turnout
Age
Black
Female
Density
Poverty
Prevalence of smoking
Prevalence of obesity
Mean0.850.940.830.820.140.200.040.50131.300.160.210.33
SD2.873.601.911.92.030.040.060.02523.100.050.020.04
Median
0.00
0.00
0.00
0.00
0.13
0.19
0.01
0.50
31.00
0.16
0.20
0.33
Mississippi (n = 82)
Variable
Postvote cases
Postvote cases (USA facts)
Cases per million
Cases per million (USA facts)
Turnout
Age
Black
Female
Density
Poverty
Prevalence of smoking
Prevalence of obesity
Mean3.023.027.937.930.200.170.420.5162.240.230.20.38
SD4.824.825.399.720.050.030.210.0264.030.070.030.05
Median1.001.009.725.340.190.170.380.5245.050.220.20.38

Prevalence of “Obesity” represents the proportion of county residents who are obese, “Age” the proportion who are aged ≥65 y, “Poverty” represents the proportion who are below the federal poverty line, and “Prevalence of Smoking” represent the proportion of adults who smoke in the county. “Density” represents the number of people per square mile in the county.

Postvote cases are confirmed covid-19 cases, listed for dates between March 13 and March 23, by either Johns Hopkins University Center for Systems Science and Engineering or by USAFacts (denoted “USA” in the table) or on their respective websites [18,19] of main text. Excludes one county (JHU-CSSE) or three counties (USAFacts) with reported prevote cases.

Voter turnout was associated with COVID-19 risks in the unadjusted analyses (Fig. 1). After adjustment for population density, the association differed by state (Table 3, Table 4, Table 5, Table 6; the interaction test results are given in the following paragraph). The association was strongest in Michigan, especially for the more restricted intervals soon after the election and was progressively weaker for longer intervals (Table 4). The association was weaker in Missouri than in Michigan and essentially null in Mississippi (Table 5, Table 6), where most of the RRs were 1.0 or less for both the main and the alternative outcomes. After additionally controlling for percent female, percent over age 65 years, percent Black, and percent below the poverty line and state, voter turnout was associated with risk, considering all states together (Tables 7). However, the association with turnout varied by state (for most of the main outcomes, the P value for interaction was less than .05 by likelihood ratio test). Therefore, we present state-specific results. With control for these same a priori variables, Michigan turnout was associated with higher COVID-19 risk in most of the risk periods soon after the election (Table 8). Many RRs were as large or larger after this additional adjustment, although the CIs were wider. Nevertheless, the lower bound of the CI was greater than one for most risk periods, and the previously observed pattern, with RRs tending to be closer to 1.0 for longer at-risk intervals, persisted after the additional adjustment. In Mississippi, the association was consistent with the null (Table 10), and in Missouri, RRs for the main outcome ranged from 0.99 to over 1.1 (Table 9). In contrast to Michigan, the RRs tended to be larger with the longer at-risk intervals (e.g., March 13 to March 23). To assess the pattern of risk, we grouped counties into tertiles based on voter turnout. In Michigan, the risk increased monotonically in most intervals with the tertile of voter turnout (Supplemental Table 1). In Missouri and Mississippi, patterns were not monotonic but consistent with no association (Online Supplement). The patterns were consistent with an approximate, linear relationship supporting the use of a linear term to represent voter turnout in the models (further detail is given in the Online Supplement).

Alternative outcomes

In the alternative outcome analyses, we defined postvoting cases as those occurring in several periods starting on April 3. Controlling for the same variables as in the a priori model, each of the RRs was close to 1.0 (bottom rows of Table 7, Table 8, Table 9), and all were consistent with no association. The results of the supplemental analyses were generally consistent with the main results (Online Supplement). For example, for the March 13 to March 20 risk period in Michigan using ordinal logistic regression, the odds ratio relating voter turnout and COVID-19 risk was 1.13 (95% CI, 0.97–1.32; P = .11). In other words, for this risk period, the estimated odds that a county had a particular risk level or higher, relative to those odds for a county where the voter turnout was about 1 percentage point lower was 1.13, consistent with a substantial positive association. Alternatively, we adjusted for additional covariates (proportions with college education, with a high school education, who smoke and who are obese) using random-effects, zero-inflated, negative binomial models and obtained RRs consistent with those in Table 7, Table 8. (Some supplemental analyses, however, involved models with relatively few observations per parameter, so we view them as secondary; Online Supplement).

Discussion

Our results differ by state. For Michigan, to a lesser extent for Missouri and not at all for Mississippi, they suggest that counties with a larger voter turnout had higher COVID-19 risks over an approximate 1- to 2-week period beginning a few days after the voting. Our negative control exposure analyses do not permit a definite conclusion. Initial analyses identified positive associations of risk with the negative control, which could indicate confounding, but the associations disappeared or reversed with the exclusion of one influential county (Online Supplement). The results are compatible with either some residual confounding or with circumstantial events (cases) in a single county and no residual confounding. It is important to consider possible reasons that might explain the heterogeneity of the association. One possibility is that Mississippi, where no association was seen, and Missouri, where a weak or minimal association was seen, had few infectious cases on March 10. If so, we would expect to see little or no association with voting in these states. This hypothesis is plausible because the number of cases in the JHU-CSSE data was five-fold to 10- or more fold greater in Michigan than in the other two states during the first weeks after the election. However, we cannot dismiss other possibilities such as greater confounding in Michigan, use of overall voter turnout as a surrogate for in-person voting in Mississippi and Missouri, differences in social distancing, or the role of chance. Our analyses for Michigan suggest a substantial increase in risk may be associated with higher voter turnout for part of the 2-week risk period after the election, perhaps as much as 20% (median RR, for the main outcomes in Table 8, is 1.2). We view this estimate as very approximate because of fairly wide CIs, more moderate RRs in some models (Online Supplement), and its model dependency. Our results also suggest no increase in Mississippi and little, if any, increase in Missouri. The increase in risk we observed in Michigan was predominantly restricted to the 1–2 weeks after March 13, lending strength to our findings. Importantly the increase was small or absent, either when we included additional days or defined outcome using periods starting in April (alternative outcome analyses). Although the chain of transmission attributable to the voting would be expected to continue after the early postvote period, the effect of voting should be less apparent because its contribution relative to other factors influencing community spread should diminish. We expect the increases would become more diffuse and less county-specific with increasing time, a pattern compatible with our observations. In analogy with negative control outcomes [29], the weak to null association with the alternative outcomes provides support for the interpretation that residual confounding was not important. An important limitation of our study is the absence of individual-level data and contact tracing. However, our purpose was not to assess the association between an individual's participation in voting and COVID-19 risk. Rather, we sought to assess population-level differences in COVID risks that can be attributed to different extents of population participation in a single event. We acknowledge that without individual-level data, we cannot adjust for patterns of risk within counties that depend on the joint distribution of covariates or for unknown or unmeasured confounders that differ across counties [32,33]. A second limitation is that voter turnout imperfectly measures the proportion of the population going to the polls and our direct measure of in-person voting is only in Michigan. (However, this difference in the type of information may have had a modest impact: when we used overall voter turnout in place of in-person turnout in Michigan, the RRs for the main outcomes were roughly 25% closer to the null, but still meaningfully elevated; data not shown.) A further limitation is that particularly for state-specific estimates, our ability to control for confounders was limited by the number of observations (counties). These limitations notwithstanding, the weak to absent associations with the alternative outcomes in Michigan and the pattern of effects, with greater increases, observed soon after the election followed by smaller increases, as the intervals of study expanded provide some evidence, although indirect, that residual confounding or ecologic bias may not be important threats to validity of the observed results. In Missouri, the lack of a consistent pattern and an association of turnout with an alternative outcome in supplemental analyses (Online Supplement) suggest that the observed associations there may reflect chance, residual confounding, or some other phenomenon driving the epidemic. In summary, we reiterate concerns noted in an open letter from multiple public health officials to the U.S. Senate and House of Representatives [34] that going to the polls in an election can be associated with increased risk of SARS-CoV-2 transmission. Although our study of the March 10 primary elections had limitations, the results are consistent with the concern that higher in-person voter turnout may have led to increases in local risk of infection in at least one state. Depending on the situation as the next vote nears, voters may wish to consider taking advantage of absentee ballots or other available voting options.
  25 in total

1.  Negative controls: a tool for detecting confounding and bias in observational studies.

Authors:  Marc Lipsitch; Eric Tchetgen Tchetgen; Ted Cohen
Journal:  Epidemiology       Date:  2010-05       Impact factor: 4.822

Review 2.  Invited commentary: ecologic studies--biases, misconceptions, and counterexamples.

Authors:  S Greenland; J Robins
Journal:  Am J Epidemiol       Date:  1994-04-15       Impact factor: 4.897

3.  Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus-Infected Pneumonia.

Authors:  Qun Li; Xuhua Guan; Peng Wu; Xiaoye Wang; Lei Zhou; Yeqing Tong; Ruiqi Ren; Kathy S M Leung; Eric H Y Lau; Jessica Y Wong; Xuesen Xing; Nijuan Xiang; Yang Wu; Chao Li; Qi Chen; Dan Li; Tian Liu; Jing Zhao; Man Liu; Wenxiao Tu; Chuding Chen; Lianmei Jin; Rui Yang; Qi Wang; Suhua Zhou; Rui Wang; Hui Liu; Yinbo Luo; Yuan Liu; Ge Shao; Huan Li; Zhongfa Tao; Yang Yang; Zhiqiang Deng; Boxi Liu; Zhitao Ma; Yanping Zhang; Guoqing Shi; Tommy T Y Lam; Joseph T Wu; George F Gao; Benjamin J Cowling; Bo Yang; Gabriel M Leung; Zijian Feng
Journal:  N Engl J Med       Date:  2020-01-29       Impact factor: 176.079

4.  COVID-19 control in China during mass population movements at New Year.

Authors:  Simiao Chen; Juntao Yang; Weizhong Yang; Chen Wang; Till Bärnighausen
Journal:  Lancet       Date:  2020-02-24       Impact factor: 79.321

5.  COVID-19 - the role of mass gatherings.

Authors:  Shahul H Ebrahim; Ziad A Memish
Journal:  Travel Med Infect Dis       Date:  2020-03-09       Impact factor: 6.211

6.  Incubation Period and Other Epidemiological Characteristics of 2019 Novel Coronavirus Infections with Right Truncation: A Statistical Analysis of Publicly Available Case Data.

Authors:  Natalie M Linton; Tetsuro Kobayashi; Yichi Yang; Katsuma Hayashi; Andrei R Akhmetzhanov; Sung-Mok Jung; Baoyin Yuan; Ryo Kinoshita; Hiroshi Nishiura
Journal:  J Clin Med       Date:  2020-02-17       Impact factor: 4.241

7.  An interactive web-based dashboard to track COVID-19 in real time.

Authors:  Ensheng Dong; Hongru Du; Lauren Gardner
Journal:  Lancet Infect Dis       Date:  2020-02-19       Impact factor: 25.071

Review 8.  The SARS-CoV-2 outbreak: What we know.

Authors:  Di Wu; Tiantian Wu; Qun Liu; Zhicong Yang
Journal:  Int J Infect Dis       Date:  2020-03-12       Impact factor: 3.623

9.  Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study.

Authors:  Fei Zhou; Ting Yu; Ronghui Du; Guohui Fan; Ying Liu; Zhibo Liu; Jie Xiang; Yeming Wang; Bin Song; Xiaoying Gu; Lulu Guan; Yuan Wei; Hui Li; Xudong Wu; Jiuyang Xu; Shengjin Tu; Yi Zhang; Hua Chen; Bin Cao
Journal:  Lancet       Date:  2020-03-11       Impact factor: 79.321

10.  Only strict quarantine measures can curb the coronavirus disease (COVID-19) outbreak in Italy, 2020.

Authors:  Henrik Sjödin; Annelies Wilder-Smith; Sarah Osman; Zia Farooq; Joacim Rocklöv
Journal:  Euro Surveill       Date:  2020-04
View more
  6 in total

1.  COVID-19 pandemic and political participation in Lagos, Nigeria.

Authors:  Cletus Famous Nwankwo
Journal:  SN Soc Sci       Date:  2021-06-03

2.  A cost-effective plan for global testing - an infection rate stratified, algorithm guided, multiple-level, continuously pooled testing strategy.

Authors:  Tianshu Gu; Lan Yao; Xia Meng; J Carolyn Graff; Donald Thomason; Jing Li; Wei Dong; Yan Jiao; Lotfi Aleya; Marcello Maida; Cong-Yi Wang; Barbara Zangerl; Sem Genini; Kunal Ray; Emanuel Goldman; Jiafu Ji; Andrei V Alexandrov; Dianjun Sun; Weikuan Gu; Yongjun Wang
Journal:  Sci Total Environ       Date:  2020-12-24       Impact factor: 7.963

3.  Communicating safety precautions can help maintain in-person voter turnout during a pandemic.

Authors:  Eric Merkley; Thomas Bergeron; Peter John Loewen; Angelo Elias; Miriam Lapp
Journal:  Elect Stud       Date:  2021-11-17

4.  Effect of meteorological factors on the COVID-19 cases: a case study related to three major cities of the Kingdom of Saudi Arabia.

Authors:  Anam Iqbal; Wajiha Haq; Tahir Mahmood; Syed Hassan Raza
Journal:  Environ Sci Pollut Res Int       Date:  2021-11-12       Impact factor: 5.190

5.  Voting in a global pandemic: Assessing dueling influences of Covid-19 on turnout.

Authors:  Sara M Constantino; Alicia D Cooperman; Thiago M Q Moreira
Journal:  Soc Sci Q       Date:  2021-09-07

6.  Predictors of Death Rate during the COVID-19 Pandemic.

Authors:  Ian Feinhandler; Benjamin Cilento; Brad Beauvais; Jordan Harrop; Lawrence Fulton
Journal:  Healthcare (Basel)       Date:  2020-09-14
  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.