Literature DB >> 32645347

Prevalence of SARS-CoV-2 in Spain (ENE-COVID): a nationwide, population-based seroepidemiological study.

Marina Pollán1, Beatriz Pérez-Gómez2, Roberto Pastor-Barriuso2, Jesús Oteo3, Miguel A Hernán4, Mayte Pérez-Olmeda5, Jose L Sanmartín6, Aurora Fernández-García7, Israel Cruz8, Nerea Fernández de Larrea2, Marta Molina9, Francisco Rodríguez-Cabrera8, Mariano Martín6, Paloma Merino-Amador10, Jose León Paniagua11, Juan F Muñoz-Montalvo6, Faustino Blanco9, Raquel Yotti12.   

Abstract

BACKGROUND: Spain is one of the European countries most affected by the COVID-19 pandemic. Serological surveys are a valuable tool to assess the extent of the epidemic, given the existence of asymptomatic cases and little access to diagnostic tests. This nationwide population-based study aims to estimate the seroprevalence of SARS-CoV-2 infection in Spain at national and regional level.
METHODS: 35 883 households were selected from municipal rolls using two-stage random sampling stratified by province and municipality size, with all residents invited to participate. From April 27 to May 11, 2020, 61 075 participants (75·1% of all contacted individuals within selected households) answered a questionnaire on history of symptoms compatible with COVID-19 and risk factors, received a point-of-care antibody test, and, if agreed, donated a blood sample for additional testing with a chemiluminescent microparticle immunoassay. Prevalences of IgG antibodies were adjusted using sampling weights and post-stratification to allow for differences in non-response rates based on age group, sex, and census-tract income. Using results for both tests, we calculated a seroprevalence range maximising either specificity (positive for both tests) or sensitivity (positive for either test).
FINDINGS: Seroprevalence was 5·0% (95% CI 4·7-5·4) by the point-of-care test and 4·6% (4·3-5·0) by immunoassay, with a specificity-sensitivity range of 3·7% (3·3-4·0; both tests positive) to 6·2% (5·8-6·6; either test positive), with no differences by sex and lower seroprevalence in children younger than 10 years (<3·1% by the point-of-care test). There was substantial geographical variability, with higher prevalence around Madrid (>10%) and lower in coastal areas (<3%). Seroprevalence among 195 participants with positive PCR more than 14 days before the study visit ranged from 87·6% (81·1-92·1; both tests positive) to 91·8% (86·3-95·3; either test positive). In 7273 individuals with anosmia or at least three symptoms, seroprevalence ranged from 15·3% (13·8-16·8) to 19·3% (17·7-21·0). Around a third of seropositive participants were asymptomatic, ranging from 21·9% (19·1-24·9) to 35·8% (33·1-38·5). Only 19·5% (16·3-23·2) of symptomatic participants who were seropositive by both the point-of-care test and immunoassay reported a previous PCR test.
INTERPRETATION: The majority of the Spanish population is seronegative to SARS-CoV-2 infection, even in hotspot areas. Most PCR-confirmed cases have detectable antibodies, but a substantial proportion of people with symptoms compatible with COVID-19 did not have a PCR test and at least a third of infections determined by serology were asymptomatic. These results emphasise the need for maintaining public health measures to avoid a new epidemic wave. FUNDING: Spanish Ministry of Health, Institute of Health Carlos III, and Spanish National Health System.
Copyright © 2020 Elsevier Ltd. All rights reserved.

Entities:  

Mesh:

Substances:

Year:  2020        PMID: 32645347      PMCID: PMC7336131          DOI: 10.1016/S0140-6736(20)31483-5

Source DB:  PubMed          Journal:  Lancet        ISSN: 0140-6736            Impact factor:   79.321


Introduction

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) was identified in December, 2019, as the cause of the illness designated COVID-19. With more than 249 000 confirmed cases and more than 28 000 deaths by July 2, Spain remains one of the European countries most severely affected by the ongoing COVID-19 pandemic.2, 3 However, epidemiological surveillance of confirmed COVID-19 cases captures only a proportion of all infections because the clinical manifestations of infection with SARS-CoV-2 range from severe disease, which can lead to death, to asymptomatic infection. By contrast, a population-based seroepidemiological survey can quantify the proportion of the population that has antibodies against SARS-CoV-2. A seroepidemiological study provides information on the proportion of the population exposed and, if the antibodies are a marker of total or partial immunity, the proportion of the population that remains susceptible to the virus. Several serological surveys of SARS-CoV-2 have been done4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15 and others are ongoing. However, many of them are small or based on non-random sampling of participants (eg, focusing on health-care workers or blood donors) and thus cannot provide precise estimates of seroprevalence by age group in the general population. Additionally, some of these studies have used antibody tests with low sensitivity or specificity or have not reported the characteristics of the test. Evidence before this study Spain is one of the European countries most affected by the COVID-19 pandemic so far. Seroepidemiological surveys are a useful tool to track the transmission of epidemics, but few have been done for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). We searched PubMed and its specific hub LitCovid, OpenAIRE, Embase, and medRxiv and bioRxiv preprint servers up to May 25, 2020, for epidemiological studies using the terms “seroprevalence” or “seroepidemiology” and “SARS-CoV-2” without date or language restrictions. Most serological surveys were fairly small or focused on specific population subgroups. Large population-based studies are required to understand the dynamics of the epidemic. Added value of this study This is the first nationwide population-based study that presents seroprevalence estimates of antibodies against SARS-CoV-2 at national and regional levels, exploring the landscape of population immunity in Spain. With more than 61 000 participants, this study provides accurate prevalence figures according to sex, age—from babies to nonagenarians—and selected risk factors. Our findings confirm that at least a third of individuals who have developed antibodies against SARS-CoV-2 were asymptomatic. Additionally, our results indicate that children and adolescents have lower seroprevalence than adults and seroprevalence does not vary by sex. Our study confirms that a high-quality point-of-care test could be a good choice for large seroepidemiological studies. The rapid test used here showed good performance compared with a chemiluminescent microparticle immunoassay. Finally, the use of two different assays allowed us to define seroprevalence ranges alternatively favouring specificity (requiring a positive result for both tests) or sensitivity (positive to either test). Implications of all the available evidence The relatively low seroprevalence observed in the context of an intense epidemic in Spain might serve as a reference to other countries. At present, herd immunity is difficult to achieve without accepting the collateral damage of many deaths in the susceptible population and overburdening of health systems. Our results, together with previous evidence, suggest that approximately a third of people with SARS-CoV-2 infection remain asymptomatic, which has important public health implications. Regional seroprevalence data offer valuable information to tailor public health policies against this epidemic. In April, 2020, the Spanish Ministry of Health and the Institute of Health Carlos III, in collaboration with the health services of the Spanish regions (Autonomous Communities), launched ENE-COVID, a nationwide, population-based, longitudinal seroepidemiological study, to quantify the extent of SARS-CoV-2 circulation throughout the country. The study included more than 61 000 individuals from randomly selected households; was designed to be representative by province, age group, and sex; and used two tests for the determination of SARS-CoV-2 antibodies. Here, we describe the study design and the results of the first wave of the study, conducted between April 27 and May 11, 2020.

Methods

Study design and participants

The Seroepidemiological Survey of SARS-CoV-2 Virus Infection in Spain (Encuesta Seroepidemiológica de la Infección por el Virus SARS-CoV-2 en España; ENE-COVID) is a nationwide population-based cohort study to investigate seropositivity for SARS-CoV-2 in the non-institutionalised (ie, excluding care-home residents, hospitalised people, people in prisons, nuns and friars in convents, and residents in other collective residences) Spanish population. The study design is described in detail in the appendix (pp 6–10). Briefly, 35 883 households were selected through a stratified two-stage sampling, with strata formed by cross-classifying the 50 Spanish provinces and the two autonomous cities (appendix p 19) with municipalities grouped by size (<5000, 5000–19 999, 20 000–99 999, and ≥100 000 residents). 1500 census tracts were initially selected with probability proportional to their size, and then 24 households were randomly sampled within each selected census tract by the National Institute of Statistics. All residents in the household were invited to participate in the study, resulting in a selected sample of 102 562 individuals of all ages. This study involved the coordination and training of 29 laboratories and 4400 health professionals in 1409 health-care centres throughout the Spanish National Health System. A single ad-hoc information system capable of hosting up to 2000 concurrent users was developed and deployed in approximately 2 weeks to allow daily data modification by study staff for 4000 households and 15 000 participants, alongside the coordination and development of uniform, nationwide support for the study procedures. The study design includes three successive follow-up waves of data collection, with a 1-week break between them. Each wave is scheduled to be completed within 2 weeks. Half of the cohort (12 households per census tract) was randomly assigned to data collection during the first week of each wave and the other half to the second week, so that serum specimens are collected in all participants 2–4 weeks apart. In this Article, we present seroprevalence data from the first wave of the ENE-COVID study, which was conducted from April 27 to May 11, 2020. Field work was carried out by staff from each of the region's health services under a common protocol developed by the Institute of Health Carlos III, which also coordinated the training of all personnel via a web platform. Individuals residing in the selected households were contacted by telephone and invited to either go to their primary health-care centres or to allow a home visit, where they provided informed consent. Participants answered a questionnaire that included history of symptoms compatible with COVID-19 (ie, fever, chills, severe tiredness, sore throat, cough, shortness of breath, headache, anosmia or ageusia, and nausea, vomiting, or diarrhoea), contact with suspected or confirmed cases, and other risk factors; had a point-of-care rapid test to detect antibodies against SARS-CoV-2; and, optionally, donated a blood sample for subsequent laboratory analysis. The answers to the questionnaire and the result of the point-of-care test were recorded on site in a secure web application, specifically designed for this study by the Ministry of Health. Blood samples were centrifuged, labelled, and stored refrigerated at the primary health-care centres, and sent to the laboratory every 2–3 days. Serum samples were analysed at the National Centre for Microbiology (Institute of Health Carlos III) or in one of 28 selected regional microbiology laboratories. The Institutional Review Board of the Institute of Health Carlos III approved the study (register number PI 39_2020). The Spanish Data Protection Agency was consulted. Written informed consent was obtained from all study participants. Different forms of informed consent were used for adults, teenagers, parents of participant children, and guardians of mentally disabled participants. Witnesses assisted participants who were not able to read any of the four official languages of Spain.

Detection of SARS-CoV-2 antibodies

Two serological tests were done: a point-of-care rapid test applied directly to fingerprick blood, and a chemiluminescent microparticle immunoassay that requires venepuncture for subsequent analysis in laboratory. The point-of-care test (Orient Gene Biotech COVID-19 IgG/IgM Rapid Test Cassette; Zhejiang Orient Gene Biotech, Zhejiang, China; reference GCCOV-402a) was a lateral-flow immunochromatographic assay for qualitative differentiation between IgG and IgM against the receptor binding domain of SARS-CoV-2 spike (S) protein, which yields results in 10 min. The manufacturer reported sensitivity of 97·2% for IgG and 87·9% for IgM and specificity of 100% for both IgG and IgM, using RT-PCR as the gold standard. A verification study, done by the National Centre for Microbiology as preparation for ENE-COVID, returned a sensitivity of 82·1% for IgG and 69·6% for IgM in fingerprick blood samples and a specificity of 100% for IgG and 99·0% for IgM (appendix p 11). An independent validation study gave similar results. Due to the lower sensitivity and specificity of IgM, its shorter duration, and the heterogeneity of results observed in initial IgM readings, results for the point-of-care test reported here are based only on IgG. The second test was a chemiluminescent microparticle immunoassay for qualitative detection of IgG against SARS-CoV-2 nucleoprotein (SARS-CoV-2 IgG for use with ARCHITECT; Abbott Laboratories, Abbott Park, IL, USA; reference 06R8620). We chose this immunoassay test after studying several high-performance serological kits at the National Centre for Microbiology, including ELISA and chemiluminescent immunoassays. The amount of IgG antibodies to SARS-CoV-2 in each sample is determined by comparing its chemiluminescent relative light unit (RLU) to the calibrator RLU (index S/C). Using an index S/C threshold of 1·4, the manufacturer reported a sensitivity of 86·4% after 7 days from symptom onset and 100% after 14 days, and a specificity of 99·6%, using RT-PCR as the gold standard. These figures were corroborated by a study in a set of samples from patients positive for SARS-CoV-2 by RT-PCR and in samples obtained in 2018–19, and thus before the epidemic (sensitivity of 100% after 17 days from symptom onset, specificity of 99·9%). Again, a verification study by the National Centre for Microbiology showed a sensitivity of 89·7% in serum samples from RT-PCR-positive patients after 14 days from symptom onset and a specificity of 100% with samples obtained before Dec 8, 2019 (appendix p 12).

Statistical analysis

We estimated seroprevalence as the proportion of individuals who had a positive result in the IgG band of the point-of-care test or, in separate analyses, who had a positive result in the immunoassay. In sensitivity analyses restricted to participants with data on both tests, we estimated seroprevalence as the proportions of individuals who had a positive result in both tests (most specific approach) or in either test (most sensitive approach). We used these analyses to provide a seroprevalence range that either favours specificity (requiring a positive test in both assays) or sensitivity (considering positive results in either test). Using the immunoassay as an alloyed reference, we also estimated the relative sensitivity of the point-of-care test as the proportion of individuals with a positive test among those with a positive result in the immunoassay, as well as the relative specificity as the proportion of individuals with a negative test among those with a negative result in the immunoassay. Sample size was determined to achieve a minimum precision in the estimation of SARS-CoV-2 seroprevalence in all Spanish provinces, assuming a priori an underlying crude seroprevalence of 5% or higher during the study period, and accounting for non-response and potential clustering of seropositivity by household and census tract. Further details on sample size determination and within-province sampling are provided in the appendix (pp 6–7). We used sampling weights to adjust the seroprevalence estimates for the different selection probabilities (individuals from less populated provinces were oversampled; appendix pp 8–10) and the distinct non-response rates to the point-of-care test and the immunoassay by sociodemographic characteristics (appendix pp 13, 20). Base design weights were initially calculated as the inverse of the sampling fractions within each province and municipality size stratum, which were further adjusted for non-response by post-stratifying the sample on income (lower or higher than the province-specific median), sex, and age group (<20, 20–34, 35–49, 50–64, or ≥65 years), so that the weighted sum of respondents in each stratum matched the known population total. Different sampling weights were constructed for the point-of-care test and the immunoassay, with trimmed extreme weights (0·2% and 0·6%, respectively) to counter highly influential observations. The weights for the immunoassay were also used for the sensitivity analysis combining both tests. Due to the complex study design, all statistical analyses accounted for stratification by province and municipality size group, as well as clustering of seropositivity for SARS-CoV-2 by household and census tract, when computing SEs of seroprevalence estimates. Design effects resulted in inflation factors for SEs of the overall seroprevalence estimates with the point-of-care test of 2·00 and of 1·99 for the immunoassay. Finite population corrections were applied because some sampling fractions of census tracts per stratum and households per census tract were not negligible. 95% CIs were calculated using logit-transformed seroprevalence estimates and their SEs, with the usual design-based degrees of freedom equal to the number of first-stage sampling units minus the number of strata, and were back-transformed to the original scale for reporting. Analyses were done using survey commands in Stata (version 16).

Role of the funding source

The funders facilitated data acquisition but had no role in the design, analysis, interpretation, or writing. The first three authors had full access to all the data. The first five authors and the senior author (RY) had final responsibility for the decision to submit for publication.

Results

Of 95 699 eligible individuals, 14 405 could not be contacted and 14 489 declined to participate (figure 1 ). Of the remaining 66 805 study participants, 61 075 participants received the point-of-care test (63·8% of eligible individuals and 75·1% of 81 294 contacted individuals) and 51 958 the immunoassay (54·3% and 63·9%, respectively; figure 1). The proportion of testing was lower in individuals aged 25–29 years and older than 65 years (and in individuals aged <15 years for the immunoassay), in middle-aged men compared with middle-aged women, and in lower income levels (appendix p 13).
Figure 1

Flow chart of participants in first wave of the ENE-COVID study

*Care-home residents, hospitalised people, people in prisons, nuns and friars in convents, and residents in other collective residences.

Flow chart of participants in first wave of the ENE-COVID study *Care-home residents, hospitalised people, people in prisons, nuns and friars in convents, and residents in other collective residences. Between April 27 and May 11, 2020, seroprevalence for the entire country was 5·0% (95% CI 4·7–5·4) by the point-of-care test and 4·6% (4·3–5·0) by immunoassay (table 1 ); the seroprevalence specificity–sensitivity range was 3·7% (3·3–4·0; both tests positive) to 6·2% (5·8–6·6; either test positive). Estimates varied markedly across provinces (figure 2 ; appendix pp 14–15). In seven provinces in the central part of Spain, including Madrid, seroprevalence was greater than 10% by both the point-of-care test and immunoassay separately (figure 2). In provinces along the coast, seroprevalence was greater than 5% only in Barcelona (appendix pp 14–15). Seroprevalence estimates were similar for both tests. Alternative definitions of seroprevalence (either favouring sensitivity or specificity) did not change the ranking of the provinces (appendix pp 14–15, 21).
Table 1

Seroprevalence of SARS-CoV-2 by general characteristics

Point-of-care test
Immunoassay
Number of participantsSeroprevalence (95% CI)Number of participantsSeroprevalence (95% CI)
Overall61 0755·0% (4·7–5·4)51 9584·6% (4·3–5·0)
Sex
Female31 7265·0% (4·7–5·5)27 1414·6% (4·2–5·0)
Male29 3495·0% (4·6–5·4)24 8174·6% (4·2–5·0)
Age, years
0–1911 4223·4% (2·9–3·9)65273·8% (3·2–4·6)
20–3484694·4% (3·7–5·1)75695·0% (4·3–5·8)
35–4914 5325·3% (4·7–5·9)13 3544·9% (4·3–5·5)
50–6415 0945·8% (5·3–6·5)13 9064·7% (4·1–5·3)
≥6511 5586·0% (5·4–6·8)10 6024·5% (3·8–5·3)
Nationality
Spanish57 8585·0% (4·7–5·4)49 5204·6% (4·2–4·9)
Other26435·6% (4·3–7·3)21785·7% (4·3–7·5)
Occupation*
Active worker25 7595·8% (5·3–6·3)23 7635·3% (4·9–5·9)
Unemployed44593·3% (2·6–4·1)39813·5% (2·7–4·6)
Student35504·6% (3·6–5·8)30604·8% (3·8–6·1)
Retired11 8956·0% (5·4–6·8)10 9324·5% (3·8–5·3)
Permanent or temporary disability14764·1% (2·9–5·9)13423·6% (2·4–5·5)
House person33694·3% (3·5–5·4)30333·3% (2·5–4·3)
Unpaid social work493·1% (0·7–11·4)424·5% (1·4–13·6)
Other9654·2% (2·8–6·2)8393·3% (2·1–5·2)
Occupation sector
Telecommuting11 8996·4% (5·7–7·0)10 9475·9% (5·3–6·6)
Retail16404·7% (3·4–6·6)15154·5% (3·1–6·5)
Transport8005·9% (3·9–8·7)7315·8% (3·6–9·2)
Police, firefighters, or public safety6436·2% (4·1–9·2)5896·3% (4·0–9·9)
Cleaning8044·1% (2·6–6·4)7484·5% (2·9–7·1)
Health care110910·2% (7·9–13·0)104810·0% (7·7–12·9)
Nursing home or other social work10167·7% (5·6–10·5)9477·9% (5·9–10·6)
Home caregiver4036·4% (3·1–12·1)3723·7% (1·6–8·3)
Other74444·3% (3·6–5·0)68653·4% (2·8–4·0)
Household size, residents
148635·1% (4·3–6·0)44564·0% (3·3–5·0)
214 0425·7% (5·1–6·5)12 8945·1% (4·4–5·8)
3–538 9644·8% (4·5–5·3)32 1404·6% (4·2–5·1)
≥632063·8% (2·7–5·3)24683·2% (2·1–4·8)
Census tract income
<5th percentile28655·1% (3·4–7·5)23824·6% (3·1–6·7)
5th to <25th percentile13 2785·0% (4·2–5·9)11 2294·7% (3·8–5·8)
25th to <50th percentile15 3565·0% (4·3–6·0)13 0964·6% (3·9–5·6)
50th to <75th percentile14 0744·8% (4·1–5·6)11 8044·3% (3·6–5·1)
75th to <95th percentile12 1835·0% (4·2–5·9)10 5834·6% (3·7–5·7)
≥95th percentile33196·2% (4·7–8·0)28645·4% (4·0–7·4)
Municipality size, inhabitants
≥100 00018 5306·4% (5·8–7·1)15 9746·0% (5·4–6·7)
20 000–99 99918 5474·2% (3·7–4·7)15 5533·8% (3·3–4·3)
5000–19 99912 9403·7% (3·2–4·4)10 7273·2% (2·7–3·9)
<500011 0584·2% (3·5–5·1)97043·8% (3·0–4·9)

SARS-CoV-2=severe acute respiratory syndrome coronavirus 2.

Among participants aged 17 years or older. Active workers are defined as anyone who is working, regardless of whether they had to leave the house to do so.

Among active workers during lockdown. One worker did not provide the sector.

Categories based on percentiles from province-specific distributions of census tract average income in 2017.

Figure 2

Seroprevalence of SARS-CoV-2 by province by the point-of-care test and immunoassay

SARS-CoV-2=severe acute respiratory syndrome coronavirus 2.

Seroprevalence of SARS-CoV-2 by general characteristics SARS-CoV-2=severe acute respiratory syndrome coronavirus 2. Among participants aged 17 years or older. Active workers are defined as anyone who is working, regardless of whether they had to leave the house to do so. Among active workers during lockdown. One worker did not provide the sector. Categories based on percentiles from province-specific distributions of census tract average income in 2017. Seroprevalence of SARS-CoV-2 by province by the point-of-care test and immunoassay SARS-CoV-2=severe acute respiratory syndrome coronavirus 2. According to the point-of-care test, seroprevalence was 1·1% (95% CI 0·3–3·5) in infants younger than 1 year and 3·1% (2·2–4·2) in children aged 5–9 years, increasing with age until plateauing around 6% in people aged 45 years or older (figure 3 ; appendix p 16). According to the immunoassay, seroprevalence was lower in the oldest age groups (≥85 years) compared with other adults. Seroprevalence with the point-of-care test was similar for females and males, was highest in the largest municipalities (6·4% [95% CI 5·8–7·1] in towns with at least 100 000 residents vs 4·2% [3·5–5·1] in those with <5000 residents), and was higher in health-care workers (10·2% [7·9–13·0]) than in other occupational groups; these results were supported by the immunoassay (table 1). Seroprevalence specificity–sensitivity ranges are shown in the appendix (p 17). For health-care workers, the range was 8·3% (6·1–11·2; both tests positive) to 11·7% (9·2–14·7; either test positive). Differences were smaller between categories defined by nationality, household size, and income percentile.
Figure 3

Seroprevalence of SARS-CoV-2 by age

Vertical lines represent 95% CIs. SARS-CoV-2=severe acute respiratory syndrome coronavirus 2.

Seroprevalence of SARS-CoV-2 by age Vertical lines represent 95% CIs. SARS-CoV-2=severe acute respiratory syndrome coronavirus 2. Compared with those without contact with a confirmed COVID-19 case, seroprevalence was greater in those who had a confirmed case in their household (ranging from 31·4% to 37·4% between the two tests), in their workplace (9·9–10·6%), among their non-cohabitating family members and friends (13·2–13·7%), or among their caregivers and cleaning staff (12·4–13·5%) or clients (11·2–11·7%; table 2 ; appendix p 18).
Table 2

Seroprevalence of SARS-CoV-2 by self-reported clinical characteristics

Point-of-care test
Immunoassay
Number of participantsSeroprevalence (95% CI)Number of participantsSeroprevalence (95% CI)
Symptoms compatible with COVID-19*
Asymptomatic40 3252·5% (2·3–2·8)34 0162·0% (1·8–2·3)
Paucisymptomatic12 3994·5% (4·0–5·0)10 6693·9% (3·4–4·4)
Symptomatic835116·9% (15·5–18·4)727316·9% (15·4–18·5)
≤14 days before study visit239713·9% (11·8–16·4)215514·0% (11·8–16·5)
>14 days before study visit595418·0% (16·4–19·8)511818·0% (16·3–19·9)
PCR status
Never done59 5684·6% (4·3–4·9)50 5944·2% (3·8–4·5)
Negative12497·9% (6·0–10·3)11348·0% (6·0–10·6)
Positive (≤14 days before study visit)3545·6% (25·0–67·8)3165·8% (41·5–83·9)
Positive (>14 days before study visit)21388·6% (82·3–92·8)19590·1% (84·3–93·9)
Contact with confirmed case
No contact55 9893·9% (3·6–4·2)47 3853·4% (3·1–3·7)
Household member101131·4% (26·5–36·8)86037·4% (31·8–43·3)
Non-cohabitating family member or friend146713·2% (11·0–15·8)128413·7% (11·2–16·7)
Co-worker157910·6% (8·5–13·1)14619·9% (8·0–12·2)
Cleaning staff, housemaid, or caregiver8313·5% (6·3–26·5)7812·4% (7·0–21·0)
Client94011·7% (9·1–14·9)88811·2% (8·6–14·4)
Contact with symptomatic person
No contact50 6913·2% (3·0–3·5)42 8942·7% (2·4–3·0)
Household member450315·1% (13·3–17·0)372815·6% (13·6–17·9)
Non-cohabitating family member or friend235112·7% (10·7–14·9)203712·2% (10·0–14·7)
Co-worker238210·7% (9·0–12·6)222110·1% (8·4–12·1)
Cleaning staff, housemaid, or caregiver1098·8% (3·9–18·8)966·1% (2·9–12·3)
Client103310·0% (7·8–12·8)98010·2% (7·8–13·1)

SARS-CoV-2=severe acute respiratory syndrome coronavirus 2.

Asymptomatic (no symptoms), paucisymptomatic (1–2 symptoms without anosmia or ageusia), and symptomatic (anosmia or ageusia, or at least three symptoms among fever; chills; severe tiredness; sore throat; cough; shortness of breath; headache; or nausea, vomiting, or diarrhoea).

Client or patient if health-care worker.

Seroprevalence of SARS-CoV-2 by self-reported clinical characteristics SARS-CoV-2=severe acute respiratory syndrome coronavirus 2. Asymptomatic (no symptoms), paucisymptomatic (1–2 symptoms without anosmia or ageusia), and symptomatic (anosmia or ageusia, or at least three symptoms among fever; chills; severe tiredness; sore throat; cough; shortness of breath; headache; or nausea, vomiting, or diarrhoea). Client or patient if health-care worker. Among those with a positive test, the proportion of individuals who reported anosmia or three or more symptoms compatible with COVID-19 was 49·1% (95% CI 46·2–51·9) for the point-of-care test and 54·2% (51·0–57·2) for the immunoassay. The proportion of individuals with a positive test who were asymptomatic was 32·7% (30·2–35·4) and 28·5% (25·6–31·6), respectively, with a specificity–sensitivity range of 21·9% (19·1–24·9; both tests positive) to 35·8% (33·1–38·5; either test positive). Based on the overall seroprevalence range of 3·7% to 6·2% and the above proportions of seropositive individuals who were asymptomatic, it was estimated that between 376 000 and 1 042 000 asymptomatic individuals went undetected in the non-institutionalised Spanish population. For both tests, the seroprevalence was 16·9% in those who reported a history of symptoms compatible with COVID-19 (specificity–sensitivity range 15·3% [95% CI 13·8–16·8] to 19·3% [17·7–21·0]) and 88·6–90·1% in those with a self-reported positive PCR more than 14 days before the test (specificity–sensitivity range 87·6% [81·1–92·1] to 91·8% [86·3–95·3]; table 2; appendix p 18). The immunoassay was positive for 65·8% (41·5–83·9) of individuals who had a positive PCR within 14 days of the test, whereas the point-of-care test was positive for only 45·6% (25·0–67·8; table 2; appendix p 18). Among those participants with a history of COVID-19-related symptoms who presented antibodies, the proportion of individuals reporting a previous PCR test ranged between 16·4% (95% CI 13·8–19·5; either test positive) and 19·5% (16·3–23·2; both tests positive). Among them, a positive PCR was obtained in 75·1% (66·9–81·8; either test positive) and 78·8% (70·3–85·4; both tests positive), respectively. When using the immunoassay as an alloyed reference, the relative sensitivity of the point-of-care test was 79·6% (77·1–81·8) overall, ranging from 61·0% (55·8–65·9) in those without COVID-19-related symptoms to 97·2% (91·7–99·1) in those with a positive PCR more than 14 days before (table 3 ). The relative specificity of the point-of-care test was 98·3% (98·2–98·5) overall, remaining higher than 97% in all subgroups except those with a positive PCR (table 3).
Table 3

Relative performance of point-of-care test compared with immunoassay for detection of IgG antibodies for SARS-CoV-2

Number of participantsSeroprevalence with immunoassay (95% CI)Point-of-care test
Relative sensitivity (95% CI)Relative specificity (95% CI)
Overall51 9584·6% (4·3–5·0)79·6% (77·1–81·8)98·3% (98·2–98·5)
Sex
Female27 1414·6% (4·2–5·0)80·1% (76·7–83·1)98·3% (98·1–98·6)
Male24 8174·6% (4·2–5·0)79·0% (75·5–82·2)98·3% (98·1–98·5)
Age, years
0–1965273·8% (3·2–4·6)82·4% (75·1–88·0)98·9% (98·5–99·2)
20–3475695·0% (4·3–5·8)71·5% (64·1–77·9)98·9% (98·5–99·2)
35–4913 3544·9% (4·3–5·5)78·4% (73·4–82·6)98·3% (98·0–98·6)
50–6413 9064·7% (4·1–5·3)83·4% (79·3–86·8)98·0% (97·6–98·3)
≥6510 6024·5% (3·8–5·3)82·3% (77·1–86·5)97·6% (97·2–98·0)
Census tract income*
<5th percentile23824·6% (3·1–6·7)75·7% (62·4–85·4)97·9% (96·5–98·8)
5th to <25th percentile11 2294·7% (3·8–5·8)82·2% (77·2–86·3)98·6% (98·3–98·9)
25th to <50th percentile13 0964·6% (3·9–5·6)78·3% (73·3–82·5)98·3% (97·9–98·6)
50th to <75th percentile11 8044·3% (3·6–5·1)77·9% (71·4–83·3)98·3% (97·9–98·6)
75th to <95th percentile10 5834·6% (3·7–5·7)79·5% (73·9–84·1)98·3% (97·9–98·6)
≥95th percentile28645·4% (4·0–7·4)85·3% (74·7–92·0)98·1% (97·2–98·6)
Self-reported symptoms
Asymptomatic34 0162·0% (1·8–2·3)61·0% (55·8–65·9)98·6% (98·4–98·7)
Paucisymptomatic10 6693·9% (3·4–4·4)76·4% (70·0–81·7)98·3% (97·9–98·6)
Symptomatic
≤14 days before study visit215514·0% (11·8–16·5)85·3% (78·7–90·1)97·3% (96·1–98·2)
>14 days before study visit511818·0% (16·3–19·9)92·0% (89·1–94·1)97·0% (96·1–97·7)
Self-reported PCR status
Never done50 5944·2% (3·8–4·5)78·0% (75·3–80·4)98·3% (98·2–98·5)
Negative11348·0% (6·0–10·6)82·0% (70·7–89·6)98·5% (97·5–99·1)
Positive (≤14 days before study visit)3165·8% (41·5–83·9)76·4% (33·2–95·5)98·3% (87·8–99·8)
Positive (>14 days before study visit)19590·1% (84·3–93·9)97·2% (91·7–99·1)82·4% (59·7–93·7)

Relative performance is among 51 958 participants with both point-of-care test and immunoassay. SARS-CoV-2=severe acute respiratory syndrome coronavirus 2.

Categories based on percentiles from province-specific distributions of census tract average income in 2017.

Asymptomatic (no symptoms), paucisymptomatic (1–2 symptoms without anosmia or ageusia), and symptomatic (anosmia or ageusia, or at least three symptoms among fever; chills; severe tiredness; sore throat; cough; shortness of breath; headache; or nausea, vomiting, or diarrhoea).

Relative performance of point-of-care test compared with immunoassay for detection of IgG antibodies for SARS-CoV-2 Relative performance is among 51 958 participants with both point-of-care test and immunoassay. SARS-CoV-2=severe acute respiratory syndrome coronavirus 2. Categories based on percentiles from province-specific distributions of census tract average income in 2017. Asymptomatic (no symptoms), paucisymptomatic (1–2 symptoms without anosmia or ageusia), and symptomatic (anosmia or ageusia, or at least three symptoms among fever; chills; severe tiredness; sore throat; cough; shortness of breath; headache; or nausea, vomiting, or diarrhoea).

Discussion

The findings from this nationwide seroprevalence study for SARS-CoV-2 indicate that the prevalence of IgG antibodies against this coronavirus is around 5% in Spain. Because the study was designed to obtain representative data at both national and provincial level, we were able to observe marked regional differences between the centre of Spain and the outskirts that generally match the surveillance data. The prevalence in hotspot areas such as Madrid is more than five times higher than that observed in low-risk regions such as most provinces along the coasts. To our knowledge, ENE-COVID is the largest population-based SARS-CoV-2 seroprevalence study in Europe. With more than 61 000 participants, the size of this study surpasses the combined 35 784 individuals described in a recent review of serosurveys. The use of two IgG antibody tests aimed at different SARS-CoV-2 antigens allows us to specify a range of seroprevalence between 3·7% and 6·2%, depending on whether we favour greater specificity (ie, a positive result in both tests), which might be preferred when prevalence is low, or greater sensitivity (ie, a positive result in either test). These estimates confirm the magnitude of seroprevalence suggested by smaller studies.5, 7, 8 We found no differences in seroprevalence between females and males. Similar to what has been reported for other endemic coronaviruses, prevalence increased throughout childhood and adolescence, remained fairly stable at older ages when using the point-of-care test, and, when using the immunoassay only, decreased after age 85 years. The lower prevalence in children might be in part related to lower nasal gene expression of angiotensin-converting enzyme 2. The first wave of the study was done while Spain was under lockdown. Participants working in essential sectors did not show higher seroprevalence values than the general population, with the exception of health-care workers (specificity–sensitivity range 8·3–11·7%), who have been previously reported to have a greater exposure to SARS-CoV-2.10, 23 In Spain, health-care workers comprise 24% of all confirmed COVID-19 cases—a proportion partly explained by greater access to PCR testing—and 9% of hospitalised cases in their age range.24, 25 Our results confirm that close contact with people with COVID-19, and particularly those in the same household, increases viral transmission. Appropriate quarantine and separation from other household members can be particularly challenging and not realistic in urban areas and less affluent scenarios. While mass quarantine during the lockdown would reduce the number of potentially infective contacts, it would also increase the transmission of the virus in a confined space, as a recent simulation study has suggested. Serological surveys are the best tool to determine the spread of an infectious disease, particularly in the presence of asymptomatic cases or incomplete ascertainment of those with symptoms. Both phenomena—asymptomatic cases and partial ascertainment—are relevant here. The proportion of asymptomatic infections reported in different studies varies greatly, ranging from 4% to 41%. Here, asymptomatic cases represent between 21·9% and 35·8% of all SARS-CoV-2 infections, corresponding to between 376 000 and 1 042 000 asymptomatic infections in the entire non-institutionalised Spanish population. This finding reinforces the importance of rapid identification, study, and isolation of people with confirmed SARS-CoV-2 infection and their contacts to prevent the spread of the epidemic. Regarding incomplete ascertainment, only between 16% and 20% of symptomatic participants with antibodies against SARS-CoV-2 reported a previous PCR, and it was positive in around 75–79% of them. We are relying on participants' retrospectively self-reported symptoms, so a certain amount of misclassification cannot be ruled out. Still, these figures suggest that a substantial number of symptomatic patients with COVID-19 did not undergo PCR testing. However, the fact that only 15·3–19·3% of symptomatic participants had antibodies against SARS-CoV-2 suggests that a sizable proportion of suspected cases might have symptoms not caused by this coronavirus. Seroprevalence was close to 90% after 14 days since a positive PCR test, which is consistent with a recent study concluding that SARS-CoV-2 IgG antibodies are detected in more than 90% of infected people 2 weeks after symptom onset, and the recently reported 99% of antibody response among confirmed COVID-19 cases. For the few patients who do not develop antibodies against SARS-CoV-2, it is unknown whether they are susceptible to reinfection.29, 31, 32 Prevalence in those participants reporting negative PCR was higher than in those without a PCR test, which might be explained by delayed PCR testing that yields a negative result or by imperfect sensitivity of PCR tests. One of the most practical conclusions from our survey is that, although the immunoassay had better performance features, our rapid point-of-care test yielded comparable epidemiological information while having a greater uptake, lower cost, and easier implementation. Thus, a high-performance point-of-care test could be a suitable option for large seroepidemiological studies. Additionally, as the two tests addressed different viral proteins, they might be providing complementary information. Differences in seroprevalence between our two tests among recently PCR-positive people could be compatible with a later appearance of IgG antibodies against the receptor binding domain of the S protein compared with those against the nucleoprotein. It is important to bear in mind that, in a context of low prevalence figures as those found in this Article, false-positive results might be a relevant issue. Even though the S protein and nucleoprotein show less than 30% similarity with endemic betacoronaviruses, a cross-reaction cannot be ruled out. In this sense, the combination of both tests provides a more conservative estimation of the real figures. We focused on IgG antibodies, which last longer than IgM or IgA and are associated with viral neutralising activity.35, 36 The point-of-care test also detected IgM antibodies, but the IgM band had lower sensitivity and specificity, might be positive in presence of rheumatoid factor, and was subject to substantial variability in initial IgM readings. A key strength of our study is the random selection of households from the national municipal register (updated on Jan 1, 2020), which allowed us to contact a representative sample of the non-institutionalised Spanish population. However, this decision has its drawbacks: young adults have proven to be more difficult to find, probably due to their higher mobility, with many of them officially registered at their parents' home but living elsewhere. Also, some potential participants were staying at their second residences, leaving an empty house whose members could not be included. Moreover, household selection excludes care-home residents, who, according to recent estimations, could account for around 6% of Spaniards older than 75 years. Even though care homes have been a hotspot of infection and death in the country, most Spanish elders reside in households and they are adequately represented in our study. The remarkably high participation across the country, even in the venepuncture-based assay, reflects the keen interest that the Spanish population has in knowing its serological status. Participation rates were a bit lower in less affluent areas, but this was compensated by adjustment for median income in the census tract. We could not explore differences by race, as this information was not available. However, most participants were Spaniards, who are mostly white. Our study only detected IgG antibodies, but the extent of the immunity they provide is unknown at this moment. However, cellular immunity, which was not evaluated here, might also play a role in protecting against SARS-CoV-2 reinfection. ENE-COVID provides seroprevalence data at a regional level to inform national and local public health policies. It offers a picture of SARS-CoV-2 circulation that can be compared with surveillance data to evaluate differences in diagnostic exhaustiveness. In addition, comparative performance among regions with similar prevalence but different burden in terms of deaths and health-care capacity could help to suggest areas of improvement and highlight unattended needs that should be considered to face a future epidemic wave. In conclusion, our study provides nationwide and regional estimates of SARS-CoV-2 dissemination in Spain, showing remarkable differences between higher and lower prevalence areas. One in three infections seems to be asymptomatic, while a substantial number of symptomatic cases remained untested. Despite the high impact of COVID-19 in Spain, prevalence estimates remain low and are clearly insufficient to provide herd immunity. This cannot be achieved without accepting the collateral damage of many deaths in the susceptible population and overburdening of health systems. In this situation, social distance measures and efforts to identify and isolate new cases and their contacts are imperative for future epidemic control.
  24 in total

1.  National Health and Nutrition Examination Survey, 2015-2018: Sample Design and Estimation Procedures.

Authors:  Te-Ching Chen; Jason Clark; Minsun K Riddles; Leyla K Mohadjer; Tala H I Fakhouri
Journal:  Vital Health Stat 2       Date:  2020-04

2.  Estimating the burden of SARS-CoV-2 in France.

Authors:  Henrik Salje; Cécile Tran Kiem; Noémie Lefrancq; Noémie Courtejoie; Paolo Bosetti; Juliette Paireau; Alessio Andronico; Nathanaël Hozé; Jehanne Richet; Claire-Lise Dubost; Yann Le Strat; Justin Lessler; Daniel Levy-Bruhl; Arnaud Fontanet; Lulla Opatowski; Pierre-Yves Boelle; Simon Cauchemez
Journal:  Science       Date:  2020-05-13       Impact factor: 47.728

3.  Seroprevalence of antibodies against SARS-CoV-2 among health care workers in a large Spanish reference hospital.

Authors:  Alberto L Garcia-Basteiro; Gemma Moncunill; Marta Tortajada; Marta Vidal; Caterina Guinovart; Alfons Jiménez; Rebeca Santano; Sergi Sanz; Susana Méndez; Anna Llupià; Ruth Aguilar; Selena Alonso; Diana Barrios; Carlo Carolis; Pau Cisteró; Eugenia Chóliz; Angeline Cruz; Silvia Fochs; Chenjerai Jairoce; Jochen Hecht; Montserrat Lamoglia; Mikel J Martínez; Robert A Mitchell; Natalia Ortega; Nuria Pey; Laura Puyol; Marta Ribes; Neus Rosell; Patricia Sotomayor; Sara Torres; Sarah Williams; Sonia Barroso; Anna Vilella; José Muñoz; Antoni Trilla; Pilar Varela; Alfredo Mayor; Carlota Dobaño
Journal:  Nat Commun       Date:  2020-07-08       Impact factor: 14.919

4.  Performance Characteristics of the Abbott Architect SARS-CoV-2 IgG Assay and Seroprevalence in Boise, Idaho.

Authors:  Andrew Bryan; Gregory Pepper; Mark H Wener; Susan L Fink; Chihiro Morishima; Anu Chaudhary; Keith R Jerome; Patrick C Mathias; Alexander L Greninger
Journal:  J Clin Microbiol       Date:  2020-07-23       Impact factor: 5.948

5.  Estimation of SARS-CoV-2 Infection Fatality Rate by Real-time Antibody Screening of Blood Donors.

Authors:  Christian Erikstrup; Christoffer Egeberg Hother; Ole Birger Vestager Pedersen; Kåre Mølbak; Robert Leo Skov; Dorte Kinggaard Holm; Susanne Gjørup Sækmose; Anna Christine Nilsson; Patrick Terrence Brooks; Jens Kjærgaard Boldsen; Christina Mikkelsen; Mikkel Gybel-Brask; Erik Sørensen; Khoa Manh Dinh; Susan Mikkelsen; Bjarne Kuno Møller; Thure Haunstrup; Lene Harritshøj; Bitten Aagaard Jensen; Henrik Hjalgrim; Søren Thue Lillevang; Henrik Ullum
Journal:  Clin Infect Dis       Date:  2021-01-27       Impact factor: 20.999

6.  Development and clinical application of a rapid IgM-IgG combined antibody test for SARS-CoV-2 infection diagnosis.

Authors:  Zhengtu Li; Yongxiang Yi; Xiaomei Luo; Nian Xiong; Yang Liu; Shaoqiang Li; Ruilin Sun; Yanqun Wang; Bicheng Hu; Wei Chen; Yongchen Zhang; Jing Wang; Baofu Huang; Ye Lin; Jiasheng Yang; Wensheng Cai; Xuefeng Wang; Jing Cheng; Zhiqiang Chen; Kangjun Sun; Weimin Pan; Zhifei Zhan; Liyan Chen; Feng Ye
Journal:  J Med Virol       Date:  2020-04-13       Impact factor: 2.327

7.  Estimation of seroprevalence of novel coronavirus disease (COVID-19) using preserved serum at an outpatient setting in Kobe, Japan: A cross-sectional study.

Authors:  Asako Doi; Kentaro Iwata; Hirokazu Kuroda; Toshikazu Hasuike; Seiko Nasu; Aya Kanda; Tomomi Nagao; Hiroaki Nishioka; Keisuke Tomii; Takeshi Morimoto; Yasuki Kihara
Journal:  Clin Epidemiol Glob Health       Date:  2021-04-19

8.  Seroprevalence of anti-SARS-CoV-2 IgG antibodies in Geneva, Switzerland (SEROCoV-POP): a population-based study.

Authors:  Silvia Stringhini; Ania Wisniak; Giovanni Piumatti; Andrew S Azman; Stephen A Lauer; Hélène Baysson; David De Ridder; Dusan Petrovic; Stephanie Schrempft; Kailing Marcus; Sabine Yerly; Isabelle Arm Vernez; Olivia Keiser; Samia Hurst; Klara M Posfay-Barbe; Didier Trono; Didier Pittet; Laurent Gétaz; François Chappuis; Isabella Eckerle; Nicolas Vuilleumier; Benjamin Meyer; Antoine Flahault; Laurent Kaiser; Idris Guessous
Journal:  Lancet       Date:  2020-06-11       Impact factor: 79.321

9.  Antibody Responses to SARS-CoV-2 in Patients With Novel Coronavirus Disease 2019.

Authors:  Juanjuan Zhao; Quan Yuan; Haiyan Wang; Wei Liu; Xuejiao Liao; Yingying Su; Xin Wang; Jing Yuan; Tingdong Li; Jinxiu Li; Shen Qian; Congming Hong; Fuxiang Wang; Yingxia Liu; Zhaoqin Wang; Qing He; Zhiyong Li; Bin He; Tianying Zhang; Yang Fu; Shengxiang Ge; Lei Liu; Jun Zhang; Ningshao Xia; Zheng Zhang
Journal:  Clin Infect Dis       Date:  2020-11-19       Impact factor: 9.079

10.  Serological tests facilitate identification of asymptomatic SARS-CoV-2 infection in Wuhan, China.

Authors:  Xiaodong Wu; Bo Fu; Lang Chen; Yong Feng
Journal:  J Med Virol       Date:  2020-06-24       Impact factor: 20.693

View more
  611 in total

1.  An estimation of undetected COVID cases in France.

Authors:  Jeffrey Shaman
Journal:  Nature       Date:  2021-02       Impact factor: 49.962

2.  Asymptomatic COVID-19 in South Africa - implications for the control of transmission.

Authors:  M Paleker; Y A Tembo; M-A Davies; H Mahomed; D Pienaar; S A Madhi; K McCarthy
Journal:  Public Health Action       Date:  2021-06-21

3.  Prevalence of COVID-19 Infection in Hemodialysis Patients Detected Using Serologic Screening.

Authors:  Diana Rodríguez-Espinosa; José Jesús Broseta; Elena Cuadrado; Francisco Maduell
Journal:  J Am Soc Nephrol       Date:  2020-09-29       Impact factor: 10.121

4.  Mortality from COVID-19: are we getting closer to the true value?

Authors:  Marco Fonzo; Chiara Bertoncello; Vincenzo Baldo
Journal:  Pathog Glob Health       Date:  2020-10-04       Impact factor: 2.894

Review 5.  Antibody Responses to SARS-CoV-2: Let's Stick to Known Knowns.

Authors:  Nicole Baumgarth; Janko Nikolich-Žugich; F Eun-Hyung Lee; Deepta Bhattacharya
Journal:  J Immunol       Date:  2020-09-04       Impact factor: 5.422

6.  Post-COVID-19 Action: Guarding Africa's Crops against Viral Epidemics Requires Research Capacity Building That Unifies a Trio of Transdisciplinary Interventions.

Authors:  Francis O Wamonje
Journal:  Viruses       Date:  2020-11-09       Impact factor: 5.048

Review 7.  Transmission of SARS-CoV-2 by Children.

Authors:  Joanna Merckx; Jeremy A Labrecque; Jay S Kaufman
Journal:  Dtsch Arztebl Int       Date:  2020-08-17       Impact factor: 5.594

8.  June: open-source individual-based epidemiology simulation.

Authors:  Joseph Aylett-Bullock; Carolina Cuesta-Lazaro; Arnau Quera-Bofarull; Miguel Icaza-Lizaola; Aidan Sedgewick; Henry Truong; Aoife Curran; Edward Elliott; Tristan Caulfield; Kevin Fong; Ian Vernon; Julian Williams; Richard Bower; Frank Krauss
Journal:  R Soc Open Sci       Date:  2021-07-07       Impact factor: 2.963

9.  Effectiveness of infection-containment measures on SARS-CoV-2 seroprevalence and circulation from May to July 2020, in Milan, Italy.

Authors:  Valeria Cento; Claudia Alteri; Marco Merli; Federica Di Ruscio; Livia Tartaglione; Roberto Rossotti; Giovanna Travi; Marta Vecchi; Alessandro Raimondi; Alice Nava; Luna Colagrossi; Roberto Fumagalli; Nicola Ughi; Oscar Massimiliano Epis; Diana Fanti; Andrea Beretta; Filippo Galbiati; Francesco Scaglione; Chiara Vismara; Massimo Puoti; Daniela Campisi; Carlo Federico Perno
Journal:  PLoS One       Date:  2020-11-20       Impact factor: 3.240

10.  Performance of rapid IgM-IgG combined antibody tests in the occupational surveillance of COVID-19 in Colombian enterprises

Authors:  Álvaro J Idrovo; José Moreno-Montoya; Carlos E Pinzón-Flórez
Journal:  Biomedica       Date:  2020-10-30       Impact factor: 0.935

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.