Irene Petersen1,2, Andrew Phillips3. 1. Research Department of Primary Care and Population Health, University College London, London, UK. 2. Department of Clinical Epidemiology, Aarhus University Hospital, Aarhus, Denmark. 3. Institute for Global Health, University College London, London, UK.
Abstract
BACKGROUND: To reduce transmission of SARS-CoV-2, it is important to identify those who are infectious. However, little is known about what proportion of infectious people are asymptomatic and potential "silent" transmitters. We evaluated the value of COVID-19 symptoms as a marker for SARS-CoV-2 infection from a representative English survey. METHODS: We used data from the Office for National Statistics Coronavirus (COVID-19) Infection Survey pilot study. We estimated sensitivity, specificity, the proportion of asymptomatic cases (1 - sensitivity), positive predictive value (PPV) and negative predictive value (NPV) of COVID-19 symptoms as a marker of infection using results of the SARS-CoV-2 test as the "gold standard". RESULTS: In total, there were 36,061 individuals with a SARS-CoV-2 test between 26 April and 27 June 2020. Of these, 625 (1.7%) reported symptoms on the day of the test. There were 115 (0.32%) with a positive SARS-CoV-2 test result. Of the 115, there were 27 (23.5%) who were symptomatic and 88 (76.5%) who were asymptomatic on the day of the test. Focusing on those with specific symptoms (cough, and/or fever, and/or loss of taste/smell), there were 158 (0.43%) with such symptoms on the day of the test. Of the 115 with a positive SARS-CoV-2, there were 16 (13.9%) reporting symptoms. In contrast, 99 (86.1%) did not report specific symptoms on the day of the test. The PPV for all symptoms was 4.3% and for the specific symptoms 10.1%. The specificity and NPV of symptoms were above 98%. CONCLUSION: COVID-19 symptoms are poor markers of SARS-CoV-2. Thus, 76.5% of this random sample who tested positive reported no symptoms, and 86.1% reported none of those specific to COVID-19. A more widespread testing programme is necessary to capture "silent" transmission and potentially prevent and reduce future outbreaks.
BACKGROUND: To reduce transmission of SARS-CoV-2, it is important to identify those who are infectious. However, little is known about what proportion of infectious people are asymptomatic and potential "silent" transmitters. We evaluated the value of COVID-19 symptoms as a marker for SARS-CoV-2 infection from a representative English survey. METHODS: We used data from the Office for National Statistics Coronavirus (COVID-19) Infection Survey pilot study. We estimated sensitivity, specificity, the proportion of asymptomatic cases (1 - sensitivity), positive predictive value (PPV) and negative predictive value (NPV) of COVID-19 symptoms as a marker of infection using results of the SARS-CoV-2 test as the "gold standard". RESULTS: In total, there were 36,061 individuals with a SARS-CoV-2 test between 26 April and 27 June 2020. Of these, 625 (1.7%) reported symptoms on the day of the test. There were 115 (0.32%) with a positive SARS-CoV-2 test result. Of the 115, there were 27 (23.5%) who were symptomatic and 88 (76.5%) who were asymptomatic on the day of the test. Focusing on those with specific symptoms (cough, and/or fever, and/or loss of taste/smell), there were 158 (0.43%) with such symptoms on the day of the test. Of the 115 with a positive SARS-CoV-2, there were 16 (13.9%) reporting symptoms. In contrast, 99 (86.1%) did not report specific symptoms on the day of the test. The PPV for all symptoms was 4.3% and for the specific symptoms 10.1%. The specificity and NPV of symptoms were above 98%. CONCLUSION: COVID-19 symptoms are poor markers of SARS-CoV-2. Thus, 76.5% of this random sample who tested positive reported no symptoms, and 86.1% reported none of those specific to COVID-19. A more widespread testing programme is necessary to capture "silent" transmission and potentially prevent and reduce future outbreaks.
A major component of the strategy to suppress SARS-CoV-2 transmission is to advise those with symptoms of COVID-19 to self-isolate. However, there are several reports suggesting that not all individuals with a positive SARS-CoV-2 RNA test result have symptoms.1–7 The proportion of asymptomatic cases varies substantially between studies and settings.8 For example, among 262 confirmed cases admitted to hospitals in Beijing 13 (5%) were asymptomatic. In contrast, reports from a small village in Italy suggest that up to 40–75% were asymptomatic.6,9 A study of 13,000 residents in Iceland found 43 out of 100 with a positive SARS-CoV-2 test were asymptomatic.7 There are also several reports of asymptomatic children,4,10,11 but many reports of asymptomatic cases are from selective and relatively small study samples.8In this analysis of data from a large representative study by the English Office for National Statistics we aimed to understand the value of COVID-19 symptoms as a marker for SARS-CoV-2 infection. We estimated the sensitivity, specificity, positive and negative predictive values of COVID-19 symptoms for SARS-CoV-2 infections as well as the proportion of asymptomatic cases (1 – sensitivity). These basic epidemiological estimates may help to inform the needed scale of future SARS-CoV-2 test programmes.
Methods
Data Source
The Office for National Statistics Coronavirus (COVID-19) Infection Survey pilot is a household survey of private households in England, excluding people living in care homes, other communal establishments and hospitals. The sample for the survey is drawn mainly from the Annual Population Survey (APS). Further information on the survey is available on the study website.12The survey is ongoing, but for this study, we used data collected in the period 26 April and 27 June 2020 and reported in the statistical bulletin on 9 July 2020 (July edition of the dataset released on 7 July).13 Thus, we used information on the number of individuals with and without symptoms testing positive for SARS-CoV-2 (Table 10 in the dataset)14 and the number of individuals with and without specific symptoms (cough, and/or fever, and/or loss of taste/smell) testing positive for SARS-CoV-2 (Table 11 in the dataset).14We use the SARS-CoV-2 test results as a proxy for presence of SARS-CoV-2 infection. It is estimated that the sensitivity of the SARS-CoV-2 test used in this survey is between 85% and 95% and the specificity is above 95%.15 The sensitivity is a measures of how often the SARS-CoV-2 test correctly identifies those who had the virus. Specificity measures how often the COVID-19 test correctly identifies those who did not have the virus.
Data Sharing
The data are available under the open government licence.14,16
Analysis
We estimated the sensitivity, specificity, and positive and negative predictive values of COVID-19 symptoms as a marker of infection by using the results of the SARS-CoV-2 test as the “gold standard”. We calculated the proportion among positive test cases who were asymptomatic on the day of the test as: 1 – sensitivity.The sensitivity was estimated as the number of individuals with COVID19 symptoms who had a positive test (A) over the total number of individuals with a positive test (A + B) (Table 1).
Table 1
Individuals Reporting Any Symptoms on the Day of the Test and COVID-19 Test Results
COVID-19 Symptoms
COVID-19 Test Result
Symptomatic
Asymptomatic
Total
Positive
(A)
(B)
(A+B)
Negative
(C)
(D)
(C+D)
Total
(A + C)
(B+D)
All Symptoms
COVID-19 Test Result
Symptomatic
Asymptomatic
Total
Positive
27
88
115
Negative
598
35,348
35,946
Total
625
35,436
36,061
Specific Symptoms (Cough, and/or Fever, and/or Loss of Taste/Smell)
COVID-19 Test Result
Symptomatic
Asymptomatic
Total
Positive
16
99
115
Negative
142
35,804
35,946
Total
158
35,903
36,061
Individuals Reporting Any Symptoms on the Day of the Test and COVID-19 Test ResultsThe specificity was estimated as the number of individuals with a negative test and without symptoms (D) over the total number of individuals with a negative test (C+ D) (Table 1).The positive predictive value was estimated as the number of individuals with COVID19 symptoms who had a positive test (A) over the total number of individuals with symptoms (A + C) (Table 1).The negative predictive value was estimated as the number of individuals with no COVID19 symptoms who had a negative test (D) over the total number of individual with no symptoms (B + D) (Table 1).All analyses were performed in Stata version 16.
Ethics
The Office for National Statistics Coronavirus (COVID-19) Infection Survey has obtained approval by South Central – Berkshire B Research Ethics Committee (20/SC/0195).
Results
In total, there were 36,061 individuals who had a SARS-CoV-2 test between 26 April and 27 June 2020. Of these, there were 625 (1.7%) who reported symptoms on the day of the test. There were 115 (0.32%) with a positive SARS-CoV-2 test result (Table 1). Of the 115, there were 27 (23.5%) who were symptomatic and 88 (76.5%) who were asymptomatic on the day of the test (Tables 1 and 2).
Table 2
Sensitivity, Specificity, Positive Predictive Values, Negative Predictive Values of COVID-19 Symptoms as Markers for COVID-19 Infection and Proportion of Asymptomatic Cases on the Day of the Test
Estimates (95% Confidence Intervals)
All Symptoms
Specific Symptoms
Sensitivity
23.5% (16.1% to 32.3%)
13.9% (8.2% to 21.6%)
Asymptomatic on the day of the test (1-sensitivity)
76.5% (67.7% to 83.9%)
86.1% (78.4% to 91.8%)
Specificity
98.3% (98.2% to 98.5%)
99.6% (99.5% to 99.7%)
Positive Predictive Values (PPV)
4.3% (2.9% to 6.2%).
10.1% (5.9% to 15.9%)
Negative Predictive Values (NPV)
99.8% (99.7% to 99.8%)
99.7% (99.7% to 99.8%)
Sensitivity, Specificity, Positive Predictive Values, Negative Predictive Values of COVID-19 Symptoms as Markers for COVID-19 Infection and Proportion of Asymptomatic Cases on the Day of the TestFocusing on those who had specific symptoms (cough, and/or fever, and/or loss of taste/smell) there were 158 (0.43%) who had such symptoms on the day of the test. Of the 115 with a positive SARS-CoV-2, there were 16 (13.9%) who reported such symptoms. In contrast, 99 (86.1%) did not report specific symptoms on the day of the test (Table 2).The positive predictive value (PPV) for symptoms was 4.3% while the PPV for specific symptoms was 10.1% (Table 2). The specificity and negative predictive values (NPV) were above 98% (Table 2).
Discussion
Overall, 115 (0.32%) of the sample tested positive for SARS-CoV-2. There were less than 2% who reported any symptoms indicative of COVID-19 and less than 0.5% who reported specific symptoms on the day of the test. The results of our study suggest that COVID-19 symptoms are a relatively poor marker of SARS-CoV-2 infection. Thus, 76.5% of those tested positive reported no symptoms and 86% reported none of the specific COVID-19 symptoms on the day of the test.To our knowledge, the Office for National Statistics Coronavirus (COVID-19) Infection Survey pilot is the largest population survey carried out to date including information on the association between COVID-19 symptoms and SARS-CoV-2 test results.8 The study sample is approximately representative of the English population outside care homes, other communal establishments and hospital settings. Information on COVID-19 symptoms was reported before results of the SARS-CoV-2 test were known and therefore not subject to recall bias.An assumption behind our interpretation is that test specificity of SARS-CoV-2 test is very close to 100%. A test with specificity of 99.9% conducted in 36,061 people without SARS-CoV-2 infection would be expected to lead to 36 false-positive tests. Thus, there is scope for over-estimating the number of people with SARS-CoV-2 and this might be part of the reason for the high proportion of positive tests we observed to be in people without symptoms. Confirmation of positive test results is important for avoiding bias in prevalence estimates in such surveys.Several studies have highlighted a proportion of individuals testing positive for SARS-CoV-2 are asymptomatic.1–6,8,9 However, the prevalence of asymptomatic cases varies substantially, possibly due to the sampling and the settings of the study.8 The findings from our analyses suggest that asymptomatic cases of COVID-19 were widespread in the UK in Spring 2020. Similar findings were observed from smaller community samples Italy where 42% of the individuals testing positive were asymptomatic6 and on Iceland where 43% of the participants who tested positive reported having no symptoms, although symptoms may have developed later in some of them.7 A study of 126 residents in a nursing facility in the US suggested 39% of those who tested positive were asymptomatic.1 There has been some debate as to whether children and young people were less susceptible to SARS-CoV-2 and/or more likely to be asymptomatic than adults.11 Unfortunately, we did not have access to age-stratified data and therefore unable to evaluate this question in further detail.As the prevalence of SARS-CoV-2 positive tests was low (0.32%), it is not surprising that the positive predictive value (PPV) of COVID-19 symptoms also was low. However, it is worth noting that the PPV for specific symptoms is more than twice as high as for the non-specific symptoms (10.1% (5.9% to 15.9%) vs 4.3% (2.9% to 6.2%)). On the other hand, the specificity of the symptoms was high consistent with the majority of people without SARS-CoV-2 infection being asymptomatic at any point in time. However, this may change in periods where there is overlap between SARS-CoV-2 infections and other respiratory infections eg, in the influenza season.Our findings have implications for ongoing and future SARS-CoV-2 test programmes. The fact that up to 86% of those who tested positive were asymptomatic on the day of a positive SARS-CoV-2 test results calls for a change to future testing strategies. In order to capture “silent” transmission and potentially prevent future outbreaks test programmes should involve frequent and widespread SARS-CoV-2 testing of all individuals, not just symptomatic cases at least in high-risk settings or specific locations. Thus, a strategy has been proposed for suppressing SARS-CoV-2 transmission which involves frequent and widespread testing which is regardless of presence of symptoms.17 Such a strategy is feasible with the development of simpler tests that produce rapid results at low cost, accepting some loss of sensitivity.18
Conclusions
COVID-19 symptoms are poor marker of SARS-CoV-2 infection. Thus, 76.5% of those who tested positive reported no symptoms and 86.1% reported none of the specific COVID-19 symptoms on the day of the test. It is likely to be necessary to set up test programmes involving frequent and widespread SARS-CoV-2 testing of all individuals, at least where there are recent cases, and certainly in high-risk setting, for example, care homes, hospitals, or specific industries in order to capture “silent” transmission and potentially prevent future outbreaks. It may be important for testing programs used to estimate prevalence for surveillance purposes to consider test specificity of SARS-CoV-2 tests and confirmation of positive cases where the person is asymptomatic.
Authors: Julian Peto; Nisreen A Alwan; Keith M Godfrey; Rochelle A Burgess; David J Hunter; Elio Riboli; Paul Romer Journal: Lancet Date: 2020-04-21 Impact factor: 79.321
Authors: Alison C Roxby; Alexander L Greninger; Kelly M Hatfield; John B Lynch; Timothy H Dellit; Allison James; Joanne Taylor; Libby C Page; Anne Kimball; Melissa Arons; Laura A Schieve; Albert Munanga; Nimalie Stone; John A Jernigan; Sujan C Reddy; James Lewis; Seth A Cohen; Keith R Jerome; Jeffrey S Duchin; Santiago Neme Journal: MMWR Morb Mortal Wkly Rep Date: 2020-04-10 Impact factor: 17.586
Authors: Mahesh C Patel; Lelia H Chaisson; Scott Borgetti; Deborah Burdsall; Rashmi K Chugh; Christopher R Hoff; Elizabeth B Murphy; Emily A Murskyj; Shannon Wilson; Joe Ramos; Lynn Akker; Debra Bryars; Evonda Thomas-Smith; Susan C Bleasdale; Ngozi O Ezike Journal: Clin Infect Dis Date: 2020-06-16 Impact factor: 9.079
Authors: Nisha S Mehta; Oliver T Mytton; Edward W S Mullins; Tom A Fowler; Catherine L Falconer; Orla B Murphy; Claudia Langenberg; Wikum J P Jayatunga; Danielle H Eddy; Jonathan S Nguyen-Van-Tam Journal: Clin Infect Dis Date: 2020-12-03 Impact factor: 9.079
Authors: Anne Kimball; Kelly M Hatfield; Melissa Arons; Allison James; Joanne Taylor; Kevin Spicer; Ana C Bardossy; Lisa P Oakley; Sukarma Tanwar; Zeshan Chisty; Jeneita M Bell; Mark Methner; Josh Harney; Jesica R Jacobs; Christina M Carlson; Heather P McLaughlin; Nimalie Stone; Shauna Clark; Claire Brostrom-Smith; Libby C Page; Meagan Kay; James Lewis; Denny Russell; Brian Hiatt; Jessica Gant; Jeffrey S Duchin; Thomas A Clark; Margaret A Honein; Sujan C Reddy; John A Jernigan Journal: MMWR Morb Mortal Wkly Rep Date: 2020-04-03 Impact factor: 17.586
Authors: Daniel F Gudbjartsson; Agnar Helgason; Hakon Jonsson; Olafur T Magnusson; Pall Melsted; Gudmundur L Norddahl; Jona Saemundsdottir; Asgeir Sigurdsson; Patrick Sulem; Arna B Agustsdottir; Berglind Eiriksdottir; Run Fridriksdottir; Elisabet E Gardarsdottir; Gudmundur Georgsson; Olafia S Gretarsdottir; Kjartan R Gudmundsson; Thora R Gunnarsdottir; Arnaldur Gylfason; Hilma Holm; Brynjar O Jensson; Aslaug Jonasdottir; Frosti Jonsson; Kamilla S Josefsdottir; Thordur Kristjansson; Droplaug N Magnusdottir; Louise le Roux; Gudrun Sigmundsdottir; Gardar Sveinbjornsson; Kristin E Sveinsdottir; Maney Sveinsdottir; Emil A Thorarensen; Bjarni Thorbjornsson; Arthur Löve; Gisli Masson; Ingileif Jonsdottir; Alma D Möller; Thorolfur Gudnason; Karl G Kristinsson; Unnur Thorsteinsdottir; Kari Stefansson Journal: N Engl J Med Date: 2020-04-14 Impact factor: 91.245
Authors: André Voigt; Nikolay Martyushenko; Emil Karlsen; Martina Hall; Kristen Nyhamar; Stig William Omholt; Eivind Almaas Journal: BMC Infect Dis Date: 2021-06-09 Impact factor: 3.090
Authors: Andrew A S Soltan; Samaneh Kouchaki; Tingting Zhu; Dani Kiyasseh; Thomas Taylor; Zaamin B Hussain; Tim Peto; Andrew J Brent; David W Eyre; David A Clifton Journal: Lancet Digit Health Date: 2020-12-11
Authors: Kristin J Meyers; Brian Dillman; Charles Williams; Jianfei Jiang; Nancy Clifford; Jennifer L Miller; Meghan E Jones; Iris A Goetz; Fady T Botros; Jack Knorr; David H Manner; Brad Woodward Journal: J Med Virol Date: 2021-02-01 Impact factor: 20.693
Authors: Rodrigo M Young; Camila J Solis; Andres Barriga-Fehrman; Carlos Abogabir; Alvaro R Thadani; Mariana Labarca; Eva Bustamante; Cecilia V Tapia; Antonia G Sarda; Francisca Sepulveda; Nadia Pozas; Leslie C Cerpa; María A Lavanderos; Nelson M Varela; Alvaro Santibañez; Ana M Sandino; Felipe Reyes-Lopez; Garth Dixon; Luis A Quiñones Journal: Elife Date: 2021-06-22 Impact factor: 8.140