| Literature DB >> 32607518 |
Eric J Nilles, Elizabeth W Karlson, Maia Norman, Tal Gilboa, Stephanie Fischinger, Caroline Atyeo, Guohai Zhou, Christopher L Bennett, Nicole V Tolan, Karina Oganezova, David R Walt, Galit Alter, Daimon P Simmons, Peter Schur, Petr Jarolim, Lindsey R Baden.
Abstract
Background Seroepidemiology is an important tool to characterize the epidemiology and immunobiology of SARS-CoV-2 but many immunoassays have not been externally validated raising questions about reliability of study findings. To ensure meaningful data, particularly in a low seroprevalence population, assays need to be rigorously characterized with high specificity. Methods We evaluated two commercial (Roche Diagnostics and Epitope Diagnostics IgM/IgG) and two non-commercial (Simoa and Ragon/MGH IgG) immunoassays against 68 confirmed positive and 232 pre-pandemic negative controls. Sensitivity was stratified by time from symptom onset. The Simoa multiplex assay applied three pre-defined algorithm models to determine sample result. Results The Roche and Ragon/MGH IgG assays each registered 1/232 false positive, the primary Simoa model registered 2/232 false positives, and the Epitope registered 2/230 and 3/230 false positives for the IgG and IgM assays respectively. Sensitivity >21 days post symptom-onset was 100% for all assays except Epitope IgM, but lower and/or with greater variability between assays for samples collected 9-14 days (67-100%) and 15-21 days (69-100%) post-symptom onset. The Simoa and Epitope IgG assays demonstrated excellent sensitivity earlier in the disease course. The Roche and Ragon/MGH IgG assays were less sensitive during early disease, particularly among immunosuppressed individuals. Conclusions The Epitope IgG demonstrated good sensitivity and specificity. The Roche and Ragon/MGH IgG assays registered rare false positives with lower early sensitivity. The Simoa assay primary model had excellent sensitivity and few false positives.Entities:
Year: 2020 PMID: 32607518 PMCID: PMC7325183 DOI: 10.1101/2020.06.24.20139006
Source DB: PubMed Journal: medRxiv
Demographics and medical history of negative and positive controls[1]
| Measures | Negative controls (n=232) | Positive controls | |||
|---|---|---|---|---|---|
| 8–14 days (n=30) | 15–21 days (n=29) | >21 days (n=9) | All (n=68) | ||
| Age in year, median (range) | 55 (20 – 89) | 59 (37 – 79) | 56 (32 – 79) | 56 (32 – 78) | 57 (32 – 79) |
| Female sex, N (%) | 90 (39%) | 17 (57%) | 15 (52%) | 3 (33%) | 35 (51%) |
| White | 198 (85%) | 12 (40%) | 7 (24%) | 3 (33%) | 22 (32%) |
| Black | 9 (4%) | 7 (23%) | 12 (41%) | 3 (33%) | 22 (32%) |
| Asian or Pacific Islander | 5 (2%) | 2 (7%) | 2 (7%) | 2 (22%) | 6 (9%) |
| American Indian or Alaskan Native | 0 (0%) | 2 (7%) | 1 (3%) | 0 (0%) | 3 (4%) |
| Other or not recorded | 20 (9%) | 7 (23%) | 7 (24%) | 1 (11%) | 15 (22%) |
| Non-Hispanic | 212 (91%) | 23 (77%) | 22 (76%) | 8 (89%) | 53 (78%) |
| Hispanic | 10 (4%) | 4 (13%) | 4 (14%) | 1 (11%) | 9 (13%) |
| Other or not recorded | 10 (4%) | 3 (10%) | 3 (10%) | 0 (0%) | 6 (9%) |
| Intensive care | N/A | 14 (47%) | 18 (62%) | 8 (89%) | 40 (59%) |
| Hypertension | 124 (53%) | 13 (43%) | 12 (41%) | 6 (67%) | 31 (46%) |
| Obesity | 74 (32%) | 14 (47%) | 11 (38%) | 4 (44%) | 29 (43%) |
| Coronary artery disease | 68 (29%) | 10 (33%) | 10 (34%) | 3 (33%) | 23 (34%) |
| Asthma | 58 (25%) | 7 (23%) | 8 (28%) | 5 (56%) | 20 (29%) |
| Malignancy | 56 (24%) | 8 (27%) | 4 (14%) | 0 (0%) | 12 (18%) |
| Diabetes mellitus | 51 (22%) | 6 (20%) | 9 (31%) | 4 (44%) | 19 (28%) |
| Liver disease | 37 (16%) | 3 (10%) | 3 (10%) | 2 (22%) | 8 (12%) |
| COPD | 36 (16%) | 0 (0%) | 0 (0%) | 0 (0%) | 0 (0%) |
| Transplant | 29 (12%) | 2 (7%) | 3 (10%) | 1 (11%) | 6 (9%) |
| Other immune compromised conditions | 13 (6%) | 0 (0%) | 2 (7%) | 1 (11%) | 3 (4%) |
| Cerebrovascular accident | 10 (4%) | 1 (3%) | 0 (0%) | 0 (0%) | 1 (1%) |
Each sample was considered as an independent data point for calculating the values in this table.
Samples were considered “Intensive care” if they were collected from patients that required ICU admission at any point during hospitalization. Only hospitalized patients provided positive control samples, therefore the non-ICU fraction is one minus the proportion of ICU.
COPD Chronic obstructive pulmonary disease
Clinical and confirmed respiratory viral infections among negative controls
| Recent acute illness | Days prior to sample collection | Males | Females | Total |
|---|---|---|---|---|
| None | N/A | 70 | 30 | 100 |
| Upper respiratory tract infection | 1–14 days | 15 | 10 | 25 |
| 15–31 days | 9 | 16 | 25 | |
| Bacterial pneumonia | 1–14 days | 7 | 3 | 10 |
| 15–31 days | 5 | 5 | 10 | |
| Viral pneumonia | 1–14 days | 3 | 2 | 5 |
| 15–31 days | 4 | 2 | 6 | |
| Unspecified pneumonia | 1–14 days | 7 | 3 | 10 |
| 15–31 days | 7 | 3 | 10 | |
| Confirmed viral respiratory infection | N/A | 15 | 16 | 31 |
N/A Not applicable or not available
Includes Parainfluenza antigen positive (n=13), Metapneumovirus antigen (10), influenza A/B antigen (8), Influenza A PCR (3), Influenza B PCR (1), RSV antigen (n=5), RSV PCR (1), Adenovirus antigen (3), Herpes Simplex I (DFA). Total number add up to more than 31 as some individuals recorded >1 positive result.
Assay specificities
| Immunoassay | No. of negative controls[ | No. testing negative | % | 95% CI |
|---|---|---|---|---|
| Epitope IgG | 230 | 228 | 99.1 | 97.9% – 100% |
| Epitope IgM | 230 | 227 | 98.7 | 97.2% – 100% |
| Ragon/MGH IgG[ | 232 | 231 | 99.6 | 98.7% – 100% |
| Roche[ | 232 | 231 | 99.6 | 98.7% – 100% |
| Simoa (Early)[ | 232 | 230 | 99.1 | 97.9% – 100% |
Given limited negative control aliquots, the Epitope assays were tested against 230 samples, versus 232 for the remaining assays
For specificity of Ragon/MGH IgM and IgA see supplementary materials.
The Roche Elecsys Anti-SARS-CoV-2 immunoassay detects IgG and likely IgM and IgA; details of other isotypes are not provided by manufacturer
Specificity of the Simoa multiplex assay Early Model. For specificities of the Late and 12-Parameter Models see supplementary materials.
Assay sensitivities by days post-symptom onset
| Assay | Days PSO | No. of positve controls | No. testing positive | % | 95% CI |
|---|---|---|---|---|---|
| Epitope IgG | 8–14 days | 30 | 29 | 96.7 | 90.2% – 100% |
| 15–21 days | 29 | 27 | 93.1 | 83.9% – 100% | |
| > 21 days | 9 | 9 | 100 | 100% – 100% | |
| Epitope IgM | 8–14 days | 30 | 20 | 66.7 | 49.8% – 83.5% |
| 15–21 days | 29 | 20 | 69 | 52.1% – 85.8% | |
| > 21 days | 9 | 3 | 33.3 | 2.5% – 64.1% | |
| Ragon/MGH IgG[ | 8–14 days | 30 | 23 | 76.7 | 61.5% – 91.8% |
| 15–21 days | 29 | 24 | 82.8 | 69.0% – 96.5% | |
| > 21 days | 9 | 9 | 100 | 100% – 100% | |
| Roche[ | 8–14 days | 30 | 26 | 86.7 | 74.5% – 98.8% |
| 15–21 days | 29 | 26 | 89.7 | 78.6% – 100% | |
| > 21 days | 9 | 9 | 100 | 100% – 100% | |
| Simoa (Early)[ | 8–14 days | 30 | 29 | 96.7 | 90.2% – 100% |
| 15–21 days | 29 | 29 | 100 | 100% – 100% | |
| > 21 days | 9 | 9 | 100 | 100% – 100% |
For sensitivity of Ragon/MGH IgM and IgA see supplementary materials.
The Roche Elecsys Anti-SARS-CoV-2 immunoassay detects IgG and likely IgM and IgA; details of other isotypes are not provided by manufacturer
Sensitivity of the Simoa multiplex assay Early Model. For sensitivities of the Late and 12-Parameter Models see supplementary materials.