| Literature DB >> 34013020 |
James M Crawford1, Maria E Aguero-Rosenfeld2, Ioannis Aifantis2, Evan M Cadoff3, Joan F Cangiarella2, Carlos Cordon-Cardo4, Melissa Cushing5, Aldolfo Firpo-Betancourt4, Amy S Fox3, Yoko Furuya6, Sean Hacking1, Jeffrey Jhang4, Debra G B Leonard7, Jenny Libien8, Massimo Loda5, Damadora Rao Mendu4, Mark J Mulligan9, Michel R Nasr10, Nicole D Pecora11, Melissa S Pessin12, Michael B Prystowsky3, Lakshmi V Ramanathan12, Kathleen R Rauch13, Scott Riddell10, Karen Roach13, Kevin A Roth6, Kenneth R Shroyer14, Bruce R Smoller11, Steven L Spitalnik6, Eric D Spitzer14, John E Tomaszewski15, Susan Waltman16, Loretta Willis13, Zeynep Sumer-King16.
Abstract
The COVID-19 pandemic, caused by severe acute respiratory syndrome coronavirus 2, created an unprecedented need for comprehensive laboratory testing of populations, in order to meet the needs of medical practice and to guide the management and functioning of our society. With the greater New York metropolitan area as an epicenter of this pandemic beginning in March 2020, a consortium of laboratory leaders from the assembled New York academic medical institutions was formed to help identify and solve the challenges of deploying testing. This report brings forward the experience of this consortium, based on the real-world challenges which we encountered in testing patients and in supporting the recovery effort to reestablish the health care workplace. In coordination with the Greater New York Hospital Association and with the public health laboratory of New York State, this consortium communicated with state leadership to help inform public decision-making addressing the crisis. Through the length of the pandemic, the consortium has been a critical mechanism for sharing experience and best practices in dealing with issues including the following: instrument platforms, sample sources, test performance, pre- and post-analytical issues, supply chain, institutional testing capacity, pooled testing, biospecimen science, and research. The consortium also has been a mechanism for staying abreast of state and municipal policies and initiatives, and their impact on institutional and laboratory operations. The experience of this consortium may be of value to current and future laboratory professionals and policy-makers alike, in dealing with major events that impact regional laboratory services.Entities:
Keywords: advocacy; communication; laboratory; public health; supply chain
Year: 2021 PMID: 34013020 PMCID: PMC8107494 DOI: 10.1177/23742895211006818
Source DB: PubMed Journal: Acad Pathol ISSN: 2374-2895
Consortium Membership.
| Department of Pathology and Cell Biology, Columbia University* | New York, NY |
*Founding Member.
Figure 1.Timeline for Consortium Activities. The dates above the timeline reflect regional events. The dates below the timeline reflect the specific activities of the consortium. Note: APC, Association of Pathology Chairs; NYS, New York State.
Consortium Recommendations to the New York State Commissioner of Health, April 17, 2020.
|
A reliable and sustainable Supply Chain for commercial testing platforms State and local community support of the Pre-Analytical and Post-Analytical Workflow and Infrastructure for testing State support for Testing Costs incurred on behalf of nonpaying populations State support for the development and implementation of a statewide surveillance and tracking platform for data intake, epidemiology interpretation, and dissemination Continued collaborative effort between consortium members and the Wadsworth Center (public health laboratory) Coordination of consortium testing efforts with those of regional commercial laboratories, to include transparent ongoing evaluation of the multiple testing platforms in use across the state, as made possible by collaborative comparisons of test performance in different test populations A strong statewide Educational Program for Healthcare Professionals, civic and private Policy Makers, and the Public Continued extramural support (as through federal and state mechanisms) for consortium-based research into the Biology, Medical Science, and Population Health of COVID-19 infection |
SARS-CoV-2 Testing Platforms in Use by Consortium Member Institutions at height of Spring 2020 COVID-19 Pandemic (March-June, 2020).
| Test platform | Original FDA EUA approval date* |
|---|---|
| SARS-CoV-2 Diagnostic Testing |
|
|
|
|
Abbreviations: CDC, Centers for Disease Control and Prevention; DOH, Department of Health; FDA EUA, Food and Drug Administration Emergency Use Authorization; PCR, polymerase chain reaction; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2.
*Source information for Date of Issuance of FDA Emergency Use Authorization (verified February 6, 2021):
- SARS-CoV-2 Molecular Testing: https://www.fda.gov/medical-devices/coronavirus-disease-2019-covid-19-emergency-use-authorizations-medical-devices/vitro-diagnostics-euas#individual-molecular.
- SARS-CoV-2 Antigen Testing: https://www.fda.gov/medical-devices/coronavirus-disease-2019-covid-19-emergency-use-authorizations-medical-devices/vitro-diagnostics-euas#individual-antigen
- SARS-CoV-2 Antibody Testing: https://www.fda.gov/medical-devices/coronavirus-disease-2019-covid-19-emergency-use-authorizations-medical-devices/vitro-diagnostics-euas#individual-serological
†The BioFire FilmArray 2.1, including SARS-CoV-2 as a target, was an update of the prior BioFire FilmArray 2.0 Respiratory Virus Panel which did not contain SARS-CoV-2 as a target.
‡Certification issued by New York State Department of Health to specific laboratories; date of first issuance.
Figure 2.Daily SARS-CoV-2 testing by consortium institutions, April 20, 2020, to May 24, 2020. A, SARS-CoV-2 molecular diagnostic testing performed by polymerase chain reaction (PCR). B, SARS-CoV-2 serologic testing. LDT indicates laboratory developed test; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2.
Consortium Discussion Topics.
|
|
| “False Positive” outbreaks from use of rapid antigen tests |
Abbreviations: CDC, Centers for Disease Control and Prevention; EMR, electronic health record; FDA EUA, Food and Drug Administration Emergency Use Authorization; IRB, institutional review board; LDT, laboratory developed test; LIS, laboratory information system; MIS-C, multisystem inflammatory syndrome of children; PCR, polymerase chain reaction; RVP, respiratory virus panel; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2.
*Agenda topics over-and-above selective updates on prior agenda items (noting that Supply Chain was an agenda item in every meeting).
Preanalytical, Analytical, and Post-Analytical Variables Affecting Deployment of SARS-CoV-2 Testing.
| Test | Variable | Considerations† |
|---|---|---|
| Diagnostic* | Preanalytical |
|
| Analytical |
| |
| Post-analytical | Turnaround Time, especially as impacts Patient Management | |
| Serologic | Pre-analytical |
|
| Analytical |
| |
| Post-analytical | Turnaround Time |
Abbreviations: rRT-PCR, real time reverse transcriptase-polymerase chain reaction; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2.
*For detection of viral nucleic acid by rRT-PCR.
†Drawn in part from the study by Schwartz et al and Moscola et al.[8,9]
‡Harmonization: Patient identification and tube labeling, ensuring that the correct testing kit (appropriate swab device; Viral Transport Media with appropriate lysate) is used at the right collection site, and delivered to the right testing platform.
Impact of Specificity, Sensitivity, and Prevalence on Negative and Positive Predictive Value.*
| Assay | Specificity | Sensitivity | Prevalence | NPV | PPV |
|---|---|---|---|---|---|
|
| 99% | 96% | 60% | 94.3% | 99.3% |
|
| 99% | 80% | 60% | 76.7% | 99.2% |
|
| 99% | 94% | 40% | 96.1% | 98.4% |
|
| 90% | 75% | 40% | 84.4% | 83.3% |
*The impact of test performance and population prevalence on negative predictive value (NPV) and positive predictive value (PPV) is illustrated for diagnostic and serologic tests for SARS-CoV-2. In the simplest sense, as the prevalence of a disease in the population decreases, the NPV of even less sensitive tests increases, whereas the PPV decreases (owing to the decreased potential for false positives and increased potential for false negatives). Conversely, as the prevalence of a disease in the population increases, the NPV of less specific tests decreases while PPV increases, owing to the increasing likelihood of false positives but decreasing likelihood of false negatives. The chosen values for specificity and sensitivity are representative of the reported literature (see text) and the experience of consortium members. The prevalence of diagnostic positivity for SARS-CoV-2 is as experienced in the greater New York metropolitan area at the peak incidence (60%) and then falling in subsequent weeks to 12% and lower, in comparison to the single percent positivity rates experienced in upstate New York. Serologic prevalence rates were generally 15% or lower during this stage of the pandemic, although specific population groups may have had higher rates; 40% is used as a high value for illustrative purposes only. The calculations for PPV and NPV are calculated as given in Figure 3.
Figure 3.The algebra of test performance and predictive value. FN indicates false negative; FP, false positive; NPV, negative predictive value; PPV, positive predictive value; TN, true negative; TP, true positive.
Considerations for SARS-CoV-2 Test Utility.
| Category | Consideration |
|---|---|
| False negative |
|
| False positive |
|
| Positive predictive value (PPV) | The likelihood that a positive test result represents a “true positive.” PPV is high in the settings of (a) a high specificity test; and/or (b) high population prevalence of viral infection/host immune response. With lower population prevalence of viral infection (and hence, host immune response) and/or lower test specificity, PPV is decreased, and the likelihood that a positive test is a false positive increases. |
| Negative predictive value (NPV) | The likelihood that a negative test result represents a “true negative.” NPV is high in the settings of (a) a test of high sensitivity; and/or (b) a low population prevalence of viral infection (and/or host response). If test sensitivity is moderate and population prevalence of viral infection/host immune response is moderate to high, NPV is significantly decreased and the likelihood that a negative test is a false negative increases. |
Abbreviations: PCR, polymerase chain reaction; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2.
*PCR test sensitivity is a function of the number of viral RNA copies required to generate a positive result, reflected in the test Limits of Detection (LOD).
†Sensitivity in an immunologic assay, for either viral antigen (diagnostic testing) or host antibodies (serologic testing) is a trade-off between assay detection of an immunologic reaction, and setting high stringency for test specificity.
Practical Challenges in Deploying SARS-CoV-2 Testing.
| Assay | Workflow step | Challenge | Problem-solving and solutions |
|---|---|---|---|
| Diagnostic |
| ||
| Personal Protective Equipment | Inadequate Supply Chain | Procurement | |
| Nasopharyngeal Swabs | Inadequate Supply Chain | Procurement, self 3D-printing | |
| Viral Transport Medium | Inadequate Supply Chain | Procurement, self-preparation | |
| Anatomic site of sample | Timing of viral burden by site | Education of clinical providers | |
| Prioritization of Patient Samples | More samples than in-house capacity | Prioritization Protocols | |
| Send-out to commercial laboratory | Delays in TAT | Load-balancing on basis of TAT | |
|
| |||
| Choice of technology (PCR vs Antigen-based) Laboratory-based vs Rapid | Sensitivity and Specificity for each testing platform, in the context of Diagnosis vs Screening | In-house test validation, Education of clinical providers, Appropriate placement of testing platforms | |
| Serologic |
| ||
| Venipuncture vs Finger-stick | Adequacy of Finger-stick sample | Finger-stick ultimately not used | |
|
| |||
| Laboratory-based vs Rapid | Accuracy of Rapid tests | Rapid tests ultimately not used | |
| Both forms of testing |
| ||
| Testing for Patient Care, vs Testing for Screening | Need for higher performance testing for Patient Care, vs for Screening | Education of and Coordination with Clinical Providers | |
| Setting for sample procurement | ED, Ambulatory, Urgent Care, Pop-up | Coordinating Supply with Site Needs | |
| Siting of testing platforms | Near-patient testing in-hospital vs testing by a centralized in-system lab | Clear protocols for Specimen Prioritization | |
| Logistics | Delays in specimen delivery to central lab | Real-time tracking of transport | |
| Harmonization of Patient and Sample identity | Standing up massive Patient Care and Screening programs for new testing | Coordination with IT and EHS | |
|
| |||
| Commercial Equipment | Availability of equipment and supplies | Diversification of testing platforms | |
| Reagents and Kits | Availability of Reagents and Kits | Diversification of testing platforms | |
| Specificity and Sensitivity, Negative Predictive Value, Positive Predictive Value | Differences between testing platforms used within the same health system, performance of different platforms | In-house validation of all testing platforms, Education of Clinical Providers on Test Performance | |
|
| |||
| Return of test results to Patient, to Provider, to Organization | Patient and Employee Privacy, vs Institutional need for knowing results | “Apps” for Patient access to Results; Privacy Protocols | |
| Informatics and Epidemiology | Institutional Incident Command needs | Reporting of aggregate data | |
| Reporting to Civic agencies | Inconsistent requirements by different agencies; expectation that Lab can provide complete clinical and demographic metadata | Communication with Civic agencies; Advocacy when appropriate |
Abbreviations: ED, Emergency Department; EHS, Employee Health Services; IT, information technology; PCR, polymerase chain reaction; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2; TAT, turnaround time.
SARS-CoV-2 Questions for Observational and Investigative Research: April 2020.
|
– What new assays can and should be developed for the new disease that is COVID-19? – How frequently should diagnostic testing be performed to screen Patients, or a population (community or workplace)? – What are the roles and limitations of less invasive specimens (eg, saliva for diagnostic testing; finger stick for serologic testing)? – What is the role of quantitative assays for diagnostic (PCR) and serologic (antibody) testing? Is there value in quantitating the level of neutralizing antibodies? – Which assays (if any) will predict immune protection against future infections with SARS-CoV-2? – What is the role of genomic sequencing of the SARS-CoV-2 virus? What is the viral mutation rate, and how does viral mutation influence detection by PCR assays, and/or immune protection? – What is the role of host genomic sequencing? – What is the role of T cell testing and tests of innate immunity in COVID-19? – What can tissue analysis reveal about COVID-19 as a disease? – How can the clinical laboratory effectively inform COVID-19 Population Health, Predictive Analytics, and Clinical Decision Support? |
Abbreviations: PCR, polymerase chain reaction; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2.