Suggested new breakpoints of anti-MERS-CoV antibody ELISA titers: performance analysis of serologic tests.

To provide optimal cut-off values of anti-Middle East respiratory syndrome coronavirus (MERS-CoV) serologic tests, we evaluated performance of ELISA IgG, ELISA IgA, IFA IgM, and IFA IgG using 138 serum samples of 49 MERS-CoV-infected patients and 219 serum samples of 219 rRT-PCR-negative MERS-CoV-exposed healthcare personnel and patients. The performance analysis was conducted for two different purposes: (1) prediction of neutralization activity in MERS-CoV-infected patients, and (2) epidemiologic surveillance of MERS-CoV infections among MERS-CoV-exposed individuals. To evaluate performance according to serum collection time, we used 'days post onset of illness (dpoi)' and 'days post exposure (dpex)' assessing neutralization activity and infection diagnosis, respectively. Performance of serologic tests improved with delayed sampling time, being maximized after a seroconversion period. In predicting neutralization activity, ELISA IgG tests showed optimal performance using sera collected after 21 dpoi at cut-off values of OD ratio 0.4 (sensitivity 100% and specificity 100%), and ELISA IgA showed optimal performance using sera collected after 14 dpoi at cut-off value of OD ratio 0.2 (sensitivity 85.2% and specificity 100%). In diagnosis of MERS-CoV infection, ELISA IgG exhibited optimal performance using sera collected after 28 dpex, at a cut-off value of OD ratio 0.2 (sensitivity 97.3% and specificity 92.9%). These new breakpoints are markedly lower than previously suggested values (ELISA IgG OD ratio 1.1, sensitivity 34.8% and specificity 100% in the present data set), and the performance data help serologic tests to be practically used in the field of MERS management.

Introduction

Middle East respiratory syndrome coronavirus (MERS-CoV) is a novel beta coronavirus that may cause lethal respiratory disease [1]. Anti-MERS-CoV serologic tests including enzyme-linked immunosorbent assay (ELISA) and immunofluorescence assay (IFA) are available as commercial kits, and have been used for various purposes including epidemiologic investigations, evaluation of antibody kinetics, and assessing feasibility of convalescent plasma infusion therapy [2-6]. The manufacturer’s instructions provided relatively high cut-off values for positivity to warrant specificity, which were derived from limited positive samples (ELISA IgG, Euroimmun, Lübeck, Germany; 4 MERS patient samples and 500 negative controls) [7]. In previously conducted serologic studies, cut-off values were differently applied depending on the purpose of serologic tests: several epidemiologic studies applied low cut-off values to increase sensitivity of the test [3, 6], while others followed the manufacturer’s instructions [2, 4]. Also, as not all confirmed MERS-CoV-infected patients mounted robust neutralization activity [2], the performance of serologic tests should be separately analyzed depending on the purposes of the tests: predicting neutralization activity in MERS-CoV-infected patients and diagnosing MERS-CoV infection in epidemiologic surveillance. To provide optimal cut-off values depending on the purposes of the tests, we evaluated performance of various anti-MERS-CoV serologic tests using 138 serum samples of 49 MERS-CoV-infected patients and 219 serum samples of 219 rRT-PCR-negative MERS-CoV-exposed healthcare personnel (HCP) and patients.

Methods

Performance analysis depending on the purposes of serologic tests

The performance analysis included sensitivity, specificity, positive predictive value, and negative predictive value, and was conducted under two different purposes of serologic tests: (1) prediction of neutralization activity in MERS-CoV-infected patients, and (2) epidemiologic surveillance of MERS-CoV infections among MERS-CoV-exposed individuals. Plaque reduction neutralization test (PRNT) and sputum real-time reverse transcriptase polymerase chain reaction (rRT-PCR) for MERS-CoV were used as gold standards for assessing neutralization activity and diagnosing MERS-CoV infection, respectively.

MERS-CoV exposure dates and symptom onsets of collected serum samples were clearly identified owing to thorough contact investigation and monitoring of exposed individuals [8]. To provide a common point of reference, we used ‘days post onset of illness (dpoi)’ assessing neutralization activity since symptom onset could be clearly identified among MERS-CoV-infected patients. Meanwhile, as epidemiologic surveillances are usually conducted on the basis of exposure events, we applied ‘days post exposure (dpex)’ assessing diagnostic performance of serologic tests in epidemiologic surveillance.

To compare performances of serologic tests depending on serum collection time, each test was evaluated at three different timepoints: (1) regardless of serum collection time, (2) after 14 dpoi (or 21 dpex), and (3) after 21 dpoi (or 28 dpex).

Study population and samples

During the 2015 Korean MERS outbreak, we obtained 138 serum samples from 49 MERS-CoV infected patients. Study population included 42 patients who were managed at a 1950-bed tertiary care university hospital [8, 9], and seven patients who donated sera for plasma infusion therapy or serologic testing. MERS-CoV infections were confirmed on the basis of rRT-PCR assays targeting upstream of the E gene (upE) and the open-reading frame gene 1a (ORF1a) [10, 11]. Epidemiologic investigation data and electronic medical records were reviewed to obtain exact exposure date and symptom onset. One or two serum samples were collected per week of illness during hospitalization. Follow-up serum samples were obtained up to 6 months from symptom onset at an outpatient clinic. Sera of 219 rRT-PCR-negative MERS-CoV-exposed HCP and patients were used as negative control samples [3]. Collected samples were stored at −70 °C for about three months before testing. The Institutional Review Board of Samsung Medical Center approved the present study.

Serologic tests for anti-MERS-CoV antibody

ELISA IgG and IgA

Anti-MERS-CoV ELISA IgG and IgA (Euroimmun, Lübeck, Germany) were based on soluble MERS-CoV spike protein S1 domain expressed in HEK-293 T cells [6, 12–14]. Sera were tested according to the manufacturer’s instructions with 1:100 dilutions. Secondary detection was done with peroxidase-labeled anti-human IgG and IgA. ELISA IgG was initially tested in all of the collected serum samples, and other serologic tests including ELISA IgA, IFA, and PRNT were selectively performed depending on ELISA IgG (using optical density (OD) ratio cut-off value of 0.2) and sputum rRT-PCR results (Table 1). Since IFA IgG was limitedly tested among an rRT-PCR-negative population, diagnostic performance for epidemiologic surveillance of IFA IgG could not be evaluated.

Table 1

Number of individuals and serum samples that underwent serologic testing

Performance analysis	Number of sera and patients	Anti-MERS-CoV serologic tests
		ELISA IgG	ELISA IgA	IFA IgM	IFA IgG	PRNT
Prediction of neutralization activity	138 sera from 49 MERS-CoV-infected patients	O	O	O*	O†	O
Epidemiologic surveillance	158 sera from 158 MERS-CoV-exposed, rRT-PCR-negative HCP, ELISA IgG OD ratio < 0.2	O	X	X	X	X
	11 sera from 11 MERS-CoV-exposed, rRT-PCR-negative HCP, ELISA IgG OD ratio ≥ 0.2	O	O	O	O‡	O
	43 sera from 43 MERS-CoV-exposed, rRT-PCR-negative patients, ELISA IgG OD ratio < 0.2	O	X	O	X	X
	7 sera from 7 MERS-CoV-exposed, rRT-PCR-negative patients, ELISA IgG OD ratio ≥ 0.2	O	O	O	O	O
Total tested serum samples		357	156	194	89	156
Total tested individuals		268	67	110	48	67

ELISA IgG was initially tested in all collected samples, and other serologic tests were selectively performed depending on rRT-PCR and ELISA IgG results. A 0.2 OD ratio cut-off value was applied for ELISA, which was approximately three-fold compared with the median (0.06) value of 41 healthy individuals

*Five sera that were collected late were not tested. †To compare performance in predicting neutralizing activity with ELISA IgG, anti-MERS-CoV IFA IgG was tested with titration from 1:50 to 1:1000 dilutions in selected sera of MERS-CoV-infected patients: 18 sera from 18 patients collected between 14 and 27 dpoi (presumed window period of seroconversion) and 53 sera from 12 patients whose sera were serially collected at least four times. ‡To substantiate ELISA results, IFA IgG was tested in these samples at a 1:100 dilution, which was not included in performance analysis.

MERS-CoV Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, IFA immunofluorescence assay, PRNT plaque reduction neutralization test, rRT-PCR real-time reverse transcriptase polymerase chain reaction, HCP healthcare personnel, OD optical density, dpoi days post onset of illness

IFA IgG and IgM

Anti-MERS-CoV IFA IgG and IgM (Euroimmun) were performed with slides carrying Vero cells infected with full MERS-CoV [12, 14, 15]. Sera were tested according to the manufacturer’s instructions with 1:10 and 1:100 dilutions for IFA IgM and IgG, respectively.

For comparison of the performance of IFA IgG with that of ELISA IgG, 71 sera were selected for titration from 1:50 to 1:1000 dilutions, including sera collected between 14 and 27 dpoi (presumed window period of seroconversion) [4, 5], and sera of patients who were serially sampled at least four times (Table 1).

PRNT

MERS-CoV PRNT was performed as previously described [12, 14]. Pre-dilution before setting up the log2-dilution series was 1:10, defining 1:20 as the lowest possible significant titer for categorizing a sample as positive [12].

Statistical analysis

Cut-off values with optimal sensitivity and specificity were analyzed per 0.1 OD ratio or each IFA intensity. Areas under the curve (AUCs) were calculated using the receiver operating characteristic (ROC) curve. R-3.3.1 for Windows (RStudio, Boston, MA, USA) was used for all statistical analyses.

Results

Performance of serologic tests in predicting neutralization activity

The performance of serologic tests improved with delayed sampling time, being maximized when sera collected after 21 dpoi were used (Fig. 1a). In predicting neutralization activity, ELISA IgG and IFA IgM tests showed optimal performance using sera collected after 21 dpoi, at cut-off values of OD ratio 0.4 and weekly-positive IFA intensity, respectively (Table 2). Especially, ELISA IgG showed 100% sensitivity and 100% specificity at this time point, while ELISA IgG and IFA IgM exhibited slightly lower performance (area under the curve (AUC) 1.000, 0.996, and 0.917, respectively). Meanwhile, ELISA IgA showed optimal performance using sera collected after 14 dpoi at cut-off value of OD ratio 0.2. Detailed performance values depending on serum collection time and cut-off values are presented in Supplementary Tables 1 to 3. IFA IgG showed optimal performance with cut-off value of 1:500 dilutions, and overall performance was not superior to ELISA IgG (Supplementary Table 4).

Fig. 1

Changes in ROC curves of anti-MERS-CoV ELISA IgG antibodies for prediction of neutralizing activity and diagnosis of MERS-CoV infection depending on serum collection time. (a) ROC curve of ELISA IgG OD ratios predicting neutralization activity in MERS-CoV-infected patients. When sera collected after 21 dpoi were used, both sensitivity and specificity increased to 100%. An ELISA OD ratio of 0.420 was the best cut-off value based on the ROC curve, and 0.4 was the optimal value on the basis of a 0.1 OD ratio. (b) ROC curve of ELISA IgG OD ratios for the diagnosis of MERS-CoV infection in a MERS-CoV-exposed population. When sera collected after 28 dpex were used, sensitivity and specificity increased to 97.3 and 98.2, respectively. An ELISA OD ratio of 0.262 was the best cut-off value based on the ROC curve, and 0.2 was the optimal value on the basis of a 0.1 OD ratio. ROC receiver operating characteristic, MERS-CoV Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, OD optical density, dpoi days post onset of illness, dpex days post exposure

Table 2

Performance of anti-MERS-CoV antibody tests in predicting neutralization activity

Data are expressed as a percentage of each predictive value according to various cut-off values. Cut-off values with optimal sensitivity and specificity analyzed per 0.1 OD ratio (ELISA) or IFA intensity are presented as gray-scale. AUCs were calculated from the ROC curve. The population of this analysis is 49 MERS-CoV-infected patients confirmed by rRT-PCR (Table 1). The neutralization activity of sera was confirmed by PRNT and a 1:20 dilution was defined as the lowest significant titer.

MERS-CoV Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, AUC area under the curve, PPV positive predictive value, NPV negative predictive value, dpoi days post onset of illness, IFA immunofluorescence assay, w+ weak positive, OD optical density, ROC receiver operating characteristic, rRT-PCR real-time reverse transcriptase polymerase chain reaction, PRNT plaque reduction neutralization test

Performance of serologic tests in diagnosing MERS-CoV infection

In diagnosing MERS-CoV infection, ELISA IgG, ELISA IgA, and IFA IgM tests showed optimal performance using sera collected after 28 dpex, at cut-off value of OD ratio 0.2, OD ratio 0.2, and weakly-positive IFA intensity, respectively (Table 3). Most values of rRT-PCR-negative MERS-CoV-exposed individuals were under these cut-off values, discriminating MERS-CoV-infected and non-infected individuals (Fig. 2). Overall, ELISA IgG showed better performance than ELISA IgA or IFA IgM for diagnosing MERS-CoV infection (AUC 0.982, 0.914, and 0.875, respectively, when sera collected after 28 dpex were used). Performance of serologic tests improved with delayed sampling time, being maximized when sera collected after 28 dpex were used (Fig. 1b and Supplementary Tables 5 to 7). In addition, the specificity of ELISA IgG, ELISA IgA, and IFA IgM tests was 100% regardless of serum collection time, at cut-off value of OD ratio 0.5, OD ratio 0.3, and IFA intensity 1+, respectively.

Table 3

Performance of anti-MERS-CoV antibody tests in epidemiologic surveillance of MERS-CoV infection

Data are expressed as a percentage of each predictive value according to various cut-off values. Cut-off values with optimal sensitivity and specificity analyzed per 0.1 OD ratio (ELISA) or IFA intensity are presented as gray-scale. AUCs were calculated from the ROC curve. The population this analysis is 268 MERS-CoV-exposed individuals (Table 1). Diagnosis of MERS-CoV infection was confirmed by positive rRT-PCR assay of respiratory specimens.

MERS-CoV Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, AUC area under the curve, PPV positive predictive value, NPV negative predictive value, dpex days post exposure, IFA immunofluorescence assay, w+ weak positive, OD optical density, ROC receiver operating characteristic, rRT-PCR real-time reverse transcriptase polymerase chain reaction

Fig. 2

Distribution of anti-MERS-CoV IgG, IgA, and IgM antibody values according to test population. (a) Distribution of anti-MERS-CoV ELISA IgG. (b) Distribution of anti-MERS-CoV ELISA IgA. (c) Distribution of anti-MERS-CoV IFA IgM. MERS-CoV-infected patients are classified according to the severity groups: asymptomatic infection (group 0), symptomatic infection without pneumonia (group 1), pneumonia without respiratory failure (group 2), and pneumonia progressing to respiratory failure (group 3). The distribution of anti-MERS-CoV antibodies of group 0 patients was similar to those of rRT-PCR-negative MERS-CoV-exposed individuals. Most values of MERS-CoV non-infected patients were under the optimal cut-off value for MERS diagnosis. MERS-CoV Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, OD optical density, IFA immunofluorescence assay

Discussion

Neutralization testing is a gold standard method for detecting antiviral antibodies, especially exhibiting virus-killing function. However, neutralization tests against MERS-CoV cannot be readily performed worldwide as it requires biosafety level 3 facilities, skilled experts, and carries a potential risk of infection [5]. To reduce such risks and workloads, previous anti-MERS-CoV serologic studies applied step-wise approaches using ELISA and IFA, which are relatively easy and safe to test [6, 12]. To make anti-MERS-CoV serologic tests more practical, we assessed performance of ELISA and IFA tests for two clinical purposes and suggested optimal cut-off values.

As previous cut-off values for positivity were provided for diagnosis of MERS-CoV infection [7], we firstly suggest cut-off values for predicting neutralization activity. In the present analysis, both ELISA IgG and IgA excellently predicted neutralization activity (using sera collected after 21 dpoi, AUC 1.000 and 0.996, respectively). Of note, ELISA IgG showed 100% sensitivity and 100% specificity at this time point, with OD ratio cut-off value of 0.4. Predicting neutralization activity is extremely important in selecting donors and recipients of convalescent plasma infusion therapy, which is a potential treatment for MERS-CoV infection [2]. In the present analysis, even after 21 dpoi, 19.5% (8/41, Supplementary Table 1) of collected sera did not have neutralization activity, which emphasizes importance of antibody testing before collecting convalescent plasma. In addition, measurement of neutralization activity is also important in selecting recipients and evaluating effect of convalescent plasma infusion. Using ELSIA tests with performance data from the present analysis, evaluation of neutralization activity can be performed in the field of MERS patient management without delay.

Diagnosing MERS-CoV infections using anti-MERS-CoV serologic tests has been practically used for post-exposure epidemiologic studies or sero-prevalence investigations in endemic regions [3, 6, 12, 16]. To increase sensitivity of ELISA as a screening test, several epidemiologic studies applied low cut-off values of OD ratio, usually a three-fold value of negative controls (ELISA IgG OD ratios 0.2 to 0.3, depending on study sites) [3, 6]. In the present analysis, we demonstrated that an ELISA IgG cut-off value of OD ratio 0.2 actually showed optimal performance with high specificity of 92 to 94%. This is visually well demonstrated in Fig. 2; an ELISA IgG cut-off value of OD ratio 0.2 optimally discriminated negative controls and symptomatic infections (groups 1 to 3), while ELISA IgA and IFA IgM show inferior performance differentiating negative controls and mild patients (group 1). Asymptomatic patients (group 0) did not show any serologic responses, which make serologic diagnosis inapplicable. The manufacturer’s instructions provided a significantly higher break point for MERS diagnosis to warrant specificity (for ELISA IgG, borderline OD ratio cut-off of 0.8–1.1 and positive ≥1.1) [7]. However, we demonstrated that ELISA IgG exhibits 100% specificity from the cut-off value of OD ratio 0.5 (Supplementary Table 5), while previous cut-off value of OD ratio 1.1 showed extremely low sensitivity of 34.8%. Therefore, we suggest ELISA IgG OD ratio 0.2 as a new break point for MERS-CoV diagnosis for general application, while OD ratio 0.5 can be applied for maximal specificity. In addition, we recommend taking at least a 28-day interval from MERS-exposure to serum sampling for post-exposure serologic investigations, to warrant seroconversion. In our unpublished data, seroconversion occurred around the third week of illness or the fourth week after exposure (18 dpoi in median, ranged 14–24; 22 dpex in median, ranged 18–30; Ko et al., data under review).

Although ELISA IgG showed slightly higher AUC than IFA IgG (Supplementary Table 4), the number of IFA tested samples was not sufficient, which limited comparison of performance between the two different methods. However, performance of ELISA IgG was at least not inferior to that of IFA IgG, which implies that additional confirmation by IFA after ELISA screening is not mandatory. In addition, considering the cross-reactivity of the serologic tests to other coronaviruses [12], the performance for MERS diagnosis could be affected by the local epidemiology of human coronavirus infections.

In conclusion, in a performance analysis using 138 serum samples form 49 MERS-CoV-infected patients, ELISA IgG showed optimal performance in predicting neutralization activity and diagnosing MERS-CoV infection at cut-off values of OD ratio 0.4 and 0.2, respectively. With this performance analysis, anti-MERS-CoV serologic tests can be practically used in the field of MERS management.

(DOCX 48 kb)