Literature DB >> 33933851

The role of IL-6/lymphocyte ratio in the peripheral blood of severe patients with COVID-19.

Boyi Yang1, Xiaoyan Chang2, Jiabao Huang3, Wen Pan4, Zhilong Si5, Cuntai Zhang1, Hong Li6.   

Abstract

BACKGROUND: To investigate the prognostic value of a novel immune-inflammatory index, the interleukin-6-to-lymphocyte ratio (IL-6/LY), with the clinical outcomes of severe coronavirus disease 2019 (COVID-19) cases.
METHODS: A cohort study of COVID-19 patients in Tongji Hospital, from January 2020 to February 2020, was evaluated. Kaplan-Meier method and the log-rank test was performed to analyze survival data. Univariate and multivariate analyses were performed with COX proportional hazard regression model. The primary and secondary outcomes were in-hospital mortality and multiple organ dysfunction syndrome (MODS), respectively.
RESULTS: Total 320 adult patients were enrolled in our analyses. Patients were divided into low IL-6/LY group and high IL-6/LY group based on the cutoff value with 2.50. The Kaplan-Meier survival curves showed that high-value group (IL-6/LY ≥ 2.50) had a greater risk of poor prognosis (P < 0.001, respectively). Multivariate analysis indicated that IL-6/LY was the independent risk predictor for in-hospital mortality (hazard ratio [HR], 3.404; 95% confidence interval [CI], 1.090-10.633, P = 0.035) and MODS development (HR, 4.143; 95%CI, 1.321-12.986, P = 0.015). Meanwhile, IL-6/LY was positively correlated with the MuLBSTA score (r = 0.137, P = 0.031), suggesting that IL-6/LY was associated with long-term mortality (90-day). Furthermore, kinetic analysis revealed that the dynamic changes of inflammatory immune indexes were related to the severity of the disease.
CONCLUSIONS: The elevated IL-6/LY was related with the increased risk of poor prognosis. Not only that, IL-6/LY could be used for risk stratification and early clinical identification of high-risk patients.
Copyright © 2021 The Authors. Published by Elsevier B.V. All rights reserved.

Entities:  

Keywords:  Coronavirus disease 2019; Immune-inflammatory index; Interleukin-6; Lymphocyte; Prognosis

Mesh:

Substances:

Year:  2021        PMID: 33933851      PMCID: PMC7953449          DOI: 10.1016/j.intimp.2021.107569

Source DB:  PubMed          Journal:  Int Immunopharmacol        ISSN: 1567-5769            Impact factor:   5.714


Introduction

In December 2019, the outbreak of coronavirus disease 2019 (COVID-19), caused by a novel coronavirus called severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has spread rapidly throughout the world [1]. Considering the present epidemic situation, the World Health Organisation (WHO) declared a global pandemic on March 11, 2020 [2]. The raging infectious disease has caused a serious threat to human health. This brings the global cumulative numbers to 110.7 million cases and over 2.4 million deaths since the start of the pandemic [3]. SARS-CoV-2 is a beta-coronavirus, similar to other two known virus: severe acute respiratory syndrome‐CoV (SARS‐CoV) and Middle East Respiratory Syndrome‐CoV (MERS‐CoV), which have caused potentially fatal infections over the last 20 years [4]. The whole genome sequencing indicated that SARS-CoV-2 was very closely related to SARS-CoV [5]. Although SARS-CoV-2 is less lethal than MERS‐CoV and SARS‐CoV, it has stronger interpersonal transmission ability [6], [7]. Most patients with COVID-19 were asymptomatic or presented mild to moderate symptoms, however, about 10–20% of cases developed severe symptoms, characterized by the rapid development of acute respiratory distress syndrome (ARDS), sepsis and/or multiple organ failure [2]. In particular, the elderly patients and those with comorbidities tended to develop severe symptoms [8], which might be due to their weaker immune function. Till now, the pathogenicity of COVID-19 has not been completely understood, and the underlying mechanism leading from mild to severe cases remained unclear. Recently, it has been speculated that the cytokine storm and immune dysfunction was closely related to the rapid disease progression [9]. Researchers found that the levels of infection-related biomarkers played vital roles in severe cases of COVID-19 [10]. Moreover, previous studies showed that lower lymphocyte counts, especially decreased levels of T lymphocyte subsets were linked to severe cases, accompanied with elevated levels of pro-inflammatory cytokines like interleukin-6 (IL-6) [11], [12]. These suggested that immune dysfunction and cytokine dysregulation might be the key factors in the progression of the disease. In the current situation, the identification of disease progression of COVID-19 mainly depends on the clinical manifestation, while effective biomarkers have not been proposed. It is important to find sensitive biomarkers to identify critically ill patients in a timely and effective manner. As mentioned above, elevated IL-6 levels and lymphopenia were correlated with severity of disease [11], [12]. The IL-6-to-lymphocyte ratio (IL-6/LY) based on the two factors may reflect the imbalance of inflammation response and immune dysfunction in the body more comprehensively. In our study, we investigated the predictive effect of the new immune-inflammatory complex index on the prognosis of COVID-19, in order to provide positive help for clinical risk assessment.

Materials and methods

Study population

A total of 320 adult patients with severe COVID-19 pneumonia who were hospitalized in Sino-French New City Branch of Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, from January 2020 to February 2020, were enrolled in our retrospective study. Diagnosis of confirmed COVID-19 was based on the interim guidance issued by WHO [13]. The definitions of severe illness associated with COVID-19 were as follow: fever or suspected respiratory infection; plus one of the following: (1) respiratory rate > 30 breaths/min; (2) severe respiratory distress; (3) or SPO2 ≤ 93% on room air. Moreover, patients with suspected COVID-19, patients whose age was below 18 years old, or the patients died within 24 h of admission were excluded. The ethics Committee of Tongji Hospital approved this study (TJ-IRB20200362) and waived the requirement for written informed consent due to the massive contagion outbreak of this infectious disease.

Clinical date collection

We reviewed the electronic medical records system in hospital and collected the clinical information of all participants, including age, sex, smoking history, past medical histories (such as coronary artery disease, hypertension and diabetes). In addition, the data of initial common symptoms were gathered at the time of admission. The treatments during hospitalization (like oxygen therapy, pharmacotherapy and invasive therapies) were included in our data as well. What’s more, the complications were destined to record. Venous blood samples were routinely collected from all patients during the time of hospitalization. The data were checked by two trained physicians independently. Laboratory findings included complete blood counts, coagulation function (prothrombin time, activated partial thromboplastin time, D-dimer), cardiac function (high sensitivity cardiac troponin I, N-terminal pro-brain natriuretic peptide), liver function (aminopherase, creatine kinase, lactate dehydrogenase), kidney function (urea nitrogen, creatinine), lipid profile and immuno-inflammatory indices.

Clinical outcomes

The primary endpoint of our study was in-hospital mortality, which was identified as the all-cause death happened during hospitalization. The secondary end point was incidence of multiple organ dysfunction syndrome (MODS), which was identified as acute dysfunction or failure happened in more than one system simultaneously or sequentially because of the severe diseases (such as serious infection). Clinically, MODS was common in lung, kidney, liver, heart, central nervous system, immune system and hematologic system [14].

Statistical analysis

The IL-6/LY was calculated as follow: IL-6/LY = IL-6/lymphocyte counts. The neutrophil to lymphocyte ratio (NLR) was calculated as follow: N/L = neutrophil counts/lymphocyte counts. Continuous variables were described as mean ± standard error and tested for normal distribution by the Kolmogorov-Smirnov test. Using independent samples t test or Mann-Whitney U test to compare the continuous variables between groups. Categorical variables were described as frequency rates and percentages and compared with the chi-square test. The correlation between IL-6/LY and MuLBSTA score was tested by using Spearman correlation coefficient. The optimal cut-off point for IL-6/LY was calculated by receiver operating characteristic (ROC) curve. Kaplan–Meier method and the log-rank test was performed to analyze survival data. Univariate and multivariate analyses were conducted with COX proportional hazard regression model. Any variables examined in the univariate analysis for which the P value was <0.10 or several established risk factors were contained in the multivariate model. A P value <0.05 was considered statistically significant. All data were analyzed using SPSS version 22.0 and Graphpad 6.0 software.

Results

Baseline characteristics of COVID-19 patients

Totally, 320 severe patients with COVID-19 were enrolled in our study and they all met the diagnostic criteria of severe COVID-19 patients as described above. In accordance with the cut-off value of IL-6/LY, the whole population was divided into low IL-6/LY group (207 patients, 100 males) and high IL-6/LY group (113 patients, 40 males). The demographics and clinical characteristics of study population were shown in Table 1 . The patients in high IL-6/LY group were older, smoking more and with more comorbidities of coronary heart disease, diabetes and chronic lung disease (P < 0.050, respectively). Additionally, more patients in the high IL-6/LY group experienced moderate to high-grade fever (P < 0.050), with longer days from onset to hospitalization (P = 0.023), more complications (P < 0.001), and higher occupancy ratio of oxygen therapy and invasive treatment applications (P < 0.050, respectively). Conversely, patients in the low IL-6/LY group stayed longer in hospital (P < 0.001). The main clinical manifestations were dyspnea and mild-grade fever, and more patients in low IL-6/LY group received pharmacotherapy in hospital (P < 0.050).
Table 1

. Demographics and clinical characteristics of study population.

All patients (n = 320)Low IL-6/LY group (n = 207)High IL-6/LY group (n = 113)P
Gender, (male), n (%)140 (43.75)100 (48.31)40 (35.40)0.026
Age, year61.37 ± 0.8657.87 ± 1.1067.77 ± 1.15<0.001
Smoking, n (%)41 (12.81)16 (7.73)25 (22.12)<0.001
Comorbidity, n (%)
 CHD46 (14.38)23 (11.11)23 (20.35)0.024
 Hypertension113 (35.31)65 (31.40)48 (42.48)0.048
 Diabetes109 (34.06)53 (25.60)56 (49.56)<0.001
 Chronic lung disease26 (8.13)12 (5.80)14 (12.39)0.039
 Chronic kidney disease8 (2.5)6 (2.90)2 (1.77)0.537
 Chronic liver disease14 (4.38)7 (3.38)7 (6.19)0.240
 Autoimmune diseases8 (2.5)7 (3.38)1 (0.88)0.172
 Tumor19 (5.94)12 (5.80)7 (6.19)0.886
 Cerebrovascular disease16 (5.00)7 (3.38)9 (7.96)0.072
 Gastrointestinal disease16 (5.00)12 (5.80)4 (3.54)0.376
Time of illness onset, days10.83 ± 0.3410.06 ± 0.3812.22 ± 0.640.023
Hospital stays, days14.49 ± 0.4215.89 ± 0.4811.93 ± 0.75<0.001
Initial common symptoms, n (%)
 Fever281 (87.81)179 (86.47)102 (90.27)0.322
 Dyspnea189 (59.06)107 (51.69)82 (72.57)<0.001
 Stomachache31 (9.69)22 (10.63)9 (7.96)0.441
 Diarrhea100 (31.25)66 (31.88)34 (30.09)0.740
 Chest distress80 (25.00)45 (21.74)35 (30.97)0.068
 Chest pain24 (7.5)13 (6.28)11 (9.73)0.262
 Palpitation32 (10.00)17 (8.21)15 (13.27)0.149
 Dizziness32 (10.00)22 (10.63)10 (8.85)0.612
 Headache60 (18.75)36 (17.39)24 (21.24)0.399
Temperature, ℃
 High fever (39.1–41.0)9 (2.81)3 (1.45)6 (5.31)0.046
 Moderate fever (38.1–39.0)68 (21.25)31 (14.98)37 (32.74)<0.001
 Mild fever (37.3–38.0)68 (21.25)40 (19.32)28 (24.78)0.254
Pharmacotherapy in hospital, n (%)
 Antibiotic therapy295 (92.19)186 (89.86)109 (96.46)0.035
 Antiviral therapy213 (66.56)146 (70.53)67 (59.29)0.042
 GCS219 (68.44)126 (60.87)93 (82.30)<0.001
Oxygen therapy in hospital, n (%)
 NMV153 (47.81)68 (32.85)85 (75.22)<0.001
 IMV85 (26.56)26 (12.56)59 (52.21)<0.001
Other treatment in hospital, n (%)
 CRRT19 (5.94)4 (1.93)15 (13.27)<0.001
 ECMO5 (1.56)1 (0.48)4 (3.54)0.035
Complications, n (%)
 Death145 (45.31)55 (26.57)90 (79.65)<0.001
 MODS137 (42.81)51 (24.64)86 (76.11)<0.001
 ARDS114 (35.63)44 (21.26)70 (61.95)<0.001
 DIC75 (23.44)19 (9.18)56 (49.56)<0.001
 Secondary infection42 (13.13)14 (6.76)28 (24.78)<0.001
 MACE80 (25.00)29 (14.01)51 (45.13)<0.001
 AKI53 (16.56)11 (5.31)42 (37.17)<0.001
 Spesis shock52 (16.25)20 (9.66)32 (28.32)<0.001
 Myelosuppression79 (24.69)24 (11.59)55 (48.67)<0.001
 GIB14 (4.38)2 (0.97)12 (10.62)<0.001
 Liver function impairment80 (25.00)35 (16.91)45 (39.82)<0.001
. Demographics and clinical characteristics of study population. The laboratory characteristics of the patients were summarized in Table 2 . Higher levels of white blood cells, neutrophil counts, monocyte counts, prothrombin time, D-dimer, hypersensitive cardiac troponin I, NT-proBNP, ALT, AST, globulin, triglyceride, creatine kinase, LDH, urea, creatinine, high-sensitivity C-reactive protein (Hs-CRP), ESR, ferritin, procalcitonin, IgA, IgG, IL-2R, IL-6, IL-8, IL-10, TNF-α and MuLBSTA score were found in high IL-6/LY group (P < 0.050, respectively), comparing to those in low IL-6/LY group. However, the value of lymphocyte, platelet, albumin, total cholesterol, HDL-C, LDL-C, C3 and C4 was lower in high IL-6/LY group compared with that in low IL-6/LY group (P < 0.050, respectively).
Table 2

. Laboratory characteristics of study population.

All patients (n = 320)Low IL-6/LY group (n = 207)High IL-6/LY group (n = 113)P
Blood routine index
 WBC, 109/L7.56 ± 0.275.99 ± 0.2510.44 ± 0.53<0.001
 Neutrophil%, %75.95 ± 0.8470.31 ± 1.0486.30 ± 0.74<0.001
 Neutrophil, 109/L6.22 ± 0.284.55 ± 0.259.28 ± 0.52<0.001
 Lymphocyte%, %16.12 ± 0.6420.44 ± 0.798.21 ± 0.56<0.001
 Lymphocyte, 109/L0.90 ± 0.041.04 ± 0.060.65 ± 0.03<0.001
 Monocyte%, %6.88 ± 0.227.83 ± 0.295.14 ± 0.290.252
 Monocyte, 109/L0.45 ± 0.020.43 ± 0.020.47 ± 0.03<0.001
 Hemoglobin, mg/dL124.73 ± 1.34124.91 ± 1.59124.41 ± 2.460.931
 Platelet, 109/L193.25 ± 5.09204.74 ± 6.33172.22 ± 8.23<0.001
Coagulation function
 PT, sec15.34 ± 0.3414.48 ± 0.2116.95 ± 0.86<0.001
 APTT, sec42.29 ± 0.7641.43 ± 0.6043.57 ± 1.650.133
 D-dimer, ug/mL FEU4.85 ± 0.422.98 ± 0.408.39 ± 0.84<0.001
Biochemical indexes
 CTnI, pg/ml616.36 ± 199.58168.54 ± 97.511331.94 ± 487.36<0.001
 NT-proBNP, pg/ml2467.98 ± 521.931449.30 ± 531.334022.81 ± 1023.28<0.001
 ALT, u/L37.37 ± 3.5631.75 ± 3.7847.57 ± 7.21<0.001
 AST (u/L)48.30 ± 5.4133.43 ± 1.9175.27 ± 14.53<0.001
 Albumin, g/L33.30 ± 0.3034.83 ± 0.3330.51 ± 0.50<0.001
 Globulin, g/L34.17 ± 0.3633.41 ± 0.4535.56 ± 0.58<0.001
 TC, mmol/l3.57 ± 0.053.66 ± 0.063.42 ± 0.080.008
 TG, mmol/L1.64 ± 0.071.51 ± 0.091.80 ± 0.120.001
 HDL-C, mmol/l0.85 ± 0.020.95 ± 0.030.75 ± 0.03<0.001
 LDL-C, mmol/l2.18 ± 0.062.30 ± 0.072.05 ± 0.110.014
 CK, u/L254.18 ± 37.96147.14 ± 18.86382.39 ± 78.34<0.001
 LDH, u/L427.50 ± 16.44334.58 ± 13.65597.58 ± 33.86<0.001
 Urea, mmol/L7.72 ± 0.455.62 ± 0.3111.55 ± 1.04<0.001
 Creatinine, mmol/L95.75 ± 5.0489.05 ± 6.76107.96 ± 6.98<0.001
Immuno-inflammatory indices
 Hs-CRP, mg/L76.95 ± 4.0152.85 ± 3.93119.18 ± 7.05<0.001
 ESR, mm/H38.93 ± 1.5835.39 ± 1.8545.02 ± 2.780.003
 Ferritin, ug/L1483.87 ± 188.08854.89 ± 87.862366.85 ± 421.14<0.001
 PCT, ng/mL1.41 ± 0.480.23 ± 0.053.44 ± 1.28<0.001
 Ig A, g/L2.40 ± 0.092.20 ± 0.102.61 ± 0.140.017
 Ig G, g/L12.43 ± 0.2911.71 ± 0.3513.21 ± 0.470.010
 Ig M, g/L1.06 ± 0.041.09 ± 0.061.03 ± 0.070.214
 Alexin C3, g/L0.83 ± 0.020.87 ± 0.020.79 ± 0.030.007
 Alexin C4, g/L0.24 ± 0.010.25 ± 0.010.22 ± 0.010.014
 IL-1β, pg/ml5.93 ± 0.265.67 ± 0.236.25 ± 0.510.890
 IL-2R, pg/ml1008.15 ± 51.85716.46 ± 59.661356.64 ± 77.04<0.001
 IL-6, pg/ml113.32 ± 31.3551.18 ± 36.95187.55 ± 52.10<0.001
 IL-8, pg/ml68.94 ± 30.3621.64 ± 3.83125.45 ± 66.25<0.001
 IL-10, pg/ml12.44 ± 1.257.92 ± 0.6717.83 ± 2.55<0.001
 TNF-α, pg/ml11.70 ± 0.639.13 ± 0.6314.76 ± 1.10<0.001
 MuLBSTA score7.88 ± 0.217.46 ± 0.258.65 ± 0.370.024
. Laboratory characteristics of study population. Mean ± SEM and n (%) are reported for continuous and categorical variables, respectively. Abbreviations in Table 1: standard error of the mean (SEM), not available (NA),interleukin-6 to lymphocyte ratio (IL-6/LY), coronary heart disease (CHD), glucocorticoids (GCS), noninvasive mechanical ventilation (NMV), invasive mechanical ventilation (IMV), continuous renal replacement therapy (CRRT), extracorporeal membrane oxygenation (ECMO), multiple organ dysfunction syndrome (MODS), acute respiratory distress syndrome (ARDS), disseminated intravascular coagulation (DIC), major adverse cardiac events (MACE), acute kidney injury (AKI), gastrointestinal bleeding (GIB). Abbreviations in Table 2: white blood cells count (WBC), prothrombin time (PT), activated partial thromboplastin time (APTT), Hypersensitive cardiac troponin I (CTnI), N-terminal pro brain natriuretic peptide (NT-proBNP), aspartate aminotransferase (AST), alanine aminotransferase (ALT), total cholesterol (TC), triglyceride (TG), high density lipoprotein cholesterol (HDL-C), low density lipoprotein cholesterol (LDL-C), creatine kinase (CK), lactate dehydrogenase (LDH), high-sensitivity C-reactive protein (Hs-CRP), erythrocyte sedimentation rate (ESR), procalcitonin (PCT), immunoglobulin A (Ig A), immunoglobulin G (Ig G), immunoglobulin M (Ig M), interleukin-1β (IL-1β), interleukin-2 receptor (IL-2R), interleukin-6 (IL-6), interleukin-8 (IL-8), interleukin-10 (IL-10), tumor necrosis factor α(TNF-α).

Prognostic factors for clinical outcomes

The following categorical variables were entered in a forward stepwise COX regression analysis: age, sex, smoking history, coronary heart disease, hypertension, diabetes, the days of illness onset, blood routine index, coagulation dysfunction indicators, serum biochemical indices, inflammatory markers and cytokines. Elevated IL-6/LY (hazard ratio [HR], 3.404; 95% confidence interval [CI], 1.090–10.633, P = 0.035) along with older age (HR, 1.034; 95%CI, 1.004–1.064, P = 0.025), lower LY% (HR, 0.897; 95%CI, 0.846–0.952, P < 0.001), lower hemoglobin (HR, 0.980; 95%CI, 0.968–0.992, P = 0.002) and higher ferritin (HR, 1.000; 95%CI, 0.999–1.001, P = 0.007) was associated with greater risk of in-hospital mortality according to multivariate COX regression analysis. In addition, compared with other inflammatory markers (including NLR, Hs-CRP, procalcitonin and interleukins; all P > 0.05), IL-6/LY showed more significant predictability on in-hospital mortality (Table 3 ). Similarly, diabetes (HR, 3.353; 95%CI, 1.640–6.856, P = 0.001), lower hemoglobin (HR, 0.984; 95%CI, 0.972–0.997, P = 0.016), prolonged prothrombin time (HR, 1.050; 95%CI, 1.022–1.079, P < 0.001), higher NT-ProBNP level (HR, 2.424; 95%CI, 1.660–3.541, P < 0.001) and elevated IL-6/LY (HR,4.143; 95%CI, 1.321–12.986, P = 0.015) was associated with higher likelihood of MODS development. As a matter of fact, among the numerous inflammatory factors considered in the computational model, IL-6/LY had the best predictive ability (Table 4 ).
Table 3

. Predictors of in-hospital mortality in univariable and multivariable Cox regression analyses.

VariablesUnivariable
Multivariable
HR95% CIPHR95% CIP
Age1.0461.033–1.060<0.0011.0341.0041.0640.025
Gender (male)1.6171.148–2.2790.006
Smoking2.4451.669–3.583<0.001
Comorbidity
 CHD1.7711.171–2.6790.007
 Hypertension1.9991.440–2.776<0.001
 Diabetes2.6201.889–3.634<0.001
Time of illness onset1.0391.012–1.0660.004
Blood routine index
 WBC1.1331.108–1.159<0.001
 Neutrophil1.1381.114–1.164<0.001
 Neutrophil%1.0951.075–1.115<0.001
 Lymphocyte0.1210.070–0.207<0.001
 Lymphocyte%0.8810.859–0.904<0.0010.8970.8460.952<0.001
 Monocyte1.5381.042–2.2700.030
 Monocyte%0.8260.783–0.871<0.001
 Hemoglobin0.9930.987–1.0000.0380.9800.9680.9920.002
 Platelet0.9940.992–0.996<0.001
Coagulation function
 PT1.0361.024–1.048<0.001
 D-Dimmer1.0881.068–1.108<0.001
Biochemical indexes
 CTnI1.3691.164–1.611<0.001
 NT-proBNP2.3191.964–2.739<0.001
 ALT1.0031.001–1.005<0.001
 AST1.0021.001–1.003<0.001
 Albumin0.8730.846–0.900<0.001
 Globulin1.0180.998–1.0390.079
 HDL-C0.0870.037–0.208<0.001
 LDL-C0.5710.419–0.778<0.001
 CK1.0001.000–1.001<0.001
 LDH1.0021.001–1.002<0.001
 Creatinine1.0021.001–1.003<0.001
Immuno-inflammatory indices
 IL-6/LY8.8895.282–14.961<0.0013.4041.09010.6330.035
 NLR1.0411.034–1.048<0.001
 Hs-CRP1.0091.007–1.011<0.001
 ESR1.0060.999–1.0130.122
 Ferritin5.5213.588–8.497<0.0011.0000.9991.0010.007
 PCT1.0281.015–1.040<0.001
 Alexin C30.0670.023–0.190<0.001
 Alexin C40.0030.001–0.049<0.001
 IL-2R1.0001.000–1.001<0.001
 IL-61.0011.000–1.001<0.001
 IL-81.0001.000–1.0010.006
 IL-101.0121.008–1.017<0.001
 TNF-α1.0441.032–1.056<0.001

Hazard ratio (HR), confidence interval (CI), coronary heart disease (CHD), white blood cell count (WBC), prothrombin time (PT), Hypersensitive cardiac troponin I (CTnI), N-terminal pro-brain natriuretic peptide (NT-proBNP), alanine aminotransferase (ALT), aspartate aminotransferase (AST), high density lipoprotein cholesterol (HDL-C), low density lipoprotein cholesterol (LDL-C), lactate dehydrogenase (LDH), creatine kinase (CK), IL-6 to lymphocyte ratio (IL-6/LY), neutrophil to lymphocyte ratio (NLR), high-sensitivity C-reactive protein (Hs-CRP), erythrocyte sedimentation rate (ESR), procalcitonin (PCT), interleukin-2 receptor (IL-2R), interleukin-6 (IL-6), interleukin-8 (IL-8), interleukin-10 (IL-10), tumor necrosis factor α(TNF-α).

Table 4

. Predictors of MODS development in univariable and multivariable Cox regression analyses.

VariablesUnivariable
Multivariable
HR95% CIPHR95% CIP
Age1.0471.033–1.062<0.001
Gender (male)1.6401.152–2.3350.006
Smoking2.6301.788–3.867<0.001
Comorbidity
 CHD1.7521.141–2.6910.010
 Hypertension1.9901.420–2.790<0.001
 Diabetes2.8162.010–3.945<0.0013.3531.6406.8560.001
Time of illness onset1.0331.005–1.0620.020
Blood routine index
 WBC1.1351.109–1.161<0.001
 Neutrophil1.1401.115–1.167<0.001
 Neutrophil%1.0961.076–1.116<0.001
 Lymphocyte0.1030.058–0.183<0.001
 Lymphocyte%0.8790.856–0.902<0.001
 Monocyte1.6151.101–2.3690.014
 Monocyte%0.8300.786–0.876<0.001
 Hemoglobin0.9930.987–1.0000.0580.9840.9720.9970.016
 Platelet0.9940.992–0.996<0.001
Coagulation function
 PT1.0371.024–1.049<0.0011.0501.0221.079<0.001
 D-Dimmer1.0871.067–1.108<0.001
Biochemical indexes
 CTnI1.4251.204–1.688<0.001
 NT-proBNP2.4212.035–2.881<0.0012.4241.6603.541<0.001
 ALT1.0031.002–1.005<0.001
 AST1.0021.001–1.003<0.001
 Albumin0.8760.848–0.905<0.001
 Globulin1.0160.994–1.0380.153
 HDL-C0.0910.037–0.221<0.001
 LDL-C0.5350.388–0.738<0.001
 CK1.0001.000–1.001<0.001
 LDH1.0021.002–1.003<0.001
 Creatinine1.0021.001–1.003<0.001
Immuno-inflammatory indices
 IL-6/LY8.4875.032–14.314<0.0014.1431.32112.9860.015
 NLR1.0421.035–1.050<0.001
 Hs-CRP1.0091.007–1.011<0.001
 ESR1.0020.995–1.0100.514
 Ferritin5.7333.674–8.946<0.001
 PCT1.0291.016–1.041<0.001
 Alexin C30.0740.025–0.221<0.001
 Alexin C40.0040.001–0.073<0.001
 IL-2R1.0001.000–1.001<0.001
 IL-61.0011.000–1.001<0.001
 IL-81.0001.000–1.0010.005
 IL-101.0131.008–1.017<0.001
 TNF-α1.0461.034–1.058<0.001

Hazard ratio (HR), confidence interval (CI), multiple organ dysfunction syndrome (MODS), coronary heart disease (CHD), white blood cell count (WBC), prothrombin time (PT), Hypersensitive cardiac troponin I (CTnI), N-terminal pro brain natriuretic peptide (NT-proBNP), alanine aminotransferase (ALT), aspartate aminotransferase (AST), high density lipoprotein cholesterol (HDL-C), low density lipoprotein cholesterol (LDL-C), lactate dehydrogenase (LDH), creatine kinase (CK), IL-6 to lymphocyte ratio (IL-6/LY), neutrophil to lymphocyte ratio (NLR), high-sensitivity C-reactive protein (Hs-CRP), erythrocyte sedimentation rate (ESR), procalcitonin (PCT), interleukin-2 receptor (IL-2R), interleukin-6 (IL-6), interleukin-8 (IL-8), interleukin-10 (IL-10), tumor necrosis factor α(TNF-α).

. Predictors of in-hospital mortality in univariable and multivariable Cox regression analyses. Hazard ratio (HR), confidence interval (CI), coronary heart disease (CHD), white blood cell count (WBC), prothrombin time (PT), Hypersensitive cardiac troponin I (CTnI), N-terminal pro-brain natriuretic peptide (NT-proBNP), alanine aminotransferase (ALT), aspartate aminotransferase (AST), high density lipoprotein cholesterol (HDL-C), low density lipoprotein cholesterol (LDL-C), lactate dehydrogenase (LDH), creatine kinase (CK), IL-6 to lymphocyte ratio (IL-6/LY), neutrophil to lymphocyte ratio (NLR), high-sensitivity C-reactive protein (Hs-CRP), erythrocyte sedimentation rate (ESR), procalcitonin (PCT), interleukin-2 receptor (IL-2R), interleukin-6 (IL-6), interleukin-8 (IL-8), interleukin-10 (IL-10), tumor necrosis factor α(TNF-α). . Predictors of MODS development in univariable and multivariable Cox regression analyses. Hazard ratio (HR), confidence interval (CI), multiple organ dysfunction syndrome (MODS), coronary heart disease (CHD), white blood cell count (WBC), prothrombin time (PT), Hypersensitive cardiac troponin I (CTnI), N-terminal pro brain natriuretic peptide (NT-proBNP), alanine aminotransferase (ALT), aspartate aminotransferase (AST), high density lipoprotein cholesterol (HDL-C), low density lipoprotein cholesterol (LDL-C), lactate dehydrogenase (LDH), creatine kinase (CK), IL-6 to lymphocyte ratio (IL-6/LY), neutrophil to lymphocyte ratio (NLR), high-sensitivity C-reactive protein (Hs-CRP), erythrocyte sedimentation rate (ESR), procalcitonin (PCT), interleukin-2 receptor (IL-2R), interleukin-6 (IL-6), interleukin-8 (IL-8), interleukin-10 (IL-10), tumor necrosis factor α(TNF-α). As shown in Fig. 1 A, compared with the ROC analysis of NLR (AUC = 0.882, 95% CI, 0.844–0.920, P < 0.001; sensitivity = 76.60%, specificity = 85.70%), IL-6/LY had better performance with in-hospital mortality (AUC = 0.919, 95% CI, 0.887–0.951, P < 0.001; sensitivity = 84.10%, specificity = 84.30%). As illustrated in Fig. 1B, such comparisons with NLR (AUC = 0.869, 95% CI, 0.829–0.909, P < 0.001; sensitivity = 79.60%, specificity = 80.30%) suggested that the IL-6/LY had better prediction power of MODS development (AUC = 0.900, 95% CI, 0.863–0.937, P < 0.001; sensitivity = 83.50%, specificity = 81.90%).
Fig. 1

The effectiveness of IL-6/LY and NLR predictor for poor prognosis of COVID-19 by ROC curves. (A) ROC curves of IL-6/LY and NLR for in-hospital mortality (AUC = 0.919, 95% CI, 0.887–0.951, P < 0.001; AUC = 0.882, 95% CI, 0.844–0.920, P < 0.001). (B) ROC curves of IL-6/LY and NLR for MODS development (AUC = 0.900, 0.863–0.937, P < 0.001; AUC = 0.869, 95% CI, 0.829–0.909, P < 0.001). IL-6/LY: interleukin-6 to lymphocyte ratio; NLR: neutrophil to lymphocyte ratio; COVID-19: coronavirus disease 2019; ROC: receiver operating characteristic curve; AUC: area under the curve; CI: confidence interval; MODS: multiple organ dysfunction syndrome.

The effectiveness of IL-6/LY and NLR predictor for poor prognosis of COVID-19 by ROC curves. (A) ROC curves of IL-6/LY and NLR for in-hospital mortality (AUC = 0.919, 95% CI, 0.887–0.951, P < 0.001; AUC = 0.882, 95% CI, 0.844–0.920, P < 0.001). (B) ROC curves of IL-6/LY and NLR for MODS development (AUC = 0.900, 0.863–0.937, P < 0.001; AUC = 0.869, 95% CI, 0.829–0.909, P < 0.001). IL-6/LY: interleukin-6 to lymphocyte ratio; NLR: neutrophil to lymphocyte ratio; COVID-19: coronavirus disease 2019; ROC: receiver operating characteristic curve; AUC: area under the curve; CI: confidence interval; MODS: multiple organ dysfunction syndrome. The Kaplan-Meier survival curves for high-value and low-value groups were shown in Fig. 2 . It was suggested that the high-value group (IL-6/LY ≥ 2.50) has a greater risk in poor prognosis (P < 0.001, respectively).
Fig. 2

Kaplan-Meier cumulative survival curves for COVID-19 patients with in-hospital mortality and developed MODS according to the cutoff value of IL-6/LY. (A) Kaplan-Meier survival curves of in-hospital mortality (log-rank test: P < 0.001). (B) Kaplan-Meier survival curves of developed MODS (log-rank test: P < 0.001). COVID-19: coronavirus disease 2019; MODS: multiple organ dysfunction syndrome; IL-6/LY: interleukin-6 to lymphocyte ratio.

Kaplan-Meier cumulative survival curves for COVID-19 patients with in-hospital mortality and developed MODS according to the cutoff value of IL-6/LY. (A) Kaplan-Meier survival curves of in-hospital mortality (log-rank test: P < 0.001). (B) Kaplan-Meier survival curves of developed MODS (log-rank test: P < 0.001). COVID-19: coronavirus disease 2019; MODS: multiple organ dysfunction syndrome; IL-6/LY: interleukin-6 to lymphocyte ratio. Interestingly, we also found that IL-6/LY was positively correlated with the MuLBSTA score which was used to predict the mortality risk of viral pneumonia (r = 0.137, P = 0.031; Fig. 3 ).
Fig. 3

The correlation between IL-6/LY and MuLBSTA score (r = 0.137, P = 0.031). IL-6/LY: interleukin-6 to lymphocyte ratio.

The correlation between IL-6/LY and MuLBSTA score (r = 0.137, P = 0.031). IL-6/LY: interleukin-6 to lymphocyte ratio.

Dynamic changes of LY%, LY, IL-6 and IL-6/LY

Among our population, there were 105 intensive care patients and 215 non-intensive care patients. As the Fig. 4 A–B showed, the blood LY% and LY were much lower in intensive care unit (ICU) group than those in non-ICU group on admission, and the difference was statistically significant (P < 0.001, respectively). Besides, the LY% and LY gradually declined during the first three days of hospitalization in non-ICU group, while since then, they increasingly rose to normal levels upon discharge (P < 0.001, respectively). In contrast, the above trend did not appear in ICU patients and both the LY% and LY still remained at a low level until discharge.
Fig. 4

Kinetic analysis of LY, LY%, IL-6 and IL-6/LY in COVID-19 patients. The counts of LY (A), LY% (B), IL-6 (C), and IL-6/LY (D) in the peripheral blood of non-ICU COVID-19 patients (blue line) and ICU COVID-19 patients (red line) were analyzed at different time points during the time of hospitalization. Error bars, mean ± SE; *P < 0.050. LY: lymphocyte; LY%: lymphocyte percentage; IL-6: interleukin-6; IL-6/LY: interleukin-6 to lymphocyte ratio; ICU: intensive care unit; COVID-19: coronavirus disease 2019.

Kinetic analysis of LY, LY%, IL-6 and IL-6/LY in COVID-19 patients. The counts of LY (A), LY% (B), IL-6 (C), and IL-6/LY (D) in the peripheral blood of non-ICU COVID-19 patients (blue line) and ICU COVID-19 patients (red line) were analyzed at different time points during the time of hospitalization. Error bars, mean ± SE; *P < 0.050. LY: lymphocyte; LY%: lymphocyte percentage; IL-6: interleukin-6; IL-6/LY: interleukin-6 to lymphocyte ratio; ICU: intensive care unit; COVID-19: coronavirus disease 2019. In addition, significantly increased in IL-6 level and IL-6/LY were observed in ICU group compared with those in non-ICU group at several time points except for the first three days in hospital (the day of at admission, four to seven days after admission, eight to eleven days after admission, twelve to fifteen days after admission, before discharge, all P < 0.001). The difference between ICU group and non-ICU group was significant at the time point of 4–7 days and became even greater before discharge (Fig. 4C–D).

Discussion

In current study, we found that patients with elevated IL-6/LY (≥2.50) was the independent risk factor for in-hospital mortality and the development of MODS in severe COVID-19 patients. Besides, our results showed that the age along with LY% were also the predictors of in-hospital mortality, and the diabetes, prothrombin time, and NT-ProBNP were significantly associated with higher likelihood of MODS development. Meanwhile, the dynamic changes of the inflammatory biomarkers could reflect the clinical severity in patients with COVID-19. A series of evidences showed that the uncontrolled inflammatory response and immunity dysregulation were the prominent feature of critical ill COVID-19 patients [2], [15]. In addition, several other researches also proved that some seriously ill COVID-19 patients had increased cytokine profile similar to cytokine storm in severe acute respiratory syndrome (SARS) and Middle East respiratory syndrome (MERS) [16], [17], [18]. Cytokine storm stems from the coronavirus infected place and then spread throughout the organism by mass of inflammatory cells infiltration which in turn lead to acute lung injury, ARDS and death [17], [18]. It was reported that higher levels of inflammatory parameters, especially IL-6 could be shown in severe COVID-19 patients, which was consistent with previous studies [8], [19], [20]. IL-6 has multiple effects in regulating inflammation. Cifaldi et al. has reported that elevated IL-6 level was linked to impaired cytolytic function by overstimulating the immune system and finally might result in multiple organ failure [21]. Furthermore, significantly reduced counts of T cells have been found in severe COVID-19 patients in recent studies [22], [23]. Previous body biopsies reported that the COVID-19 patients’ secondary lymphoid tissues had been destroyedvery and very few lymphocytes infiltrated in the alveolar of damaged lung tissue [10], [16], [24]. A similar decrease in lymphocyte counts and the subset of T cells could be seen in SARS patients according to previous investigations [25], [26]. However, the exact mechanism of lymphopenia in severe COVID-19 patients remains still unclear. Zhang et al. speculated that lymphocytes were directly invaded by virus infection or indirectly damaged by cytokine storm which induced by immune response [16]. And a substantial decrease in lymphocytes revealed that the immune cells may be consumed by the viruses and the body’s cellular immune function may be restrained [27], [28]. It suggested that COVID-19 infection can lead to immune dysfunction through affecting the subsets of T cells [29]. Through analyzing the immune cells and inflammatory cytokines in the severe COVID-19 patients, Zhou et al. noted that the Th1 cells (GM-CSF+IFN-γ+) and inflammatory monocytes (CD14+CD16+ with high expression of IL-6) existed particularly in ICU patients [30]. Therefore, lots of these pathogenic T cells and inflammatory monocytes may get into the pulmonary circulation and arouse inflammatory storm which probably prevents alveolar gas exchange and contributing to the high mortality of severe COVID-19 patients [31]. Given their weight during the course of COVID-19, our study developed a novel biomarker, named as IL-6/LY, in order to estimate condition, evaluate prognosis and conduct risk stratification. As we know, this was the first research for exploring the effect of IL-6/LY on predicting the clinical outcomes for COVID-19 cases. According to existing research results, we proposed potential mechanisms of high IL-6/LY was resulted from the increased IL-6 and the decreased lymphocyte counts. Recent studies' results would give some explanations. Wan S et al. found that patients with severe COVID-19 patients were more likely to have higher IL-6 levels than those mild COVID-19 cases [23]. It was also showed that lymphopenia was one of the important features of COVID-19 infection and which was also the common ground in most severe patients [1]. As shown in another study, IL-6 could suppress the T cell activation, which may explain the decrease of lymphocyte [32]. Furthermore, according to the study by Jing Liu et al., they revealed that the T cell counts were negatively associated with the examined cytokine levels (such as IL-6) [33]. Accordingly, the balance of IL-6 and lymphocyte played a crucial role in the immunoregulation of patients with COVID-19. When evaluating patients infected with COVID-19, inflammatory biomarkers might be useful to help clinicians start treatment and monitor closely. Compared to other biomarkers, people were often hesitant to use a inflammatory marker alone because it might be influenced by many factors. While IL-6/LY, consisted of two inflammatory components (IL-6 and lymphocyte), might reflect the immune dysregulation in COVID-19 patients more realistically and comprehensively. Still not only such, IL-6/LY could be analyzed rapidly and accurately in the light of the blood test at the time of admission. Our data suggested that IL-6/LY could serve as an indicator of poor prognosis of COVID-19. The dynamic changes of IL-6/LY in patients revealed that the magnitude of the immune response dysregulation was related to the severity of COVID-19 patients. Herby, the physicians could identify the specific subpopulations of COVID-19 patients who were at greater risk for unfavorable outcomes at an early stage. What’s more, in our study, the relationship between other immunoinflammatory parameters and poor prognosis were also evaluated. We found that individual variable (such as WBC, Hs-CRP, procalcitonin, ferritin and interleukins) had an influence on the occurrence of clinical outcomes partly. However, after adjustment for potential confounders, the results statistically supported the conclusions that the incidence of high IL-6/LY was significantly correlated with the poor prognosis of the disease. Not only that, older age and comorbidities were proved to be in connection with severe COVID-19 [34]. Weina Guo et al suggested that COVID-19 patients with diabetes had a poor prognosis and diabetes was proposed as a risk factor for the progression of COVID-19 cases [35], [36]. Clinically, infected by SARS-CoV-2 caused multiple system organ failure, such as the hematologic system [37], [38], [39]. Previous studies showed that prothrombin time was positively correlated with 28-day mortality [40]. Besides, a retrospective study showed that NT-proBNP was an independent risk factor for in-hospital death in patients with severe COVID-19 [41]. In fact, these results were in consistent with our findings. We have to acknowledge that there were some limitations in this study. Firstly, the retrospective design of the study set a limit to the convincement of our study. Due to the nature of our study, the results must be explained with caution, given the possibility of confounders. Secondly, because of the objective conditions, the patients were not followed up outside of hospital. And we did not study the relationship between IL-6/LY and the long-term outcomes. Thirdly, our sample size was small. Therefore, prospective clinical studies with larger population are needed.

Conclusion

In conclusion, the elevated IL-6/LY was an independent risk factor for in-hospital mortality and the development of MODS in severe COVID-19 patients. The dynamic change of IL-6/LY was associated with the severity of the disease, which could predict the rapid progression and bad prognosis of COVID-19. Thus, more intensive attention should be paid to the immune dysregulation and systemic inflammatory response in severe cases with COVID-19.

Financial support

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

CRediT authorship contribution statement

Boyi Yang: Project administration, Writing - review & editing. Xiaoyan Chang: Methodology, Resources. Jiabao Huang: Investigation, Data curation. Wen Pan: Validation. Zhilong Si: Formal analysis, Software. Cuntai Zhang: Supervision. Hong Li: Conceptualization, Writing - original draft.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
  38 in total

1.  Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China.

Authors:  Dawei Wang; Bo Hu; Chang Hu; Fangfang Zhu; Xing Liu; Jing Zhang; Binbin Wang; Hui Xiang; Zhenshun Cheng; Yong Xiong; Yan Zhao; Yirong Li; Xinghuan Wang; Zhiyong Peng
Journal:  JAMA       Date:  2020-03-17       Impact factor: 56.272

2.  Dysregulation of Immune Response in Patients With Coronavirus 2019 (COVID-19) in Wuhan, China.

Authors:  Chuan Qin; Luoqi Zhou; Ziwei Hu; Shuoqi Zhang; Sheng Yang; Yu Tao; Cuihong Xie; Ke Ma; Ke Shang; Wei Wang; Dai-Shi Tian
Journal:  Clin Infect Dis       Date:  2020-07-28       Impact factor: 9.079

3.  Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding.

Authors:  Roujian Lu; Xiang Zhao; Juan Li; Peihua Niu; Bo Yang; Honglong Wu; Wenling Wang; Hao Song; Baoying Huang; Na Zhu; Yuhai Bi; Xuejun Ma; Faxian Zhan; Liang Wang; Tao Hu; Hong Zhou; Zhenhong Hu; Weimin Zhou; Li Zhao; Jing Chen; Yao Meng; Ji Wang; Yang Lin; Jianying Yuan; Zhihao Xie; Jinmin Ma; William J Liu; Dayan Wang; Wenbo Xu; Edward C Holmes; George F Gao; Guizhen Wu; Weijun Chen; Weifeng Shi; Wenjie Tan
Journal:  Lancet       Date:  2020-01-30       Impact factor: 79.321

4.  A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family cluster.

Authors:  Jasper Fuk-Woo Chan; Shuofeng Yuan; Kin-Hang Kok; Kelvin Kai-Wang To; Hin Chu; Jin Yang; Fanfan Xing; Jieling Liu; Cyril Chik-Yan Yip; Rosana Wing-Shan Poon; Hoi-Wah Tsoi; Simon Kam-Fai Lo; Kwok-Hung Chan; Vincent Kwok-Man Poon; Wan-Mui Chan; Jonathan Daniel Ip; Jian-Piao Cai; Vincent Chi-Chung Cheng; Honglin Chen; Christopher Kim-Ming Hui; Kwok-Yung Yuen
Journal:  Lancet       Date:  2020-01-24       Impact factor: 79.321

Review 5.  Coronavirus Disease 2019: Coronaviruses and Blood Safety.

Authors:  Le Chang; Ying Yan; Lunan Wang
Journal:  Transfus Med Rev       Date:  2020-02-21

Review 6.  COVID-19, cytokines and immunosuppression: what can we learn from severe acute respiratory syndrome?

Authors:  Piercarlo Sarzi-Puttini; Valeria Giorgi; Silvia Sirotti; Daniela Marotto; Sandro Ardizzone; Giuliano Rizzardini; Spinello Antinori; Massimo Galli
Journal:  Clin Exp Rheumatol       Date:  2020-03-22       Impact factor: 4.473

7.  Characteristics of Peripheral Lymphocyte Subset Alteration in COVID-19 Pneumonia.

Authors:  Fan Wang; Jiayan Nie; Haizhou Wang; Qiu Zhao; Yong Xiong; Liping Deng; Shihui Song; Zhiyong Ma; Pingzheng Mo; Yongxi Zhang
Journal:  J Infect Dis       Date:  2020-05-11       Impact factor: 5.226

Review 8.  MERS, SARS and other coronaviruses as causes of pneumonia.

Authors:  Yudong Yin; Richard G Wunderink
Journal:  Respirology       Date:  2017-10-20       Impact factor: 6.424

9.  Pathological findings of COVID-19 associated with acute respiratory distress syndrome.

Authors:  Zhe Xu; Lei Shi; Yijin Wang; Jiyuan Zhang; Lei Huang; Chao Zhang; Shuhong Liu; Peng Zhao; Hongxia Liu; Li Zhu; Yanhong Tai; Changqing Bai; Tingting Gao; Jinwen Song; Peng Xia; Jinghui Dong; Jingmin Zhao; Fu-Sheng Wang
Journal:  Lancet Respir Med       Date:  2020-02-18       Impact factor: 30.700

10.  CoViD-19 Immunopathology and Immunotherapy.

Authors:  Francesco Chiappelli; Allen Khakshooy; Gillian Greenberg
Journal:  Bioinformation       Date:  2020-03-31
View more
  3 in total

1.  Deciphering the balance of IL-6/IL-10 cytokines in severe to critical COVID-19 patients.

Authors:  Mouna Ben Azaiz; Awatef Ben Jemaa; Walid Sellami; Chihebeddine Romdhani; Ridha Ouslati; Hedi Gharsallah; Ezzedine Ghazouani; Mustapha Ferjani
Journal:  Immunobiology       Date:  2022-06-08       Impact factor: 3.152

Review 2.  Interleukin-6 in SARS-CoV-2 induced disease: Interactions and therapeutic applications.

Authors:  Jamal Majidpoor; Keywan Mortezaee
Journal:  Biomed Pharmacother       Date:  2021-11-12       Impact factor: 7.419

Review 3.  The Association between TNF-α, IL-6, and Vitamin D Levels and COVID-19 Severity and Mortality: A Systematic Review and Meta-Analysis.

Authors:  Ceria Halim; Audrey Fabianisa Mirza; Mutiara Indah Sari
Journal:  Pathogens       Date:  2022-02-01
  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.