Establishment of a novel risk score for in-hospital mortality in adult sepsis patients.

Background: Existing scoring systems have limitations in predicting the in-hospital mortality of adult sepsis patients. We aimed to develop and validate a novel risk score for predicting the in-hospital mortality of adult sepsis patients.
Methods: The clinical data of 1,335 adult sepsis inpatients were retrospectively analyzed. Enrolled patients were randomly divided into a modeling group and a validation group at a 3:2 ratio. The modeling group (n=801) was used to develop the risk score by univariate and multivariate logistic regression analyses. The score's performance was validated in the validation group (n=534). We classified patients into four risk levels according to the novel risk score.
Results: Age, central vein catheterization, mechanical ventilation, vasopressin, Charlson comorbidity index (CCI), respiratory rate (RR), heart rate (HR), Glasgow coma scale (GCS) score, platelet (PLT), hematocrit (HCT), aspartate aminotransferase (AST), and activated partial thrombin time (APTT) were independent risk factors for in-hospital death in adult sepsis patients. Continuous variables were converted into classified variables to develop the risk score, with a total score of 39 points. Adult sepsis patients with low, lower medium, higher medium, and high risk levels had in-hospital mortality rates of 9.8%, 24.7%, 55.8%, and 83.5%, respectively. Conclusions: Compared with the Acute Physiology and Chronic Health Evaluation II scoring system (APACHE II) and the Modified Early Warning Score (MEWS), the novel risk score showed good predictive performance for in-hospital mortality in adult sepsis patients. 2022 Annals of Translational Medicine. All rights reserved.

Introduction

Sepsis is a common critical disease in the emergency department and intensive care unit (ICU) (1). Due to its rapid deterioration and insidious onset, sepsis has high rates of misdiagnosis, mortality, and disability (2). Despite improvements to diagnostic methods and treatment measures, the incidence and mortality of sepsis remain high, and thus it is presently a prominent global health challenge (3).

To predict the outcomes of critically ill patients quickly and accurately, numerous scoring standards have been proposed. Currently, the most commonly used scoring standards in clinical practice include the Acute Physiology and Chronic Health Evaluation II scoring system (APACHE II) and the Modified Early Warning Score (MEWS).

The APACHE II score includes acute physiological indicators, chronic health status, and age, which can be used to quantify the condition of critically ill patients and objectively evaluate the possibility of organ failure and death in these patients (4). However, the APACHE II score is not an assessment of the prognosis of patients with sepsis, and is time-consuming to calculate, with poor clinical operability.

The MEWS is a simple and rapid scoring system that focuses on the patient’s heart rate (HR), systolic blood pressure (SBP), respiratory rate (RR), body temperature, and conscious state (5). However, it lacks confirmation of large sample studies, and cannot fully reflect the pathophysiologic process of sepsis. The results of a multicenter prospective study in Italy showed that MEWS could not effectively predict sepsis in death (6). Similarly, a meta-analysis of 4,298 patients from six studies also suggested that the MEWS was not very effective in predicting sepsis mortality (7).

Following the sepsis-3 criteria update, no scoring systems fit the new diagnosis well and can accurately and easily predict the in-hospital mortality of adult patients with sepsis. The present study was conducted to identify the prognostic factors for in-hospital mortality in adult sepsis patients, in order to develop a simpler and more accurate scoring system, and to evaluate its efficacy compared with that of APACHE II and MEWS. We present the following article in accordance with the TRIPOD reporting checklist (available at https://atm.amegroups.com/article/view/10.21037/atm-21-2900/rc).

Methods

Study design

This study was conducted in accordance with the Declaration of Helsinki (as revised in 2013). The study was approved by ethics committee of Ruijin Hospital (No. 2021-59) and informed consent was taken from all the patients.

A total of 1,860 patients diagnosed with sepsis, bacteriaemia, septicemia, septic shock, or infectious multiple organ dysfunction syndromes, who were admitted to the Ruijin Hospital, Shanghai Jiao Tong University School of Medicine (a 1,900-bed, university-affiliated, tertiary hospital in Shanghai, China), were screened from January 1st, 2015, to December 31st, 2019. After excluding 18 patients younger than 18 years of age, 486 patients who did not meet the sepsis-3 criteria, and 21 patients with missing important data, 1,335 patients were included in this study. The enrolled patients were randomly divided into a modeling group (n=801) and a validation group (n=534), at a 3:2 ratio. The study population selection and research process flowchart were shown in . Diagnosis of sepsis was based on the sepsis-3 definition and sequential organ failure assessment (SOFA) score (3).

Figure 1

Study population and research process flowchart. APACHE II, Acute Physiology and Chronic Health Evaluation II scoring system; MEWS, Modified Early Warning Score; ROC, receiver operating characteristic.

Data collection

Demographic, clinical, and laboratory data were retrieved from an electronic hospital database, including age, gender, comorbidity, immunosuppressor use, admission department, timing of sepsis diagnosis, length of stay (LOS), hospitalization expenses, site of infection, blood culture positivity, neutropenia, central venous catheterization, invasive intervention or surgery, vasopressin, mechanical ventilation, hemodialysis, urine output, Glasgow coma scale (GCS) score, maximum temperature (Tmax), minimum temperature (Tmin), HR, RR, SBP, diastolic blood pressure (DBP), mean artery pressure (MAP), partial pressure of carbon dioxide (PaCO2), partial pressure of oxygen (PaO2), C-reactive protein (CRP), procalcitonin (PCT), lactic acid (Lac), white blood cell (WBC), neutrophil (NE), hemoglobin (Hb), platelet (PLT), hematocrit (HCT), creatinine (Cr), total bilirubin (TBil), serum potassium ions (K+), cardiac troponin I (cTnI), aspartate aminotransferase (AST), alanine aminotransferase (ALT), γ-glutamyl transpeptidase (γ-GT), activated partial thromboplastin time (APTT), prothrombin time (PT), and D-dimer (D-D).

Vital signs and laboratory data were measured within 24 hours of sepsis diagnosis. The primary endpoint was in-hospital death. LOS was defined as the number of days between the date of admission to the ward and the date of discharge or death. Neutropenia was defined an absolute NE count of less than 1,500 per microliter (1,500/mL).

Statistical analysis

The collected data were statistically analyzed using SPSS (ver.22.0; Chicago, IL, USA) and MedCalc (ver.19.7; Ostend, Belgium) software. Data were tested for normal distribution using the Kolmogorov-Smirnov and Shapiro-Wilk tests. Continuous variables were expressed as mean ± standard deviation (SD) in cases of normally distributed data, or as median (first quartile, third quartile) in cases of non-normally distributed data. Analysis was carried out using the Student’s t-test or the Mann-Whitney U test, as appropriate. Categorical variables were recorded, frequency percentages were calculated, and the χ2 test was used for these analyses. Multivariable logistic regression analyses were performed to identify independent prognostic factors for mortality using variables with P values <0.1 in the univariable analyses. Also, the Hosmer-Lemeshow goodness-of-fit test was used for evaluating calibration. Discrimination was assessed using the area under the receiver operating characteristic (ROC) curve (AUROC). DeLong test was used to compare the differences in the AUROC. Odds ratios (ORs) and 95% confidence intervals (CIs) were calculated. P values <0.05 were considered statistically significant.

Results

Baseline characteristics

A total of 1,335 adult inpatients with sepsis were included, and 34.6% were women. The average age was 61.31 (range, 18–107) years. These patients were divided into two groups: survivors (n=785, 58.8%) and non-survivors (n=550, 41.2%).

Compared with the survivor group, the non-survivor group was older (59.34±17.74 vs. 64.13±17.22 years, P<0.001), had a lower body mass index (BMI) (24.01±12.96 vs. 22.74±4.43 kg/m2, P=0.028), higher Charlson comorbidity index (CCI) {1 [0-3] vs. 2 [1-4], P<0.001}, greater use of immunosuppressor (5.4% vs. 9.3%, P=0.006), and shorter LOS {27 [15-45] vs. 19 [8-40] days, P<0.001}. In the non-survivor group, the respiratory system was the most common infection site (P<0.001), and more patients were diagnosed with sepsis after 48 hours compared to the survivor group (26.5% vs. 42.5%, P<0.001). No significant differences were observed between the two groups in gender and admission department (P=0.436, P=0.319, relatively). The results are shown in .

Table 1

Baseline characteristics of study subjects (n=1,335)

Variables	Survival group (n=785)	Non-survival group (n=550)	P value
Age (years)	59.34±17.74	64.13±17.22	<0.001
Female	265 (33.8)	197 (35.8)	0.436
BMI (kg/m2)	24.01±12.96	22.74±4.43	0.028
CCI	1 [0–3]	2 [1–4]	<0.001
Immunosuppressor	42 (5.4)	51 (9.3)	0.006
Admission department			0.319
Surgery	242 (30.8)	184 (33.5)
Internal medicine	294 (37.5)	212 (38.5)
ICU	249 (31.7)	154 (28.0)
Infection site			<0.001
Gastrointestinal and abdominal	285 (36.3)	143 (26.0)
Respiratory	256 (32.6)	262 (47.6)
Others	244 (30.1)	145 (26.4)
Diagnosed with sepsis after 48 hours	208 (26.5)	234 (42.5)	<0.001
LOS (days)	27 [15–45]	19 [8–40]	<0.001

Data were expressed as mean ± SD or medium [IQR] for continuous variables and n (%) for categorical variables. BMI, body mass index; CCI, Charlson comorbidity index; ICU, intensive care unit; LOS, length of stay; SD, standard deviation; IQR, interquartile range.

Comparison of baseline characteristics between the modeling and validation groups

As shown in , there were no statistical differences in the various variables between the modeling and validation groups.

Table 2

Comparison of basic data between the modeling and validation groups

Variables	Modeling group (n=801)	Validation group (n=534)	P value
Age (years)	61.15±18.00	61.56±17.19	0.679
Female	279 (34.8)	183 (34.3)	0.833
BMI (kg/m2)	23.18±4.32	23.94±15.48	0.190
CCI	2 [0–3]	2 [0–3]	0.308
Diabetes	116 (14.5)	80 (15.0)	0.801
Neutropenia	104 (13.0)	72 (13.5)	0.792
Immunosuppressor use	58 (7.2)	35 (6.6)	0.629
Admission department			0.491
Surgery	260 (32.5)	166 (31.1)
Internal medicine	309 (38.6)	197 (36.9)
ICU	232 (29.0)	171 (32.0)
APACHE II score	6 [4–8]	5 [3–8]	0.547
MEWS	9 [5–11]	8 [6–11]	0.091
Central venous catheterization	344 (42.9)	227 (42.5)	0.874
Mechanical ventilation	270 (33.7)	181 (33.9)	0.943
Hemodialysis	36 (4.5)	17 (3.2)	0.229
Vasopressin	350 (43.7)	234 (43.8)	0.964
Invasive intervention or surgery	607 (75.8)	413 (77.3)	0.511
LOS (days)	24 [12–43.5]	24 [12–45]	0.869
Hospitalization expense (RMB)	154,856±233,889	145,882±175,839	0.450
Diagnosed with sepsis after 48 hours	251 (31.3)	191 (35.8)	0.293
In-hospital death	336 (41.9)	214 (40.1)	0.496

Data were expressed as mean ± SD or medium [IQR] for continuous variables and n (%) for categorical variables. BMI, body mass index; CCI, Charlson comorbidity index; ICU, intensive care unit; APACHE II, Acute Physiology and Chronic Health Evaluation II scoring system; MEWS, Modified Early Warning Score; LOS, length of stay; SD, standard deviation; IQR, interquartile range.

Establishment of the in-hospital mortality risk factors in the modeling group in adult sepsis inpatients

The clinical data in the modeling group were compared between the survival and non-survivor groups (). Variables including age, CCI, immunosuppressor use, sepsis diagnosis after 48 h, neutropenia, central venous catheterization, mechanical ventilation, vasopressin, invasive intervention or surgery, DBP, RR, Tmax, HR, GCS, PaCO2, Lac, Hb, PLT, HCT, AST, K+, cTnI, APTT, PT, and D-D showed statistical significance between the two groups (P<0.05). Further multivariate logistic regression analysis indicated that age, CCI, central venous catheterization, mechanical ventilation, vasopressin, RR, HR, GCS, PLT, HCT, AST, and APTT were independent risk factors for in-hospital death (shown in ).

Table 3

Single factor analysis of the survival and death groups in the modeling group

Variables	Survival (n=465)	Death (n=336)	P value	OR	95% CI
Female	162 (34.8)	117 (34.8)	0.996	1.001	0.745–1.344
Age (years)	58.60±18.03	64.68±17.38	<0.001	1.020	1.011–1.028
BMI (kg/m2)	23.29±4.20	23.03±4.48	0.395	0.986	0.954–1.019
Diabetes	67 (14.4)	49 (14.6)	0.945	1.014	0.681–1.511
CCI	1 [0–3]	2 [1–4]	<0.001	1.287	1.194–1.387
Immunosuppressor use	25 (5.4)	33 (9.8)	0.018	1.917	1.117–3.289
Diagnosed with sepsis after 48 hours	113 (24.3)	138 (41.1)	<0.001	2.171	1.603–2.941
Neutropenia	51 (11.0)	53 (15.8)	0.047	1.520	1.006–2.298
Blood culture positivity	219 (47.1)	171 (50.9)	0.289	1.164	0.879–1.542
Central venous catheterization	186 (40.0)	158 (47.0)	0.048	1.331	1.003–1.768
Mechanical ventilation	117 (25.2)	153 (45.5)	<0.001	2.487	1.842–3.357
Hemodialysis	17 (3.7)	19 (5.7)	0.181	1.580	0.808–3.087
Vasopressin	134 (28.8)	216 (64.3)	<0.001	4.446	3.293–6.003
Invasive intervention or surgery	327 (70.3)	280 (83.3)	<0.001	2.110	1.488–2.992
SBP (mmHg)	110.8±19.05	111.9±22.18	0.443	1.003	0.996–1.010
DBP (mmHg)	63.4±12.36	61.3±14.19	0.026	0.988	0.977–0.998
MAP (mmHg)	79.2±13.45	78.2±15.5	0.302	0.995	0.985–1.005
RR (/min)	12.8±2.60	13.7±3.61	<0.001	1.101	1.050–1.155
Tmax (℃)	38.9±1.02	39.3±1.10	<0.001	1.393	1.214–1.598
Tmin (℃)	36.1±0.32	36.1±0.60	0.707	1.061	0.779–1.445
HR (/min)	122.8±29.38	136.6±23.08	<0.001	1.022	1.015–1.028
GCS score	14.7±1.37	13.4±3.22	<0.001	0.768	0.710–0.831
Urine output (mL)	1,605.2±1,167.6	1,498.5± 1,214.9	0.274	1.0	1.000–1.000
PaCO2 (kPa)	5.01 [4.39–5.72]	5.10 [4.12–6.31]	0.009	1.144	1.034–1.267
PaO2 (kPa)	12.37 [9.68–16.68]	12.51 [9.52–18.15]	0.094	1.022	0.996–1.049
CRP (mg/L)	85.69±94.99	89.00±101.46	0.709	1.000	0.999–1.002
PCT (μg/L)	10.46±26.93	13.37±27.12	0.174	1.004	0.998–1.010
Lac (mmol/L)	1.80 [1.39–2.87]	2.93 [1.91–5.11]	<0.001	1.211	1.123–1.305
WBC (×109/L)	9.31 [5.72–13.69]	10.01 [5.05–16.42]	0.080	1.015	0.998–1.032
NE (×109/L)	7.58 [4.45–11.77]	8.49 [3.37–14.75]	0.052	1.019	1.000–1.038
Hb (g/L)	101.20±26.69	89.01±27.97	<0.001	0.984	0.978–0.989
PLT (×109/L)	127 [72.5–205.5]	94.5 [36.25–164]	<0.001	0.996	0.995–0.998
HCT (%)	0.303±0.077	0.267±0.081	<0.001	0.003	0.000–0.019
TBil (μmol/L)	22.5 [14.3–38.6]	41.5 [25–96]	0.162	1.001	1.001–1.003
AST (U/L)	34 [20–61.5]	25 [41.5–66]	0.002	1.001	1.000–1.002
ALT (U/L)	23 [14–55.5]	25 [13–66]	0.123	1.000	1.000–1.001
γ-GT (U/L)	52 [23–116.5]	48.5 [25–98]	0.146	0.999	0.998–1.000
K+ (mmol/L)	3.83 [3.53–4.20]	3.94 [3.49–4.40]	0.005	1.356	1.098–1.674
cTnI (μg/L)	0.04 [0.01–0.16]	0.11 [0.03–0.76]	0.001	1.132	1.054–1.217
APTT (s)	34.0 [29.6–39.0]	37.5 [32.5–47.675]	<0.001	1.038	1.026–1.051
PT (s)	14.0 [12.9–15.5]	15.3 [13.3–18.7]	<0.001	1.122	1.081–1.164
D-D (mg/L)	4.17 [1.91–7.83]	5.98 [2.54–11.72]	<0.001	1.051	1.030–1.073

Data were expressed as mean ± SD or medium [IQR] for continuous variables and n (%) for categorical variables. BMI, body mass index; CCI, Charlson comorbidity index; SBP, systolic blood pressure; DBP, diastolic blood pressure; MAP, mean artery pressure; RR, respiratory rate; Tmax, maximum temperature; Tmin, minimum temperature; HR, heart rate; GCS, Glasgow coma scale; PaCO2, partial pressure of carbon dioxide; PaO2, partial pressure of oxygen; CRP, C-reactive protein; PCT, procalcitonin; Lac, lactic acid; WBC, white blood cell; NE, neutrophil; Hb, hemoglobin; PLT, platelet; HCT, hematocrit; TBil, total bilirubin; AST, aspartate aminotransferase; ALT, alanine aminotransferase; γ-GT, γ-glutamyl transpeptidase; K+, serum potassium ions; cTnI, cardiac troponin I; APTT, activated partial thromboplastin time; PT, prothrombin time; D-D, D-dimer; SD, standard deviation; IQR, interquartile range.

Table 4

Multivariate logistic regression analysis in the modeling group

Variables	B	SE	Wald	P value	OR	95% CI
Age	0.031	0.007	21.588	<0.001	1.031	1.018–1.044
Central venous catheterization	–0.912	0.293	9.694	0.002	0.402	0.226–0.715
Mechanical ventilation	0.544	0.294	3.423	0.064	1.723	0.968–3.067
Vasopressin	1.376	0.281	24.036	<0.001	3.960	2.284–6.86
CCI	0.200	0.057	12.245	<0.001	1.221	1.092–1.365
RR	0.162	0.040	16.438	<0.001	1.176	1.087–1.272
HR	0.021	0.005	17.720	<0.001	1.021	1.011–1.031
GCS score	–0.196	0.049	15.863	<0.001	0.822	0.746–0.906
PLT	–0.003	0.001	5.902	0.015	0.997	0.995–0.999
HCT	–5.343	1.476	13.100	<0.001	0.005	0.000–0.010
AST	0.001	0.001	3.279	0.070	1.001	1.000–1.002
APTT	0.024	0.009	7.514	0.006	1.025	1.007–1.043
Constant	–4.100	1.339	9.375	0.002	0.017	–

CCI, Charlson comorbidity index; RR, respiratory rate; HR, heart rate; GCS, Glasgow coma scale; PLT, platelet; HCT, hematocrit; AST, aspartate aminotransferase; APTT, activated partial thromboplastin time; SE, standard error; OR, odds ratio; CI, confidence interval.

Establishment of the risk score for in-hospital mortality in adult sepsis inpatients

We converted the continuous variables into categorical variables according to the cutoff point of continuous variables and clinical experience as follows: age: 18–69, 70–79, ≥80 years; CCI: 0–1, 2–4, ≥5; RR: <16/min, ≥16/min; HR: <125/min, ≥125/min; GCS: 13–15, 9–12, 3–8; PLT: <20×109/L, ≥20×109/L; HCT: <0.284%, ≥0.284%; AST: ≤36 U/L, >36 U/L; and APTT: <43.0 s, ≥43.0 s. We further analyzed the new variables with multivariate logistic regression (shown in ), and the corresponding integrals of various OR values were endowed according to the principle of round. Each patient’s score was calculated. As shown in , 0 points for age 18–69 years, 2 points for age 70–79 years, 4 points for age ≥80 years; 0 points for CCI 0–1, 2 points for CCI 2–4, 4 points for CCI ≥5; 3 points for without central venous catheterization; 2 points for mechanical ventilation; 6 points for vasopressin; 0 points for RR <16/min, 3 points for RR ≥16/min; 0 points for HR <125/min, 3 points for HR ≥125/min; 0 points for GCS 13–15, 2 points for GCS 9–12, 6 points for GCS 3–8; 2 points for PLT <20×109/L, 0 points for PLT ≥20×109/L; 2 points for HCT <0.284%, 0 points for HCT ≥0.284%; 0 points for AST ≤36 U/L, 2 points for AST >36 U/L; 0 points for APTT <43.0 s, 2 points for APTT ≥43.0 s, with a total score of 39 points ().

Table 5

Multivariate logistic regression analysis for risk score in the modeling group

Variables	B	SE	Wald	P	OR	95% CI
Age (years)
18–69			34.218	<0.001
70–79	0.724	0.247	8.612	0.003	2.062	1.272–3.343
≥80	1.468	0.259	32.080	0.000	4.340	2.611–7.212
Central venous catheterization	–1.124	0.264	18.096	<0.001	0.325	0.194–0.545
Mechanical ventilation	0.593	0.264	5.054	0.025	1.809	1.079–3.034
Vasopressin	1.756	0.238	54.368	<0.001	5.792	3.631–9.238
CCI
0–1			24.454	<0.001
2–4	0.544	0.206	6.954	0.008	1.723	1.150–2.583
≥5	1.441	0.295	23.884	<0.001	4.224	2.370–7.529
RR (/min)
<16	1.008	0.218	21.475	<0.001	2.740	1.789–4.197
≥16
HR (/min)
<125
≥125	1.089	0.197	30.663	<0.001	2.970	2.021–4.367
GCS score
13–15			21.694	<0.001
9–12	0.599	0.398	2.264	0.032	1.821	0.834–3.973
3–8	1.887	0.419	20.266	0.000	6.396	2.901–14.997
PLT (×109/L)
<20
≥20	0.870	0.341	6.514	0.011	2.386	1.224–4.653
HCT (%)
<0.284
≥0.284	0.867	0.197	19.364	0.000	2.380	1.618–3.502
AST (U/L)
≤36
>36	0.644	0.195	10.904	0.001	1.904	1.299–2.790
APTT (s)
<43.0
≥43.0	0.814	0.221	13.584	<0.001	2.257	1.464–3.479
Constant	–3.768	0.321	138.188	0.000	0.023	–

CCI, Charlson comorbidity index; RR, respiratory rate; HR, heart rate; GCS, Glasgow coma scale; PLT, platelet; HCT, hematocrit; AST, aspartate aminotransferase; APTT, activated partial thromboplastin time; SE, standard error; OR, odds ratio; CI, confidence interval.

Table 6

Risk score for in-hospital mortality in adult sepsis patients

Variables	Score
Age (years)
18–69	0
70–79	2
≥80	4
Central venous catheterization
Yes	0
No	3
Mechanical ventilation
Yes	2
No	0
Vasopressin
Yes	6
No	0
CCI
0–1	0
2–4	2
≥5	4
RR (/min)
<16	0
≥16	3
HR (/min)
<125	0
≥125	3
GCS score
13–15	0
9–12	2
3–8	6
PLT (×109/L)
≥20	0
<20	2
HCT (%)
≥0.284	0
<0.284	2
AST (U/L)
≤36	0
>36	2
APTT (s)
<43.0	0
≥43.0	2
Maximum	39 points

CCI, Charlson comorbidity index; RR, respiratory rate; HR, heart rate; GCS, Glasgow coma scale; PLT, platelet; HCT, hematocrit; AST, aspartate aminotransferase; APTT, activated partial thromboplastin time.

Comparison between the novel risk score, APACHE II, and MEWS in predicting in-hospital mortality in adult sepsis inpatients

The predictive value of the novel risk score for predicting in-hospital mortality in the modeling group (AUROC =0.857, 95% CI: 0.831–0.881) was superior to the APACHE II score (AUROC =0.767, 95% CI: 0.736–0.796) and the MEWS (AUROC =0.805, 95% CI: 0.776–0.832) (). The DeLong test showed that Z was 4.433 and 2.980, respectively, with a P value of <0.001 and 0.003, respectively. After validating the novel risk score in the validation group, similar outcomes were observed. The novel risk score (AUROC =0.819, 95% CI: 0.783–0.851) was superior to the APACHE II score (AUROC =0.756, 95% CI: 0.717–0.792) and the MEWS (AUROC =0.772, 95% CI: 0.734–0.807) (). The DeLong test showed that Z was 2.323 and 1.923, respectively, with a P value of 0.02 and 0.05, respectively.

Figure 2

Validation of the novel risk score. (A) Comparison of the AUROCs between the novel risk score, the APACHE II score, and the MEWS in the modeling group. (B) Comparison of the AUROCs between the novel risk score, the APACHE II score, and the MEWS in the validation group. (C) Comparison of the AUROCs of the novel risk score between the modeling and validation groups. APACHE II, Acute Physiology and Chronic Health Evaluation scoring system; MEWS, Modified Early Warning Score; AUROC, area under the receiver operating characteristic curve.

We also compared the predictive value of the novel risk score between the modeling and validation groups (shown in ). The DeLong test showed that Z was 1.675, with a P value of 0.09, which indicated that the novel risk score had good repeatability.

The risk levels according to the novel risk score

The mortality risk score was divided into four quartiles: low risk level [0-9], lower medium risk level [10-13], higher medium risk level [14-17], and high risk level [18-39]. The actual mortality rates of the modeling and validation groups were 9.1% and 10.9%, 27.0% and 20.9%, 61.4% and 48.7%, and 87.3% and 78.7%, respectively (). In both the modeling and validation groups, there were significant differences in actual mortality among the different risk level groups (P<0.001).

Figure 3

In-hospital morality of the different levels of the novel risk score between the modeling and validation groups.

Discussion

In this study, the in-hospital mortality rate of sepsis reached 41.2%, which was higher than other domestic studies (8,9). We hypothesized that this might be due to the fact that some community-acquired sepsis patients were first diagnosed and treated in the emergency department, and after appropriate treatment, their SOFA score was less than 2 points when admitted to the wards. Thus, these patients were excluded in our study.

Considering that the diagnostic criteria for sepsis have been controversial, and the fact that clinicians’ understanding of sepsis has not been updated, we found that misdiagnosis of sepsis is quite common in internal medicine and surgical wards. We hereby call for strengthen of sepsis awareness.

In this study, we found that a total of 442 patients (33.1%) developed sepsis 48 hours after admission, and we speculated that this might have been hospital-acquired sepsis. Among them, 234 people died, with a mortality rate as high as 52.9%, which accounted for 42.5% of all deaths. This mortality rate is higher than that of community-acquired sepsis, and thus, we call for more attention to be paid to hospital-acquired sepsis, those patients needed further monitoring and treatment in ICU unit.

Through univariable and multivariable logistic regression analysis, twelve variables were finally screened, including two basic situations (age and CCI), three clinical interventions (mechanical ventilation, vasopressin, and central venous catheterization), three vital signs (HR, RR, and GCS), and four laboratory results (PLT, HCT, AST, and APTT). Among these, central venous catheterization, GCS, PLT, and HCT were independent protective factors for in-hospital death in adult sepsis patients, while the remaining eight variables were independent risk factors.

PLTs have received increasing attention due to their role in the pathophysiology of infectious diseases, inflammatory responses, and immunity. In 1976, Bone et al. explained the relationship between thrombocytopenia and sepsis (10). PLTs can release cytokines, recruit WBCs, and interact with bacteria and endothelial cells to promote microthrombosis. These mechanisms are adaptive and protective in the context of a locally-controlled infection, but become unregulated during sepsis, leading to impaired organ function (11). Thrombocytopenia in patients with sepsis is not only an indicator of poor prognosis for sepsis; sepsis-associated thrombocytopenia itself may increase the risk of death. Both Claushuis et al. and Thiery-Antier et al. found that PLT count <50×109/L is indicative of poor prognosis of patients with sepsis (12,13). Similarly, PLTs were found in our study to be a protective factor for nosocomial death in adults with sepsis. A study by Vandijck et al. showed that critically ill patients with a PLT count <20×109/L had a mortality rate of 77.8% (14).

APTT is also one of the most commonly used indicators to reflect the coagulation activity of endogenous coagulation systems in clinical practice. Niederwanger et al. and Benediktsson et al. showed that the extension of APTT is a risk factor for the death of children with sepsis and ICU patients (15,16).

Central venous catheterization has many advantages in critically ill patients; it provides secure and lasting vascular access for drug infusion and parenteral nutrition. However, an indwelling central venous catheter may increase the risk of iatrogenic infection, which might cause bloodstream infections (17), and thus, the use of a central venous catheter is a double-edged sword. In this study, central venous catheterization was found to be an independent protective factor. We speculated that it provides vascular access for sepsis patients, and facilitates early fluid resuscitation and parenteral nutrition. We compared the proportion of central venous catheterization in different wards, among which, the surgical ward (56.8%) and the ICU ward (54.1%) were significantly higher than the medical ward (21.9%).

The variables in the novel risk score are all easily obtained. The four laboratory tests (HCT, PLT, APTT, and AST) are routine test items for hospitalized patients. Compared with the other risk scores such as MEWS and APACHE II, our score does not require some indicators that are difficult to obtain, such as PaO2 and FiO2, and does not require indicators that are not routinely detected outside of ICU wards, such as Lac and PCT.

This study had several limitations that should be noted. Firstly, it was a retrospective study and was conducted at a single center in China, and no external validation was carried out in this study, which limits the generalization of its findings. Secondly, the sepsis-3 criteria were updated in 2016, so there may have been some missing cases during 2015–2016. Thirdly, some community-acquired sepsis patients were first diagnosed and treated in the emergency department, and after appropriate treatment, their SOFA score might have been less than 2 points when admitted to wards. Thus, these patients were excluded in our study.

Conclusions

In conclusion, age, central vein catheterization, mechanical ventilation, vasopressin, CCI, RR, HR, GCS, PLT, HCT, AST, and APTT were found to be independent risk factors for in-hospital death in adult sepsis patients. We developed and validated a novel risk score, which better predicts mortality than the APACHE II score and the MEWS.

The article’s supplementary files as