Cheng Zhu1, Sheng Zhang2, Han Zhong3, Zhichun Gu3, Yuening Kang4, Chun Pan5, Zhijun Xu6, Erzhen Chen1, Yuetian Yu7, Qian Wang8, Enqiang Mao1. 1. Department of Emergency, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. 2. Department of Critical Care Medicine, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. 3. Department of Pharmacy, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. 4. Department of Rheumatology, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. 5. Department of Critical Care Medicine, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China. 6. Department of Critical Care Medicine, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China. 7. Department of Critical Care Medicine, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China. 8. Department of Emergency Internal Medicine, Shuguang Hospital Affiliated to Shanghai University of Traditional Chinese Medicine, Shanghai, China.
Abstract
BACKGROUND: This study aimed to investigate the microbiol distribution of intra-abdominal infection in patients with acute pancreatitis, and to develop a reliable prediction model to guide the use of antibiotics. METHODS: Inpatient with acute pancreatitis between January 2015 and June 2020 were enrolled in the study. Participants were divided into the intra-abdominal infection group and non-infection group. Isolated pathogens and antibiotic susceptibility were documented. Characteristics parameters, laboratory results, and outcomes were also compared. Least absolute shrinkage and selection operator (LASSO) regression model was used to select the risk factors associated with intra-abdominal infection in patients with acute pancreatitis. Logistic regression analysis, random forest model, and artificial neural network were also used to validate the performance of the selected predictors in intra-abdominal infection prediction. A novel nomogram based on selected predictors was established to provide individualized risk of developing intra-abdominal infection in patients with acute pancreatitis. RESULTS: A total amount of 711 participants were enrolled in the study, and of these, 182 (25.6%) had intra-abdominal infection. Of the 247 isolated pathogens, 45 (18.2%) were multidrug-resistant bacteria, and antibiotic susceptibility was lower than that of China Antimicrobial Surveillance Network 2020. The LASSO method identified 5 independent predictors [intra-abdominal pressure (IAP), acute physiology and chronic health evaluation II (APACHE II), computed tomography severity index (CTSI), the severity of pancreatitis, and intensive care unit (ICU) admission] of intra-abdominal infection, which were validated by three different models. The area under the curve was >0.95 for all 5 predictors. A clinically useful nomogram based on these predictors was successfully established. CONCLUSIONS: Multidrug-resistant bacteria were quite common in intra-abdominal infection. IAP, APACHE II, CTSI, the severity of pancreatitis, and ICU admission were identified as risk factors and the new nomogram based on these could help clinicians estimate the risk of intra-abdominal infection and optimize antimicrobial prescription for acute pancreatitis patients. 2021 Annals of Translational Medicine. All rights reserved.
BACKGROUND: This study aimed to investigate the microbiol distribution of intra-abdominal infection in patients with acute pancreatitis, and to develop a reliable prediction model to guide the use of antibiotics. METHODS: Inpatient with acute pancreatitis between January 2015 and June 2020 were enrolled in the study. Participants were divided into the intra-abdominal infection group and non-infection group. Isolated pathogens and antibiotic susceptibility were documented. Characteristics parameters, laboratory results, and outcomes were also compared. Least absolute shrinkage and selection operator (LASSO) regression model was used to select the risk factors associated with intra-abdominal infection in patients with acute pancreatitis. Logistic regression analysis, random forest model, and artificial neural network were also used to validate the performance of the selected predictors in intra-abdominal infection prediction. A novel nomogram based on selected predictors was established to provide individualized risk of developing intra-abdominal infection in patients with acute pancreatitis. RESULTS: A total amount of 711 participants were enrolled in the study, and of these, 182 (25.6%) had intra-abdominal infection. Of the 247 isolated pathogens, 45 (18.2%) were multidrug-resistant bacteria, and antibiotic susceptibility was lower than that of China Antimicrobial Surveillance Network 2020. The LASSO method identified 5 independent predictors [intra-abdominal pressure (IAP), acute physiology and chronic health evaluation II (APACHE II), computed tomography severity index (CTSI), the severity of pancreatitis, and intensive care unit (ICU) admission] of intra-abdominal infection, which were validated by three different models. The area under the curve was >0.95 for all 5 predictors. A clinically useful nomogram based on these predictors was successfully established. CONCLUSIONS: Multidrug-resistant bacteria were quite common in intra-abdominal infection. IAP, APACHE II, CTSI, the severity of pancreatitis, and ICU admission were identified as risk factors and the new nomogram based on these could help clinicians estimate the risk of intra-abdominal infection and optimize antimicrobial prescription for acute pancreatitis patients. 2021 Annals of Translational Medicine. All rights reserved.
Entities:
Keywords:
Acute pancreatitis; intra-abdominal infection; microbiology; prediction model
Acute pancreatitis is an inflammatory condition of the pancreas that is also known to involve the peri-pancreatic tissues (1). It has various underlying etiologies, such as acute cholecystitis, hyperlipidemia, and excessive alcohol consumption (1). Secondary intra-abdominal infection of acute pancreatitis is one of the leading complications that has been of great concern in recent years. Epidemiological studies have shown that infection of the pancreas and peripancreatic necrosis occurs in about 20–40% of patients with severe acute pancreatitis, which can cause life-threatening organ dysfunction and lead to poor prognosis (2). In a meta-analysis of 6,970 patients, it was indicated that the mortality rate could be as high as 35.2% in acute pancreatitis with intra-abdominal infection and organ failure (3). Therefore, the early identification of these infectious diseases is a major challenge in managing patients with acute pancreatitis, especially in severe cases.Prophylactic antibiotics in acute pancreatitis was once believed to reduce the incidence of infection-related complications (4,5). However, the effects of treatment are still controversial due to the heterogeneity of enrolled patients in clinical trials and different antimicrobial applications (6). The abuse of antibiotics will lead to gut microflora dysbiosis and increased medical expenses (7). Therefore, it is important to identify those at high risk of developing an infection and to recognize microbiological features after infection onset. It was reported that some of the host factors like diabetes and gallstones were once recognized as the risk factors for secondary intra-abdominal infection (1,2). However, no comprehensive systematic analysis with large sample size has been performed and the valuable information provided to clinical practice is limited. Thus, the present study was performed to establish a reliable clinical prediction model by least absolute shrinkage and selection operator (LASSO) regression and was further validated in the logistic regression model, random forest model, and artificial neural network model, respectively. With the valuable nomogram established, we hope it could optimize the antimicrobial prescription for acute pancreatitis patients with suspected intra-abdominal infection.We present the following article in accordance with the TRIPOD reporting checklist (available at http://dx.doi.org/10.21037/atm-21-399).
Methods
The retrospective clinical study was conducted at 6 pancreatitis diagnosis and treatment centers in eastern China (Ruijin Hospital, Ren Ji Hospital, Zhongda Hospital, Sir Run Run Shaw Hospital, The Second Zhejiang Hospital, and Shu Guang Hospital). The analyzed data were obtained from electronic medical records of each hospital between January 2015 and June 2020 by 6 attending physicians. The Ethics Committee of Shanghai Jiaotong University School of Medicine approved the study (No. 2019-RES-082), and the study was conducted in accordance with the declaration of Helsinki (as revised in 2013). Written informed consent was obtained from all patients.
Study population
Inpatients who were diagnosed with acute pancreatitis and aged 18–80 years were included in the study. The exclusion criteria were as follows: (I) was diagnosed with an extra-abdominal infectious disease during hospital stay; (II) was pregnancy; and (III) had incomplete medical history.Extra-abdominal infectious diseases include bloodstream infections, pneumonia (hospital-acquired pneumonia or ventilator-acquired pneumonia), urinary tract infections, and skin and soft tissue infections. All diagnostic criteria of the infection were based on the practice guideline of the European Society of Clinical Microbiology and Infectious Diseases (8).
Disease definitions
Based on the guidelines of the World Society of Emergency Surgery 2019 (1), acute pancreatitis can be diagnosed by any 2 of the following 3 criteria: (I) acute epigastric pain, which can radiate to the back or waist; (II) the level of amylase and/or lipase in blood samples is at least 3 times higher than the normal limit; and (III) enhanced computed tomography (CT) or magnetic resonance imaging (MRI) was performed, and typical pancreatic lesions can be detected.Secondary intra-abdominal infection is suspected in patients with acute pancreatitis when the 1 of the following criteria is met: (I) new-onset fever (body temperature >38.5 °C) or persistent fever; (II) the level of inflammatory biomarkers [leukocyte count, neutrophil count, procalcitonin (PCT), and C-reactive protein (CRP)] is increased; and (III) clinical symptoms of continuous deterioration and organ dysfunction are detected. The diagnostic methods consist of the following: (I) gas configurations in the necrotic pancreatic tissue can be detected via enhanced CT (Figure S1); and (II) positive culture results are acquired from the fine-needle aspiration (FNA) sample (1,2).
Identification of strains and antimicrobial susceptibility testing operation
CT-guided FNA was performed to obtain drainage fluid from peri-pancreatic tissues (Figure S2). To identify pathogens, samples were gram and fluorescence stained and were also amplified by bacteria culture. Identification of pathogens was also conducted by the VITEK-2 compact automated microbiology system (BioMerienx, France, Version 1.7), and the results of the antimicrobial susceptibility testing were determined based on the standards of the Clinical and Laboratory Standards Institute (CLSI). Information on the pathogens that caused intra-abdominal infection was obtained from each research center’s microbiological database.Only the first isolated pathogen from the drainage fluid samples was tested in our study. Multidrug-resistant (MDR) strain was defined as acquired non-susceptibility to at least 1 agent in 3 or more antimicrobial categories (9). China Antimicrobial Surveillance Network data were obtained from the internet (http://www.chinets.com) to compare antimicrobial susceptibility.
Clinical assessment and data collection
Clinical medical information of the hospitalized acute pancreatitis patients included in the present study was obtained from the electronic medical record management system of each hospital. The clinical characteristics of the enrolled patients were as follows: (I) basic information, including age, sex, comorbidity (hypertension, diabetes), and body mass index; (II) etiology of pancreatitis; (III) severity of the disease [Acute Physiology and Chronic Health Evaluation II (APACHE II) score, CT severity index (CTSI)]; (IV) intra-abdominal pressure (IAP); (V) biomarkers of inflammation (PCT, CRP, and white blood cell counts); (VI) change in coagulation index; and (VII) change in clinical biochemical index on days 1, 3, 7, and 14 and the prognosis (intra-abdominal infection, dead).
Statistical analysis
Categorical variables were presented as counts (n) and percentages (%), and compared using χ2-test or Fisher’s exact test. Normally distributed variables were compared using Student’s t-test, and were expressed as means (standard deviations), whereas non-normally distributed data was compared using Wilcoxon rank sum test and reported as medians (interquartile range). Kaplan-Meier plot and log-rank test were used for the survival analysis.To identify risk factors for intra-abdominal infection in patients with acute pancreatitis, we applied a series of artificial intelligence algorithms. The LASSO regression model with the “lambda.1se” criterion was used for the selection of variables. This analytic strategy enables us to exclude non-essential variables, retaining a subset of the most important variables for outcome prediction. The predictive performance of the selected variables was further validated in the logistic regression model, random forest model, and artificial neural network model, respectively. Model discrimination and calibration were assessed by receiver-operating characteristic (ROC) curves and calibration curves, respectively. In addition, ROC curve parameters, including sensitivity, specificity, correctly classified rate, positive likelihood ratio, and negative likelihood ratio, were also computed for each model. To reduce the risk of overfitting, the whole cohort was randomly divided into the training cohort and validation cohort with a ratio of 6:4. In each model, the training cohort was used for model development and the validation cohort was used for the unbiased assessment of model performance. Finally, a novel nomogram based on the selected predictors was established to provide individualized risk of developing intra-abdominal infection in patients with acute pancreatitis. Statistical analyses were performed using R (University of Auckland, New Zealand, Version 3.6.2), SPSS (IBM, USA, Version 21.0), and GraphPad Prism (GraphPad Software, USA, Version 7.0). A 2-sided P value <0.05 was considered statistically significant (10,11).
Results
A total of 874 hospitalized patients who were diagnosed with acute pancreatitis were initially screened, and of these, 163 were excluded due to factors, such as extra-abdominal infection and pregnancy. Finally, 711 patients were included in the study and 182 (25.6%) of these were diagnosed with intra-abdominal infection ().
Figure 1
Flow chart of the study.
Flow chart of the study.
Isolated bacteria and antimicrobial susceptibility
In total, 247 pathogens from 182 FNA samples were isolated. Of these, 146 (59.1%) were gram-negative bacteria, 47 (19%) were gram-positive bacteria, while the other 32 were fungi. Enterobacteriaceae accounted for the main gram-negative bacteria. Forty-five (18.2%) pathogens were identified as MDR bacteria (). Antimicrobial susceptibility of the 4 main gram-negative bacteria (Escherichia coli, Klebsiella pneumoniae, Pseudomonas aeruginosa, and Acinetobacter baumannii) is shown in , and a relatively high incidence of resistance to carbapenem and 3rd-generation cephalosporin was indicated. For gram-positive bacteria, vancomycin, linezolid, teicoplanin, and tigecycline were considered the best choices for antimicrobial susceptibility (close to 100%) (Figure S3).
Table 1
Microbiology distribution of the 247 pathogens from 182 patients with intra-abdominal infection
Antimicrobial susceptibility of the four main gram-negative bacteria. (A) Escherichia coli; (B) Klebsiella pneumoniae; (C) Pseudomonas aeruginosa; (D) Acinetobacter baumannii.
CoNS, coagulase-negative staphylococci; ESBL, extended spectrum β-lactamase; MDR, multidrug resistant.Antimicrobial susceptibility of the four main gram-negative bacteria. (A) Escherichia coli; (B) Klebsiella pneumoniae; (C) Pseudomonas aeruginosa; (D) Acinetobacter baumannii.
Clinical features and outcomes of patients with or without intra-abdominal infection
The clinical features of patients with or without intra-abdominal infection are listed in . It was indicated that more acute pancreatitis patients with intra-abdominal infection were admitted to intensive care unit (ICU). A high CTSI, APACHE II score, and IAP were found in the intra-abdominal infection group, as well as more patients with diabetes and excessive alcohol consumption (). The laboratory results showed a higher serum PCT level and neutrophil count in patients with intra-abdominal infection (Tables S1-S4).
Table 2
Demographics and clinical characteristics of patients with acute pancreatitis
Variables
Total (n=711)
Non-IAI group (n=529)
IAI group (n=182)
P value
Sex, n (%)
0.31
Female
242 (34.0)
174 (32.9)
68 (37.4)
Male
469 (66.0)
355 (67.1)
114 (62.6)
Age, median (IQR)
49 (37, 62)
50 (38, 62)
48 (37, 59)
0.3
Severity of pancreatitis, n (%)
<0.01
AP
294 (41.4)
291 (55)
3 (1.6)
MSAP
188 (26.4)
179 (33.8)
9 (4.9)
SAP
229 (32.2)
59 (11.2)
170 (93.4)
Cause of pancreatitis, n (%)
<0.01
Hyperlipidemic pancreatitis
323 (45.4)
237 (44.8)
86 (47.3)
Biliary pancreatitis
207 (29.1)
114 (21.6)
93 (51.1)
Other
181 (25.5)
178 (33.6)
3 (1.6)
Alcohol consumption, n (%)
<0.01
No
632 (88.9)
493 (93.2)
139 (76.4)
Yes
79 (11.1)
36 (6.8)
43 (23.6)
Smoking, n (%)
0.07
No
467 (65.7)
358 (67.7)
109 (59.9)
Yes
244 (34.3)
171 (32.3)
73 (40.1)
Diabetes, n (%)
<0.01
No
487 (68.5)
417 (78.8)
70 (38.5)
Yes
224 (31.5)
112 (21.2)
112 (61.5)
Hypertension, n (%)
0.75
No
511 (71.9)
378 (71.5)
133 (73.1)
Yes
200 (28.1)
151 (28.5)
49 (26.9)
Admission, n (%)
<0.01
Emergency Department
447 (62.9)
423 (80.0)
24 (13.2)
ICU
264 (37.1)
106 (20.0)
158 (86.8)
CTSI, median (IQR)
3.0 (4, 5)
4.0 (2, 4)
5.0 (5, 7)
<0.01
BMI, median (IQR)
25.1 (23.4, 26.8)
25.1 (23.4, 26.5)
25.2 (22.8, 27.6)
0.67
APACHE II, median (IQR)
7 (6, 8)
6 (5, 7)
10 (7, 13)
<0.01
Drainage, n (%)
<0.01
No
641 (90.2)
529 (100.0)
112 (61.5)
Yes
70 (9.8)
0 (0)
70 (38.5)
Operation, n (%)
<0.01
No
695 (97.7)
529 (100.0)
166 (91.2)
Yes
16 (2.3)
0 (0)
16 (8.8)
CRRT, n (%)
<0.01
No
702 (98.7)
528 (99.8)
174 (95.6)
Yes
9 (1.3)
1 (0.2)
8 (4.4)
IAP, median (IQR)
14 (12, 18)
12 (11, 16)
19 (17, 22.8)
<0.01
Initiation of enteral nutrition, n (%)
<0.01
Day 0
10 (1.4)
5 (0.9)
5 (2.7)
Day 1
12 (1.7)
11 (2.1)
1 (0.5)
Day 2
81 (11.4)
77 (14.6)
4 (2.2)
Day 3
330 (46.4)
284 (53.7)
46 (25.3)
Day 4
213 (30.0)
122 (23.1)
91 (50.0)
Day 5
57 (8.0)
29 (5.5)
28 (15.4)
Day 6
8 (1.1)
1 (0.2)
7 (3.8)
LOS, median (IQR)
20 (12, 31)
16 (10, 22)
40.5 (36, 51.8)
<0.01
Prognosis, n (%)
<0.01
Survival
689 (96.9)
525 (99.2)
164 (90.1)
Non-survival
22 (3.1)
4 (0.8)
18 (9.9)
AP, acute pancreatitis; APACHE II, Acute Physiology and Chronic Health Evaluation II; BMI, body mass index; CRRT, continuous renal replacement therapy; CTSI, computed tomography severity index; IAI, intra-abdominal infection; IAP, intra-abdominal pressure; ICU, intensive care unit; IQR, interquartile range; LOS, length of stay; MSAP, mild-severe acute pancreatitis; SAP, severe acute pancreatitis.
AP, acute pancreatitis; APACHE II, Acute Physiology and Chronic Health Evaluation II; BMI, body mass index; CRRT, continuous renal replacement therapy; CTSI, computed tomography severity index; IAI, intra-abdominal infection; IAP, intra-abdominal pressure; ICU, intensive care unit; IQR, interquartile range; LOS, length of stay; MSAP, mild-severe acute pancreatitis; SAP, severe acute pancreatitis.It was also noted that high mortality (9.9% vs. 0.8%) and long hospital stay (40.5 vs. 16 days) were associated with acute pancreatitis patients diagnosed with intra-abdominal infection (P<0.01) ().
Figure 3
Ninety-day survival curves of hospitalized patients with acute pancreatitis (intra-abdominal infection vs. non intra-abdominal infection).
Ninety-day survival curves of hospitalized patients with acute pancreatitis (intra-abdominal infection vs. non intra-abdominal infection).
Identification and validation predictive factors for intra-abdominal infection in patients with acute pancreatitis
Variable selection using the LASSO regression model
The whole cohort was randomly divided into the training cohort and validation cohort with a ratio of 6:4. The demographic and clinical data of patients in the training and validation groups are summarized in and Table S5. Most of the included variables and outcomes were well balanced between the two groups. Using the LASSO model with the “lambda.1se” criterion, 5 variables (intra-abdominal pressure, APACHE II score, CTSI, ICU admission, and severity grade) were retained for subsequent model construction and intra-abdominal infection prediction ().
Table 3
Demographic and clinical characteristics of patients in training and validation groups
Variables
Total (n=711)
Validation group (n=294)
Train group (n=417)
P value
Sex, n (%)
0.02
Female
242 (34.0)
85 (28.9)
157 (37.6)
Male
469 (66.0)
209 (71.1)
260 (62.4)
Age, median (IQR)
49 (38, 62)
50 (37, 63)
49 (38, 60)
0.65
Severity of pancreatitis, n (%)
0.99
AP
294 (41.4)
122 (41.5)
172 (41.2)
MSAP
188 (26.4)
78 (26.5)
110 (26.4)
SAP
229 (32.2)
94 (32.0)
135 (32.4)
Cause of pancreatitis, n (%)
0.38
Hyperlipidemic pancreatitis
323 (45.4)
125 (42.5)
198 (47.5)
Biliary pancreatitis
207 (29.1)
88 (29.9)
119 (28.5)
Other
181 (25.5)
81 (27.6)
100 (24)
Alcohol consumption, n (%)
0.6
No
632 (88.9)
264 (89.8)
368 (88.2)
Yes
79 (11.1)
30 (10.2)
49 (11.8)
Smoking, n (%)
0.56
No
467 (65.7)
189 (64.3)
278 (66.7)
Yes
244 (34.3)
105 (35.7)
139 (33.3)
Diabetes, n (%)
0.98
No
487 (68.5)
202 (68.7)
285 (68.3)
Yes
224 (31.5)
92 (31.3)
132 (31.7)
Hypertension, n (%)
0.76
No
511 (71.9)
209 (71.1)
302 (72.4)
Yes
200 (28.1)
85 (28.9)
115 (27.6)
Admission, n (%)
0.29
Emergency Department
447 (62.9)
192 (65.3)
255 (61.2)
ICU
264 (37.1)
102 (34.7)
162 (38.8)
CTSI, median (IQR)
3 (4.0, 5.0)
3 (4.0, 5.0)
3 (4.0, 5.0)
0.33
BMI, median (IQR)
25.1 (23.4, 26.8)
25.3 (23.3, 27)
25.1 (23.4, 26.8)
0.71
APACHE II, median (IQR)
7 (6, 8)
7 (5, 8)
7 (6, 8)
0.33
Drainage, n (%)
0.38
No
641 (90.2)
269 (91.5)
372 (89.2)
Yes
70 (9.8)
25 (8.5)
45 (10.8)
Operation, n (%)
0.57
No
695 (97.7)
289 (98.3)
406 (97.4)
Yes
16 (2.3)
5 (1.7)
11 (2.6)
CRRT, n (%)
1
No
702 (98.7)
290 (98.6)
412 (98.8)
Yes
9 (1.3)
4 (1.4)
5 (1.2)
IAP, median (IQR)
14 (12, 18)
14 (12, 18)
14 (12, 18)
0.89
Initiation of enteral nutrition, n (%)
0.52
Day 0
10 (1.4)
6 (2.0)
4 (1.0)
Day 1
12 (1.7)
4 (1.4)
8 (1.9)
Day 2
81 (11.4)
36 (12.2)
45 (10.8)
Day 3
330 (46.4)
145 (49.3)
185 (44.4)
Day 4
213 (30.0)
80 (27.2)
133 (31.9)
Day 5
57 (8.0)
20 (6.8)
37 (8.9)
Day 6
8 (1.1)
3 (1.0)
5 (1.2)
LOS, median (IQR)
20 (12, 31)
20 (11, 30)
21 (12, 32)
0.47
IAI, n (%)
0.51
No
529 (74.4)
223 (75.9)
306 (73.4)
Yes
182 (25.6)
71 (24.1)
111 (26.6)
Prognosis, n (%)
1
Survival
689 (96.9)
285 (96.9)
404 (96.9)
Non-survival
22 (3.1)
9 (3.1)
13 (3.1)
AP, acute pancreatitis; APACHE II, Acute Physiology and Chronic Health Evaluation II; BMI, body mass index; CRRT, continuous renal replacement therapy; CTSI, computed tomography severity index; IAI, intra-abdominal infection; IAP, intra-abdominal pressure; ICU, intensive care unit; IQR, interquartile range; LOS, length of stay; MSAP, mild-severe acute pancreatitis; SAP, severe acute pancreatitis.
Figure 4
Selection of risk factors of intra-abdominal infection using the LASSO logistic regression algorithm. (A) LASSO coefficient profiles of the 43 candidate variables. Vertical line was plotted at the given lambda, selected by 10-fold cross-validation with minimum classification error and minimum classification error plus 1 standard error, respectively. For the optimal lambda that gives minimum classification error plus 1 standard error, 5 features with a non-0 coefficient were selected. (B) Penalization coefficient lambda in the LASSO model was tuned using 10-fold cross-validation and the “lambda.1se” criterion. Area under the curve (AUC) metrics (y-axis) were plotted against log(lambda) (bottom x-axis). Top x-axis indicates the number of predictors for the given log(lambda). Red dots indicate average AUC for each model at the given lambda, and vertical bars through the red dots show the upper and lower values of the AUC according to the 10-fold cross-validation. Vertical black lines define the optimal lambda that gives the minimum classification error plus 1 standard error.
AP, acute pancreatitis; APACHE II, Acute Physiology and Chronic Health Evaluation II; BMI, body mass index; CRRT, continuous renal replacement therapy; CTSI, computed tomography severity index; IAI, intra-abdominal infection; IAP, intra-abdominal pressure; ICU, intensive care unit; IQR, interquartile range; LOS, length of stay; MSAP, mild-severe acute pancreatitis; SAP, severe acute pancreatitis.Selection of risk factors of intra-abdominal infection using the LASSO logistic regression algorithm. (A) LASSO coefficient profiles of the 43 candidate variables. Vertical line was plotted at the given lambda, selected by 10-fold cross-validation with minimum classification error and minimum classification error plus 1 standard error, respectively. For the optimal lambda that gives minimum classification error plus 1 standard error, 5 features with a non-0 coefficient were selected. (B) Penalization coefficient lambda in the LASSO model was tuned using 10-fold cross-validation and the “lambda.1se” criterion. Area under the curve (AUC) metrics (y-axis) were plotted against log(lambda) (bottom x-axis). Top x-axis indicates the number of predictors for the given log(lambda). Red dots indicate average AUC for each model at the given lambda, and vertical bars through the red dots show the upper and lower values of the AUC according to the 10-fold cross-validation. Vertical black lines define the optimal lambda that gives the minimum classification error plus 1 standard error.
Development, validation, and assessment of models for predicting intra-abdominal infection
Three predictive models were built by incorporating the five selected variables. The logistic regression model (), random forest model (), and artificial neural network () were used. ROC curve parameters at the optimal cut-off point according to different models were compared (). It was indicated that all of the areas under the curve were >0.95 and had high sensitivity and specificity in both the training set and validation set (all >93%). In addition, calibration curves indicated good agreement between predicted probability and observed probability for intra-abdominal infection in both the training set and validation set.
Figure 5
Performance of the logistic regression algorithm in intra-abdominal infection prediction. (A,B) Receiver-operating characteristic curves; (C,D) calibration curves.
Figure 6
Development and assessment of the random forest algorithm in intra-abdominal infection prediction. (A) Relationship between out-of-bag error and number of trees. In total, 114 trees are selected to establish a random forest model; (B) feature importance; (C,D) receiver-operating characteristic curves; (E,F) calibration curves.
Figure 7
Development and assessment of the artificial neural network algorithm in intra-abdominal infection prediction. (A) Structure of artificial neural network; (B) feature importance; (C,D) receiver-operating characteristic curves; (E,F) calibration curves.
Table 4
Receiver-operating characteristic curves at the optimal cut-off point according to different models
Models
AUC
Sensitivity
Specificity
Correctly classified
LR+
LR–
Training set
Logistic model
0.99
0.91
0.97
0.95
27.84
0.09
Random forest model
0.98
0.93
0.95
0.94
18.93
0.08
Artificial neural network model
0.99
0.96
0.96
0.96
22.48
0.05
Validation set
Logistic model
0.98
0.93
0.95
0.95
18.85
0.07
Random forest model
0.98
0.94
0.93
0.94
14.03
0.06
Artificial neural network model
0.98
0.93
0.95
0.95
18.85
0.07
AUC, area under the curve; LR, likelihood ratio.
Performance of the logistic regression algorithm in intra-abdominal infection prediction. (A,B) Receiver-operating characteristic curves; (C,D) calibration curves.Development and assessment of the random forest algorithm in intra-abdominal infection prediction. (A) Relationship between out-of-bag error and number of trees. In total, 114 trees are selected to establish a random forest model; (B) feature importance; (C,D) receiver-operating characteristic curves; (E,F) calibration curves.Development and assessment of the artificial neural network algorithm in intra-abdominal infection prediction. (A) Structure of artificial neural network; (B) feature importance; (C,D) receiver-operating characteristic curves; (E,F) calibration curves.AUC, area under the curve; LR, likelihood ratio.
Estimating the probability of intra-abdominal infection using the nomogram
For the development of the nomogram, we incorporated the five selected predictors as prognostic features: intra-abdominal pressure, APACHE II score, CTSI, ICU admission, and severity grade. This novel 5 predictor-based nomogram can be utilized to predict individualized risk of intra-abdominal infection in patients with acute pancreatitis ().
Figure 8
Nomogram to predict intra-abdominal infection was developed using the LASSO model selected predictors (intra-abdominal pressure, APACHE II score, CTSI, ICU admission, and severity grade were identified as risk factors). ***, P<0.001. APACHE II, Acute Physiology and Chronic Health Evaluation II; CTSI, CT severity index; ICU, Intensive care unit.
Nomogram to predict intra-abdominal infection was developed using the LASSO model selected predictors (intra-abdominal pressure, APACHE II score, CTSI, ICU admission, and severity grade were identified as risk factors). ***, P<0.001. APACHE II, Acute Physiology and Chronic Health Evaluation II; CTSI, CT severity index; ICU, Intensive care unit.
Discussion
Data of the 711 patients with acute pancreatitis were analyzed in our study and indicated that gram-negative bacteria were still the main cause of intra-abdominal infection with high antimicrobial resistance trends. A new nomogram model that consisted of five risk factors (IAP, ICU admission, APACHE II score, CTSI, and severity of pancreatitis) was built and verified, and revealed a high predictive value.Gut is the largest microecological reservoir of the human body which is mainly filled with Enterococcus, Enterobacter and Bacteroides fragilis (1,12). As an inflammatory disease, the permeability of intestinal mucosa could be increased by neutrophil-derived elastase, which could also destroy the tissue, increase the vascular permeability, and promotes the microecological imbalance. Thus, during the period of acute pancreatitis, the integrity of mucosa could also be destroyed. Therefore, bacteria translocation was easily recognized from the intestine to abdomen, and Enterococcus or Enterobacter could be isolated from the FNA samples (12). What’s more, high concentrations of inflammatory mediators like IL-1 and IL-6 created during the cause of acute pancreatitis could lead to the obstruction of lymphatic reflux which is a “helping hand” to bacteria translocation (13).Most abdominal infections secondary to acute pancreatitis should be classified as hospital-acquired infections. For patients with severe acute pancreatitis, especially for those who need to be admitted to the ICU, isolated pathogens were often MDR, which might relate to the previous antimicrobial exposure in the ICU (13,14). For gram-negative bacteria, the β-lactam/β-lactamase inhibitor complex was a better choice than carbapenem. For gram-negative bacteria, vancomycin, linezolid, and teicoplanin were found to have high susceptibility.The APACHE II score can be used to comprehensively evaluate the acute and chronic physiological status of patients (15). The acute physiology score includes 12 physiological measurements, such as body temperature and respiratory rate, that clearly reflects the inflammatory state (16). Chronic health evaluation can assess the immune condition of the host, plays an important role in the anti-inflammatory response. Therefore, more patients with a high APACHE II score could be recognized in the intra-abdominal infection group (10 vs. 6) in our study, and more patients with a higher score were admitted to the ICU (86.8% vs. 20%), which was proved to be a risk factor for secondary intra-abdominal infection.Many of the 711 included patients with acute pancreatitis could not be treated with injections alone, but also required drainage of peritoneal effusion (38.5%), operation (8.8%), and continuous renal replacement therapy (4.4%), especially those admitted to the ICU. Surgery and minimally invasive treatment can destroy the integrity of skin and mucosa which pose a hidden danger for secondary infection (17,18).CT outperforms all other scores, not only for diagnostic accuracy but also for demonstrating the extent of the disease, as well as for guiding interventional procedures. Moreover, contrast-enhanced CT is the gold standard modality in the imaging evaluation of patients with acute pancreatitis (19). In 1990 Balthazar et al. established the CT severity index (CTSI) (20). This system grades pancreatic inflammation and necrosis, and is able to predict the morbidity and mortality of acute pancreatitis. Therefore, it was still found to be an independent risk factor for intra-abdominal infection, as well as IAP.A prediction model with 5 main risk factors was built during our 6-year study, and a high predictive value for intra-abdominal infection was confirmed. However, there are many limitations. First, prophylactic antimicrobial application was not further analyzed. Therefore, the relationship between antimicrobial resistance and its consumption could not be established. Second, no indicators related to immune status were analyzed, such as the human leukocyte antigen D-related expression or the CD4+Th/CD8+Th cell ratio, which was reported to be a risk factor for MDR infection in patients with severe acute pancreatitis (21-23). Third, although the sample size of the present study was adequate, the mortality was relatively low, which led to the uncompleted subgroup analysis. Further prospective trials with large sample size are needed in the future to obtain a higher grade of evidence.
Conclusions
Gram-negative bacteria, especially Enterobacteriaceae, are the main cause of intra-abdominal infection. Therefore, more attention should be paid to MDR pathogens. A new nomogram model that consisted of 5 risk factors (IAP, ICU admission, APACHE II score, CTSI, and severity of pancreatitis) was built for intra-abdominal infection prediction for patients with acute pancreatitis. Multicenter prospective validation cohorts should be used in subsequent studies to achieve a higher level of evidence.The article’s supplementary files as
Authors: A-P Magiorakos; A Srinivasan; R B Carey; Y Carmeli; M E Falagas; C G Giske; S Harbarth; J F Hindler; G Kahlmeter; B Olsson-Liljequist; D L Paterson; L B Rice; J Stelling; M J Struelens; A Vatopoulos; J T Weber; D L Monnet Journal: Clin Microbiol Infect Date: 2011-07-27 Impact factor: 8.067