Literature DB >> 28729412

Simple Scoring System to Predict In-Hospital Mortality After Surgery for Infective Endocarditis.

Giuseppe Gatti1, Andrea Perrotti2, Jean-François Obadia3, Xavier Duval4,5, Bernard Iung6,7, François Alla8, Catherine Chirouze9, Christine Selton-Suty10, Bruno Hoen11, Gianfranco Sinagra12, François Delahaye3, Pierre Tattevin13, Vincent Le Moing13,14, Aniello Pappalardo12, Sidney Chocron2.   

Abstract

BACKGROUND: Aspecific scoring systems are used to predict the risk of death postsurgery in patients with infective endocarditis (IE). The purpose of the present study was both to analyze the risk factors for in-hospital death, which complicates surgery for IE, and to create a mortality risk score based on the results of this analysis. METHODS AND
RESULTS: Outcomes of 361 consecutive patients (mean age, 59.1±15.4 years) who had undergone surgery for IE in 8 European centers of cardiac surgery were recorded prospectively, and a risk factor analysis (multivariable logistic regression) for in-hospital death was performed. The discriminatory power of a new predictive scoring system was assessed with the receiver operating characteristic curve analysis. Score validation procedures were carried out. Fifty-six (15.5%) patients died postsurgery. BMI >27 kg/m2 (odds ratio [OR], 1.79; P=0.049), estimated glomerular filtration rate <50 mL/min (OR, 3.52; P<0.0001), New York Heart Association class IV (OR, 2.11; P=0.024), systolic pulmonary artery pressure >55 mm Hg (OR, 1.78; P=0.032), and critical state (OR, 2.37; P=0.017) were independent predictors of in-hospital death. A scoring system was devised to predict in-hospital death postsurgery for IE (area under the receiver operating characteristic curve, 0.780; 95% CI, 0.734-0.822). The score performed better than 5 of 6 scoring systems for in-hospital death after cardiac surgery that were considered.
CONCLUSIONS: A simple scoring system based on risk factors for in-hospital death was specifically created to predict mortality risk postsurgery in patients with IE.
© 2017 The Authors. Published on behalf of the American Heart Association, Inc., by Wiley.

Entities:  

Keywords:  cardiac valvular surgery; critical care; infective endocarditis; mortality; predictors; pulmonary hypertension; quality control; treatment outcome

Mesh:

Year:  2017        PMID: 28729412      PMCID: PMC5586260          DOI: 10.1161/JAHA.116.004806

Source DB:  PubMed          Journal:  J Am Heart Assoc        ISSN: 2047-9980            Impact factor:   5.501


Introduction

Outcome in patients with infective endocarditis (IE) is a complex process, mediated by the immune system, and a function of interactions between patient‐related factors (eg, demographic data, risk factors for cardiovascular disease, underlying cardiac disease, and comorbidities) and the properties of the causal agent (eg, nature, virulence, and antibiotic resistance). In 25% to 30% of cases, medical treatment alone is inadequate and must be combined with surgery, which aims to control infection by debridement and removal of necrotic tissue, and to restore cardiac morphology by surgical repair and/or valve replacement. Cardiac operations in some of these critically ill patients may be challenging and yield poor early and late results, even when carefully performed. Mortality rates have been reported to range between 10% in elective patients and up to 30% in urgent surgery. Prolonged invasive ventilation, low cardiac output, acute kidney injury, sepsis, and bleeding are frequent postoperative complications.1, 2, 3 Consequently, for patients with IE, risk stratification is important not only for the surgeon for decision making, but also for counseling of the patient and comparative assessment of quality of care. Currently, the risk of mortality postsurgery for IE is estimated using predictive scoring systems that have been derived from patient databases where most of the patients had had cardiac operations other than those for endocarditis.4, 5, 6, 7 Because of this inherent limitation, the utility of these aspecific predictive systems for patients with IE has been called into question.8, 9, 10, 11, 12, 13 In fact, specific scores to predict in‐hospital death postsurgery in patients with IE have also been devised,14, 15, 16 but with no external validation, and their impact in clinical practice is unclear. In this context, we performed a prospective, population‐based observational study in 8 European centers of cardiac surgery. The aims of the study were both to analyze the risk factors for hospital death and create a risk score based on the results of this analysis.

Methods

Study Patients

The study population consisted of 361 patients who underwent surgery for IE: (1) 138 consecutive patients (mean age, 60.6±8.5 years; 19.6% females) who were operated on between 2000 and 2015 at the Cardiovascular Department of the University Hospital of Trieste, Trieste, Italy; (2) 223 consecutive patients (mean age, 58.2±15.6 years; 22% females) who underwent surgery in 2008 in 7 French administrative areas: greater Paris, Lorraine, Rhône‐Alpes, Franche‐Comté, Marne, Ille‐et‐Vilaine, and Languedoc‐Roussillon. The adult population in these areas (15.3 million inhabitants) covers 31.9% of the overall French population aged >18 years.11 The French centers are grouped in the Association for the study and prevention of IE (Association pour l'Étude et la Prévention de l'Endocadite Infectieuse; AEPEI). Since 2001, the members of the AEPEI (see Appendix for full list of members) are enrolling patients with IE in each of the French administrative areas in an ad‐hoc prospective registry.17 In 2008, the data collection was particularly exhaustive, comprehensive, and accurate because it coincided with an epidemiological study performed by the AEPEI to update national data regarding the epidemiology of IE in France. Only definite cases of IE, as defined by the modified Duke criteria,18 were included into the present study. For all patients, baseline characteristics, surgical and endocarditis‐related features, as well as postoperative complications were prospectively recorded in a computerized data registry. For each center, approval to conduct the study was acquired from the local ethics committee. Patients were informed about the study, but were not required to provide individual consent, in accord with French and Italian legislation. A risk factor analysis for in‐hospital death postsurgery for IE was performed and a predictive scoring system, named the AEPEI score, was devised from the results of the analysis. External validation was performed using data from the AEPEI registry of patients with definite IE who underwent surgery between 2001 and 2015. The validation sample comprised 161 AEPEI patients for whom there were sufficient data to calculate the AEPEI score. The 223 AEPEI patients operated on in 2008 and included in the present study had been excluded preventively from the validation sample.

Definitions

Unless otherwise stated, the definitions and cut‐off values of the preoperative variables were those used for the European System for Cardiac Operative Risk Evaluation (EuroSCORE). In particular, critical state was defined as the presence of ventricular tachycardia/ventricular fibrillation or aborted sudden death, preoperative cardiac massage, preoperative ventilation before anesthetic room, preoperative inotropes or intra‐aortic balloon pump, and preoperative acute renal failure (anuria or oliguria <10 mL/h).5, 6 Myocardial infarction (MI) was defined according to the recent definition criteria of type V MI by Moussa et al.19 Acute kidney injury was defined as an increase in serum creatinine of 1.5 to 1.9 times the baseline level or serum creatinine increase ≥26.5 μmol/L within 7 days postsurgery.20 Sternal wound infections were graded according to the Centers for Disease Control and Prevention definitions of surgical site infections. In brief, superficial incisional infection involves only skin or subcutaneous tissues, deep incisional infection involves deep soft tissues (fascial and muscle layers) with or without the sternal bone, and organ/space infection involves the mediastinum (mediastinitis).21 For the purposes of this study, deep incisional infection and mediastinitis were considered to be deep sternal wound infections. Any sternal wound infection occurring within 3 months postsurgery was considered as postoperative wound infection.

Statistical Analysis

Continuous variables with normal distribution are expressed as mean±SD and those without normal distribution as median [interquartile range]. Categorical variables are expressed as number and percentage. Statistical comparison of baseline characteristics was performed using Pearson's chi‐square or Fisher's exact test for categorical variables, and Student t test or the Mann–Whitney U test for continuous variables. Backward step‐wise multivariable logistic regression analysis was used to identify independent predictors of in‐hospital mortality. All variables with a P<0.1 by univariable analysis were included in the multivariable model. For each variable, the odds ratio (OR) and the corresponding 95% CI were calculated. Each of the risk indices had the variable weighted according to its regression coefficient. Goodness of fit of the model was evaluated with the Hosmer–Lemeshow test. The discriminatory power of the model was assessed with the receiver operating characteristic (ROC) curve and the calculation of the area under the curve (AUC). The new predictive scoring system, the AEPEI score, was compared (using De Long's method) with 3 existing scoring systems for in‐hospital mortality after cardiac surgery, namely the EuroSCORE II,5 the logistic EuroSCORE,16 and the Ontario Province Risk (OPR) score,17 as well as with 3 existing scores specifically designed to predict early mortality postsurgery for IE, namely the PALSUSE score (the prosthetic valve, age ≥70, large intracardiac destruction, Staphylococcus spp, urgent surgery, sex [female], and EuroSCORE ≥10),18 the De Feo score (for native valve IE),19 and the Society of Thoracic Surgeons (STS) score for IE.20 Both internal validation, based on the 0.632 bootstrap method, and external validation were performed. In addition, a new set of statistical analyses was carried out as follows: (1) In order to verify the stability of the original 5‐variable model of the AEPEI score without the variable linked to pulmonary artery pressure, an alternate model of the AEPEI score was created by removing systolic pulmonary artery pressure (sPAP) >55 mm Hg from the original set of variables from which the score was generated. The goodness of fit and the discriminatory power of this alternate model were measured. (2) Because all the variables of the AEPEI score except BMI >27 kg/m2 were also components of the EuroSCORE II, we added BMI >27 kg/m2 to EuroSCORE II and investigated its incremental value with continuous net reclassification improvement and integrated discrimination improvement measures.22 (3) Given the ratio of events to potential predictor variables, Akaike's information criterion (AIC), which accounts for the small number of events relative to the number of covariates, was analyzed.23 Statistical analyses were performed using SPSS for Windows (version 13.0; SPSS, Inc, Chicago, IL).

Results

Italian Versus French Study Patients

There were some differences in baseline characteristics, surgical data, and endocarditis‐related features between the Italian and French patients of the study. The rates of preoperative dialysis, Canadian Cardiovascular Society (CCS) class 4, previous cardiac surgery, urgent/emergency priority, and combined coronary surgery were higher in Italian patients, whereas poor mobility, recurrent embolism, and active endocarditis were more frequent in French patients. Baseline levels of C‐reactive protein were higher in Italian patients (Tables 1, 2 through 3). Overall, the expected operative risk was higher in Italian patients than in the French series (mean EuroSCORE II, 15.9±18.7% versus 9.9±3.6%; P<0.0001). In‐hospital mortality was higher in Italian than in French patients (20.3% versus 12.6%; P=0.049); 30‐day mortality was also higher in the Italian series (18.1% versus 7.6%; P=0.0025).
Table 1

Baseline Characteristics of Patients (n=361)a

VariableTrieste Database (n=138)AEPEI Registry (n=223) P Value
Age, y60.6±8.558.2±15.60.15
Female sex27 (19.6)49 (22.0)0.58
Hypertension21 (15.2)90 (40.4)<0.0001
Current smoker11 (8)54 (24.2)<0.0001
BMI, kg/m2 25.5±4.125.4±5.40.88
Diabetes mellitus22 (15.9)48 (21.5)0.19
Diabetes mellitus on insulin9 (6.5)18 (8.1)0.58
Anemiab 113 (81.9)171 (76.6)0.95
White blood cell, 103/mm3 12±5.914.9±10.50.0032
CRP, mg/L193.6±81.3140.4±85.5<0.0001
Poor mobilityc 2 (1.4)18 (8.1)0.0075
Chronic lung diseasec 13 (9.4)20 (9.0)0.88
eGFR, mL/mind 67.7±37.369.4±35.40.67
Dialysis13 (9.4)2 (0.9)<0.0001
Extracardiac arteriopathyc 22 (15.9)28 (12.6)0.36
NYHA class IV55 (39.9)81 (36.3)0.5
CCS class 420 (14.5)3 (1.3)<0.0001
Recent MIc 01 (0.4)1
Left ventricular ejection fraction <50%c 32 (23.2)43 (19.3)0.37
sPAP >55 mm Hgc 3 (2.2)15 (12.4)0.053
Coronary artery disease18 (13)25 (18.1)0.6
Previous cardiac surgery37 (26.8)17 (7.6)<0.0001
Critical statec 27 (19.6)35 (15.7)0.34
Length of the preoperative hospital stay (days)e 6 [2–19]13 [5–25]0.16

CCS indicates Canadian Cardiovascular Society; CRP, C‐reactive protein; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; MI, myocardial infarction; NYHA, New York Heart Association; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure.

Unless otherwise stated, values are mean±SD, or number (percentage).

Defined as haemoglobin <12 g/dL for women and <13 g/dL for men.

The definitions and the cut‐off values are those used for the EuroSCORE II.5

The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR.

Median [interquartile range].

Table 2

Surgical Features (n=361)a

VariableTrieste Database (n=138)AEPEI Registry (n=223) P Value
Reason for surgery
Refractory heart failure attributed to valvular dysfunction32 (23.2)59 (26.5)0.49
Persistent infection18 (13)28 (12.6)0.89
Embolism58 (42)106 (47.5)0.31
Recurrent4 (2.9)49 (22)<0.0001
Perivalvular complicationsb 40 (29)67 (30)0.82
Surgical priorityc <0.0001
Elective26 (18.8)107 (48.0)
Urgent90 (65.2)94 (42.2)
Emergency22 (15.9)11 (4.9)
Salvage011 (4.9)
Valve involvement
Aortic valve86 (62.3)138 (61.9)0.93
Mitral valve60 (43.5)107 (48.0)0.40
Tricuspid valve7 (5.1)28 (12.6)0.02
Multivalvular23 (16.7)55 (24.7)0.07
Large intracardiac destructiond 57 (41.3)119 (52)0.08
Weight of the interventionc
Combined CABG25 (18.1)13 (5.8)<0.0001
Single non‐CABG89 (64.5)126 (56.5)0.13
Two procedures46 (33.3)82 (36.8)0.51
Three procedures3 (2.2)15 (6.7)0.053
Surgery on thoracic aorta9 (6.5)15 (6.7)0.94

CABG indicates coronary artery bypass grafting; EuroSCORE, European System for Cardiac Operative Risk Evaluation.

Number (percentage).

Perivalvular leak, annular or aortic abscess, sinus of Valsalva aneurysm, aortic fistula, and prosthetic valve detachment.

The definitions are those used for the EuroSCORE II.5

Defined as extensive valve destruction, perivalvular complications, or multivalvular involvement.

Table 3

Endocarditis‐Related Features (n=361)a

VariableTrieste Database (n=138)AEPEI Registry (n=223) P Value
Endocarditis<0.0001
Activeb 72 (52.2)203 (91)
Treatedb 66 (47.8)20 (9.0)
Type of endocarditis
Native valve103 (74.6)182 (81.6)0.78
Prosthetic valve27 (19.6)41 (18.3)0.78
Intracardiac device or other side12 (8.7)36 (16.1)0.043
Causal agents0.014
Streptococcus species45 (32.6)89 (39.9)
Staphylococcus aureus 23 (16.7)49 (22)
Coagulase‐negative Staphylococci10 (7.2)23 (10.3)
Enterococcus species13 (9.4)24 (10.8)
Gram‐negative bacteria6 (4.3)9 (4)
Fungi2 (1.4)2 (0.9)
Not identified39 (28.3)27 (12.1)

EuroSCORE indicates European System for Cardiac Operative Risk Evaluation.

Number (percentage).

The definitions are those used for the EuroSCORE II.5

Baseline Characteristics of Patients (n=361)a CCS indicates Canadian Cardiovascular Society; CRP, C‐reactive protein; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; MI, myocardial infarction; NYHA, New York Heart Association; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure. Unless otherwise stated, values are mean±SD, or number (percentage). Defined as haemoglobin <12 g/dL for women and <13 g/dL for men. The definitions and the cut‐off values are those used for the EuroSCORE II.5 The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR. Median [interquartile range]. Surgical Features (n=361)a CABG indicates coronary artery bypass grafting; EuroSCORE, European System for Cardiac Operative Risk Evaluation. Number (percentage). Perivalvular leak, annular or aortic abscess, sinus of Valsalva aneurysm, aortic fistula, and prosthetic valve detachment. The definitions are those used for the EuroSCORE II.5 Defined as extensive valve destruction, perivalvular complications, or multivalvular involvement. Endocarditis‐Related Features (n=361)a EuroSCORE indicates European System for Cardiac Operative Risk Evaluation. Number (percentage). The definitions are those used for the EuroSCORE II.5

Risk Factors for Hospital Death and Multivariable Analysis Model

A total of 56 (15.5%) patients died in hospital after surgery (Table 4). Baseline characteristics and operative data of these patients and the corresponding endocarditis‐related features (Table S1) were compared with those of survivors of the in‐hospital phase postsurgery (Tables S2 through S4). Risk factor analysis for in‐hospital death postsurgery for IE was performed. A multivariable model with 16 variables was created using all the variables with a P<0.1 by univariable analysis. BMI >27 kg/m2, estimated glomerular filtration rate (eGFR) <50 mL/min, New York Heart Association (NYHA) class IV, sPAP >55 mm Hg, and critical state were found to be independent predictors of postoperative in‐hospital death (Tables 5 and 6).
Table 4

In‐Hospital Mortality and Perioperative Complicationsa

Complicationn=361
In‐hospital death56 (15.5)
30‐day death42 (11.6)
Stroke9 (2.5)
Prolonged (>48 hours) invasive ventilation482 (22.7)
Pneumonia30 (8.3)
Atrial fibrillation, new onset38/358b (10.6)
MI19 2 (0.6)
Immediate reoperation for acute prosthetic failure9 (2.5)
Low cardiac outputc 32 (8.9)
Intraoperative and postoperative use of IABP9 (2.5)
Use of ECMO6 (1.7)
Acute kidney injury20 67 (18.6)
Renal replacement therapy23 (6.4)
Bleeding peptic disease4 (1.1)
Mesenteric ischemia7 (1.9)
Acute pancreatitis2 (0.6)
Multiorgan failure (3 or more organs)11 (3.0)
Sepsis22 (6.1)
Mediastinal re‐explorationd 38 (10.5)
Deep sternal wound infection21 10 (2.8)
Length of the postoperative hospital stay, days23.9 [12.7–42.4]e

ECMO indicates extracorporeal membrane oxygenator; IABP, intra‐aortic balloon pumping; KDIGO, Kidney Disease: Improving Global Outcomes; MI, myocardial infarction.

Unless otherwise stated, values are number (percentage).

Patients with preoperative stable sinus rhythm or paroxysmal atrial fibrillation.

Defined as 3 consecutive cardiac index measurements <2.0 L/min per m2 despite adequate preload, afterload and inotropic support, or IABP.

Through resternotomy or subxifoid window.

Median [interquartile range].

Table 5

Risk Factor Analysis for In‐Hospital Death After Surgery for IE (n=361)

VariableUnivariable Analysisa Original Multivariable Analysisb Alternate Multivariable Analysisc
P ValueOR95% CI P ValueOR95% CI P Value
Age >70 years0.0161.140.52 to 2.530.741.180.55 to 2.550.67
BMI >27 kg/m2 d 0.0392.151.06 to 4.370.0341.910.96 to 3.810.065
eGFR <50 mL/mine , f <0.00013.621.78 to 7.78<0.00013.191.59 to 6.41<0.0001
Dialysis0.0661.040.27 to 3.960.961.470.41 to 5.270.56
NYHA class IV0.00012.431.14 to 5.180.0222.071.00 to 4.270.05
CCS class 40.0151.130.38 to 3.30.831.190.41 to 3.450.74
Left ventricular ejection fraction, 30% to 50%f 0.0361.370.65 to 2.90.411.290.61 to 2.720.51
sPAP >55 mm Hgf 0.0443.291.13 to 9.530.028·········
Coronary artery disease0.0521.330.1 to 17.90.831.460.11 to 18.60.77
Previous cardiac surgery0.0221.290.48 to 3.480.611.300.50 to 3.380.59
Critical statef <0.00012.521.11 to 5.730.0272.491.11 to 5.780.026
Length of the preoperative hospital stay <10 daysd 0.0611.120.52 to 2.440.771.060.51 to 3.390.87
Urgent surgical priorityf 0.0061.620.76 to 3.470.211.800.84 to 3.830.13
Combined CABG0.0521.490.12 to 2.340.771.260.09 to 17.80.87
Surgery on thoracic aorta0.0752.440.69 to 8.670.172.550.78 to 8.310.12
Prosthetic valve endocarditis0.0431.490.61 to 6.340.381.450.61 to 3.450.4

CABG indicates coronary artery bypass grafting; CCS, Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; OR, odds ratio; ROC, receiver operating characteristic curve; sPAP, systolic pulmonary artery pressure.

All the variables that were considered for the univariable analysis are listed in Table S1.

All variables with a P<0.1 by univariable analysis were included in the multivariable model.

All variables with a P<0.1 by univariable analysis except sPAP >55 mm Hg were included in the multivariable model.

The best discriminative value for in‐hospital mortality by ROC analysis.

The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR.

The definitions and cut‐off values are those used for EuroSCORE II.5

Table 6

The AEPEI Score: the Risk Factors for In‐Hospital Death (by Backward Multivariable Logistic Regression) and the Scoring (n=361)

VariableThe Original Modela The Alternate Modelb
Regression CoefficientSEOR95% CI P ValuePointsc Regression CoefficientSEOR95% CI P ValuePointsc
BMI >27 kg/m2 d 0.580.341.791.02 to 3.450.0491··················
eGFR <50 mL/mine , f 1.260.333.521.84 to 6.73<0.00012.21.320.333.751.97 to 7.14<0.00011.8
NYHA class IV0.750.332.111.10 to 4.050.0241.30.750.332.121.12 to 4.020.0211
sPAP >55 mm Hgf 0.580.581.781.06 to 5.610.0321··················
Critical statef 0.860.362.371.16 to 4.820.0171.50.850.362.351.17 to 4.740.0171.1
Constant−3.065−1.411

eGFR indicates estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; ROC, receiver‐operating characteristic curve; sPAP, systolic pulmonary artery pressure.

All variables with a P<0.05 by the original multivariable analysis (Table 5) were included.

All variables with a P<0.05 by the alternate multivariable analysis (Table 5) were included.

Dividing each regression coefficient by the lowest coefficient and approximating to the first decimal place.

The best discriminatory value for in‐hospital mortality by ROC analysis.

The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR.

The definitions and cut‐off values are those used for EuroSCORE II.5

In‐Hospital Mortality and Perioperative Complicationsa ECMO indicates extracorporeal membrane oxygenator; IABP, intra‐aortic balloon pumping; KDIGO, Kidney Disease: Improving Global Outcomes; MI, myocardial infarction. Unless otherwise stated, values are number (percentage). Patients with preoperative stable sinus rhythm or paroxysmal atrial fibrillation. Defined as 3 consecutive cardiac index measurements <2.0 L/min per m2 despite adequate preload, afterload and inotropic support, or IABP. Through resternotomy or subxifoid window. Median [interquartile range]. Risk Factor Analysis for In‐Hospital Death After Surgery for IE (n=361) CABG indicates coronary artery bypass grafting; CCS, Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; OR, odds ratio; ROC, receiver operating characteristic curve; sPAP, systolic pulmonary artery pressure. All the variables that were considered for the univariable analysis are listed in Table S1. All variables with a P<0.1 by univariable analysis were included in the multivariable model. All variables with a P<0.1 by univariable analysis except sPAP >55 mm Hg were included in the multivariable model. The best discriminative value for in‐hospital mortality by ROC analysis. The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR. The definitions and cut‐off values are those used for EuroSCORE II.5 The AEPEI Score: the Risk Factors for In‐Hospital Death (by Backward Multivariable Logistic Regression) and the Scoring (n=361) eGFR indicates estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; ROC, receiver‐operating characteristic curve; sPAP, systolic pulmonary artery pressure. All variables with a P<0.05 by the original multivariable analysis (Table 5) were included. All variables with a P<0.05 by the alternate multivariable analysis (Table 5) were included. Dividing each regression coefficient by the lowest coefficient and approximating to the first decimal place. The best discriminatory value for in‐hospital mortality by ROC analysis. The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR. The definitions and cut‐off values are those used for EuroSCORE II.5

The AEPEI Score: Performance and Validation

By multivariable analysis (Table 5), a new scoring system, the AEPEI score, was created to predict in‐hospital mortality postsurgery for IE (Table 6). The new score includes 5 variables and consists of 7 risk classes (Table 7); its performance is summarized in Tables 8 and 9. In the study population, the AEPEI score had equivalent discriminatory power to that of the EuroSCORE II (P=0.4). It was found to be better than the logistic EuroSCORE (P=0.0026) and OPR score (P=0.065) and better than each of the 3 specific predictive systems (De Feo score, P=0.054, PALSUSE score, P=0.047, and STS risk score for IE; P=0.027), albeit without reaching statistical significance for the De Feo score (Figure 1). There was no difference in performance of the AEPEI score between the Italian and French series (P=0.37; Table 10). The logistic equation of the AEPEI final model was:where β0 is the constant of the logistic regression equation (ie, −3.0645) and βi the coefficient of the variable Xi. The coefficients and variable values are: for BMI, βi=0.58 and Xi=1 if BMI >27 kg/m2, or 0 if BMI ≤27 kg/m2; for eGFR, βi=1.26 and Xi=1if eGFR <50 mL/min, or 0 if eGFR ≥50 mL/min; for NYHA class IV, βi=0.75 and Xi=1 in case of NYHA class IV, or 0 if not; for sPAP, βi=0.58 and Xi=1 if sPAP ≥55 mm Hg, or 0 if sPAP <55 mm Hg; for critical state, βi=0.86 and Xi=1 if the patient is in critical state, or 0 if not (Table 6).
Table 7

Specific Predictive Scoring Systems for In‐Hospital Mortality After Surgery for IE

Scoring SystemStudy PopulationVariables (Points)Discrimination PowerExpected Hospital Mortality
AEPEI score, the original modela (2016) 361 pts. (mean age, 59.1±15.4 years); AEPEI registry (223 pts., 7 French hospitals, 2008) & Cardiovascular Department of Trieste, Italy (138 pts., 2000–2015); Hospital mortality, 15.5%; 30‐Day mortality, 11.6% 5 variables: BMI >27 kg/m2 (1) eGFR <50 mL/min (2.2) NYHA class IV (1.3) sPAP >55 mm Hg (1) Critical state (1.5) AUC, 0.780 (95% CI, 0.734–0.822) Score, 0 to 1 point: expected mortality, 4.5% to 7.7%; Score, 1.3 to 2 points: expected mortality, 9% to 12.9%; Score, 2.2 to 2.8 points: expected mortality, 14.1% to 18.9%; Score, 3.2 to 3.8 points: expected mortality, 22.6% to 29.4%; Score, 4.5 to 5 points: expected mortality, 38.2% to 45.1%; Score, 5.5 to 6 points: expected mortality, 52.5% to 59.4%; Score, 7 points: expected mortality, 72.4%
AEPEI score, the alternate modela (2016)Idem 3 variables: eGFR <50 mL/min (1.8) NYHA class IV (1) Critical state (1.1) AUC, 0.774 (95% CI, 0.727–0.816) Score, 0 to 1 point: expected mortality, 19.6% to 34.1%; Score, 1.1 to 1.8 points: expected mortality, 36.6% to 47.7%; Score, 2.1 to 2.9 points: expected mortality, 55% to 68.3%; Score, 3.9 points: expected mortality, 82%
PALSUSE score14 (2014) 437 pts. (mean age, 61.4±15.5 years); GAMES registry (26 Spanish hospitals, 2008–2010); Hospital mortality, 24.3% 7 variables: Prosthetic valve (2) Age ≥70 years (1) Large intracardiac destruction (2) Staphylococcus spp (2) Urgent surgery (2) Sex, female (2) EuroSCORE II ≥10% (1) AUC, 0.84 (95% CI, 0.79–0.88)Hospital mortality ranged from 0, in patients with score=0, to 45.4% in patients with score >3
De Feo score (for native valve IE)15 (2012) 440 pts. (mean age, 49±16 years); Department of Cardiothoracic Surgery of Naples, Italy (1980–2009); Hospital mortality, 9.1% 6 variables: Age, 5 classes (5–13) Renal failure (5) NYHA class IV (9) Preop. ventilator support (11) Positivity of latest preop. blood cultures (5) Perivalvular involvement (5) AUC, 0.88 (95% CI, 0.82–0.93) Score, 0 to 5 points: expected mortality ≤4.55%; Score, 7 to 13 points: expected mortality, 4.55% to 9.1%; Score, 14 to 19 points: expected mortality, 9.2% to 27.3%; Score ≥20 points: expected mortality >27.3%
STS risk score for IE16 (2011) 19 543 pts. (mean age, 55 years); STS database (2002–2008) 30‐day mortality, 8.2% 12 variables: Emergency, salvage status, or cardiogenic shock (17) Preop. hemodialysis, renal failure, or creatinine level >2.0 mg/dL (12) Preop. inotropic or balloon pump support (10) Active (vs treated) endocarditis (10) Multiple valve involvement (9) Insulin‐dependent diabetes mellitus (8) Arrhythmia (8) Previous cardiac surgery (7) Urgent status without cardiogenic shock (6) Non‐insulin‐dependent diabetes mellitus (6) Hypertension (5) Chronic lung disease (5) AUC, 0.758···

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic (ROC) curve; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; GAMES, Grupo de Apoyo al Manejo de la Endocarditis infecciosa en ESpaña; IE, infective endocarditis; NYHA, New York Heart Association; PALSUSE, Prosthetic valve, Age ≥70, Large intracardiac destruction, Staphylococcus spp, Urgent surgery, Sex [female], EuroSCORE II ≥10%; Preop., preoperative; pts., patients; sPAP, systolic pulmonary artery pressure; STS, the Society of Thoracic Surgery.

Table 6.

Table 8

Performance of the AEPEI Score (2 Models) and of 6 Other Specific/Nonspecific Predictive Scoring Systems for In‐Hospital Mortality After Surgery for IE in the Original Series of Patients

SystemOriginal Series (n=361)
Goodness of Fita Discriminatory Powerb AIC Value23
Chi‐squareDF P ValueAUC95% CI
Specific
AEPEI score, the original model2.650.760.7800.734 to 0.822257.5
AEPEI score, the alternate model3.930.270.7740.727 to 0.816266.9
PALSUSE score14 2.370.970.6840.633 to 0.731289.1
De Feo score (for native valve IE)15 2.860.90.7220.654 to 0.790296.8
STS risk score for IE16 7.980.440.7090.659 to 0.756300
Aspecific
EuroSCORE II5 9.580.30.7510.704 to 0.795132.5
Logistic EuroSCORE6 14.380.0680.6320.580 to 0.682306.9
OPR score7 12.180.150.6980.647 to 0.745288.7

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AIC, Akaike's information criterion; AUC, area under the receiver operating characteristic (ROC) curve; DF, degrees of freedom; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; NYHA, New York Heart Association; OPR, Ontario Province Risk; PALSUSE, prosthetic valve, age ≥70, large intracardiac destruction, Staphylococcus spp, urgent surgery, sex (female), EuroSCORE II ≥10%; STS, the Society of Thoracic Surgeons.

By the Hosmer–Lemeshow test for logistic regression.

By ROC analysis.

Table 9

The AEPEI Score, the Original Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=361)

GroupDeathSurvivalTotal
ObservedExpectedObservedExpected
145.2113111.8117
223.23937.841
354.54545.550
474.52628.533
578.03332.040
61110.22626.837
72020.42322.643

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

Figure 1

The new predictive scoring system for in‐hospital death postsurgery for IE (the AEPEI score) vs (A) three scoring systems specifically created to predict in‐hospital (or 30‐day) mortality postsurgery for IE and (B) 3 predictive scoring systems for in‐hospital (or 30‐day) mortality after cardiac surgery. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic curve; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; OPR, Ontario Province Risk; PALSUSE, Prosthetic valve, Age ≥70, Large intracardiac destruction, Staphylococcus spp, Urgent surgery, Sex [female], EuroSCORE ≥10; STS, the Society of Thoracic Surgeons.

Table 10

Performance of the Considered Predictive Scores in the Trieste Database and in the AEPEI Registry

SystemTrieste Database (n=138)AEPEI Registry (n=223)
Goodness of Fita Discriminatory Powerb Goodness of Fita Discriminatory Powerb
Chi‐squareDF P ValueAUC95% CIChi‐squareDF P ValueAUC95% CI
Specific
AEPEI score, the original model12.660.550.7440.662 to 0.8144.550.490.8040.746 to 0.854
AEPEI score, the alternate model5.0340.280.7320.650 to 0.8041.530.680.8020.744 to 0.852
PALSUSE score14 3.470.850.7230.640 to 0.7956.370.50.6910.626 to 0.751
De Feo score (for native valve IE)15 1.660.950.7300.648 to 0.8025.260.630.7200.656 to 0.778
STS risk score for IE16 3.380.920.7060.623 to 0.7803.180.930.7400.677 to 0.796
Aspecific
EuroSCORE II5 4.280.840.7630.683 to 0.8315.180.650.7720.711 to 0.825
Logistic EuroSCORE6 15.580.050.6580.572 to 0.73613.880.0880.5000.433 to 0.568
OPR score7 13.880.0870.6370.551 to 0.7173.980.870.6940.656 to 0.753

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic (ROC) curve; DF, degrees of freedom; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; NYHA, New York Heart Association; OPR, Ontario Province Risk; PALSUSE, prosthetic valve, age ≥70, large intracardiac destruction, Staphylococcus spp, urgent surgery, sex (female), EuroSCORE II ≥10%; STS, The Society of Thoracic Surgeons.

By the Hosmer–Lemeshow test for logistic regression.

By ROC analysis.

Specific Predictive Scoring Systems for In‐Hospital Mortality After Surgery for IE AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic (ROC) curve; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; GAMES, Grupo de Apoyo al Manejo de la Endocarditis infecciosa en ESpaña; IE, infective endocarditis; NYHA, New York Heart Association; PALSUSE, Prosthetic valve, Age ≥70, Large intracardiac destruction, Staphylococcus spp, Urgent surgery, Sex [female], EuroSCORE II ≥10%; Preop., preoperative; pts., patients; sPAP, systolic pulmonary artery pressure; STS, the Society of Thoracic Surgery. Table 6. Performance of the AEPEI Score (2 Models) and of 6 Other Specific/Nonspecific Predictive Scoring Systems for In‐Hospital Mortality After Surgery for IE in the Original Series of Patients AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AIC, Akaike's information criterion; AUC, area under the receiver operating characteristic (ROC) curve; DF, degrees of freedom; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; NYHA, New York Heart Association; OPR, Ontario Province Risk; PALSUSE, prosthetic valve, age ≥70, large intracardiac destruction, Staphylococcus spp, urgent surgery, sex (female), EuroSCORE II ≥10%; STS, the Society of Thoracic Surgeons. By the Hosmer–Lemeshow test for logistic regression. By ROC analysis. The AEPEI Score, the Original Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=361) AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse. The new predictive scoring system for in‐hospital death postsurgery for IE (the AEPEI score) vs (A) three scoring systems specifically created to predict in‐hospital (or 30‐day) mortality postsurgery for IE and (B) 3 predictive scoring systems for in‐hospital (or 30‐day) mortality after cardiac surgery. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic curve; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; OPR, Ontario Province Risk; PALSUSE, Prosthetic valve, Age ≥70, Large intracardiac destruction, Staphylococcus spp, Urgent surgery, Sex [female], EuroSCORE ≥10; STS, the Society of Thoracic Surgeons. Performance of the Considered Predictive Scores in the Trieste Database and in the AEPEI Registry AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic (ROC) curve; DF, degrees of freedom; EuroSCORE, European System for Cardiac Operative Risk Evaluation; IE, infective endocarditis; NYHA, New York Heart Association; OPR, Ontario Province Risk; PALSUSE, prosthetic valve, age ≥70, large intracardiac destruction, Staphylococcus spp, urgent surgery, sex (female), EuroSCORE II ≥10%; STS, The Society of Thoracic Surgeons. By the Hosmer–Lemeshow test for logistic regression. By ROC analysis. All the AEPEI score variables remained significant by bootstrap internal validation (Table 11). By external validation, there were no significant differences between expected and observed deaths (χ2=2.7; 5 df; P=0.75; Table 12) and the discriminatory power of the score was confirmed to be good (AUC, 0.715; 95% CI, 0.638–0.783; Figure 2).
Table 11

Bootstrap Analysis of the Logistic Regression Model From Which the Original Model of the AEPEI Score was Generateda

VariableABootstrap (No. of Samples: 1000)
BiasSE95% CI P Value
Age >70 years0.40−0.010.40−0.41 to 1.150.27
BMI >27 kg/m2 b 0.720.020.38−0.02 to 1.430.03
eGFR <50 mL/minc, d 1.110.090.390.43 to 1.99<0.01
Dialysis0.19−0.132.03−2.09 to 2.060.83
NYHA class IV0.810.080.430.03 to 1.760.028
CCS class 40.27−0.020.67−1.22 to 1.540.63
Left ventricular ejection fraction, 30% to 50%d 0.260.010.41−0.51 to 1.060.48
sPAP >55 mm Hgd −1.24−0.211.10−2.77 to −0.360.013
Coronary artery disease0.33−5.579.88−20.8 to 3.250.502
Previous cardiac surgery0.410.010.52−0.60 to 1.410.41
Critical stated 0.970.060.51−0.001 to 2.080.042
Length of the preop. hospital stay <10 daysb 0.16−0.040.48−0.78 to 1.100.73
Urgent surgical priorityd 0.650.040.40−0.12 to 1.500.078
Combined CABG0.285.599.89−2.84 to 21.50.55
Surgery on thoracic aorta1.110.050.76−0.45 to 2.550.086
Prosthetic valve endocarditis0.370.010.50−0.60 to 1.290.44

CABG indicates coronary artery bypass grafting; CCS indicates Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; preop., preoperative; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure.

All variables with a P<0.1 by univariable analysis were included in the model.

The best discriminatory value for in‐hospital mortality by ROC analysis.

The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR.

The definitions and cut‐off values are those used for the EuroSCORE II.5

Table 12

The AEPEI Score, the Original Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=161)

GroupDeathSurvivalTotal
ObservedExpectedObservedExpected
110.82121.222
200.232.83
355.07676.081
431.71011.313
512.71412.315
644.11211.916
776.644.411

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

Figure 2

External validation of the AEPEI score in a validation sample of 161 patients: discriminatory power. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver‐operating characteristic curve.

Bootstrap Analysis of the Logistic Regression Model From Which the Original Model of the AEPEI Score was Generateda CABG indicates coronary artery bypass grafting; CCS indicates Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; preop., preoperative; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure. All variables with a P<0.1 by univariable analysis were included in the model. The best discriminatory value for in‐hospital mortality by ROC analysis. The creatinine clearance rate, calculated according to the Cockcroft–Gault formula, was used to estimate GFR. The definitions and cut‐off values are those used for the EuroSCORE II.5 The AEPEI Score, the Original Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=161) AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse. External validation of the AEPEI score in a validation sample of 161 patients: discriminatory power. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver‐operating characteristic curve.

The Alternative 3‐Variable AEPEI Score Model

According to the alternate multivariable model (Table 5), an alternate model of the AEPEI score was created (Table 6). This model includes 3 variables and consists of 4 risk classes (Table 7). Its discriminatory power was equivalent to that of the original 5‐variable model (P=0.49); calibration was slightly lower (Tables 8 and 13; Figure 3). There was no significant difference in the performance of the alternate model of the AEPEI score between the Italian and the French series (P=0.29; Table 10). The logistic equation of the alternate AEPEI model was:where β0 is the constant of the logistic regression equation (ie, −1.411) and βi the coefficient of the variable Xi. The coefficients and variable values are: for eGFR, βi=1.32 and Xi=1if eGFR <50 mL/min, or 0 if eGFR ≥50 mL/min; for NYHA class IV, βi=0.75 and Xi=1 in case of NYHA class IV, or 0 if not; for critical state, βi=0.86 and Xi=1 if the patient is in critical state, or 0 if not (Table 6).
Table 13

The AEPEI Score, the Alternate Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=361)

GroupDeathSurvivalTotal
ObservedExpectedObservedExpected
168.5153150.5159
266.55554.561
3118.94143.152
41713.13033.947
51619.02623.042

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

Figure 3

AEPEI score discriminatory power: the original 5‐variable model vs the alternate 3‐variable model. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic curve.

The AEPEI Score, the Alternate Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=361) AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse. AEPEI score discriminatory power: the original 5‐variable model vs the alternate 3‐variable model. AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse; AUC, area under the receiver operating characteristic curve. The 3 variables of the alternate model of the AEPEI score remained significant by bootstrap internal validation (Table 14). By external validation, there were no significant differences between expected and observed deaths (χ2=2.1; 1 df; P=0.15; Table 15) and the discriminatory power of the score was satisfactory (AUC, 0.690; 95% CI, 0.613–0.761).
Table 14

Bootstrap Analysis of the Logistic Regression Model From Which the Alternate Model of the AEPEI Score was Generateda

VariableABootstrap (No. of Samples: 1000)
BiasSE95% CI P Value
Age >70 years0.16<0.0010.47−0.81 to 1.050.7
BMI >27 kg/m2 b 0.650.040.41−0.13 to 1.550.08
eGFR <50 mL/minc , d 1.160.140.410.49 to 2.13<0.01
Dialysis0.38−0.081.66−1.68 to 2.180.66
NYHA class IV0.730.060.41−0.004 to 1.660.05
CCS class 40.18−0.010.74−1.40 to 1.530.8
Left ventricular ejection fraction, 30% to 50%d 0.25−0.010.47−0.75 to 1.140.54
Coronary artery disease0.38−6.5010.1−20.2 to 3.130.44
Previous cardiac surgery0.260.010.57−0.82 to 1.440.6
Critical stated 0.910.080.53−0.07 to 2.070.05
Length of the preop. hospital stay <10 daysb 0.060.050.44−0.76 to 0.990.89
Urgent surgical priorityd 0.59−0.010.44−0.25 to 1.420.14
Combined CABG0.236.5110.1−2.68 to 21.10.53
Surgery on thoracic aorta0.940.010.76−0.70 to 2.410.13
Prosthetic valve endocarditis0.37<0.0010.49−0.66 to 1.280.4

CABG indicates coronary artery bypass grafting; CCS indicates Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; preop., preoperative; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure.

All variables with a P<0.1 by univariable analysis except sPAP >55 mm Hg were included in the model.

The best discriminatory value for in‐hospital mortality by ROC analysis.

The creatinine clearance rate, calculated according to the Cockcroft‐Gault formula, was used to estimate GFR.

The definitions and cut‐off values are those used for the EuroSCORE II.5

Table 15

The AEPEI Score, the Alternate Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=161)

GroupDeathSurvivalTotal
ObservedExpectedObservedExpected
1109.0110111.0120
213.12118.922
3108.9910.119

AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

Bootstrap Analysis of the Logistic Regression Model From Which the Alternate Model of the AEPEI Score was Generateda CABG indicates coronary artery bypass grafting; CCS indicates Canadian Cardiovascular Society; eGFR, estimated glomerular filtration rate; EuroSCORE, European System for Cardiac Operative Risk Evaluation; NYHA, New York Heart Association; preop., preoperative; ROC, receiver operating characteristic; sPAP, systolic pulmonary artery pressure. All variables with a P<0.1 by univariable analysis except sPAP >55 mm Hg were included in the model. The best discriminatory value for in‐hospital mortality by ROC analysis. The creatinine clearance rate, calculated according to the Cockcroft‐Gault formula, was used to estimate GFR. The definitions and cut‐off values are those used for the EuroSCORE II.5 The AEPEI Score, the Alternate Model: Contingency Table for the Hosmer–Lemeshow Test for Logistic Regression (n=161) AEPEI indicates Association pour l'Etude et la Prévention de l'Endocadite Infectieuse.

The AEPEI Incremented EuroSCORE II

The variable BMI >27 kg/m2 was added to the EuroSCORE II. The integrated discrimination improvement was 0.027 (P<0.01). The continuous net reclassification improvement was 0.13 (P=0.37).

The AIC Analysis

With 56 events and 16 variables in the initial logistic regression (with multiple categories that further increase the dimension), the initial model was severely overfit (Table 5). However, according to the AIC,22 each predictive system that was considered in this study except EuroSCORE II was <0.0001 times as probable as the AEPEI score to minimize the information loss. The alternate AEPEI model was 0.0091 times as probable as the original AEPEI model to minimize the information loss (Table 8).

Discussion

Based on analysis of perioperative data from 361 patients from 8 European centers of cardiac surgery, we devised a weighted scoring system to predict in‐hospital mortality postsurgery for IE, namely the AEPEI score. The score is composed of only 5 variables and consists of 7 classes of risk. It was derived from a backward step‐wise logistic regression model that was created to find the independent predictors of in‐hospital death in this series of patients with IE. Although the variables of the model were chosen from a pool of baseline characteristics of the patients, surgical data, and endocarditis‐related features, all the variables of the AEPEI score (BMI >27 kg/m2, eGFR <50 mL/min, NYHA class IV, sPAP >55 mm Hg, and critical state) refer to the patient's preoperative state and include an anthropometric measurement, a laboratory finding, an estimate of resting dyspnea, an invasive (or ultrasound) intracardiac pressure measurement, and a well‐defined composite variable of events indicating the critical preoperative state of the patient. The goodness of fit of the statistical model was satisfactory and the score showed a good discriminatory power. Both internal and external validation of the AEPEI score were performed. The results of the validation procedures confirmed satisfactory calibration and discriminatory power of the score. In the study population, the AEPEI score performed better than 3 specific scoring systems for in‐hospital (or 30‐day) mortality postsurgery for IE that were considered18, 19, 20 and was superior to 214, 16 of the 3 scoring systems for in‐hospital (or 30‐day) mortality after any cardiac operation that were used for comparison. These results were confirmed also according to a more‐robust approach such as the AIC.22 In addition, the AEPEI score is not intended only for native valve endocarditis, as is the De Feo score,15 and the AEPEI score includes a composite variable, that is, critical state, similar to what applies in the PALSUSE and STS risk scores for IE.18, 20 The AEPEI score was found to be equivalent to EuroSCORE II, which consists of 18 (simple and composite) variables and was modeled from a contemporary surgical cohort of 22 381 patients, including 497 (2.2%) with active IE.5 The EuroSCORE II performance in estimating perioperative risk of patients undergoing surgery for IE has been evaluated by other investigators. Some researchers think that it underestimates post–cardiac surgery mortality in these patients7; others have demonstrated poor calibration and comparatively poor discrimination of the system for emergency cardiac surgery.8 Yet, others believe that the EuroSCORE II may be a useful and appropriate tool for estimating perioperative risk, even for IE patients, and that specific endocarditis features will increase model complexity without an unequivocal improvement in predictive ability.6, 9 Consequently, there is a lack of consensus on this issue. To improve the EuroSCORE II performance in IE, we added the only variable present in the AEPEI score that is not in the EuroSCORE II (namely, BMI >27 kg/m2). Results showed that there was no added value to be derived from adding this variable to EuroSCORE II. Logistic EuroSCORE showed a poor performance in the present study, even though other researchers have reported different results.21 sPAP was the sole hemodynamic parameter that was considered for analysis, which can be evaluated by echocardiography when even a trivial tricuspid regurgitation is present. In the absence of any grade of tricuspid regurgitation, the PAP measurement requires right heart catheterization. The fact that this method is invasive and could be a port of entry for infection make some practitioners reluctant to perform it presurgery. We therefore created an alternate model of the AEPEI score by removing sPAP >55 mm Hg from the original set of variables on which the original score was based. This procedure generated a 3‐variable predictive scoring system (eGFR <50 mL/min, NYHA class IV, and critical state) that had equivalent discriminatory power, but lower goodness of fit, compared to the original AEPEI score. Unlike other predictive systems,14 no infectious agent was related to an increased in‐hospital mortality postsurgery. However, in the present experience, there was an under‐representation of potentially catastrophic organisms, such as fungi and multidrug resistant Gram‐negative bacteria. Although 3 surgical features (urgent priority, combined coronary surgery, and surgery on thoracic aorta) and 1 endocarditis‐related feature (prosthetic valve endocarditis) were found to be related (P<0.1) to in‐hospital death by univariable analysis, they were not confirmed as risk factors by multivariable analyses. Contrary to other previous risk prediction models,4, 5, 6, 7, 14, 16 the variable “prosthetic valve endocarditis” was not found to be an independent risk factor for postoperative in‐hospital death in either of the AEPEI scores. Our data do not provide any firm evidence to explain this discrepancy. No intraoperative features were associated with increased postoperative death, even when a composite variable, such as large intracardiac destruction, was considered. In our opinion, this is a strong point of the AEPEI score. Every practitioner is indeed well aware that results of combined cardiac operations in critically ill patients and the treatment of complex intracardiac lesions can be dependent on the surgeon's experience and expertise, which are both difficult to measure. Despite the existence of some differences between the Italian and French patients of the study, such as the preoperative characteristics of patients, surgical data, and endocarditis‐related features, there was no significant difference in the discriminatory power of the AEPEI score between the 2 series of patients. Besides, the Italian series included patients operated on between 2000 and 2015. This could imply that the score works well even in populations of patients with different rates of comorbidities from other institutions, and operated on in different historical periods. Obviously, these hypotheses remain to be verified by new studies that take into consideration the impact on outcomes of the use of different surgical methods, different rates of use of surgical techniques, and different perioperative management of patients. Overall, the performance of the predictive models considered and derived from large populations of patients from North America, that is, STS risk score for IE and OPR score, was lower than the European models. This could stress the concept that outcomes postsurgery for IE are influenced by epidemiological features both of the patient and the involved pathogen.

Study Limitations

The primary limitation of the present study was the small size of the sample. Actually, because the study patients were only 361, it is not surprising that only 5 variables were significant upon multivariable modeling. There may be indeed insufficient power to determine higher dimensional models. However, this is a problem common also to 2 other existing scoring systems that are being used to predict early mortality postsurgery for IE, namely the PALSUSE and the De Feo score,14, 16 and more generally to every predictive system of rare events occurring in patients having rare diseases. Although the present authors are aware that each score performs well in the data set in which it is fit, and the more‐interesting comparison would be of the various scores in the external validation sample, this comparison was impossible because no other score than the AEPEI could be calculated in the validation sample with the available data. Because the pathogen was not identified in about 18% of cases, there is the possibility that some microorganisms were related to increased mortality rate postsurgery, especially because some infections may have been misclassified in terms of etiology because of the frequent rate of coinfections in endocarditis. This study did not evaluate the contribution to mortality risk of potentially important factors, such as antibiotic treatment and preoperative patient preparation. The impact of different strategies of myocardial protection and techniques, such as intraoperative ultrafiltration, on the risk of death was not taken into account.

Conclusions

Nonspecific scoring systems derived from large populations of patients are being used worldwide to predict adverse events after cardiac surgery, even in patients with IE. For this difficult subset of patients, however, risk stratification is of the utmost importance not only to aid the surgeon's decision making, but also to ensure true informed consent for patients and their family, and to allow comparative assessment of quality of care. Specific and simple predictive systems, such as the AEPEI score developed and validated here, could be useful to achieve these objectives. However, further larger validation studies are necessary before introducing the AEPEI score into the clinical practice.

Appendix

The Association pour l'Etude et la Prevention de l'Endocadite Infectieuse (AEPEI) Study Group Members

Main investigators: B. Hoen and X. Duval; F. Alla, A. Bouvet, S. Briancon, E. Cambau, M. Celard, C. Chirouze, N. Danchin, T. Doco‐ Lecompte, F. Delahaye, J. Etienne, B. Iung, V. Le Moing, J. F. Obadia, C. Leport, C. Poyart, M. Revest, C. Selton‐Suty, C. Strady, P. Tattevin, and F. Vandenesch. Coordinating investigators in the study areas: Y. Bernard, S. Chocron, C. Chirouze, B. Hoen, P. Plesiat, I. Abouliatim, C. De Place, P. Tattevin, M. Revest, P. Y. Donnio, F. Alla, J. P. Carteaux, T. Doco‐Lecompte, C. Lion, N. Aissa, C. Selton‐Suty, B. Baehrel, R. Jaussaud, P. Nazeyrollas, C. Strady, V. Vernet, E. Cambau, X. Duval, B. Iung, P. Nataf, C. Chidiac, M. Celard, F. Delahaye, J. F. Obadia, F. Vandenesch, H. Aumaître, J. M. Frappier, V. Le Moing, E. Oziol, A. Sotto, and C. Sportouch. Centre National de Référence des Streptocoques: C. Poyart and A. Bouvet. Centre National de Référence des Staphylocoques: F. Vandenesch, M. Celard, and M. Bes. Investigators: P. Abassade, E. Abrial, C. Acar, N. Aissa, J. F. Alexandra, N. Amireche, D. Amrein, P. Andre, M. Appriou, M. A. Arnould, P. Assayag, A. Atoui, F. Aziza, N. Baille, N. Bajolle, P. Battistella, S. Baumard, A. Ben Ali, J. Bertrand, S. Bialek, M. Bois Grosse, M. Boixados, F. Borlot, A. Bouchachi, O. Bouche, S. Bouchemal, J. L. Bourdon, A. Bouvet, L. Brasme, F. Bricaire, E. Brochet, J. F. Bruntz, A. Cady, J. Cailhol, M. P. Caplan, B. Carette, J. P. Carteaux, O. Cartry, C. Cazorla, M. Celard, H. Chamagne, H. Champagne, G. Chanques, J. Chastre, B. Chevalier, C. Chirouze, S. Chocron, F. Chometon, C. Christophe, A. Cohen, N. Colin de Verdiere, N. Danchin, V. Daneluzzi, L. David, P. De Lentdecker, F. Delahaye, V. Delcey, P. Deleuze, E. Donal, X. Duval, B. Deroure, V. Descotes‐Genon, K. Didier Petit, A. Dinh, V. Doat, F. Duchene, F. Duhoux, M. Dupont, S. Ederhy, O. Epaulard, M. Evest, J. F. Faucher, B. Fantin, E. Fauveau, T. Ferry, M. Fillod, T. Floch, T. Fraisse, J. M. Frapier, L. Freysz, B. Fumery, B. Gachot, S. Gallien, I. Gandjbach, P. Garcon, A. Gaubert, J. L. Genoud, S. Ghiglione, C. Godreuil, A. Grentzinger, L. Groben, D. Gherissi, P. Guéret, A. Hagege, N. Hammoudi, F. Heliot, P. Henry, S. Herson, B. Hoen, P. Houriez, L. Hustache‐Mathieu, O. Huttin, S. Imbert, B. Iung, S. Jaureguiberry, M. Kaaki, A. Konate, J. M. Kuhn, S. Kural Menasche, A. Lafitte, B. Lafon, F. Lanternier, V. Le Chenault, V. Le Moing, C. Lechiche, S. Lefèvre‐Thibaut, A. Lefort, A. Leguerrier, J. Lemoine, L. Lepage, C. Leport, C. Lepouse ´, J. Leroy, P. Lesprit, L. Letranchant, D. Loisance, G. Loncar, C. Lorentz, P. Mabo, I. Magnin‐Poull, T. May, A. Makinson, H. Man, M. Mansouri, O. Marxcon, J. P. Maroni, V. Masse, F. Maurier, M. C. Meyohas, P. L. Michel, C. Michelet, F. Mechaï, O. Merceron, D. Messika‐Zeitoun, Z. Metref, V. Meyssonnier, C. Mezher, S. Micheli, M. Monsigny, S. Mouly, B. Mourvillier, O. Nallet, P. Nataf, P. Nazeyrollas, V. Noel, J. F. Obadia, E. Oziol, T. Papo, B. Payet, A. Pelletier, P. Perez, J. S. Petit, F. Philippart, E. Piet, C. Plainvert, B. Popovic, J. M. Porte, P. Pradier, R. Ramadan, M. Revest, J. Richemond, M. Rodermann, M. Roncato, I. Roigt, O. Ruyer, M. Saada, J. Schwartz, C. Selton‐Suty, M. Simon, B. Simorre, S. Skalli, F. Spatz, C. Strady, J. Sudrial, L. Tartiere, A. Terrier De La Chaise, M. C. Thiercelin, D. Thomas, M. Thomas, L. Toko, F. Tournoux, A. Tristan, J. L. Trouillet, L. Tual, A. Vahanian, F. Verdier, V. Vernet Garnier, V. Vidal, P. Weyne, M. Wolff, A. Wynckel, N. Zannad, and P. Y. Zinzius.

Sources of Funding

Dr Duval reports grants from Pfizer Inc (New York, NY) outside the submitted work.

Disclosures

None. Table S1. The Variables Entered in the Analysis Table S2. Baseline Characteristics of Patients (n=361)* Table S3. Surgical Features (n=361)* Table S4. Endocarditis‐Related Features (n=361)* Click here for additional data file.
  21 in total

1.  EuroSCORE II.

Authors:  Samer A M Nashef; François Roques; Linda D Sharples; Johan Nilsson; Christopher Smith; Antony R Goldstone; Ulf Lockowandt
Journal:  Eur J Cardiothorac Surg       Date:  2012-02-29       Impact factor: 4.191

2.  Interpreting incremental value of markers added to risk prediction models.

Authors:  Michael J Pencina; Ralph B D'Agostino; Karol M Pencina; A Cecile J W Janssens; Philip Greenland
Journal:  Am J Epidemiol       Date:  2012-08-08       Impact factor: 4.897

3.  Performance of the EuroSCORE models in emergency cardiac surgery.

Authors:  Stuart W Grant; Graeme L Hickey; Ioannis Dimarakis; Graham Cooper; David P Jenkins; Rakesh Uppal; Iain Buchan; Ben Bridgewater
Journal:  Circ Cardiovasc Qual Outcomes       Date:  2013-03-05

4.  Clinical and prognostic profile of patients with infective endocarditis who need urgent surgery.

Authors:  Ana Revilla; Javier López; Isidre Vilacosta; Eduardo Villacorta; María J Rollán; José R Echevarría; Yolanda Carrascal; Salvatore Di Stefano; Enrique Fulquet; Enrique Rodríguez; Luis Fiz; José A San Román
Journal:  Eur Heart J       Date:  2006-10-10       Impact factor: 29.983

5.  EuroSCORE II underestimates mortality after cardiac surgery for infective endocarditis.

Authors:  Soléne Patrat-Delon; Adrien Rouxel; Arnaud Gacouin; Matthieu Revest; Erwan Flécher; Olivier Fouquet; Yves Le Tulzo; Nicolas Lerolle; Pierre Tattevin; Jean-Marc Tadié
Journal:  Eur J Cardiothorac Surg       Date:  2015-06-26       Impact factor: 4.191

6.  New criteria for diagnosis of infective endocarditis: utilization of specific echocardiographic findings. Duke Endocarditis Service.

Authors:  D T Durack; A S Lukes; D K Bright
Journal:  Am J Med       Date:  1994-03       Impact factor: 4.965

7.  Assessment of perioperative mortality risk in patients with infective endocarditis undergoing cardiac surgery: performance of the EuroSCORE I and II logistic models.

Authors:  Sérgio Madeira; Ricardo Rodrigues; António Tralhão; Miguel Santos; Carla Almeida; Marta Marques; Jorge Ferreira; Luís Raposo; José Neves; Miguel Mendes
Journal:  Interact Cardiovasc Thorac Surg       Date:  2015-11-06

8.  Consideration of a new definition of clinically relevant myocardial infarction after coronary revascularization: an expert consensus document from the Society for Cardiovascular Angiography and Interventions (SCAI).

Authors:  Issam D Moussa; Lloyd W Klein; Binita Shah; Roxana Mehran; Michael J Mack; Emmanouil S Brilakis; John P Reilly; Gilbert Zoghbi; Elizabeth Holper; Gregg W Stone
Journal:  J Am Coll Cardiol       Date:  2013-10-22       Impact factor: 24.094

9.  Preoperative risk stratification in infective endocarditis. Does the EuroSCORE model work? Preliminary results.

Authors:  Carlos A Mestres; Miguel A Castro; Eduardo Bernabeu; Miguel Josa; Ramón Cartaná; José L Pomar; José M Miró; Jaime Mulet
Journal:  Eur J Cardiothorac Surg       Date:  2007-06-04       Impact factor: 4.191

10.  The need for a specific risk prediction system in native valve infective endocarditis surgery.

Authors:  Marisa De Feo; Maurizio Cotrufo; Antonio Carozza; Luca S De Santo; Francesco Amendolara; Salvatore Giordano; Ester E Della Ratta; Gianantonio Nappi; Alessandro Della Corte
Journal:  ScientificWorldJournal       Date:  2012-03-12
View more
  10 in total

1.  Should we include microorganisms in scores to predict outcome in candidates for cardiac surgery during the acute phase of endocarditis?

Authors:  Pierre Tattevin; Pierre Fillâtre; Serge Tchamgoué; Mathieu Lesouhaitier; Nicolas Nesseler; Jean-Marc Tadié
Journal:  J Thorac Dis       Date:  2019-10       Impact factor: 2.895

2.  Bugs at the operating theatre in infective endocarditis: one step forward, still a long way to go.

Authors:  Juan M Pericàs; Eduard Quintana; José M Miró
Journal:  J Thorac Dis       Date:  2019-10       Impact factor: 2.895

3.  Surgical Procedure Time and Mortality in Patients with Infective Endocarditis Caused by Staphylococcus aureus or Streptococcus Species.

Authors:  Gregor Paul; Laurin Ochs; Christopher Hohmann; Stephan Baldus; Guido Michels; Charlotte Meyer-Schwickerath; Gerd Fätkenheuer; Navid Mader; Thorsten Wahlers; Carolyn Weber; Norma Jung
Journal:  J Clin Med       Date:  2022-04-30       Impact factor: 4.964

4.  Machine Learning-Based Risk Model for Predicting Early Mortality After Surgery for Infective Endocarditis.

Authors:  Li Luo; Sui-Qing Huang; Chuang Liu; Quan Liu; Shuohui Dong; Yuan Yue; Kai-Zheng Liu; Lin Huang; Shun-Jun Wang; Hua-Yang Li; Shaoyi Zheng; Zhong-Kai Wu
Journal:  J Am Heart Assoc       Date:  2022-06-03       Impact factor: 6.106

5.  Impact of Valve Culture Positivity on Prognosis in Patients with Infective Endocarditis Who Underwent Valve Surgery.

Authors:  Jinnam Kim; Jung Ho Kim; Hi Jae Lee; Se Ju Lee; Ki Hyun Lee; Eun Hwa Lee; Yae Jee Baek; Jin Young Ahn; Su Jin Jeong; Nam Su Ku; Seung Hyun Lee; Jun Yong Choi; Joon-Sup Yeom
Journal:  Infect Dis Ther       Date:  2022-04-30

6.  A Simplified Risk Scoring System to Predict Mortality in Cardiovascular Intensive Care Unit.

Authors:  Hendry Purnasidha Bagaswoto; Nahar Taufiq; Budi Yuli Setianto
Journal:  Cardiol Res       Date:  2019-07-31

7.  Surgery Is Underused in Elderly Patients With Left-Sided Infective Endocarditis: A Nationwide Registry Study.

Authors:  Sigurdur Ragnarsson; Sonsoles Salto-Alejandre; Axel Ström; Lars Olaison; Magnus Rasmussen
Journal:  J Am Heart Assoc       Date:  2021-09-24       Impact factor: 5.501

8.  Comorbidity and Prognosis in Octogenarians with Infective Endocarditis.

Authors:  Jose-Angel Perez-Rivera; Carlos Armiñanzas; Patricia Muñoz; Martha Kestler; Blanca Pinilla; Maria-Carmen Fariñas; Ignacio Alvarez-Rodriguez; Guillermo Cuervo; Angeles Rodriguez-Esteban; Aristides de Alarcón; Andrea Gutiérrez-Villanueva; Ana Pello-Lazaro; Manuel Martínez Sellés
Journal:  J Clin Med       Date:  2022-06-29       Impact factor: 4.964

9.  Analysis of Risk Scores to Predict Mortality in Patients Undergoing Cardiac Surgery for Endocarditis.

Authors:  Fernando Pivatto Júnior; Clarissa Carmona de Azevedo Bellagamba; Eduardo Gatti Pianca; Fernando Schmidt Fernandes; Maurício Butzke; Stefano Boemler Busato; Miguel Gus
Journal:  Arq Bras Cardiol       Date:  2020 May-Jun       Impact factor: 2.000

10.  Prognostic Scores for Mortality in Cardiac Surgery for Infective Endocarditis.

Authors:  Alexandre Bahia Barreiras Martins; Cristiane da Cruz Lamas
Journal:  Arq Bras Cardiol       Date:  2020 May-Jun       Impact factor: 2.000

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.