A risk score for predicting postoperative complications in non-intubated thoracic surgery.

BACKGROUND: The risk factors for postoperative complications in non-intubated video-assisted thoracoscopic surgery (VATS) have not been observed before. Here to develop a simple risk score to predict the risk of postoperative complications for patients who scheduling non-intubated VATS, which is beneficial to guide the clinical interventions.
METHODS: A total of 1,837 patients who underwent non-intubated VATS were included from January 2011 to December 2018. A development data set and a validation data set were allocated according to an approximate 3:2 ratio of total cases. The stepwise logistic regression was used to establish a risk score model, and the methods of bootstrap and split-sample were used for validation.
RESULTS: Multivariable analysis revealed that the forced expiratory volume in the first second in percent of predicted, the anesthesia method, blood loss, surgical time, and preoperative neutrophil ratio were risk factors for postoperative complications. The risk score was established with these 5 factors, varied from 0 to 53, with the corresponding predicted probability of postoperative complications occurrence ranged from 1% to 92% and was calibrated (Hosmer-Lemeshow χ2 =6.261; P=0.618). Good discrimination was acquired in the development and validation data sets (C-statistic 0.705 and 0.700). A positive correlation was between the risk score and postoperative complications (P for trend <0.01). Three levels of low-risk (0-15 points], moderate-risk (15-30 points], and high-risk (>30 points] were established based on the score distribution of postoperative complications.
CONCLUSIONS: This simple risk score model based on risk factors of postoperative complications can validly identify the high-risk patients with postoperative complications in the non-intubated VATS, and allow for early interventions. 2021 Journal of Thoracic Disease. All rights reserved.

Introduction

At the end of the 1800s, the first attempts of anesthesia in thoracic surgery were made by non-intubated patients with spontaneous breathing air-ether through a mask (1). With the development of pulmonary isolation techniques and mechanical ventilation, the intubated thoracic anesthesia became mainstream. However, in recent years, non-intubated video-assisted thoracoscopic surgery (VATS) had been successfully performed in different types of procedures (2-6).

VATS surgery under non-intubated anesthesia decreased the duration of surgery and postoperative hospital stay (7), and improved recovery with fewer postoperative complications (PC) (2-4,8). At present, the surgical procedures and anesthesia techniques of non-intubated VATS had been described clearly (9-11), but it still lacks specific observations for perioperative complications. The postoperative clinical complications are the most concerning issues to postoperative rehabilitation. However, risk factors of PC in non-intubated VATS had not been reported before. Moreover, this question cannot be easy to answer. The reason is not only the majority of publications on non-intubated VATS came from scattered and different medical centers, with inevitably different selection criteria for patients, but also most of them were small sample observations. Hence, since non-intubated VATS has gradually gained popularity in the past two decades, and no clinical risk model of predicting PC has been established at present. It is necessary to explicit the risk factors of PC and accurately allows for timely interventions for the high-risk patients.

Hereupon, through this observation, the primary outcome was to find out the risk factors for PC and develop a convenient and accurate risk score to identify the high-risk patients with PC in non-intubated VATS.

We present the following article in accordance with the TRIPOD reporting checklist (available at https://dx.doi.org/10.21037/jtd-21-636).

Methods

Study design

We conducted a post hoc reanalysis of a large single-center retrospective cohort. The data collectors were blind to the primary outcome. The analysis included patients who successfully underwent VATS with non-intubated anesthesia from January 1st, 2011, to December 30th, 2018 at the Guangzhou Institute of Respiratory Diseases. The inclusion for non-intubated VATS is the same as described before (12-14), which patients were age ≥18 years, with body mass index (BMI) ≤25, the American Society of Anesthesiologists (ASA) physical status III or less, with no abnormal airway and spinal anatomy, no compromised coagulation, no serious cardiopulmonary dysfunction, and no extensive pleural adhesion. Patients were excluded from this observation if they proceeded to overlapping operations besides lungs, thoracotomy, tracheal surgery, esophagus surgery, and emergency surgery. Patients who had invalid or unavailable preoperative basic examination results and incomplete intraoperative and postoperative medical records were also excluded.

Main operating procedures

All patients received VATS under non-intubated anesthesia (12,15). Two anesthesia methods were initiated in our institution, one was plasma concentration target-controlled infusion (TCI) of propofol and remifentanil, combined with intravenous dexmedetomidine and placed with laryngeal mask airway (LMA), the other method was epidural anesthesia (EA), which maintained anesthesia with ropivacaine with placing the epidural catheter in the fifth or seventh epidural space. It was up to the patients, the experience of surgeons and anesthesiologists to decided which anesthesia method to choose.

The thoracoscopic procedures were consistent with the guidelines of the American Association for Thoracic Surgery (16). Whether to place a chest-drainage tube or not depends on the patient’s condition and surgical procedures. All thoracic procedures were divided into five types, such as nonanatomic wedge resection, including wedge resection, bullectomy, and lung volume reduction surgery; the anatomic resection, including lobectomy and segmentectomy; the mediastinal mass resection; bilateral sympathectomy; and other procedures, including thoracoscopic exploration, lung biopsy, pericardial cyst resection, etc. Surgical time was defined as the interval from skin cutting to wound suturing and a surgical dressing covering. After the operation, the patients were removed LMA or epidural catheter and sent back to the ward, or transfer to the intensive care unit (ICU). If the patient did not place a drainage tube or enter the ICU, the duration of chest drainage and ICU stay were recorded as zero.

Primary endpoint and candidate predictors

The primary endpoint was PC. The minor PC included: pleural effusion, dyspnea, arrhythmia, air leakage, fever, while the major PC included: reoperation, chylothorax, mechanical ventilation, cardio-dysfunction, pulmonary embolism, and death. According to the definition of Clavien-Dindo classification (17), pleural effusion, air leakage and fever are belonged to Grade I, dyspnea and arrhythmia are belonged to Grade II, reoperation and chylothorax are belonged to Grade III, mechanical ventilation and pulmonary embolism are belonged to Grade IV, cardio-dysfunction is belonged to Grade IVa, the death of patient is belonged to Grade V.

The candidate predictors included preoperative characteristics and intraoperative variables, such as age, gender, BMI, the level of ASA physical status, the previous medical history, Revised Cardiac Risk Index (RCRI), stair climbing, values of the forced vital capacity in percent of predicted (FVC% predicted), and the forced expiratory volume in the first second in percent of predicted (FEV1% predicted), left ventricular ejection fraction (LVEF), types of thoracic procedures, surgical location, preoperative values of leukocyte and neutrophil ratio, anesthesia methods, surgery time, blood loss, intraoperative values of minimum pulse oxygen saturation (SpO2) and arterial partial pressure of carbon dioxide (PaCO2).

Statistical analysis

Statistical analyses of patient distribution were performed with SAS software version 9.2. All analyses were based on the input of complete cases.

All eligible patients were allocated on the ratio of 3:2, and a development data set and a validation data set were established respectively. A risk model and a risk score model were established according to the development data set. In univariate analysis, P<0.05 candidate predictors were included in the development of the risk model. The best subset of risk factors was selected by the bootstrap method to avoid over-fitting. The scoring method of the risk score model was similar to Sullivan’s (18) and was based on the development of the risk model. Continuous variables were classified as clinical significant categories for scoring purposes. Pearson’s contingency coefficient evaluated the degree of correlation between the score levels and the PC risk, and the Cochran-Armitage test was used to examine the trend.

The predictive accuracy of the risk model and the risk score model was assessed by both discriminations measured by the C-statistic and calibration evaluated by the Hosmer-Lemeshow c2 statistic and calibration plot. Furthermore, the risk scoring model was validated by split-sample to evaluate the stability of the model. The area under the receiver operating characteristic (ROC) curve was compared by the nonparametric approach of DeLong (19).

Ethical statement

The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013). The study was approved on November 5th, 2019 by the Medical Ethics Committee of the first affiliated hospital of Guangzhou Medical University (No. K-51) before data were accessed and individual consent for this retrospective analysis was waived.

Results

A total of 1,837 patients who underwent non-intubated thoracic surgery were included (, Table S1).

Figure 1

The flow chart of this observation. VATS, video-assisted thoracoscopic surgery; PFT, pulmonary function test; LVEF, left ventricular ejection fraction.

Risk model and risk score development

A total of 157 (9%) experienced PC among the 1,837 patients. One hundred and one of 1,097 patients experienced PC in the development data set, while 56 of 740 patients experienced PC in the validation data set (Tables S2,S3). After variables selected by a bootstrap technique, the FEV1% predicted, anesthesia method, blood loss, surgical time, and preoperative neutrophil ratio were selected as the best subset of risk factors to establish a risk model (). The scores of all predictors were shown in .

Table 1

Univariate and multivariable logistic regression analysis of risk factors that were selected to develop the risk model for predicting post-operative complications (developmental data set, n=1,097)

Variable	Univariate analysis				Multivariable analysis
	OR	95% CI	P value		OR	95% CI	P value
FVE1% predicted	0.982	0.972 to 0.992	0.000		0.977	0.966 to 0.987	0.000
Anesthesia method (EA vs. TCI + LMA)	2.165	1.396 to 3.356	0.001		2.092	1.316 to 3.326	0.002
Blood loss	1.003	1.001 to 1.004	0.000		1.002	1.001 to 1.003	0.006
Log surgical time*	2.080	1.437 to 3.011	0.000		1.885	1.263 to 2.815	0.002
Preoperative neutrophil ratio	1.025	1.005 to 1.045	0.015		1.021	1.001 to 1.042	0.041

*, the natural logarithmic transformations of surgery time were made because of their extreme positive skewness. FEV1% predicted, the forced expiratory volume in the first second in percent of predicted; EA, epidural anesthesia; TCI, target controlled infusion; LMA, laryngeal mask airway; OR, odds ratio; CI, confidence interval.

Table 2

Risk scores for all predicting variables

Risk factors	Score
FVE1% predicted
≥80%	0
70–79%	2.5
60–69%	5
50–59%	7.5
35–49%	10
<35%	15
Preoperative neutrophil ratio
<40%	0
40–49%	2
50–59%	4
60–69%	6
70–79%	8
≥80%	10
Surgical time
<30 min	0
30–59 min	4.5
60–119 min	9
120–239 min	13.5
≥240 min	18
Blood loss
≤50 mL	0
51–100 mL	1
101–200 mL	3
>200 mL	6
Anesthesia method
TCI + LMA	0
EA	4

FEV1% predicted, the forced expiratory volume in the first second in percent of predicted; TCI, target controlled infusion; LMA, laryngeal mask airway; EA, epidural anesthesia.

Risk score validation

The risk score model was applied to the development data set for discrimination, with a C-statistic of 0.705 (95% CI: 0.650–0.759) and high calibration with a χ2 statistic of 6.261 (P=0.618) (). The validation results of the split-sample, which based on the validation data set, were similar to those of the development data set, with an average C-statistic of 0.700 (95% CI: 0.619–0.781) and high calibration with a χ2 statistic of 7.963 (P=0.437) (). The ROC () and the PC proportions () from the development and validation data sets were consistent with each other. The predicted incidence of PC was nicely corresponding to the observed ().

Figure 2

The area under the ROC curves and calibration plot with the Hosmer-Lemeshow test for goodness-of-fit result for the risk score. ROC, receiver operator characteristic.

Figure 3

The correlation of PC with the risk score. Increasing the risk of PC with increasing risk score is showed in the development and validation data sets. The observed incidence of PC was consistent with the predicted ones based on the data set risk score. PC, post-operative complications.

Clinical implications of the risk score model

Based on the risk score model, the risk scores were classified into three levels for clinical use (). The definitions of three levels were low-risk (0–15 points], moderate-risk (15–30 points], and high-risk (>30 points], which was based on the score distribution of PC (). The total risk score varied from the minimum 0 (lowest risk) to the maximum 53 (highest risk) (), and the corresponding predicted probability of PC occurrence ranged from 1% to 92%. The relationship of risk level and predicted risk of PC were low-risk (1–6%), moderate-risk (7–33%), high-risk (36–92%) ().

Figure 4

The correlation of risk level with the range of risk score.

Table 3

The relationship between risk level and predicted risks of postoperative complications

Risk level	Risk score level (points)	Predicted risk (%)
Low-risk	0–15	1–6
Moderate-risk	>15–30	7–33
High-risk	>30	36–92

Discussion

In this observation, we established and validated a risk score model based on 5 available factors (FEV1% predicted, preoperative neutrophil ratio, surgical time, blood loss, and anesthesia method), to predict the risk of PC in non-intubated VATS. And we provided three classifications of low, moderate, and higher-risk levels of post-operative complications for the clinicians to use. Predicting PC through preoperative and intraoperative variables is the original intention. This recommended a convenient risk score allows for the identification of high-risk patients immediately and makes the right risk allocation, finally initiates early treatments.

Non-intubated VATS has been applied to a large number of patients in a series of observations, such as Klijian’s report under awake VATS (20), Chen’s experience in lung resection, and Hung’s studies in the thoracoscopic lobectomy (11,21-23). However, no specific perioperative complications have been proposed in these observations. In our previous studies, eligibility criteria for non-intubated VATS were strictly identified, but the occurrence of PC still existed (12-14). Based on this observation, the incidence of PC was 9%, and we could speculate that the FEV1% predicted, the anesthesia method, the blood loss, the surgical time, and the preoperative neutrophil ratio were the risk factors of PC. It has been proved that poor pulmonary function and a longer surgical time can increase PC (24-26), and EA with high plane block can retardant the movement of intercostal muscles and reduce the inspiratory capacity (27,28), which can lead to hypercapnia and hypoxia. Therefore, it requires initiating timely interventions for high-risk patients and proceed with personality procedures in non-intubated VATS.

Of note, PC prolonged the hospital stay and increased unfavorable clinical outcomes, which are contrary to the rapid rehabilitation paraded by non-intubated VATS. A practical and efficacious method for avoiding complications is its early identification and prevention. Therefore, the establishment of a risk score model to detect PC earlier is immediately needed in non-intubated VATS. In this observation, the proposed risk score revealed a high degree of differentiation and good calibration both in the development and validation data sets, and the predictive power of the risk score for PC was higher. Moreover, the quantitative variables in our risk model may be more objective, which comes from a large number of clinical cases of non-intubated VATS in our institution.

Non-intubated VATS are usually practiced in simple surgical procedures for which intubated anesthesia is deemed more complex and thus unnecessary, such as treatment of spontaneous pneumothorax, recurrent pleural effusion, pleural, pulmonary and mediastinal biopsy, and sympathectomy, etc. (2,4,8); on the other, non-intubated VATS are preferred in some cases which are deemed at higher risk for standard intubated anesthesia, such as patients with compromised pulmonary function, older age, associated cardiovascular comorbidity (5,10,29). It’s in brief that the advantage of non-intubated VAST outweighs the disadvantage for some high-risk patients, and the intraoperative factors can significantly affect the postoperative rehabilitation of patients. Licker proposes that prolonged surgery is an independent risk factor for predicting PC (30), and that was why we included intraoperative factors to establish the risk score model. In our risk score, the ability to predict was more comprehensive by combining with four other factors. If the score is less than 15, the risk level of PC is low-risk, the patient can be directly transferred to the ward, and just receive routine treatment after the operation, such as atomization and pulmonary function training, without placement of chest drainage tube, and whether the use of postoperative analgesia is depending on personal need. If the score is >15–30, the risk level of postoperative complication is medium risk, in addition to routine treatments, the patient continues to use pre-operative drugs, such as antiasthmatics and expectorants, and they should be placed chest drainage tube after the operation. If the score is more than 30, the risk level of postoperative complication is high risk, the patient not only initiates the therapies the same as in medium risk level, but also should be placed chest-tube drainage longer, receive intensive care and monitoring in the ICU, and need more chest-radiography and laboratory examination for postoperative evaluation.

Limitations

Undoubtedly, this study has several limitations. First, this investigation proceeded in a single-center, and its results may be limited to the non-intubated populations. But it can avoid the study bias coming from different training programs of surgeons and different protocols of management and therapy in multi-center. Second, patients without values of pulmonary function and LVEF (such as patients with pneumothorax or intolerance of pulmonary function test) were excluded from this study, which resulted in a lack of data analysis for such non-intubated VATS patients. However, pulmonary function and LVEF are important indexes for preoperative evaluation of thoracic surgery, thus the established risk score model should be included in the patients with these results. Third, this model was verified by the split-sample method. It is a simple way to examine the overfitting, and cannot determine the generalizability of independent cohorts. Fourth, this risk model was based on different types of surgical procedures which may result in a heterogeneity of comparison, but it would make the risk model more in accordance with the actual clinical practice, since non-intubated VATS has been applied in a wide range of thoracoscopic procedures. And we also proved the feasibility of this risk model by analyzing the subgroup of different types of surgical procedures (Table S4). Fifth, the diffusing capacity of the lung for carbon monoxide (DLCO) had not been included in the analysis. The reasons were that, firstly, DLCO was not a routine examination for every patient in our institute; secondly, if DLCO were included in the analysis, the results may be bias due to removal of many cases without DLCO.

Conclusions

In summary, the preoperative evaluations should be rigorous on patients scheduled for non-intubated VATS. This simple risk score model, which is based on five available factors (FEV1% predicted, preoperative neutrophil ratio, surgical time, blood loss, and anesthesia method), is a valid tool for the identification of high-risk patients with PC in non-intubated thoracic surgery. This could help clinicians to distinguish the high-risk patients and initiate the appropriate and earlier interventions for them.

The article’s supplementary files as