Christine K Lee1, Ira Hofer, Eilon Gabel, Pierre Baldi, Maxime Cannesson. 1. From the Department of Anesthesiology and Perioperative Care (C.K.L., M.C.) Department of Computer Sciences (C.K.L., P.B.) Department of Bioengineering (M.C.), University of California Irvine, Irvine, California Department of Anesthesiology and Perioperative Medicine, University of California Los Angeles, Los Angeles, California (I.H., E.G., M.C.).
Abstract
WHAT WE ALREADY KNOW ABOUT THIS TOPIC: WHAT THIS ARTICLE TELLS US THAT IS NEW: BACKGROUND: : The authors tested the hypothesis that deep neural networks trained on intraoperative features can predict postoperative in-hospital mortality. METHODS: The data used to train and validate the algorithm consists of 59,985 patients with 87 features extracted at the end of surgery. Feed-forward networks with a logistic output were trained using stochastic gradient descent with momentum. The deep neural networks were trained on 80% of the data, with 20% reserved for testing. The authors assessed improvement of the deep neural network by adding American Society of Anesthesiologists (ASA) Physical Status Classification and robustness of the deep neural network to a reduced feature set. The networks were then compared to ASA Physical Status, logistic regression, and other published clinical scores including the Surgical Apgar, Preoperative Score to Predict Postoperative Mortality, Risk Quantification Index, and the Risk Stratification Index. RESULTS: In-hospital mortality in the training and test sets were 0.81% and 0.73%. The deep neural network with a reduced feature set and ASA Physical Status classification had the highest area under the receiver operating characteristics curve, 0.91 (95% CI, 0.88 to 0.93). The highest logistic regression area under the curve was found with a reduced feature set and ASA Physical Status (0.90, 95% CI, 0.87 to 0.93). The Risk Stratification Index had the highest area under the receiver operating characteristics curve, at 0.97 (95% CI, 0.94 to 0.99). CONCLUSIONS: Deep neural networks can predict in-hospital mortality based on automatically extractable intraoperative data, but are not (yet) superior to existing methods.
WHAT WE ALREADY KNOW ABOUT THIS TOPIC: WHAT THIS ARTICLE TELLS US THAT IS NEW: BACKGROUND: : The authors tested the hypothesis that deep neural networks trained on intraoperative features can predict postoperative in-hospital mortality. METHODS: The data used to train and validate the algorithm consists of 59,985 patients with 87 features extracted at the end of surgery. Feed-forward networks with a logistic output were trained using stochastic gradient descent with momentum. The deep neural networks were trained on 80% of the data, with 20% reserved for testing. The authors assessed improvement of the deep neural network by adding American Society of Anesthesiologists (ASA) Physical Status Classification and robustness of the deep neural network to a reduced feature set. The networks were then compared to ASA Physical Status, logistic regression, and other published clinical scores including the Surgical Apgar, Preoperative Score to Predict Postoperative Mortality, Risk Quantification Index, and the Risk Stratification Index. RESULTS: In-hospital mortality in the training and test sets were 0.81% and 0.73%. The deep neural network with a reduced feature set and ASA Physical Status classification had the highest area under the receiver operating characteristics curve, 0.91 (95% CI, 0.88 to 0.93). The highest logistic regression area under the curve was found with a reduced feature set and ASA Physical Status (0.90, 95% CI, 0.87 to 0.93). The Risk Stratification Index had the highest area under the receiver operating characteristics curve, at 0.97 (95% CI, 0.94 to 0.99). CONCLUSIONS: Deep neural networks can predict in-hospital mortality based on automatically extractable intraoperative data, but are not (yet) superior to existing methods.
Authors: David Silver; Aja Huang; Chris J Maddison; Arthur Guez; Laurent Sifre; George van den Driessche; Julian Schrittwieser; Ioannis Antonoglou; Veda Panneershelvam; Marc Lanctot; Sander Dieleman; Dominik Grewe; John Nham; Nal Kalchbrenner; Ilya Sutskever; Timothy Lillicrap; Madeleine Leach; Koray Kavukcuoglu; Thore Graepel; Demis Hassabis Journal: Nature Date: 2016-01-28 Impact factor: 49.962
Authors: Atul A Gawande; Mary R Kwaan; Scott E Regenbogen; Stuart A Lipsitz; Michael J Zinner Journal: J Am Coll Surg Date: 2006-12-27 Impact factor: 6.113
Authors: Mathieu Guillame-Bert; Artur Dubrawski; Donghan Wang; Marilyn Hravnak; Gilles Clermont; Michael R Pinsky Journal: J Am Med Inform Assoc Date: 2016-06-06 Impact factor: 4.497
Authors: Daniel I Sessler; Jeffrey C Sigl; Paul J Manberg; Scott D Kelley; Armin Schubert; Nassib G Chamoun Journal: Anesthesiology Date: 2010-11 Impact factor: 7.892
Authors: Alex B Haynes; Scott E Regenbogen; Thomas G Weiser; Stuart R Lipsitz; Gerald Dziekan; William R Berry; Atul A Gawande Journal: Surgery Date: 2011-01-08 Impact factor: 3.982
Authors: Scott E Regenbogen; Jesse M Ehrenfeld; Stuart R Lipsitz; Caprice C Greenberg; Matthew M Hutter; Atul A Gawande Journal: Arch Surg Date: 2009-01
Authors: Yannick Le Manach; Gary Collins; Reitze Rodseth; Christine Le Bihan-Benjamin; Bruce Biccard; Bruno Riou; P J Devereaux; Paul Landais Journal: Anesthesiology Date: 2016-03 Impact factor: 7.892
Authors: Michael L Burns; Michael R Mathis; John Vandervest; Xinyu Tan; Bo Lu; Douglas A Colquhoun; Nirav Shah; Sachin Kheterpal; Leif Saager Journal: Anesthesiology Date: 2020-04 Impact factor: 7.892
Authors: Xinyu Yan; Jeff Goldsmith; Sumit Mohan; Zachary A Turnbull; Robert E Freundlich; Frederic T Billings; Ravi P Kiran; Guohua Li; Minjae Kim Journal: Anesth Analg Date: 2022-01-01 Impact factor: 5.108
Authors: Shikhar H Shah; Yi-Fan Chen; Heather E Moss; Daniel S Rubin; Charlotte E Joslin; Steven Roth Journal: Anesth Analg Date: 2020-04 Impact factor: 5.108
Authors: Brian L Hill; Robert Brown; Eilon Gabel; Nadav Rakocz; Christine Lee; Maxime Cannesson; Pierre Baldi; Loes Olde Loohuis; Ruth Johnson; Brandon Jew; Uri Maoz; Aman Mahajan; Sriram Sankararaman; Ira Hofer; Eran Halperin Journal: Br J Anaesth Date: 2019-10-15 Impact factor: 9.166
Authors: Brent D Ershoff; Christine K Lee; Christopher L Wray; Vatche G Agopian; Gregor Urban; Pierre Baldi; Maxime Cannesson Journal: Transplant Proc Date: 2020-01-08 Impact factor: 1.066
Authors: Jessica M Schwartz; Amanda J Moy; Sarah C Rossetti; Noémie Elhadad; Kenrick D Cato Journal: J Am Med Inform Assoc Date: 2021-03-01 Impact factor: 4.497
Authors: Yang Cao; Maximilian Peter Forssten; Ahmad Mohammad Ismail; Tomas Borg; Ioannis Ioannidis; Scott Montgomery; Shahin Mohseni Journal: J Pers Med Date: 2021-04-28