Meghan Brennan1, Sahil Puri2, Tezcan Ozrazgat-Baslanti3, Zheng Feng4, Matthew Ruppert3, Haleh Hashemighouchani3, Petar Momcilovic5, Xiaolin Li4, Daisy Zhe Wang6, Azra Bihorac7. 1. Precision and Intelligent Systems in Medicine (PRISMA(P)), Division of Nephrology, Hypertension and Transplantation, University of Florida, Gainesville; Department of Anesthesiology, University of Florida College of Medicine, Gainesville. 2. Department of Computer and Information Science and Engineering, University of Florida Herbert Wertheim College of Engineering, Gainesville. 3. Precision and Intelligent Systems in Medicine (PRISMA(P)), Division of Nephrology, Hypertension and Transplantation, University of Florida, Gainesville; Department of Medicine, University of Florida College of Medicine, Gainesville. 4. Precision and Intelligent Systems in Medicine (PRISMA(P)), Division of Nephrology, Hypertension and Transplantation, University of Florida, Gainesville; Department of Electrical and Computer Engineering, University of Florida Herbert Wertheim College of Engineering, Gainesville. 5. Precision and Intelligent Systems in Medicine (PRISMA(P)), Division of Nephrology, Hypertension and Transplantation, University of Florida, Gainesville; Department of Industrial and Systems Engineering, University of Florida Herbert Wertheim College of Engineering, Gainesville. 6. Precision and Intelligent Systems in Medicine (PRISMA(P)), Division of Nephrology, Hypertension and Transplantation, University of Florida, Gainesville; Department of Computer and Information Science and Engineering, University of Florida Herbert Wertheim College of Engineering, Gainesville. 7. Precision and Intelligent Systems in Medicine (PRISMA(P)), Division of Nephrology, Hypertension and Transplantation, University of Florida, Gainesville; Department of Medicine, University of Florida College of Medicine, Gainesville. Electronic address: abihorac@ufl.edu.
Abstract
BACKGROUND: Major postoperative complications are associated with increased cost and mortality. The complexity of electronic health records overwhelms physicians' abilities to use the information for optimal and timely preoperative risk assessment. We hypothesized that data-driven, predictive-risk algorithms implemented in an intelligent decision-support platform simplify and augment physicians' risk assessments. METHODS: This prospective, nonrandomized pilot study of 20 physicians at a quaternary academic medical center compared the usability and accuracy of preoperative risk assessment between physicians and MySurgeryRisk, a validated, machine-learning algorithm, using a simulated workflow for the real-time, intelligent decision-support platform. We used area under the receiver operating characteristic curve to compare the accuracy of physicians' risk assessment for six postoperative complications before and after interaction with the algorithm for 150 clinical cases. RESULTS: The area under the receiver operating characteristic curve of the MySurgeryRisk algorithm ranged between 0.73 and 0.85 and was significantly better than physicians' initial risk assessments (area under the receiver operating characteristic curve between 0.47 and 0.69) for all postoperative complications except cardiovascular. After interaction with the algorithm, the physicians significantly improved their risk assessment for acute kidney injury and for an intensive care unit admission greater than 48 hours, resulting in a net improvement of reclassification of 12% and 16%, respectively. Physicians rated the algorithm as easy to use and useful. CONCLUSION: Implementation of a validated, MySurgeryRisk computational algorithm for real-time predictive analytics with data derived from the electronic health records to augment physicians' decision-making is feasible and accepted by physicians. Early involvement of physicians as key stakeholders in both design and implementation of this technology will be crucial for its future success.
BACKGROUND: Major postoperative complications are associated with increased cost and mortality. The complexity of electronic health records overwhelms physicians' abilities to use the information for optimal and timely preoperative risk assessment. We hypothesized that data-driven, predictive-risk algorithms implemented in an intelligent decision-support platform simplify and augment physicians' risk assessments. METHODS: This prospective, nonrandomized pilot study of 20 physicians at a quaternary academic medical center compared the usability and accuracy of preoperative risk assessment between physicians and MySurgeryRisk, a validated, machine-learning algorithm, using a simulated workflow for the real-time, intelligent decision-support platform. We used area under the receiver operating characteristic curve to compare the accuracy of physicians' risk assessment for six postoperative complications before and after interaction with the algorithm for 150 clinical cases. RESULTS: The area under the receiver operating characteristic curve of the MySurgeryRisk algorithm ranged between 0.73 and 0.85 and was significantly better than physicians' initial risk assessments (area under the receiver operating characteristic curve between 0.47 and 0.69) for all postoperative complications except cardiovascular. After interaction with the algorithm, the physicians significantly improved their risk assessment for acute kidney injury and for an intensive care unit admission greater than 48 hours, resulting in a net improvement of reclassification of 12% and 16%, respectively. Physicians rated the algorithm as easy to use and useful. CONCLUSION: Implementation of a validated, MySurgeryRisk computational algorithm for real-time predictive analytics with data derived from the electronic health records to augment physicians' decision-making is feasible and accepted by physicians. Early involvement of physicians as key stakeholders in both design and implementation of this technology will be crucial for its future success.
Authors: Tara Lagu; Michael B Rothberg; Meng-Shiou Shieh; Penelope S Pekow; Jay S Steingrub; Peter K Lindenauer Journal: Crit Care Med Date: 2012-03 Impact factor: 7.598
Authors: Azra Bihorac; Tezcan Ozrazgat-Baslanti; Ashkan Ebadi; Amir Motaei; Mohcine Madkour; Panagote M Pardalos; Gloria Lipori; William R Hogan; Philip A Efron; Frederick Moore; Lyle L Moldawer; Daisy Zhe Wang; Charles E Hobson; Parisa Rashidi; Xiaolin Li; Petar Momcilovic Journal: Ann Surg Date: 2019-04 Impact factor: 12.969
Authors: Michael E Detsky; Michael O Harhay; Dominique F Bayard; Aaron M Delman; Anna E Buehler; Saida A Kent; Isabella V Ciuffetelli; Elizabeth Cooney; Nicole B Gabler; Sarah J Ratcliffe; Mark E Mikkelsen; Scott D Halpern Journal: JAMA Date: 2017-06-06 Impact factor: 56.272
Authors: Sidney T Le; Vincent X Liu; Patricia Kipnis; Jie Zhang; Peter D Peng; Elizabeth M Cespedes Feliciano Journal: JAMA Surg Date: 2022-05-11 Impact factor: 16.681
Authors: Tyler J Loftus; Amanda C Filiberto; Jeremy Balch; Alexander L Ayzengart; Patrick J Tighe; Parisa Rashidi; Azra Bihorac; Gilbert R Upchurch Journal: J Surg Res Date: 2020-04-24 Impact factor: 2.192
Authors: Tyler J Loftus; Patrick J Tighe; Amanda C Filiberto; Philip A Efron; Scott C Brakenridge; Alicia M Mohr; Parisa Rashidi; Gilbert R Upchurch; Azra Bihorac Journal: JAMA Surg Date: 2020-02-01 Impact factor: 14.766
Authors: Claire M Felmingham; Nikki R Adler; Zongyuan Ge; Rachael L Morton; Monika Janda; Victoria J Mar Journal: Am J Clin Dermatol Date: 2021-03 Impact factor: 7.403
Authors: Amanda C Filiberto; Tezcan Ozrazgat-Baslanti; Tyler J Loftus; Ying-Chih Peng; Shounak Datta; Philip Efron; Gilbert R Upchurch; Azra Bihorac; Michol A Cooper Journal: Surgery Date: 2021-02-27 Impact factor: 4.348
Authors: Tyler J Loftus; Jeremy A Balch; Matthew M Ruppert; Patrick J Tighe; William R Hogan; Parisa Rashidi; Gilbert R Upchurch; Azra Bihorac Journal: Ann Surg Date: 2022-02-01 Impact factor: 13.787