Alexis C Gimovsky1, Daisy Zhuo2, Jordan T Levine3, Jack Dunn2, Maxime Amarm2, Alan M Peaceman4. 1. Division of Maternal-Fetal Medicine, Department of Obstetrics and Gynecology, Alpert Medical School of Brown University, Providence, Rhode Island, USA. 2. Interpretable AI, One Broadway, Cambridge, Massachusetts, USA. 3. Alexandria Health, Providence, Rhode Island, USA. 4. Division of Maternal-Fetal Medicine, Department of Obstetrics and Gynecology, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.
Abstract
OBJECTIVE: To establish a case-adjusted hospital-specific performance evaluation tool using machine learning methodology for cesarean delivery. DATA SOURCES: Secondary data were collected from patients between January 1, 2015 and February 28, 2018 using a hospital's "Electronic Data Warehouse" database from Illinois, USA. STUDY DESIGN: The machine learning methodology of optimal classification trees (OCTs) was used to predict cesarean delivery rate by physician group, thereby establishing the case-adjusted benchmarking standards in comparison to the overall hospital cesarean delivery rate. Outcomes of specific patient populations of each participating practice were predicted, as if each were treated in the overall hospital environment. The resulting OCTs estimate physician group expected cesarean delivery outcomes, both aggregate and in specific clinical situations. DATA COLLECTION/EXTRACTION METHODS: Twelve thousand eight hunderd and forty one singleton, vertex, term deliveries, cared for by practices with ≥50 births. PRINCIPAL FINDINGS: The overall rate of cesarean delivery was 18.6% (n = 2384), with a range of 13.3%-33.7% amongst 22 physician practices. An optimal decision tree was used to create a prediction model for the hospital overall, which defined 23 patient cohorts divided by 46 nodes. The model's performance for prediction of cesarean delivery is as follows: area under the curve 0.73, sensitivity 98.4%, specificity 16.1%, positive predictive value 83.7%, negative predictive value 70.6%. Comparisons with the overall hospital's specific-case adjusted benchmark groups revealed that several groups outperformed the overall hospital benchmark, and some practice groups underperformed in comparison to the overall hospital benchmark. CONCLUSIONS: OCT benchmarking can assess physician practice-specific case-adjusted performance, both overall and clinical situation-specific, and can serve as a valuable tool for hospital self-assessment and quality improvement.
OBJECTIVE: To establish a case-adjusted hospital-specific performance evaluation tool using machine learning methodology for cesarean delivery. DATA SOURCES: Secondary data were collected from patients between January 1, 2015 and February 28, 2018 using a hospital's "Electronic Data Warehouse" database from Illinois, USA. STUDY DESIGN: The machine learning methodology of optimal classification trees (OCTs) was used to predict cesarean delivery rate by physician group, thereby establishing the case-adjusted benchmarking standards in comparison to the overall hospital cesarean delivery rate. Outcomes of specific patient populations of each participating practice were predicted, as if each were treated in the overall hospital environment. The resulting OCTs estimate physician group expected cesarean delivery outcomes, both aggregate and in specific clinical situations. DATA COLLECTION/EXTRACTION METHODS: Twelve thousand eight hunderd and forty one singleton, vertex, term deliveries, cared for by practices with ≥50 births. PRINCIPAL FINDINGS: The overall rate of cesarean delivery was 18.6% (n = 2384), with a range of 13.3%-33.7% amongst 22 physician practices. An optimal decision tree was used to create a prediction model for the hospital overall, which defined 23 patient cohorts divided by 46 nodes. The model's performance for prediction of cesarean delivery is as follows: area under the curve 0.73, sensitivity 98.4%, specificity 16.1%, positive predictive value 83.7%, negative predictive value 70.6%. Comparisons with the overall hospital's specific-case adjusted benchmark groups revealed that several groups outperformed the overall hospital benchmark, and some practice groups underperformed in comparison to the overall hospital benchmark. CONCLUSIONS: OCT benchmarking can assess physician practice-specific case-adjusted performance, both overall and clinical situation-specific, and can serve as a valuable tool for hospital self-assessment and quality improvement.
Authors: Brian K Iriye; Kimberly D Gregory; George R Saade; William A Grobman; Haywood L Brown Journal: Am J Obstet Gynecol Date: 2017-07-20 Impact factor: 8.661
Authors: Mary A Vadnais; Michele R Hacker; Neel T Shah; JoAnn Jordan; Anna M Modest; Molly Siegel; Toni H Golen Journal: Jt Comm J Qual Patient Saf Date: 2016-11-15
Authors: Niamh C Murphy; Naomi Burke; Fionnuala M Breathnach; Gerard Burke; Fionnuala M McAuliffe; John J Morrison; Michael J Turner; Samina Dornan; John Higgins; Amanda Cotter; Michael P Geary; Fiona Cody; Peter McParland; Cecelia Mulcahy; Sean Daly; Patrick Dicker; Elizabeth C Tully; Fergal D Malone Journal: Eur J Obstet Gynecol Reprod Biol Date: 2020-05-06 Impact factor: 2.435
Authors: Daniel N Pasko; Paula McGee; William A Grobman; Jennifer L Bailit; Uma M Reddy; Ronald J Wapner; Michael W Varner; John M Thorp; Kenneth J Leveno; Steve N Caritis; Mona Prasad; George Saade; Yoram Sorokin; Dwight J Rouse; Sean C Blackwell; Jorge E Tolosa Journal: Obstet Gynecol Date: 2018-06 Impact factor: 7.661
Authors: Alexis C Gimovsky; Daisy Zhuo; Jordan T Levine; Jack Dunn; Maxime Amarm; Alan M Peaceman Journal: Health Serv Res Date: 2022-01-12 Impact factor: 3.734