Mari M Nakamura1, Sara L Toomey2, Alan M Zaslavsky3, Carter R Petty4, Chen Lin5, Guergana K Savova6, Sherri Rose3, Mark S Brittan7, Jody L Lin8, Maria C Bryant9, Sepideh Ashrafzadeh9, Mark A Schuster10. 1. Division of General Pediatrics (MM Nakamura, SL Toomey, MC Bryant, S Ashrafzadeh, and MA Schuster); Division of Infectious Diseases (MM Nakamura), Institutional Centers for Clinical and Translational Research (CR Petty); Informatics Program (C Lin and GK Savova), Boston Children's Hospital. Electronic address: mari.nakamura@childrens.harvard.edu. 2. Division of General Pediatrics (MM Nakamura, SL Toomey, MC Bryant, S Ashrafzadeh, and MA Schuster); Informatics Program (C Lin and GK Savova), Boston Children's Hospital. 3. Department of Pediatrics (MM Nakamura, SL Toomey, GK Savova, and MA Schuster). 4. Department of Health Care Policy (AM Zaslavsky and S Rose). 5. Harvard Medical School, Boston, Mass; Department of Pediatrics (MS Brittan). 6. Informatics Program (C Lin and GK Savova), Boston Children's Hospital; Harvard Medical School, Boston, Mass; Department of Pediatrics (MS Brittan). 7. Children's Hospital Colorado, Aurora; Department of Pediatrics (JL Lin). 8. Stanford School of Medicine, Stanford, Calif. 9. Division of General Pediatrics (MM Nakamura, SL Toomey, MC Bryant, S Ashrafzadeh, and MA Schuster). 10. Division of General Pediatrics (MM Nakamura, SL Toomey, MC Bryant, S Ashrafzadeh, and MA Schuster); Informatics Program (C Lin and GK Savova), Boston Children's Hospital; Kaiser Permanente School of Medicine (MA Schuster), Pasadena, Calif.
Abstract
OBJECTIVE: Comparison of readmission rates requires adjustment for case-mix (ie, differences in patient populations), but previously only claims data were available for this purpose. We examined whether incorporation of relatively readily available clinical data improves prediction of pediatric readmissions and thus might enhance case-mix adjustment. METHODS: We examined 30-day readmissions using claims and electronic health record data for patients ≤18 years and 29 days of age who were admitted to 3 children's hospitals from February 2011 to February 2014. Using the Pediatric All-Condition Readmission Measure and starting with a model including age, gender, chronic conditions, and primary diagnosis, we examined whether the addition of initial vital sign and laboratory data improved model performance. We employed machine learning to evaluate the same variables, using the L2-regularized logistic regression with cost-sensitive learning and convolutional neural network. RESULTS: Controlling for the core model variables, low red blood cell count and mean corpuscular hemoglobin concentration and high red cell distribution width were associated with greater readmission risk, as were certain interactions between laboratory and chronic condition variables. However, the C-statistic (0.722 vs 0.713) and McFadden's pseudo R2 (0.085 vs 0.076) for this and the core model were similar, suggesting minimal improvement in performance. In machine learning analyses, the F-measure (harmonic mean of sensitivity and positive predictive value) was similar for the best-performing model (containing all variables) and core model (0.250 vs 0.243). CONCLUSIONS: Readily available clinical variables do not meaningfully improve the prediction of pediatric readmissions and would be unlikely to enhance case-mix adjustment unless their distributions varied widely across hospitals.
OBJECTIVE: Comparison of readmission rates requires adjustment for case-mix (ie, differences in patient populations), but previously only claims data were available for this purpose. We examined whether incorporation of relatively readily available clinical data improves prediction of pediatric readmissions and thus might enhance case-mix adjustment. METHODS: We examined 30-day readmissions using claims and electronic health record data for patients ≤18 years and 29 days of age who were admitted to 3 children's hospitals from February 2011 to February 2014. Using the Pediatric All-Condition Readmission Measure and starting with a model including age, gender, chronic conditions, and primary diagnosis, we examined whether the addition of initial vital sign and laboratory data improved model performance. We employed machine learning to evaluate the same variables, using the L2-regularized logistic regression with cost-sensitive learning and convolutional neural network. RESULTS: Controlling for the core model variables, low red blood cell count and mean corpuscular hemoglobin concentration and high red cell distribution width were associated with greater readmission risk, as were certain interactions between laboratory and chronic condition variables. However, the C-statistic (0.722 vs 0.713) and McFadden's pseudo R2 (0.085 vs 0.076) for this and the core model were similar, suggesting minimal improvement in performance. In machine learning analyses, the F-measure (harmonic mean of sensitivity and positive predictive value) was similar for the best-performing model (containing all variables) and core model (0.250 vs 0.243). CONCLUSIONS: Readily available clinical variables do not meaningfully improve the prediction of pediatric readmissions and would be unlikely to enhance case-mix adjustment unless their distributions varied widely across hospitals.
Authors: Marion R Sills; Matthew Hall; Gretchen J Cutler; Jeffrey D Colvin; Laura M Gottlieb; Michelle L Macy; Jessica L Bettenhausen; Rustin B Morse; Evan S Fieldston; Jean L Raphael; Katherine A Auger; Samir S Shah Journal: J Pediatr Date: 2017-05-02 Impact factor: 4.406
Authors: Mari M Nakamura; Sara L Toomey; Alan M Zaslavsky; Jay G Berry; Scott A Lorch; Ashish K Jha; Maria C Bryant; Alexandra T Geanacopoulos; Samuel S Loren; Debanjan Pain; Mark A Schuster Journal: Acad Pediatr Date: 2014 Sep-Oct Impact factor: 3.107
Authors: Zongqi Xia; Elizabeth Secor; Lori B Chibnik; Riley M Bove; Suchun Cheng; Tanuja Chitnis; Andrew Cagan; Vivian S Gainer; Pei J Chen; Katherine P Liao; Stanley Y Shaw; Ashwin N Ananthakrishnan; Peter Szolovits; Howard L Weiner; Elizabeth W Karlson; Shawn N Murphy; Guergana K Savova; Tianxi Cai; Susanne E Churchill; Robert M Plenge; Isaac S Kohane; Philip L De Jager Journal: PLoS One Date: 2013-11-11 Impact factor: 3.240