Sean M O'Brien1, Jeffrey P Jacobs2, David M Shahian3, Marshall L Jacobs2, J William Gaynor4, Jennifer C Romano5, Michael G Gaies6, Kevin D Hill1, John E Mayer7, Sara K Pasquali8. 1. Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina. 2. Division of Cardiac Surgery, Department of Surgery, Johns Hopkins University School of Medicine, Baltimore, Maryland; Division of Cardiovascular Surgery, Department of Surgery, Johns Hopkins All Children's Heart Institute, St. Petersburg, Florida. 3. Department of Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts. 4. Department of Surgery, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania. 5. Department of Cardiac Surgery, University of Michigan Medical School, Ann Arbor, Michigan. 6. Department of Pediatrics, University of Michigan C.S. Mott Children's Hospital, Ann Arbor, Michigan. 7. Department of Cardiovascular Surgery, Boston Children's Hospital, Boston, Massachusetts. 8. Department of Pediatrics, University of Michigan C.S. Mott Children's Hospital, Ann Arbor, Michigan. Electronic address: pasquali@med.umich.edu.
Abstract
BACKGROUND: We describe the statistical methods and results related to development of the first congenital heart surgery composite quality measure. METHODS: The composite measure was developed using The Society of Thoracic Surgeons Congenital Heart Surgery Database (2012 to 2015), Bayesian hierarchical modeling, and the current Society of Thoracic Surgeons risk model for case-mix adjustment. It consists of a mortality domain (operative mortality) and morbidity domain (major complications and postoperative length of stay). We evaluated several potential weighting schemes and properties of the final composite measure, including reliability (signal-to-noise ratio) and hospital classification in various performance categories. RESULTS: Overall, 100 hospitals (78,425 operations) were included. Each adjusted metric included in the composite varied across hospitals: operative mortality (median, 3.1%; 10th to 90th percentile, 2.1% to 4.4%) major complications (median 11.7%, 10th to 90th percentile, 6.4% to 17.4%), and length of stay (median, 7.0 days; 10th to 90th percentile, 5.9 to 8.2 days). In the final composite weighting scheme selected, mortality had the greatest influence, followed by major complications and length of stay (correlation with overall composite score of 0.87, 0.69, and 0.47, respectively). Reliability of the composite measure was 0.73 compared with 0.59 for mortality alone. The distribution of hospitals across composite measure performance categories (defined by whether the 95% credible interval overlapped The Society of Thoracic Surgeons average) was 75% (same as expected), 9% (worse than expected), and 16% (better than expected). CONCLUSIONS: This congenital heart surgery composite measure incorporates aspects of both morbidity and mortality, has clinical face validity, and greater ability to discriminate hospital performance compared with mortality alone. Ongoing efforts will support the use of the composite measure in benchmarking and quality improvement activities.
BACKGROUND: We describe the statistical methods and results related to development of the first congenital heart surgery composite quality measure. METHODS: The composite measure was developed using The Society of Thoracic Surgeons Congenital Heart Surgery Database (2012 to 2015), Bayesian hierarchical modeling, and the current Society of Thoracic Surgeons risk model for case-mix adjustment. It consists of a mortality domain (operative mortality) and morbidity domain (major complications and postoperative length of stay). We evaluated several potential weighting schemes and properties of the final composite measure, including reliability (signal-to-noise ratio) and hospital classification in various performance categories. RESULTS: Overall, 100 hospitals (78,425 operations) were included. Each adjusted metric included in the composite varied across hospitals: operative mortality (median, 3.1%; 10th to 90th percentile, 2.1% to 4.4%) major complications (median 11.7%, 10th to 90th percentile, 6.4% to 17.4%), and length of stay (median, 7.0 days; 10th to 90th percentile, 5.9 to 8.2 days). In the final composite weighting scheme selected, mortality had the greatest influence, followed by major complications and length of stay (correlation with overall composite score of 0.87, 0.69, and 0.47, respectively). Reliability of the composite measure was 0.73 compared with 0.59 for mortality alone. The distribution of hospitals across composite measure performance categories (defined by whether the 95% credible interval overlapped The Society of Thoracic Surgeons average) was 75% (same as expected), 9% (worse than expected), and 16% (better than expected). CONCLUSIONS: This congenital heart surgery composite measure incorporates aspects of both morbidity and mortality, has clinical face validity, and greater ability to discriminate hospital performance compared with mortality alone. Ongoing efforts will support the use of the composite measure in benchmarking and quality improvement activities.
Authors: Eric D Peterson; Elizabeth R Delong; Frederick A Masoudi; Sean M O'Brien; Pamela N Peterson; John S Rumsfeld; David M Shahian; Richard E Shaw; David C Goff; Kathleen Grady; Lee A Green; Kathy J Jenkins; Ann Loth; Martha J Radford Journal: Circulation Date: 2010-03-29 Impact factor: 29.690
Authors: David M Shahian; Fred H Edwards; Victor A Ferraris; Constance K Haan; Jeffrey B Rich; Sharon-Lise T Normand; Elizabeth R DeLong; Sean M O'Brien; Cynthia M Shewan; Rachel S Dokholyan; Eric D Peterson Journal: Ann Thorac Surg Date: 2007-04 Impact factor: 4.330
Authors: Sara K Pasquali; Chitra Ravishankar; Jennifer C Romano; Kristin Kane; Suzanne Viers; Andrea Kennedy; Nancy Burnham; Ray Lowery; Karen Uzark; Lauren Retzloff; Jonathon J Rome; Joseph W Rossano; John R Charpie; Thomas L Spray; Michael G Gaies; Richard G Ohye; J William Gaynor Journal: Cardiol Young Date: 2016-12 Impact factor: 1.093
Authors: Christina Pagel; Emily Jesper; Joanne Thomas; Emily Blackshaw; Tim Rakow; Mike Pearson; David Spiegelhalter Journal: Ann Thorac Surg Date: 2017-03-15 Impact factor: 4.330
Authors: Sara K Pasquali; Amelia S Wallace; J William Gaynor; Marshall L Jacobs; Sean M O'Brien; Kevin D Hill; Michael G Gaies; Jennifer C Romano; David M Shahian; John E Mayer; Jeffrey P Jacobs Journal: Ann Thorac Surg Date: 2016-07-22 Impact factor: 4.330
Authors: Jeffrey P Jacobs; David M Shahian; Richard S D'Agostino; Marshall L Jacobs; Benjamin D Kozower; Vinay Badhwar; Vinod H Thourani; Henning A Gaissert; Felix G Fernandez; Richard L Prager Journal: Ann Thorac Surg Date: 2017-12 Impact factor: 4.330
Authors: Sean M O'Brien; Jeffrey P Jacobs; Sara K Pasquali; J William Gaynor; Tara Karamlou; Karl F Welke; Giovanni Filardo; Jane M Han; Sunghee Kim; David M Shahian; Marshall L Jacobs Journal: Ann Thorac Surg Date: 2015-08-03 Impact factor: 4.330
Authors: Sara K Pasquali; Michael Gaies; Mousumi Banerjee; Wenying Zhang; Janet Donohue; Mark Russell; J William Gaynor Journal: Ann Thorac Surg Date: 2019-08-06 Impact factor: 4.330
Authors: Monique M Gardner; Garrett Keim; Jill Hsia; Anh D Mai; J William Gaynor; Andrew C Glatz; Nadir Yehya Journal: J Am Heart Assoc Date: 2022-06-14 Impact factor: 6.106
Authors: Philip Allen; Farhan Zafar; Junhui Mi; Sarah Crook; Joyce Woo; Natalie Jayaram; Roosevelt Bryant; Tara Karamlou; James Tweddell; Kacie Dragan; Stephen Cook; Edward L Hannan; Jane W Newburger; Emile A Bacha; Robert Vincent; Khanh Nguyen; Kathleen Walsh-Spoonhower; Ralph Mosca; Neil Devejian; Steven A Kamenir; George M Alfieris; Michael F Swartz; David Meyer; Erin A Paul; John Billings; Brett R Anderson Journal: J Am Coll Cardiol Date: 2022-02-08 Impact factor: 24.094
Authors: Timothy E Nissen; Isabella Zaniletti; R Thomas Collins; Lawrence E Greiten; Parthak Prodhan; Paul M Seib; Elijah H Bolin Journal: Pediatr Cardiol Date: 2021-07-30 Impact factor: 1.655