David M Shahian1, Xia He2, Jeffrey P Jacobs3, Paul A Kurlansky4, Vinay Badhwar5, Joseph C Cleveland6, Frank L Fazzalari7, Giovanni Filardo8, Sharon-Lise T Normand9, Anthony P Furnary10, Mitchell J Magee11, J Scott Rankin12, Karl F Welke13, Jane Han14, Sean M O'Brien2. 1. Department of Surgery and Center for Quality and Safety, Massachusetts General Hospital, and Harvard Medical School, Boston, Massachusetts. Electronic address: dshahian@partners.org. 2. Duke Clinical Research Institute, Durham, North Carolina. 3. Johns Hopkins All Children's Heart Institute, St. Petersburg, Florida. 4. Columbia HeartSource, Columbia University College of Physicians and Surgeons, New York, New York. 5. Department of Cardiothoracic Surgery, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania. 6. Division of Cardiothoracic Surgery, University of Colorado School of Medicine, Aurora, Colorado. 7. Cardiac Surgery Department, University of Michigan Health System, Ann Arbor, Michigan. 8. Institute for Health Care Research and Improvement, Baylor Health Care System, Dallas, Texas. 9. Department of Health Care Policy, Harvard Medical School and Department of Biostatistics, Harvard School of Public Health, Boston, Massachusetts. 10. Starr-Wood Cardiac Group, Portland, Oregon. 11. HCA North Texas Division, Dallas, Texas. 12. Cardiothoracic Surgery Associates, Nashville, Tennessee. 13. Children's Hospital of Illinois and the University of Illinois College of Medicine, Peoria, Illinois. 14. The Society of Thoracic Surgeons, Chicago, Illinois.
Abstract
BACKGROUND: Previous composite performance measures of The Society of Thoracic Surgeons (STS) were estimated at the STS participant level, typically a hospital or group practice. The STS Quality Measurement Task Force has now developed a multiprocedural, multidimensional composite measure suitable for estimating the performance of individual surgeons. METHODS: The development sample from the STS National Database included 621,489 isolated coronary artery bypass grafting procedures, isolated aortic valve replacement, aortic valve replacement plus coronary artery bypass grafting, mitral, or mitral plus coronary artery bypass grafting procedures performed by 2,286 surgeons between July 1, 2011, and June 30, 2014. Each surgeon's composite score combined their aggregate risk-adjusted mortality and major morbidity rates (each weighted inversely by their standard deviations) and reflected the proportion of case types they performed. Model parameters were estimated in a Bayesian framework. Composite star ratings were examined using 90%, 95%, or 98% Bayesian credible intervals. Measure reliability was estimated using various 3-year case thresholds. RESULTS: The final composite measure was defined as 0.81 × (1 minus risk-standardized mortality rate) + 0.19 × (1 minus risk-standardized complication rate). Risk-adjusted mortality (median, 2.3%; interquartile range, 1.7% to 3.0%), morbidity (median, 13.7%; interquartile range, 10.8% to 17.1%), and composite scores (median, 95.4%; interquartile range, 94.4% to 96.3%) varied substantially across surgeons. Using 98% Bayesian credible intervals, there were 207 1-star (lower performance) surgeons (9.1%), 1,701 2-star (as-expected performance) surgeons (74.4%), and 378 3-star (higher performance) surgeons (16.5%). With an eligibility threshold of 100 cases over 3 years, measure reliability was 0.81. CONCLUSIONS: The STS has developed a multiprocedural composite measure suitable for evaluating performance at the individual surgeon level.
BACKGROUND: Previous composite performance measures of The Society of Thoracic Surgeons (STS) were estimated at the STS participant level, typically a hospital or group practice. The STS Quality Measurement Task Force has now developed a multiprocedural, multidimensional composite measure suitable for estimating the performance of individual surgeons. METHODS: The development sample from the STS National Database included 621,489 isolated coronary artery bypass grafting procedures, isolated aortic valve replacement, aortic valve replacement plus coronary artery bypass grafting, mitral, or mitral plus coronary artery bypass grafting procedures performed by 2,286 surgeons between July 1, 2011, and June 30, 2014. Each surgeon's composite score combined their aggregate risk-adjusted mortality and major morbidity rates (each weighted inversely by their standard deviations) and reflected the proportion of case types they performed. Model parameters were estimated in a Bayesian framework. Composite star ratings were examined using 90%, 95%, or 98% Bayesian credible intervals. Measure reliability was estimated using various 3-year case thresholds. RESULTS: The final composite measure was defined as 0.81 × (1 minus risk-standardized mortality rate) + 0.19 × (1 minus risk-standardized complication rate). Risk-adjusted mortality (median, 2.3%; interquartile range, 1.7% to 3.0%), morbidity (median, 13.7%; interquartile range, 10.8% to 17.1%), and composite scores (median, 95.4%; interquartile range, 94.4% to 96.3%) varied substantially across surgeons. Using 98% Bayesian credible intervals, there were 207 1-star (lower performance) surgeons (9.1%), 1,701 2-star (as-expected performance) surgeons (74.4%), and 378 3-star (higher performance) surgeons (16.5%). With an eligibility threshold of 100 cases over 3 years, measure reliability was 0.81. CONCLUSIONS: The STS has developed a multiprocedural composite measure suitable for evaluating performance at the individual surgeon level.
Authors: Fenton H McCarthy; Lingjiao Zhang; Vicky Tam; Jinbo Chen; Chase Brown; William L Patrick; Walter Clark Hargrove; Wilson Y Szeto; Nimesh D Desai; Douglas J Wiebe; Peter W Groeneveld; Matthew L Williams Journal: Am J Cardiol Date: 2018-09-26 Impact factor: 2.778
Authors: Michael R Mathis; Neal M Duggal; Allison M Janda; Jordan L Fennema; Bo Yang; Francis D Pagani; Michael D Maile; Ryan E Hofer; Elizabeth S Jewell; Milo C Engoren Journal: J Cardiothorac Vasc Anesth Date: 2021-01-27 Impact factor: 2.894
Authors: Reinier Feitz; Yara E van Kooij; Marloes H P Ter Stege; Mark J W van der Oest; J Sebastiaan Souer; Robbert M Wouters; Harm P Slijper; Ruud W Selles; Steven E R Hovius Journal: EFORT Open Rev Date: 2021-06-28