BACKGROUND: Regardless of statistical methodology, public performance report cards must use the highest-quality validated data, preferably from a prospectively maintained clinical database. Using logistic regression and hierarchical models, we compared hospital cardiac surgery profiling results based on clinical data with those derived from contemporaneous administrative data. METHODS AND RESULTS: Fiscal year 2003 isolated coronary artery bypass grafting surgery results based on an audited and validated Massachusetts clinical registry were compared with those derived from a contemporaneous state administrative database, the latter using the inclusion/exclusion criteria and risk model of the Agency for Healthcare Research and Quality. There was a 27.4% disparity in isolated coronary artery bypass grafting surgery volume (4440 clinical, 5657 administrative), a 0.83% difference in observed in-hospital mortality (2.05% versus 2.88%), corresponding differences in risk-adjusted mortality calculated by various statistical methodologies, and 1 hospital classified as an outlier only with the administrative data-based approach. The discrepancies in volumes and risk-adjusted mortality were most notable for higher-volume programs that presumably perform a higher proportion of combined procedures that were misclassified as isolated coronary artery bypass grafting surgery in the administrative cohort. Subsequent analyses of a patient cohort common to both databases revealed the smoothing effect of hierarchical models, a 9% relative difference in mortality (2.21% versus 2.03%) resulting from nonstandardized mortality end points, and 1 hospital classified as an outlier using logistic regression but not using hierarchical regression. CONCLUSIONS: Cardiac surgery report cards using administrative data are problematic compared with those derived from audited and validated clinical data, primarily because of case misclassification and nonstandardized end points.
BACKGROUND: Regardless of statistical methodology, public performance report cards must use the highest-quality validated data, preferably from a prospectively maintained clinical database. Using logistic regression and hierarchical models, we compared hospital cardiac surgery profiling results based on clinical data with those derived from contemporaneous administrative data. METHODS AND RESULTS: Fiscal year 2003 isolated coronary artery bypass grafting surgery results based on an audited and validated Massachusetts clinical registry were compared with those derived from a contemporaneous state administrative database, the latter using the inclusion/exclusion criteria and risk model of the Agency for Healthcare Research and Quality. There was a 27.4% disparity in isolated coronary artery bypass grafting surgery volume (4440 clinical, 5657 administrative), a 0.83% difference in observed in-hospital mortality (2.05% versus 2.88%), corresponding differences in risk-adjusted mortality calculated by various statistical methodologies, and 1 hospital classified as an outlier only with the administrative data-based approach. The discrepancies in volumes and risk-adjusted mortality were most notable for higher-volume programs that presumably perform a higher proportion of combined procedures that were misclassified as isolated coronary artery bypass grafting surgery in the administrative cohort. Subsequent analyses of a patient cohort common to both databases revealed the smoothing effect of hierarchical models, a 9% relative difference in mortality (2.21% versus 2.03%) resulting from nonstandardized mortality end points, and 1 hospital classified as an outlier using logistic regression but not using hierarchical regression. CONCLUSIONS: Cardiac surgery report cards using administrative data are problematic compared with those derived from audited and validated clinical data, primarily because of case misclassification and nonstandardized end points.
Authors: Aimee S Parnell; Justine Shults; J William Gaynor; Mary B Leonard; Dingwei Dai; Chris Feudtner Journal: Ann Thorac Surg Date: 2013-11-05 Impact factor: 4.330
Authors: David W Jantzen; Xia He; Jeffrey P Jacobs; Marshall L Jacobs; Michael G Gaies; Matt Hall; John E Mayer; Samir S Shah; Jennifer Hirsch-Romano; J William Gaynor; Eric D Peterson; Sara K Pasquali Journal: World J Pediatr Congenit Heart Surg Date: 2014-07
Authors: David M Shahian; Sean M O'Brien; Shubin Sheng; Frederick L Grover; John E Mayer; Jeffrey P Jacobs; Jocelyn M Weiss; Elizabeth R Delong; Eric D Peterson; William S Weintraub; Maria V Grau-Sepulveda; Lloyd W Klein; Richard E Shaw; Kirk N Garratt; Issam D Moussa; Cynthia M Shewan; George D Dangas; Fred H Edwards Journal: Circulation Date: 2012-02-23 Impact factor: 29.690
Authors: Laura Mauri; Treacy S Silbaugh; Robert E Wolf; Katya Zelevinsky; Ann Lovett; Zheng Zhou; Frederic S Resnic; Sharon-Lise T Normand Journal: Circulation Date: 2008-10-13 Impact factor: 29.690
Authors: Sara K Pasquali; Amelia S Wallace; J William Gaynor; Marshall L Jacobs; Sean M O'Brien; Kevin D Hill; Michael G Gaies; Jennifer C Romano; David M Shahian; John E Mayer; Jeffrey P Jacobs Journal: Ann Thorac Surg Date: 2016-07-22 Impact factor: 4.330