Craig S Brown1, John R Montgomery2, Gloria Y Kim3, Michael T Kemp4, Nicholas H Osborne3. 1. Section of General Surgery, Department of Surgery, University of Michigan, Ann Arbor, Mich; Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, Mich. Electronic address: brcraig@med.umich.edu. 2. Section of General Surgery, Department of Surgery, University of Michigan, Ann Arbor, Mich; Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, Mich. 3. Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor, Mich; Section of Vascular Surgery, Department of Surgery, University of Michigan, Ann Arbor, Mich. 4. Section of General Surgery, Department of Surgery, University of Michigan, Ann Arbor, Mich.
Abstract
OBJECTIVE: The relationship between volume and surgical outcomes has been shown for a variety of surgical procedures. The effects in abdominal aortic aneurysm repair have continued to be debated. Reliability adjustment has been used as a method to remove statistical noise from hospital-level outcomes. However, its impact on aortic aneurysm repair is not well understood. METHODS: We used prospectively collected data from the Vascular Quality Initiative to identify all patients who had undergone abdominal aortic aneurysm repair from 2003 to 2019. We first calculated the hospital-level risk-adjusted 30-day mortality rates. We subsequently used hierarchical logistic regression modeling to adjust for measurement reliability using empirical Bayes techniques. The effect of volume on risk- and reliability-adjusted mortality rates was then assessed using linear regression. RESULTS: Between 2003 and 2019, 67,073 abdominal aortic aneurysms were repaired, of which 11,601 (17.3%) were repaired with an open approach. The median annual volume was 7.4 (interquartile range, 3.0-13.3) for open repairs and 35.4 (interquartile range, 18.8-59.8) for endovascular repairs. Of the 223 hospitals that had performed open repairs during the study period, only 11 (4.9%) had performed ≥15 open repairs annually, and the risk-adjusted mortality rates varied from 0% to 75% across all centers. After reliability adjustment, the variability of the risk-adjusted mortality rates had decreased significantly to 1.3% to 8.2%. The endovascular repair risk-adjusted mortality rate variability had decreased from 0% to 14.3% to 0.3% to 2.8% after reliability adjustment. A decreasing trend in mortality was found with increasing an annual case volume for open repair with each additional annual case associated with a 0.012% decrease in mortality (P = .05); however, the relationship was not significant for endovascular repair (P = .793). CONCLUSIONS: We found that most hospitals do not perform a sufficient number of annual cases to generate a reliable center-specific mortality rate for open aneurysm repair. Center-specific mortality rates for low-volume centers should be viewed with caution, because a substantial proportion of the variation for these outcomes will be statistical noise rather than true center-level differences in the quality of care.
OBJECTIVE: The relationship between volume and surgical outcomes has been shown for a variety of surgical procedures. The effects in abdominal aortic aneurysm repair have continued to be debated. Reliability adjustment has been used as a method to remove statistical noise from hospital-level outcomes. However, its impact on aortic aneurysm repair is not well understood. METHODS: We used prospectively collected data from the Vascular Quality Initiative to identify all patients who had undergone abdominal aortic aneurysm repair from 2003 to 2019. We first calculated the hospital-level risk-adjusted 30-day mortality rates. We subsequently used hierarchical logistic regression modeling to adjust for measurement reliability using empirical Bayes techniques. The effect of volume on risk- and reliability-adjusted mortality rates was then assessed using linear regression. RESULTS: Between 2003 and 2019, 67,073 abdominal aortic aneurysms were repaired, of which 11,601 (17.3%) were repaired with an open approach. The median annual volume was 7.4 (interquartile range, 3.0-13.3) for open repairs and 35.4 (interquartile range, 18.8-59.8) for endovascular repairs. Of the 223 hospitals that had performed open repairs during the study period, only 11 (4.9%) had performed ≥15 open repairs annually, and the risk-adjusted mortality rates varied from 0% to 75% across all centers. After reliability adjustment, the variability of the risk-adjusted mortality rates had decreased significantly to 1.3% to 8.2%. The endovascular repair risk-adjusted mortality rate variability had decreased from 0% to 14.3% to 0.3% to 2.8% after reliability adjustment. A decreasing trend in mortality was found with increasing an annual case volume for open repair with each additional annual case associated with a 0.012% decrease in mortality (P = .05); however, the relationship was not significant for endovascular repair (P = .793). CONCLUSIONS: We found that most hospitals do not perform a sufficient number of annual cases to generate a reliable center-specific mortality rate for open aneurysm repair. Center-specific mortality rates for low-volume centers should be viewed with caution, because a substantial proportion of the variation for these outcomes will be statistical noise rather than true center-level differences in the quality of care.
Authors: Margaret E Smith; Danielle C Sutzko; Frank M Davis; Jonathan L Eliason; Peter K Henke; Nicholas H Osborne Journal: Ann Vasc Surg Date: 2019-06-14 Impact factor: 1.466
Authors: John D Birkmeyer; Therese A Stukel; Andrea E Siewers; Philip P Goodney; David E Wennberg; F Lee Lucas Journal: N Engl J Med Date: 2003-11-27 Impact factor: 91.245
Authors: Imogen J John; Huay Choo; Christopher J Pettengell; Celia V Riga; Guy F J Martin; Colin D Bicknell Journal: Ann Surg Date: 2021-12-01 Impact factor: 13.787