Brenda M Vincent1, Daniel Molling1, Gabriel J Escobar2, Timothy P Hofer1,3, Theodore J Iwashyna1,3,4, Vincent X Liu2, Amy K Rosen5, Andrew M Ryan6, Sarah Seelye1, Wyndy L Wiitala1, Hallie C Prescott1,3. 1. VA Center for Clinical Management Research, Ann Arbor, MI. 2. Division of Research, Kaiser Permanente Northern California, Oakland, CA. 3. Department of Internal Medicine, University of Michigan. 4. Survey Research Center, Institute for Social Research, Ann Arbor, MI. 5. VA Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, Boston, MA. 6. Department of Health Management and Policy, School of Public Health, University of Michigan, Ann Arbor, MI.
Abstract
BACKGROUND: Hospital-specific template matching is a newer method of hospital performance measurement that may be fairer than regression-based benchmarking. However, it has been tested in only limited research settings. OBJECTIVE: The objective of this study was to test the feasibility of hospital-specific template matching assessments in the Veterans Affairs (VA) health care system and determine power to detect greater-than-expected 30-day mortality. RESEARCH DESIGN: Observational cohort study with hospital-specific template matching assessment. For each VA hospital, the 30-day mortality of a representative subset of hospitalizations was compared with the pooled mortality from matched hospitalizations at a set of comparison VA hospitals treating sufficiently similar patients. The simulation was used to determine power to detect greater-than-expected mortality. SUBJECTS: A total of 556,266 hospitalizations at 122 VA hospitals in 2017. MEASURES: A number of comparison hospitals identified per hospital; 30-day mortality. RESULTS: Each hospital had a median of 38 comparison hospitals (interquartile range: 33, 44) identified, and 116 (95.1%) had at least 20 comparison hospitals. In total, 8 hospitals (6.6%) had a significantly lower 30-day mortality than their benchmark, 5 hospitals (4.1%) had a significantly higher 30-day mortality, and the remaining 109 hospitals (89.3%) were similar to their benchmark. Power to detect a standardized mortality ratio of 2.0 ranged from 72.5% to 79.4% for a hospital with the fewest (6) versus most (64) comparison hospitals. CONCLUSIONS: Hospital-specific template matching may be feasible for assessing hospital performance in the diverse VA health care system, but further refinements are needed to optimize the approach before operational use. Our findings are likely applicable to other large and diverse multihospital systems.
BACKGROUND: Hospital-specific template matching is a newer method of hospital performance measurement that may be fairer than regression-based benchmarking. However, it has been tested in only limited research settings. OBJECTIVE: The objective of this study was to test the feasibility of hospital-specific template matching assessments in the Veterans Affairs (VA) health care system and determine power to detect greater-than-expected 30-day mortality. RESEARCH DESIGN: Observational cohort study with hospital-specific template matching assessment. For each VA hospital, the 30-day mortality of a representative subset of hospitalizations was compared with the pooled mortality from matched hospitalizations at a set of comparison VA hospitals treating sufficiently similar patients. The simulation was used to determine power to detect greater-than-expected mortality. SUBJECTS: A total of 556,266 hospitalizations at 122 VA hospitals in 2017. MEASURES: A number of comparison hospitals identified per hospital; 30-day mortality. RESULTS: Each hospital had a median of 38 comparison hospitals (interquartile range: 33, 44) identified, and 116 (95.1%) had at least 20 comparison hospitals. In total, 8 hospitals (6.6%) had a significantly lower 30-day mortality than their benchmark, 5 hospitals (4.1%) had a significantly higher 30-day mortality, and the remaining 109 hospitals (89.3%) were similar to their benchmark. Power to detect a standardized mortality ratio of 2.0 ranged from 72.5% to 79.4% for a hospital with the fewest (6) versus most (64) comparison hospitals. CONCLUSIONS: Hospital-specific template matching may be feasible for assessing hospital performance in the diverse VA health care system, but further refinements are needed to optimize the approach before operational use. Our findings are likely applicable to other large and diverse multihospital systems.
Authors: Marta L Render; James Deddens; Ron Freyberg; Peter Almenoff; Alfred F Connors; Douglas Wagner; Timothy P Hofer Journal: Crit Care Med Date: 2008-04 Impact factor: 7.598
Authors: S F Khuri; J Daley; W Henderson; K Hur; J Demakis; J B Aust; V Chong; P J Fabri; J O Gibbs; F Grover; K Hammermeister; G Irvin; G McDonald; E Passaro; L Phillips; F Scamman; J Spencer; J F Stremple Journal: Ann Surg Date: 1998-10 Impact factor: 12.969
Authors: Jeffrey H Silber; Paul R Rosenbaum; Richard N Ross; Justin M Ludwig; Wei Wang; Bijan A Niknam; Alexander S Hill; Orit Even-Shoshan; Rachel R Kelz; Lee A Fleisher Journal: Health Serv Res Date: 2016-02-29 Impact factor: 3.402
Authors: Jeffrey H Silber; Paul R Rosenbaum; Richard N Ross; Justin M Ludwig; Wei Wang; Bijan A Niknam; Nabanita Mukherjee; Philip A Saynisch; Orit Even-Shoshan; Rachel R Kelz; Lee A Fleisher Journal: Health Serv Res Date: 2014-03-03 Impact factor: 3.402
Authors: Jeffrey H Silber; Paul R Rosenbaum; Richard N Ross; Justin M Ludwig; Wei Wang; Bijan A Niknam; Philip A Saynisch; Orit Even-Shoshan; Rachel R Kelz; Lee A Fleisher Journal: Health Serv Res Date: 2014-09-08 Impact factor: 3.402
Authors: Matthew R Baldwin; Wazim R Narain; Hannah Wunsch; Neil W Schluger; Joseph T Cooke; Mathew S Maurer; John W Rowe; David J Lederer; Peter B Bach Journal: Chest Date: 2013-04 Impact factor: 9.410
Authors: Brenda M Vincent; Wyndy L Wiitala; Kaitlyn A Luginbill; Daniel J Molling; Timothy P Hofer; Andrew M Ryan; Hallie C Prescott Journal: Medicine (Baltimore) Date: 2019-05 Impact factor: 1.817
Authors: Brenda M McGrath; Linda Takamine; Cainnear K Hogan; Timothy P Hofer; Amy K Rosen; Jeremy B Sussman; Wyndy L Wiitala; Andrew M Ryan; Hallie C Prescott Journal: BMC Health Serv Res Date: 2022-06-03 Impact factor: 2.908