Arjun Venkatesh1, Shashank Ravi2, Craig Rothenberg2, Jeremiah Kinsman2, Jean Sun2, Pawan Goyal3, James Augustine4, Stephen K Epstein5. 1. Department of Emergency Medicine, Yale University School of Medicine, New Haven, CT; Department of Emergency Medicine, Yale New Haven Health System, New Haven, CT. Electronic address: arjun.venkatesh@yale.edu. 2. Department of Emergency Medicine, Yale University School of Medicine, New Haven, CT. 3. American College of Emergency Physicians, Washington, DC. 4. National Clinical Governance Board, US Acute Care Solutions, Canton, OH. 5. Department of Emergency Medicine, Harvard Medical School, Boston, MA; Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, MA.
Abstract
STUDY OBJECTIVE: The measurement of emergency department (ED) throughput as a patient-centered quality measure is ubiquitous; however, marked heterogeneity exists between EDs, complicating comparisons for payment purposes. We evaluate 4 scoring methodologies for accommodating differences in ED visit volume and heterogeneity among ED groups that staff multiple EDs to improve the validity and "fairness" of ED throughput quality measurement in a national registry, with the goal of developing a volume-adjusted throughput measure that balances variation at the ED group level. METHODS: We conducted an ED group-level analysis using the 2017 American College of Emergency Physicians Clinical Emergency Data Registry data set, which included 548 ED groups inclusive of 889 unique EDs. We calculated ED throughput performance scores for each ED group by using 4 scoring approaches: plurality, simple average, weighted average, and a weighted standardized score. For comparison, ED groups (ie, taxpayer identification numbers) were grouped into 3 types: taxpayer identification numbers with only 1 ED; those with multiple EDs, but no ED with greater than 60,000 visits; and those with multiple EDs and at least 1 ED with greater than 60,000 visits. RESULTS: We found marked differences in the classification of ED throughput performance between scoring approaches. The weighted standardized score (z score) approach resulted in the least skewed and most uniform distribution across the majority of ED types, with a kurtosis of 12.91 for taxpayer identification numbers composed of 1 ED, 2.58 for those with multiple EDs without any supercenter, and 3.56 for those with multiple EDs with at least 1 supercenter, all lower than comparable scoring methods. The plurality and simple average scoring approaches appeared to disproportionally penalize ED groups that staff a single ED or multiple large-volume EDs. CONCLUSION: Application of a weighted standardized (z score) approach to ED throughput measurement resulted in a more balanced variation between different ED group types and reduced distortions in the length-of-stay measurement among ED groups staffing high-volume EDs. This approach may be a more accurate and acceptable method of profiling ED group throughput pay-for-performance programs.
STUDY OBJECTIVE: The measurement of emergency department (ED) throughput as a patient-centered quality measure is ubiquitous; however, marked heterogeneity exists between EDs, complicating comparisons for payment purposes. We evaluate 4 scoring methodologies for accommodating differences in ED visit volume and heterogeneity among ED groups that staff multiple EDs to improve the validity and "fairness" of ED throughput quality measurement in a national registry, with the goal of developing a volume-adjusted throughput measure that balances variation at the ED group level. METHODS: We conducted an ED group-level analysis using the 2017 American College of Emergency Physicians Clinical Emergency Data Registry data set, which included 548 ED groups inclusive of 889 unique EDs. We calculated ED throughput performance scores for each ED group by using 4 scoring approaches: plurality, simple average, weighted average, and a weighted standardized score. For comparison, ED groups (ie, taxpayer identification numbers) were grouped into 3 types: taxpayer identification numbers with only 1 ED; those with multiple EDs, but no ED with greater than 60,000 visits; and those with multiple EDs and at least 1 ED with greater than 60,000 visits. RESULTS: We found marked differences in the classification of ED throughput performance between scoring approaches. The weighted standardized score (z score) approach resulted in the least skewed and most uniform distribution across the majority of ED types, with a kurtosis of 12.91 for taxpayer identification numbers composed of 1 ED, 2.58 for those with multiple EDs without any supercenter, and 3.56 for those with multiple EDs with at least 1 supercenter, all lower than comparable scoring methods. The plurality and simple average scoring approaches appeared to disproportionally penalize ED groups that staff a single ED or multiple large-volume EDs. CONCLUSION: Application of a weighted standardized (z score) approach to ED throughput measurement resulted in a more balanced variation between different ED group types and reduced distortions in the length-of-stay measurement among ED groups staffing high-volume EDs. This approach may be a more accurate and acceptable method of profiling ED group throughput pay-for-performance programs.
Authors: Daniel A Handel; Rongwei Fu; Eugene Vu; James J Augustine; Renee Y Hsia; Charles M Shufflebarger; Benjamin Sun Journal: J Emerg Med Date: 2014-01-22 Impact factor: 1.484
Authors: Maame Y A B Yiadom; Anthony Napoli; Michael Granovsky; Rebecca B Parker; Randy Pilgrim; Jesse M Pines; Jeremiah Schuur; James Augustine; Nicholas Jouriles; Shari Welch Journal: Acad Emerg Med Date: 2020-05-08 Impact factor: 3.451
Authors: David F Gaieski; J Matthew Edwards; Michael J Kallan; Mark E Mikkelsen; Munish Goyal; Brendan G Carr Journal: Am J Respir Crit Care Med Date: 2014-09-15 Impact factor: 21.405
Authors: Benjamin C Sun; Amber Laurie; Lela Prewitt; Rongwei Fu; Anna M Chang; James Augustine; Charles Reese; K John McConnell Journal: Ann Emerg Med Date: 2015-06-24 Impact factor: 5.721
Authors: Jennifer L Wiler; Michael Granovsky; Stephen V Cantrill; Richard Newell; Arjun K Venkatesh; Jeremiah D Schuur Journal: West J Emerg Med Date: 2016-03-02