Deena Kelly Costa1, Courtney Colonna Kuza2, Jeremy M Kahn3. 1. Department of Systems, Populations and Leadership, University of Michigan School of Nursing, Ann Arbor, MI, USA. 2. Clinical Research, Investigation and Systems Modeling of Acute Illness (CRISMA) Center, Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA. 3. Clinical Research, Investigation and Systems Modeling of Acute Illness (CRISMA) Center, Department of Critical Care Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA Department of Health Policy and Management, University of Pittsburgh Graduate School of Public Health, Pittsburgh, PA, USA.
Abstract
OBJECTIVE: Surveys are often used to assess intensive care unit (ICU) organizational characteristics for quality improvement. Typically these surveys target ICU nurse managers and/or physician directors. However, it is unclear whether these providers' assessments differ. We sought to determine whether differences existed in nurse- and physician-assessed ICU characteristics using a standardized survey. DESIGN: We administered a previously developed survey to nurse managers and medical directors in adult ICUs within a single healthcare system in 2013. The survey asked about interprofessional staffing and evidence-based protocols. We examined differences between nurse managers' and medical directors' responses using McNemar's test and assessed concordance using the kappa statistic. SETTING: Twenty-three ICUs in 10 hospitals in Southwestern Pennsylvania. RESULTS: Sixteen (69%) were specialty ICUs. The median number of ICU beds was 34. Concordance was moderate for high- vs. low-intensity physician staffing (κ = 0.60) and almost perfect on questions related to interprofessional staffing (κ = 0.83 nurse practitioners/physician assistants; 1.0 respiratory therapists; 0.83 physical therapists). However, concordance was slight to fair with regard to the presence of these providers on rounds (κ = 0.20-0.21) and poor to slight for protocols for liberation from mechanical ventilation (κ = 0.19), sedation (κ = -0.03) and central line insertion (κ = -0.03). CONCLUSIONS: Despite a standardized survey, we found substantial disagreement on ICU characteristics when assessed by the nurse manager or physician director. This study raises questions about the use of surveys to examine ICU organizational characteristics and suggests that differences in nurse managers' and medical directors' assessments could be helpful in guiding future ICU quality improvement projects.
OBJECTIVE: Surveys are often used to assess intensive care unit (ICU) organizational characteristics for quality improvement. Typically these surveys target ICU nurse managers and/or physician directors. However, it is unclear whether these providers' assessments differ. We sought to determine whether differences existed in nurse- and physician-assessed ICU characteristics using a standardized survey. DESIGN: We administered a previously developed survey to nurse managers and medical directors in adult ICUs within a single healthcare system in 2013. The survey asked about interprofessional staffing and evidence-based protocols. We examined differences between nurse managers' and medical directors' responses using McNemar's test and assessed concordance using the kappa statistic. SETTING: Twenty-three ICUs in 10 hospitals in Southwestern Pennsylvania. RESULTS: Sixteen (69%) were specialty ICUs. The median number of ICU beds was 34. Concordance was moderate for high- vs. low-intensity physician staffing (κ = 0.60) and almost perfect on questions related to interprofessional staffing (κ = 0.83 nurse practitioners/physician assistants; 1.0 respiratory therapists; 0.83 physical therapists). However, concordance was slight to fair with regard to the presence of these providers on rounds (κ = 0.20-0.21) and poor to slight for protocols for liberation from mechanical ventilation (κ = 0.19), sedation (κ = -0.03) and central line insertion (κ = -0.03). CONCLUSIONS: Despite a standardized survey, we found substantial disagreement on ICU characteristics when assessed by the nurse manager or physician director. This study raises questions about the use of surveys to examine ICU organizational characteristics and suggests that differences in nurse managers' and medical directors' assessments could be helpful in guiding future ICU quality improvement projects.
Authors: Curtis H Weiss; Farzad Moazed; Colleen A McEvoy; Benjamin D Singer; Igal Szleifer; Luís A N Amaral; Mary Kwasny; Charles M Watts; Stephen D Persell; David W Baker; Jacob I Sznajder; Richard G Wunderink Journal: Am J Respir Crit Care Med Date: 2011-05-26 Impact factor: 21.405
Authors: John W Devlin; Jeffrey J Fong; Greg Schumaker; Heidi O'Connor; Robin Ruthazer; Erik Garpestad Journal: Crit Care Med Date: 2007-12 Impact factor: 7.598
Authors: Sangeeta Mehta; Lisa Burry; Deborah Cook; Dean Fergusson; Marilyn Steinberg; John Granton; Margaret Herridge; Niall Ferguson; John Devlin; Maged Tanios; Peter Dodek; Robert Fowler; Karen Burns; Michael Jacka; Kendiss Olafson; Yoanna Skrobik; Paul Hébert; Elham Sabri; Maureen Meade Journal: JAMA Date: 2012-11-21 Impact factor: 56.272
Authors: Rachel Kohn; Vanessa Madden; Jeremy M Kahn; David A Asch; Amber E Barnato; Scott D Halpern; Meeta Prasad Kerlin Journal: Ann Am Thorac Soc Date: 2017-02
Authors: Juliana Barr; Amir A Ghaferi; Deena Kelly Costa; Haley K Hedlin; Victoria Y Ding; Corine Ross; Brenda T Pun; Sam R Watson; Steven M Asch Journal: Crit Care Explor Date: 2020-08-19
Authors: Sebastian Blecha; Susanne Brandstetter; Frank Dodoo-Schittko; Magdalena Brandl; Bernhard M Graf; Thomas Bein; Christian Apfelbacher Journal: BMJ Open Date: 2018-09-24 Impact factor: 2.692