Matthew P Kirschen1,2,3, Megan Snyder4, Katherine Smith4, Kristen Lourie4, Kenya Agarwal4, Pamela DiDonato4, Ashlee Doll4, Bingqing Zhang1, Janell Mensinger5, Rebecca Ichord2,3, Judy A Shea6, Robert A Berg1,3, Vinay Nadkarni1,3, Alexis Topjian1,3. 1. Department of Anesthesiology and Critical Care Medicine, Children's Hospital of Philadelphia, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA. 2. Department of Neurology, Children's Hospital of Philadelphia, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA. 3. Department of Pediatrics, Children's Hospital of Philadelphia, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA. 4. Department of Nursing and Clinical Care Services, Children's Hospital of Philadelphia, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA. 5. Department of Epidemiology and Biostatistics, Dornsife School of Public Health, Drexel University, Philadelphia, PA. 6. Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA.
Abstract
OBJECTIVES: Estimate the inter-rater reliability of critical care nurses performing a pediatric modification of the Glasgow Coma Scale in a contemporary PICU. DESIGN: Prospective observation study. SETTING: Large academic PICU. PATIENTS/ SUBJECTS: All 274 nurses with permanent assignments in the PICU were eligible to participate. A subset of 18 nurses were selected as study registered nurses. All PICU patients were eligible to participate. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: PICU nurses were educated and demonstrated proficiency on a pediatric modification of the Glasgow Coma Scale we created to make it more applicable to a diverse PICU population that included patients who are sedated, mechanically ventilated, and/or have developmental disabilities. Each study registered nurse observed a sample of nurses perform the Glasgow Coma Scale, and they independently scored the Glasgow Coma Scale. Patients were categorized as having developmental disabilities if their preillness Pediatric Cerebral Performance Category score was greater than or equal to 3. Fleiss' Kappa (κ), intraclass correlation coefficient, and percent agreement assessed inter-rater reliability for each Glasgow Coma Scale component (eye, verbal, motor) and age-specific scale (≥ 2 and < 2-yr-old). The overall percent agreement between study registered nurses and nurses was 89% for the eye, 91% for the verbal, and 79% for the motor responses. Inter-rater reliability ranged from good (intraclass correlation coefficient = 0.75) to excellent (intraclass correlation coefficient = 0.96) for testable patients. Agreement on the motor response was significantly lower for children with developmental disabilities (< 2 yr: 59% vs 95%; p = 0.0012 and ≥ 2 yr: 55% vs 91%; p = 0.0012). Agreement was significantly worse for intermediate range Glasgow Coma Scale motor responses compared with responses at the extremes (e.g., motor responses 2, 3, 4 vs 1, 5, 6; p < 0.05). CONCLUSIONS: A pediatric modification of the Glasgow Coma Scale performed by trained PICU nurses has excellent inter-rater reliability, although reliability was reduced in patients with developmental disabilities and for intermediate range Glasgow Coma Scale responses. Further research is needed to determine the effectiveness of this Glasgow Coma Scale modification to detect clinical deterioration.
OBJECTIVES: Estimate the inter-rater reliability of critical care nurses performing a pediatric modification of the Glasgow Coma Scale in a contemporary PICU. DESIGN: Prospective observation study. SETTING: Large academic PICU. PATIENTS/ SUBJECTS: All 274 nurses with permanent assignments in the PICU were eligible to participate. A subset of 18 nurses were selected as study registered nurses. All PICU patients were eligible to participate. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: PICU nurses were educated and demonstrated proficiency on a pediatric modification of the Glasgow Coma Scale we created to make it more applicable to a diverse PICU population that included patients who are sedated, mechanically ventilated, and/or have developmental disabilities. Each study registered nurse observed a sample of nurses perform the Glasgow Coma Scale, and they independently scored the Glasgow Coma Scale. Patients were categorized as having developmental disabilities if their preillness Pediatric Cerebral Performance Category score was greater than or equal to 3. Fleiss' Kappa (κ), intraclass correlation coefficient, and percent agreement assessed inter-rater reliability for each Glasgow Coma Scale component (eye, verbal, motor) and age-specific scale (≥ 2 and < 2-yr-old). The overall percent agreement between study registered nurses and nurses was 89% for the eye, 91% for the verbal, and 79% for the motor responses. Inter-rater reliability ranged from good (intraclass correlation coefficient = 0.75) to excellent (intraclass correlation coefficient = 0.96) for testable patients. Agreement on the motor response was significantly lower for children with developmental disabilities (< 2 yr: 59% vs 95%; p = 0.0012 and ≥ 2 yr: 55% vs 91%; p = 0.0012). Agreement was significantly worse for intermediate range Glasgow Coma Scale motor responses compared with responses at the extremes (e.g., motor responses 2, 3, 4 vs 1, 5, 6; p < 0.05). CONCLUSIONS: A pediatric modification of the Glasgow Coma Scale performed by trained PICU nurses has excellent inter-rater reliability, although reliability was reduced in patients with developmental disabilities and for intermediate range Glasgow Coma Scale responses. Further research is needed to determine the effectiveness of this Glasgow Coma Scale modification to detect clinical deterioration.
Authors: Kate L Brown; Shruti Agrawal; Matthew P Kirschen; Chani Traube; Alexis Topjian; Ronit Pressler; Cecil D Hahn; Barnaby R Scholefield; Hari Krishnan Kanthimathinathan; Aparna Hoskote; Felice D'Arco; Melania Bembea; Joseph C Manning; Maayke Hunfeld; Corinne Buysse; Robert C Tasker Journal: Intensive Care Med Date: 2022-04-21 Impact factor: 17.440
Authors: Alicia M Alcamo; Scott L Weiss; Julie C Fitzgerald; Matthew P Kirschen; Laura L Loftis; Swee Fong Tang; Neal J Thomas; Vinay M Nadkarni; Sholeen T Nett Journal: Pediatr Crit Care Med Date: 2022-05-03 Impact factor: 3.971