Bhavesh Mehta1,2, Nadine Griffiths1, Kaye Spence1, Sharon Laing3. 1. Grace Centre for Newborn Care, Children's Hospital at Westmead, Sydney, New South Wales, Australia. 2. Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia. 3. School of Social Sciences and Psychology, Western Sydney University, Sydney, New South Wales, Australia.
Abstract
AIM: Amplitude-integrated electroencephalogram (aEEG) is widely used in neonates to detect electrical seizure and predict outcome following hypoxic ischaemic encephalopathy and other encephalopathy. Because accurate interpretation is important for clinical decision-making and family counselling, inter-observer reliability is a major concern. We aimed to evaluate inter-observer reliability in the interpretation of aEEG tracings in a neonatal intensive care unit. METHODS: Three neonatal intensive care unit clinicians with different levels of experience in reading aEEG independently reviewed and scored aEEG traces using standardised criteria, categories and interpretation rules. Inter-observer reliability was evaluated using weighted Cohen's κ and intra-class correlation coefficients. RESULTS: All 131 tracings from 120 neonates were reviewed by the neontalogist, 128 (97.7%) by the clinical nurse specialist, 73 (55.7%) by the nurse educator and 70 (53.4%) by all three clinicians. The majority (88 of 120, 73.3%) were term infants (mean gestational age 38 weeks, standard deviation 3.2). Average duration of recording was 27 h (standard deviation 19.1, range 1-105 h). Inter-observer reliability varied across categories and observers - from very good to excellent for the main background activity (intra-class correlation coefficients 0.93-0.98); good to very good for seizures; and moderate to very good for sleep-wake cycle and quality of recording (weighted κs' 0.71-0.85, 0.50-0.75, 0.46-0.81, respectively). CONCLUSION: While certain aEEG features appear challenging to inter-observer reliability, our findings suggest that with training and consensus guidelines, levels of reliability needed to enhance clinical and prognostic usefulness of aEEG are achievable across clinicians with different levels of experience in reading aEEG.
AIM: Amplitude-integrated electroencephalogram (aEEG) is widely used in neonates to detect electrical seizure and predict outcome following hypoxic ischaemic encephalopathy and other encephalopathy. Because accurate interpretation is important for clinical decision-making and family counselling, inter-observer reliability is a major concern. We aimed to evaluate inter-observer reliability in the interpretation of aEEG tracings in a neonatal intensive care unit. METHODS: Three neonatal intensive care unit clinicians with different levels of experience in reading aEEG independently reviewed and scored aEEG traces using standardised criteria, categories and interpretation rules. Inter-observer reliability was evaluated using weighted Cohen's κ and intra-class correlation coefficients. RESULTS: All 131 tracings from 120 neonates were reviewed by the neontalogist, 128 (97.7%) by the clinical nurse specialist, 73 (55.7%) by the nurse educator and 70 (53.4%) by all three clinicians. The majority (88 of 120, 73.3%) were term infants (mean gestational age 38 weeks, standard deviation 3.2). Average duration of recording was 27 h (standard deviation 19.1, range 1-105 h). Inter-observer reliability varied across categories and observers - from very good to excellent for the main background activity (intra-class correlation coefficients 0.93-0.98); good to very good for seizures; and moderate to very good for sleep-wake cycle and quality of recording (weighted κs' 0.71-0.85, 0.50-0.75, 0.46-0.81, respectively). CONCLUSION: While certain aEEG features appear challenging to inter-observer reliability, our findings suggest that with training and consensus guidelines, levels of reliability needed to enhance clinical and prognostic usefulness of aEEG are achievable across clinicians with different levels of experience in reading aEEG.
Authors: Ipsita Goswami; Panadda Chansarn; Jose Aldana Aguirre; Floura Taher; Diane Wilson; Cecil Hahn; Amr ElShahed; Kyong-Soon Lee Journal: Pediatr Qual Saf Date: 2021-08-26