OBJECTIVE: To describe the Neonatal Research Network's efforts to improve the certification process for the Follow-Up Study neurologic exam and to evaluate inter-rater agreement before and after two annual training workshops. STUDY DESIGN: The Neonatal Research Network Follow-Up Study is a multi-center observational study that has examined more than 11 500 infants from 1998-2010 and born ≤26 weeks gestational age at 18-22 months corrected age for neurodevelopmental outcome. The percentages of examiners who agreed with the Gold Standard examiner on 4 neurodevelopmental outcomes on the initial training video and a test video were calculated. Consistency among examiners was assessed with the first-order agreement coefficient statistic. RESULTS: Improvements in agreement among examiners occurred between 2009 and 2010 and between initial training and test. Examiner agreement with the Gold Standard during the initial training was 83%-91% in 2009 and 89%-99% in 2010. Examiner agreement on the workshop test video increased from 2009-2010 with agreement reaching 100% for all four neurodevelopmental outcomes examined in 2010. First-order agreement coefficient values for the four neurodevelopmental outcomes on the training videos ranged from 0.64-0.82 in 2009 and 0.77-0.97 in 2010. CONCLUSIONS: We demonstrate the importance of annual certification and the benefits of evaluation and revision of certification protocols to achieve high levels of confidence in neurodevelopmental study outcomes for multi-center networks.
OBJECTIVE: To describe the Neonatal Research Network's efforts to improve the certification process for the Follow-Up Study neurologic exam and to evaluate inter-rater agreement before and after two annual training workshops. STUDY DESIGN: The Neonatal Research Network Follow-Up Study is a multi-center observational study that has examined more than 11 500 infants from 1998-2010 and born ≤26 weeks gestational age at 18-22 months corrected age for neurodevelopmental outcome. The percentages of examiners who agreed with the Gold Standard examiner on 4 neurodevelopmental outcomes on the initial training video and a test video were calculated. Consistency among examiners was assessed with the first-order agreement coefficient statistic. RESULTS: Improvements in agreement among examiners occurred between 2009 and 2010 and between initial training and test. Examiner agreement with the Gold Standard during the initial training was 83%-91% in 2009 and 89%-99% in 2010. Examiner agreement on the workshop test video increased from 2009-2010 with agreement reaching 100% for all four neurodevelopmental outcomes examined in 2010. First-order agreement coefficient values for the four neurodevelopmental outcomes on the training videos ranged from 0.64-0.82 in 2009 and 0.77-0.97 in 2010. CONCLUSIONS: We demonstrate the importance of annual certification and the benefits of evaluation and revision of certification protocols to achieve high levels of confidence in neurodevelopmental study outcomes for multi-center networks.
Authors: David A Cook; Denise M Dupras; Thomas J Beckman; Kris G Thomas; V Shane Pankratz Journal: J Gen Intern Med Date: 2008-11-11 Impact factor: 5.128
Authors: Athina Pappas; Ira Adams-Chapman; Seetha Shankaran; Scott A McDonald; Barbara J Stoll; Abbot R Laptook; Waldemar A Carlo; Krisa P Van Meurs; Susan R Hintz; Martha D Carlson; Jane E Brumbaugh; Michele C Walsh; Myra H Wyckoff; Abhik Das; Rosemary D Higgins Journal: JAMA Pediatr Date: 2018-01-01 Impact factor: 16.193
Authors: Ira Adams-Chapman; Roy J Heyne; Sara B DeMauro; Andrea F Duncan; Susan R Hintz; Athina Pappas; Betty R Vohr; Scott A McDonald; Abhik Das; Jamie E Newman; Rosemary D Higgins Journal: Pediatrics Date: 2018-04-17 Impact factor: 7.124
Authors: Stephanie L Merhar; Elveda Gozdas; Jean A Tkach; Nehal A Parikh; Beth M Kline-Fath; Lili He; Weihong Yuan; Mekibib Altaye; James L Leach; Scott K Holland Journal: Am J Perinatol Date: 2019-03-27 Impact factor: 1.862
Authors: Myriam Peralta-Carcelen; Waldemar A Carlo; Athina Pappas; Yvonne E Vaucher; Keith Owen Yeates; Vivien A Phillips; Kathryn E Gustafson; Allison H Payne; Andrea F Duncan; Jamie E Newman; Carla M Bann Journal: Pediatrics Date: 2017-06 Impact factor: 7.124
Authors: Abbot R Laptook; Seetha Shankaran; Jon E Tyson; Breda Munoz; Edward F Bell; Ronald N Goldberg; Nehal A Parikh; Namasivayam Ambalavanan; Claudia Pedroza; Athina Pappas; Abhik Das; Aasma S Chaudhary; Richard A Ehrenkranz; Angelita M Hensman; Krisa P Van Meurs; Lina F Chalak; Amir M Khan; Shannon E G Hamrick; Gregory M Sokol; Michele C Walsh; Brenda B Poindexter; Roger G Faix; Kristi L Watterberg; Ivan D Frantz; Ronnie Guillet; Uday Devaskar; William E Truog; Valerie Y Chock; Myra H Wyckoff; Elisabeth C McGowan; David P Carlton; Heidi M Harmon; Jane E Brumbaugh; C Michael Cotten; Pablo J Sánchez; Anna Maria Hibbs; Rosemary D Higgins Journal: JAMA Date: 2017-10-24 Impact factor: 56.272
Authors: Elisabeth C McGowan; Abbot R Laptook; Jean Lowe; Myriam Peralta-Carcelen; Dhuly Chowdhury; Rosemary D Higgins; Susan R Hintz; Betty R Vohr Journal: J Pediatr Date: 2019-09-06 Impact factor: 4.406
Authors: Athina Pappas; Douglas E Kendrick; Seetha Shankaran; Barbara J Stoll; Edward F Bell; Abbott R Laptook; Michele C Walsh; Abhik Das; Ellen C Hale; Nancy S Newman; Rosemary D Higgins Journal: JAMA Pediatr Date: 2014-02 Impact factor: 16.193