Lindsay Johnston1, Taylor Sawyer2, Akira Nishisaki3, Travis Whitfill4, Anne Ades5, Heather French5, Kristen Glass6, Rita Dadiz7, Christie Bruno4, Orly Levit4, Sandeep Gangadharan8, Daniel Scherzer9, Ahmed Moussa10, Marc Auerbach4. 1. Department of Pediatrics (L Johnston,T Whitfill, C Bruno,O Levit, and M Auerbach), Yale University School of Medicine, New Haven, Conn. Electronic address: Lindsay.johnston@yale.edu. 2. Department of Pediatrics (T Sawyer), University of Washington School of Medicine, Seattle. 3. Departments of Anesthesiology and Critical Care Medicine (A Nishisaki); Departments of Pediatrics (A Nishisaki, A Ades, and H French), University of Pennsylvania Perelman School of Medicine, Philadelphia. 4. Department of Pediatrics (L Johnston,T Whitfill, C Bruno,O Levit, and M Auerbach), Yale University School of Medicine, New Haven, Conn. 5. Departments of Pediatrics (A Nishisaki, A Ades, and H French), University of Pennsylvania Perelman School of Medicine, Philadelphia. 6. Department of Pediatrics (K Glass), Penn State College of Medicine, Hershey, Pa. 7. Department of Pediatrics (R Dadiz), University of Rochester School of Medicine and Dentistry, Rochester, NY. 8. Department of Pediatrics (S Gangadharan), Cohen Children's Medical Center-Northwell Health/Hofstra University, New Hyde Park, NY. 9. Division of Emergency Medicine (D Scherzer), Nationwide Children's Hospital, Columbus, Ohio. 10. Department of Pediatrics (A Moussa), CHU Sainte-Justine, University of Montreal, Canada.
Abstract
BACKGROUND: Neonatal tracheal intubation (NTI) is an important clinical skill. Suboptimal performance is associated with patient harm. Simulation training can improve NTI performance. Improving performance requires an objective assessment of competency. Competency assessment tools need strong evidence of validity. We hypothesized that an NTI competency assessment tool with multisource validity evidence could be developed and be used for formative and summative assessment during simulation-based training. METHODS: An NTI assessment tool was developed based on a literature review. The tool was refined through 2 rounds of a modified Delphi process involving 12 subject-matter experts. The final tool included a 22-item checklist, a global skills assessment, and an entrustable professional activity (EPA) level. The validity of the checklist was assessed by having 4 blinded reviewers score 23 videos of health care providers intubating a neonatal simulator. RESULTS: The checklist items had good internal consistency (overall α = 0.79). Checklist scores were greater for providers at greater training levels and with more NTI experience. Checklist scores correlated with global skills assessment (ρ = 0.85; P < .05), EPA levels (ρ = 0.87; P < .05), percent glottic exposure (r = 0.59; P < .05), and Cormack-Lehane scores (ρ = 0.95; P < .05). Checklist scores reliably predicted EPA levels. CONCLUSIONS: We developed an NTI competency assessment tool with multisource validity evidence. The tool was able to discriminate NTI performance based on experience. The tool can be used during simulation-based NTI training to provide formative and summative assessment and can aid with entrustment decisions.
BACKGROUND: Neonatal tracheal intubation (NTI) is an important clinical skill. Suboptimal performance is associated with patient harm. Simulation training can improve NTI performance. Improving performance requires an objective assessment of competency. Competency assessment tools need strong evidence of validity. We hypothesized that an NTI competency assessment tool with multisource validity evidence could be developed and be used for formative and summative assessment during simulation-based training. METHODS: An NTI assessment tool was developed based on a literature review. The tool was refined through 2 rounds of a modified Delphi process involving 12 subject-matter experts. The final tool included a 22-item checklist, a global skills assessment, and an entrustable professional activity (EPA) level. The validity of the checklist was assessed by having 4 blinded reviewers score 23 videos of health care providers intubating a neonatal simulator. RESULTS: The checklist items had good internal consistency (overall α = 0.79). Checklist scores were greater for providers at greater training levels and with more NTI experience. Checklist scores correlated with global skills assessment (ρ = 0.85; P < .05), EPA levels (ρ = 0.87; P < .05), percent glottic exposure (r = 0.59; P < .05), and Cormack-Lehane scores (ρ = 0.95; P < .05). Checklist scores reliably predicted EPA levels. CONCLUSIONS: We developed an NTI competency assessment tool with multisource validity evidence. The tool was able to discriminate NTI performance based on experience. The tool can be used during simulation-based NTI training to provide formative and summative assessment and can aid with entrustment decisions.
Authors: Lindsay Johnston; Taylor Sawyer; Anne Ades; Ahmed Moussa; Jeanne Zenge; Philipp Jung; Stephen DeMeo; Kristen Glass; Neetu Singh; Alexandra Howlett; Justine Shults; James Barry; Brianna Brei; Elizabeth Foglia; Akira Nishisaki Journal: Neonatology Date: 2021-06-10 Impact factor: 5.106
Authors: Mohammad A A Bayoumi; Einas E Elmalik; Hossamaldein Ali; Sunitha D'Souza; Jojo Furigay; Ava Romo; Sunitha Shyam; Rajvir Singh; Olfa Koobar; Jihad Al Shouli; Matheus van Rens; Fouad F Abounahia; Ashraf Gad; Mostafa Elbaba; Samawal Lutfi Journal: Front Pediatr Date: 2022-03-21 Impact factor: 3.418
Authors: Justin M Jeffers; William Golden; Amit K Pahwa; Stacy Cooper; David Cooke; Rebekah Reisig; Christopher Grybauskas; Eric Balighian; Emily Frosch; John H Shatzer Journal: Cureus Date: 2020-04-28