Kiyetta H Alade1, Jennifer R Marin2, Erika Constantine3, Atim Ekpenyong4, Susan E Farrell5, Russ Horowitz6, Deborah Hsu1, Charisse W Kwan7, Lorraine Ng8, Perry J Leonard1, Resa E Lewiss9. 1. Baylor College of Medicine Houston Texas USA. 2. UPMC Children's Hospital of Pittsburgh Pittsburgh Pennsylvania USA. 3. Alpert Medical School of Brown University Providence Rhode Island USA. 4. University of California-San Diego San Diego California USA. 5. Harvard Medical School Boston Massachusetts USA. 6. Northwestern School of Medicine Chicago Illinois USA. 7. Children's Hospital London Health Sciences Centre London Ontario Canada. 8. Columbia University Irving Medical Center New York New York USA. 9. Thomas Jefferson University Philadelphia Pennsylvania USA.
Abstract
BACKGROUND AND OBJECTIVES: Measuring pediatric emergency medicine (PEM) fellow competency in point-of-care ultrasound (POCUS) is important for ensuring adequate training and performance. Assessment may include direct observation, image review, quality assessment, and written examination. The purpose of this study was to develop a pediatric POCUS question bank that could subsequently be used as a POCUS assessment for graduating PEM fellows. METHODS: We organized a 10-person question writing group (QWG). Eight hold expertise in POCUS and two hold expertise in medical education. Members of the QWG created questions within four domains: interpretation/diagnosis (50% of questions), anatomy (30%), physics (10%), and pitfalls (10%). POCUS faculty ascertained content validity and the medical education faculty revised questions for syntax and readability. In 2016, we recruited 31 pediatric POCUS experts. The majority were members of the P2 Network, an international group of experts and leaders in PEM POCUS, to participate in three iterative rounds of a modified Delphi process to review, revise, and establish consensus on the question bank. RESULTS: Thirty-one pediatric POCUS experts participated in the three rounds of the modified Delphi process and evaluated 437 questions developed by the expert panel. Forty-nine percent (n = 216) of the questions were accepted in round 1, 30% (n = 130) in round 2, and 11% (n = 47) in the final round. The final question bank included 393 questions covering 17 pediatric POCUS applications. CONCLUSION: We developed a 393-question bank to aid in the assessment of PEM POCUS competency. Future work includes piloting the questions with PEM fellows to evaluate the response process and implementing the assessment tool to establish a minimum passing score.
BACKGROUND AND OBJECTIVES: Measuring pediatric emergency medicine (PEM) fellow competency in point-of-care ultrasound (POCUS) is important for ensuring adequate training and performance. Assessment may include direct observation, image review, quality assessment, and written examination. The purpose of this study was to develop a pediatric POCUS question bank that could subsequently be used as a POCUS assessment for graduating PEM fellows. METHODS: We organized a 10-person question writing group (QWG). Eight hold expertise in POCUS and two hold expertise in medical education. Members of the QWG created questions within four domains: interpretation/diagnosis (50% of questions), anatomy (30%), physics (10%), and pitfalls (10%). POCUS faculty ascertained content validity and the medical education faculty revised questions for syntax and readability. In 2016, we recruited 31 pediatric POCUS experts. The majority were members of the P2 Network, an international group of experts and leaders in PEM POCUS, to participate in three iterative rounds of a modified Delphi process to review, revise, and establish consensus on the question bank. RESULTS: Thirty-one pediatric POCUS experts participated in the three rounds of the modified Delphi process and evaluated 437 questions developed by the expert panel. Forty-nine percent (n = 216) of the questions were accepted in round 1, 30% (n = 130) in round 2, and 11% (n = 47) in the final round. The final question bank included 393 questions covering 17 pediatric POCUS applications. CONCLUSION: We developed a 393-question bank to aid in the assessment of PEM POCUS competency. Future work includes piloting the questions with PEM fellows to evaluate the response process and implementing the assessment tool to establish a minimum passing score.
Authors: Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde Journal: J Biomed Inform Date: 2008-09-30 Impact factor: 6.317
Authors: Susan Humphrey-Murto; Lara Varpio; Timothy J Wood; Carol Gonsalves; Lee-Anne Ufholz; Kelly Mascioli; Carol Wang; Thomas Foth Journal: Acad Med Date: 2017-10 Impact factor: 6.893