BACKGROUND: Point-of-care ultrasound is an emerging technology in critical care medicine. Despite requirements for critical care medicine fellowship programs to demonstrate knowledge and competency in point-of-care ultrasound, tools to guide competency-based training are lacking. OBJECTIVE: We describe the development and validity arguments of a competency assessment tool for critical care ultrasound. METHODS: A modified Delphi method was used to develop behaviorally anchored checklists for 2 ultrasound applications: "Perform deep venous thrombosis study (DVT)" and "Qualify left ventricular function using parasternal long axis and parasternal short axis views (Echo)." One live rater and 1 video rater evaluated performance of 28 fellows. A second video rater evaluated a subset of 10 fellows. Validity evidence for content, response process, and internal consistency was assessed. RESULTS: An expert panel finalized checklists after 2 rounds of a modified Delphi method. The DVT checklist consisted of 13 items, including 1.00 global rating step (GRS). The Echo checklist consisted of 14 items, and included 1.00 GRS for each of 2 views. Interrater reliability evaluated with a Cohen kappa between the live and video rater was 1.00 for the DVT GRS, 0.44 for the PSLA GRS, and 0.58 for the PSSA GRS. Cronbach α was 0.85 for DVT and 0.92 for Echo. CONCLUSIONS: The findings offer preliminary evidence for the validity of competency assessment tools for 2 applications of critical care ultrasound and data on live versus video raters.
BACKGROUND: Point-of-care ultrasound is an emerging technology in critical care medicine. Despite requirements for critical care medicine fellowship programs to demonstrate knowledge and competency in point-of-care ultrasound, tools to guide competency-based training are lacking. OBJECTIVE: We describe the development and validity arguments of a competency assessment tool for critical care ultrasound. METHODS: A modified Delphi method was used to develop behaviorally anchored checklists for 2 ultrasound applications: "Perform deep venous thrombosis study (DVT)" and "Qualify left ventricular function using parasternal long axis and parasternal short axis views (Echo)." One live rater and 1 video rater evaluated performance of 28 fellows. A second video rater evaluated a subset of 10 fellows. Validity evidence for content, response process, and internal consistency was assessed. RESULTS: An expert panel finalized checklists after 2 rounds of a modified Delphi method. The DVT checklist consisted of 13 items, including 1.00 global rating step (GRS). The Echo checklist consisted of 14 items, and included 1.00 GRS for each of 2 views. Interrater reliability evaluated with a Cohen kappa between the live and video rater was 1.00 for the DVT GRS, 0.44 for the PSLA GRS, and 0.58 for the PSSA GRS. Cronbach α was 0.85 for DVT and 0.92 for Echo. CONCLUSIONS: The findings offer preliminary evidence for the validity of competency assessment tools for 2 applications of critical care ultrasound and data on live versus video raters.
Authors: Irene W Y Ma; Nadia Zalunardo; George Pachev; Tanya Beran; Melanie Brown; Rose Hatala; Kevin McLaughlin Journal: Adv Health Sci Educ Theory Pract Date: 2011-08-30 Impact factor: 3.853
Authors: Mohsen Davoudi; Henri G Colt; Kathryn E Osann; Carla R Lamb; John J Mullon Journal: Am J Respir Crit Care Med Date: 2012-07-26 Impact factor: 21.405
Authors: Henry E Fessler; Doreen Addrizzo-Harris; James M Beck; John D Buckley; Stephen M Pastores; Craig A Piquette; James A Rowley; Antoinette Spevetz Journal: Chest Date: 2014-09 Impact factor: 9.410
Authors: Anna Dölp; Katja Schneider-Momm; Philip Heiser; Christina Clement; Reinhold Rauh; Hans-Willi Clement; Eberhard Schulz; Christian Fleischhaker Journal: Front Psychiatry Date: 2020-08-20 Impact factor: 4.157
Authors: Nilam J Soni; Robert Nathanson; Mark Andreae; Rahul Khosla; Karthik Vadamalai; Karthik Kode; Jeremy S Boyd; Charles M LoPresti; Dana Resop; Zahir Basrai; Jason Williams; Brian Bales; Harald Sauthoff; Erin Wetherbee; Elizabeth K Haro; Natalie Smith; Michael J Mader; Jacqueline Pugh; Erin P Finley; Christopher K Schott Journal: Ultrasound J Date: 2022-05-12