David J Blehar1, Bruce Barton2, Romolo J Gaspari1. 1. Department of Emergency Medicine, University of Massachusetts Medical School, Worcester, MA. 2. Department of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA.
Abstract
OBJECTIVES: Proficiency in the use of bedside ultrasound (US) has become standard in emergency medicine residency training. While milestones have been established for this training, supporting data for minimum standard experience are lacking. The objective of this study was to characterize US learning curves to identify performance plateaus for both image acquisition and interpretation, as well as compare performance characteristics of learners to those of expert sonographers. METHODS: A retrospective review of an US database was conducted at a single academic institution. Each examination was scored for agreement between the learner and expert reviewer interpretation and given a score for image quality. A locally weighted scatterplot smoothing method was used to generate a model of predicted performance for each individual examination type. Performance characteristics for expert sonographers at the site were also tracked and used in addition to performance plateaus as benchmarks for learning curve analysis. RESULTS: There were 52,408 US examinations performed between May 2007 and January 2013 and included for analysis. Performance plateaus occurred at different points for different US protocols, from 18 examinations for soft tissue image quality to 90 examinations for right upper quadrant image interpretation. For the majority of examination types, a range of 50 to 75 examinations resulted in both excellent interpretation (sensitivity > 84% and specificity > 90%) and good image quality (90% the image quality benchmark of expert sonographers). CONCLUSIONS: Educational performance benchmarks occur at variable points for image interpretation and image quality for different examination types. These data should be considered when developing training standards for US education as well as experience requirements for US credentialing.
OBJECTIVES: Proficiency in the use of bedside ultrasound (US) has become standard in emergency medicine residency training. While milestones have been established for this training, supporting data for minimum standard experience are lacking. The objective of this study was to characterize US learning curves to identify performance plateaus for both image acquisition and interpretation, as well as compare performance characteristics of learners to those of expert sonographers. METHODS: A retrospective review of an US database was conducted at a single academic institution. Each examination was scored for agreement between the learner and expert reviewer interpretation and given a score for image quality. A locally weighted scatterplot smoothing method was used to generate a model of predicted performance for each individual examination type. Performance characteristics for expert sonographers at the site were also tracked and used in addition to performance plateaus as benchmarks for learning curve analysis. RESULTS: There were 52,408 US examinations performed between May 2007 and January 2013 and included for analysis. Performance plateaus occurred at different points for different US protocols, from 18 examinations for soft tissue image quality to 90 examinations for right upper quadrant image interpretation. For the majority of examination types, a range of 50 to 75 examinations resulted in both excellent interpretation (sensitivity > 84% and specificity > 90%) and good image quality (90% the image quality benchmark of expert sonographers). CONCLUSIONS: Educational performance benchmarks occur at variable points for image interpretation and image quality for different examination types. These data should be considered when developing training standards for US education as well as experience requirements for US credentialing.
Authors: Nilam J Soni; Daniel Schnobrich; Benji K Mathews; David M Tierney; Trevor P Jensen; Ria Dancel; Joel Cho; Renee K Dversdal; Gregory Mints; Anjali Bhagra; Kreegan Reierson; Linda M Kurian; Gigi Y Liu; Carolina Candotti; Brandon Boesch; Charles M LoPresti; Joshua Lenchus; Tanping Wong; Gordon Johnson; Anna M Maw; Ricardo Franco-Sadud; Brian P Lucas Journal: J Hosp Med Date: 2019-01-02 Impact factor: 2.960
Authors: John Bailitz; James O'Brien; Matt McCauley; David Murray; Christine Jung; Gary Peksa; Michael Gottlieb Journal: AEM Educ Train Date: 2022-08-03
Authors: Rachel M Haney; Michael Halperin; Eden Diamond; Daniel Ratanski; Hamid Shokoohi; Calvin Huang; Andrew S Liteplo Journal: AEM Educ Train Date: 2020-07-20
Authors: Jessica Schleifer; Rachel M Haney; Hamid Shokoohi; Calvin K Huang; Daniel Ratanski; Heidi Kimberly; Andrew S Liteplo Journal: AEM Educ Train Date: 2021-02-17