Tobias Todsen1, Martin Grønnebæk Tolsgaard, Beth Härstedt Olsen, Birthe Merete Henriksen, Jens Georg Hillingsø, Lars Konge, Morten Lind Jensen, Charlotte Ringsted. 1. *Centre for Clinical Education, University of Copenhagen, and The Capital Region of Denmark †Juliane Marie Centre, Copenhagen University Hospital Rigshospitalet, Denmark ‡Department of Radiology, Copenhagen University Hospital Hvidovre, Denmark §Department of Radiology, Ultrasound Section, Diagnostic Centre, Copenhagen University Hospital Rigshospitalet, Denmark ¶Department of Surgery, Abdominal Centre, Copenhagen University Hospital Rigshospitalet, Denmark; and ‖Department of Anesthesia and The Wilson Centre, University of Toronto, and The University Health Network, Toronto, Canada.
Abstract
OBJECTIVE: To explore the reliability and validity of the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale for point-of-care ultrasonography (POC US) performance. BACKGROUND: POC US is increasingly used by clinicians and is an essential part of the management of acute surgical conditions. However, the quality of performance is highly operator-dependent. Therefore, reliable and valid assessment of trainees' ultrasonography competence is needed to ensure patient safety. METHODS: Twenty-four physicians, representing novices, intermediates, and experts in POC US, scanned 4 different surgical patient cases in a controlled set-up. All ultrasound examinations were video-recorded and assessed by 2 blinded radiologists using OSAUS. Reliability was examined using generalizability theory. Construct validity was examined by comparing performance scores between the groups and by correlating physicians' OSAUS scores with diagnostic accuracy. RESULTS: The generalizability coefficient was high (0.81) and a D-study demonstrated that 1 assessor and 5 cases would result in similar reliability. The construct validity of the OSAUS scale was supported by a significant difference in the mean scores between the novice group (17.0; SD 8.4) and the intermediate group (30.0; SD 10.1), P = 0.007, as well as between the intermediate group and the expert group (72.9; SD 4.4), P = 0.04, and by a high correlation between OSAUS scores and diagnostic accuracy (Spearman ρ correlation coefficient = 0.76; P < 0.001). CONCLUSIONS: This study demonstrates high reliability as well as evidence of construct validity of the OSAUS scale for assessment of POC US competence. Hence, the OSAUS scale may be suitable for both in-training as well as end-of-training assessment.
OBJECTIVE: To explore the reliability and validity of the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale for point-of-care ultrasonography (POC US) performance. BACKGROUND: POC US is increasingly used by clinicians and is an essential part of the management of acute surgical conditions. However, the quality of performance is highly operator-dependent. Therefore, reliable and valid assessment of trainees' ultrasonography competence is needed to ensure patient safety. METHODS: Twenty-four physicians, representing novices, intermediates, and experts in POC US, scanned 4 different surgical patient cases in a controlled set-up. All ultrasound examinations were video-recorded and assessed by 2 blinded radiologists using OSAUS. Reliability was examined using generalizability theory. Construct validity was examined by comparing performance scores between the groups and by correlating physicians' OSAUS scores with diagnostic accuracy. RESULTS: The generalizability coefficient was high (0.81) and a D-study demonstrated that 1 assessor and 5 cases would result in similar reliability. The construct validity of the OSAUS scale was supported by a significant difference in the mean scores between the novice group (17.0; SD 8.4) and the intermediate group (30.0; SD 10.1), P = 0.007, as well as between the intermediate group and the expert group (72.9; SD 4.4), P = 0.04, and by a high correlation between OSAUS scores and diagnostic accuracy (Spearman ρ correlation coefficient = 0.76; P < 0.001). CONCLUSIONS: This study demonstrates high reliability as well as evidence of construct validity of the OSAUS scale for assessment of POC US competence. Hence, the OSAUS scale may be suitable for both in-training as well as end-of-training assessment.
Authors: Salman Y Guraya; Shaista S Guraya; Nehal Anam Mahabbat; Khulood Yahya Fallatah; Bashaer Ahmad Al-Ahmadi; Hadeel Hadi Alalawi Journal: J Clin Diagn Res Date: 2016-05-01
Authors: V Cantisani; C F Dietrich; R Badea; S Dudea; H Prosch; E Cerezo; D Nuernberg; A L Serra; P S Sidhu; M Radzina; F Piscaglia; M Bachmann Nielsen; C Ewertsen; A Săftoiu; F Calliada; O H Gilja Journal: Ultrasound Int Open Date: 2016-03
Authors: Mia Louise Østergaard; Kristina Rue Nielsen; Elisabeth Albrecht-Beste; Annette Kjær Ersbøll; Lars Konge; Michael Bachmann Nielsen Journal: Eur Radiol Date: 2019-01-07 Impact factor: 5.315
Authors: M G Tolsgaard; C Ringsted; E Dreisler; L N Nørgaard; J H Petersen; M E Madsen; N L C Freiesleben; J L Sørensen; A Tabor Journal: Ultrasound Obstet Gynecol Date: 2015-08-06 Impact factor: 7.299
Authors: Martin G Tolsgaard; Mette E Madsen; Charlotte Ringsted; Birgitte S Oxlund; Anna Oldenburg; Jette L Sorensen; Bent Ottesen; Ann Tabor Journal: Med Educ Date: 2015-03 Impact factor: 6.251