Adam Slomer1, Jordan Chenkin1,2. 1. Division of Emergency Medicine Department of Medicine University of Toronto Toronto Ontario Canada. 2. University of Toronto Sunnybrook Health Sciences Centre Toronto Ontario Canada.
Abstract
INTRODUCTION: Teaching procedural skills in medicine is time- and resource-intensive, and it is therefore important to determine which educational strategies are most effective. Test-enhanced learning (TEL) has been demonstrated to be effective in improving learner retention; however, there is little research evaluating the testing effect on the acquisition of procedural skills in medicine. The objective of this study was to examine the impact of TEL on learning ultrasound-guided intravenous (USG IV) insertion on a simulated model. METHODS: We conducted a prospective randomized controlled trial of medical students at a single tertiary care academic hospital. Participants were randomized to either the TEL group (TEG) or control group (CG). Each group received an USG peripheral IV teaching session that included a didactic portion and hands-on skills training. The training sessions were identical except that the TEG was informed at the outset that there would be an assessment at the end of the session. The TEG then received a formal assessment of the skill during the last 15 minutes of the session, whereas the CG had continued practice time. Subjects in both groups were evaluated 10-14 days later to compare skill performance using a simulation-based assessment tool consisting of a global rating scale (GRS) and checklist items. RESULTS: Thirty medical students completed the study, 15 in the TEG and 15 in the CG. There were no significant differences between the two groups at baseline based on year of medical training or prior IV or ultrasound experience. The overall procedural success rate was 93.3% (95% CI = 79.0%-100.0%) in the TEG and 80.0% (95% CI = 57.1%-100%) in the CG (p = 0.60). The first-attempt failure rate was 13.3% (95% CI = 0.0%-32.8%) in the TEG and 33.3% (95% CI = 6.3%-60.4%) in the CG (p = 0.39). There were no statistically significant differences between the means of the GRS (TEG = 4.7, CG = 4.2; p = 0.53, r = 0.11) or checklist scores (TEG = 78.6%, CG = 75.3%; p = 0.20, r = 0.24). CONCLUSIONS: In this study of novice learners, both TEL with structured practice and structured practice alone lead to high success rates performing USG IV insertion on a simulated model. While we noted a trend toward higher procedural success rates and lower first-attempt failure rates in the TEG, these did not meet statistical significance. Further studies with larger sample sizes are required to determine whether the beneficial effects of TEL can be transferred to procedural skills teaching.
INTRODUCTION: Teaching procedural skills in medicine is time- and resource-intensive, and it is therefore important to determine which educational strategies are most effective. Test-enhanced learning (TEL) has been demonstrated to be effective in improving learner retention; however, there is little research evaluating the testing effect on the acquisition of procedural skills in medicine. The objective of this study was to examine the impact of TEL on learning ultrasound-guided intravenous (USG IV) insertion on a simulated model. METHODS: We conducted a prospective randomized controlled trial of medical students at a single tertiary care academic hospital. Participants were randomized to either the TEL group (TEG) or control group (CG). Each group received an USG peripheral IV teaching session that included a didactic portion and hands-on skills training. The training sessions were identical except that the TEG was informed at the outset that there would be an assessment at the end of the session. The TEG then received a formal assessment of the skill during the last 15 minutes of the session, whereas the CG had continued practice time. Subjects in both groups were evaluated 10-14 days later to compare skill performance using a simulation-based assessment tool consisting of a global rating scale (GRS) and checklist items. RESULTS: Thirty medical students completed the study, 15 in the TEG and 15 in the CG. There were no significant differences between the two groups at baseline based on year of medical training or prior IV or ultrasound experience. The overall procedural success rate was 93.3% (95% CI = 79.0%-100.0%) in the TEG and 80.0% (95% CI = 57.1%-100%) in the CG (p = 0.60). The first-attempt failure rate was 13.3% (95% CI = 0.0%-32.8%) in the TEG and 33.3% (95% CI = 6.3%-60.4%) in the CG (p = 0.39). There were no statistically significant differences between the means of the GRS (TEG = 4.7, CG = 4.2; p = 0.53, r = 0.11) or checklist scores (TEG = 78.6%, CG = 75.3%; p = 0.20, r = 0.24). CONCLUSIONS: In this study of novice learners, both TEL with structured practice and structured practice alone lead to high success rates performing USG IV insertion on a simulated model. While we noted a trend toward higher procedural success rates and lower first-attempt failure rates in the TEG, these did not meet statistical significance. Further studies with larger sample sizes are required to determine whether the beneficial effects of TEL can be transferred to procedural skills teaching.
Authors: Melanie Crowley; Carla Brim; Jean Proehl; Susan Barnason; Sherry Leviner; Cathleen Lindauer; Mary Naccarato; Andrew Storer; Jennifer Williams; AnnMarie Papa Journal: J Emerg Nurs Date: 2012-07 Impact factor: 1.836
Authors: Irene W Y Ma; Nadia Zalunardo; George Pachev; Tanya Beran; Melanie Brown; Rose Hatala; Kevin McLaughlin Journal: Adv Health Sci Educ Theory Pract Date: 2011-08-30 Impact factor: 3.853
Authors: Douglas P Larsen; Andrew C Butler; Amy L Lawson; Henry L Roediger Journal: Adv Health Sci Educ Theory Pract Date: 2012-05-23 Impact factor: 3.853
Authors: Chad S Kessler; Yalda Afshar; Gurkiran Sardar; Rachel Yudkowsky; Felix Ankel; Alan Schwartz Journal: Acad Emerg Med Date: 2012-08 Impact factor: 3.451
Authors: Frédéric Lapostolle; Jean Catineau; Bruno Garrigue; Vincent Monmarteau; Thierry Houssaye; Isabelle Vecci; Virginie Tréoux; Baptistine Hospital; Nicolas Crocheton; Frédéric Adnet Journal: Intensive Care Med Date: 2007-06-07 Impact factor: 41.787
Authors: Belinda Lowe; Jessica Ng; Stephanie Jordan; David Waynforth; Donald Angstetra; Victoria Brazil Journal: Aust N Z J Obstet Gynaecol Date: 2022-04-28 Impact factor: 1.884
Authors: Rasmus Jørgensen; Christian B Laursen; Lars Konge; Pia Iben Pietersen Journal: Scand J Trauma Resusc Emerg Med Date: 2021-06-27 Impact factor: 2.953