Mary A Yovanoff1, Hong-En Chen1, David F Pepley2, Katelin A Mirkin3, David C Han3, Jason Z Moore2, Scarlett R Miller4. 1. Department of Industrial and Manufacturing Engineering, Penn State, University Park, Pennsylvania. 2. Department of Mechanical and Nuclear Engineering, Penn State, University Park, Pennsylvania. 3. Department of Surgery, Penn State Health Milton S. Hershey Medical Center, Hershey, Pennsylvania. 4. Department of Industrial and Manufacturing Engineering, Penn State, University Park, Pennsylvania; School of Engineering Design, Technology, and Professional Programs, Penn State, University Park, Pennsylvania. Electronic address: scarlettmiller@psu.edu.
Abstract
OBJECTIVE: To compare the effect of simulator functional fidelity (manikin vs a Dynamic Haptic Robotic Trainer [DHRT]) and personalized feedback on surgical resident self-efficacy and self-ratings of performance during ultrasound-guided internal jugular central venous catheterization (IJ CVC) training. In addition, we seek to explore how self-ratings of performance compare to objective performance scores generated by the DHRT system. DESIGN: Participants were randomly assigned to either manikin orDHRT IJCVC training over a 6-month period. Self-efficacy surveys were distributed before and following training. Training consisted of a pretest, 22 practice IJ CVC needle insertion attempts, 2 full-line practice attempts, and a posttest. Participants provided self-ratings of performance for each needle insertion and were presented with feedback from either an upper level resident (manikin) or a personalized learning system (DHRT). SETTING: A study was conducted from July 2016 to February 2017 through a surgical skills training program at Hershey Medical Center in Hershey, Pennsylvania. PARTICIPANTS: Twenty-six first-year surgical residents were recruited for the study. Individuals were informed that IJ CVC training procedures would be consistent regardless of participation in the study and that participation was optional. All recruited residents opted to participate in the study. RESULTS: Residents in both groups significantly improved their self-efficacy scores from pretest to posttest (p < 0.01). Residents in the manikin group consistently provided higher self-ratings of performance (p < 0.001). Residents in the DHRT group recorded more feedback on errors (228 instances) than the manikin group (144 instances). Self-ratings of performance on the DHRT system were able to significantly predict the objective score of the DHRT system (R2 = 0.223, p < 0.001). CONCLUSION: Simulation training with the DHRT system and the personalized learning feedback can improve resident self-efficacy with IJ CVC procedures and provide sufficient feedback to allow residents to accurately assess their own performance.
RCT Entities:
OBJECTIVE: To compare the effect of simulator functional fidelity (manikin vs a Dynamic Haptic Robotic Trainer [DHRT]) and personalized feedback on surgical resident self-efficacy and self-ratings of performance during ultrasound-guided internal jugular central venous catheterization (IJ CVC) training. In addition, we seek to explore how self-ratings of performance compare to objective performance scores generated by the DHRT system. DESIGN:Participants were randomly assigned to either manikin or DHRT IJ CVC training over a 6-month period. Self-efficacy surveys were distributed before and following training. Training consisted of a pretest, 22 practice IJ CVC needle insertion attempts, 2 full-line practice attempts, and a posttest. Participants provided self-ratings of performance for each needle insertion and were presented with feedback from either an upper level resident (manikin) or a personalized learning system (DHRT). SETTING: A study was conducted from July 2016 to February 2017 through a surgical skills training program at Hershey Medical Center in Hershey, Pennsylvania. PARTICIPANTS: Twenty-six first-year surgical residents were recruited for the study. Individuals were informed that IJ CVC training procedures would be consistent regardless of participation in the study and that participation was optional. All recruited residents opted to participate in the study. RESULTS: Residents in both groups significantly improved their self-efficacy scores from pretest to posttest (p < 0.01). Residents in the manikin group consistently provided higher self-ratings of performance (p < 0.001). Residents in the DHRT group recorded more feedback on errors (228 instances) than the manikin group (144 instances). Self-ratings of performance on the DHRT system were able to significantly predict the objective score of the DHRT system (R2 = 0.223, p < 0.001). CONCLUSION: Simulation training with the DHRT system and the personalized learning feedback can improve resident self-efficacy with IJ CVC procedures and provide sufficient feedback to allow residents to accurately assess their own performance.
Keywords:
Practice-Based Learning and Improvement; central venous catheterization; medical training simulation; residency training; self-efficacy; simulator fidelity; virtual reality
Authors: Leigh V Evans; Kelly L Dodge; Tanya D Shah; Lewis J Kaplan; Mark D Siegel; Christopher L Moore; Cara J Hamann; Zhenqiu Lin; Gail D'Onofrio Journal: Acad Med Date: 2010-09 Impact factor: 6.893
Authors: C Christopher Smith; Grace C Huang; Lori R Newman; Peter F Clardy; David Feller-Kopman; Michael Cho; Trustin Ennacheril; Richard M Schwartzstein Journal: Simul Healthc Date: 2010-06 Impact factor: 1.929
Authors: L L Leape; T A Brennan; N Laird; A G Lawthers; A R Localio; B A Barnes; L Hebert; J P Newhouse; P C Weiler; H Hiatt Journal: N Engl J Med Date: 1991-02-07 Impact factor: 91.245
Authors: N Moureau; M Lamperti; L J Kelly; R Dawson; M Elbarbary; A J H van Boxtel; M Pittiruti Journal: Br J Anaesth Date: 2013-01-29 Impact factor: 9.166
Authors: Seth S Leopold; Hannah D Morgan; Nancy J Kadel; Gregory C Gardner; Douglas C Schaad; Fredric M Wolf Journal: J Bone Joint Surg Am Date: 2005-05 Impact factor: 5.284
Authors: W C Oliver; G A Nuttall; F M Beynen; H S Raimundo; J P Abenstein; J J Arnold Journal: J Cardiothorac Vasc Anesth Date: 1997-12 Impact factor: 2.628
Authors: Hong-En Chen; Mary A Yovanoff; David F Pepley; Rohan S Prabhu; Cheyenne C Sonntag; David C Han; Jason Z Moore; Scarlett R Miller Journal: J Surg Res Date: 2018-09-08 Impact factor: 2.192
Authors: Haroula M Tzamaras; Jason Martinez; Dailen C Brown; Jessica M Gonzalez-Vargas; Jason Z Moore; Scarlett R Miller Journal: Proc Int Symp Hum Factors Ergon Healthc Date: 2021-11-12
Authors: Jessica M Gonzalez-Vargas; Haroula M Tzamaras; Jason Martinez; Dailen C Brown; Jason Z Moore; David C Han; Elizabeth Sinz; Philip Ng; Michael X Yang; Scarlett R Miller Journal: Am J Surg Date: 2021-12-07 Impact factor: 3.125
Authors: Hong-En Chen; Cheyenne C Sonntag; Katelin A Mirkin; David F Pepley; David C Han; Jason Z Moore; Scarlett R Miller Journal: Am J Surg Date: 2019-10-21 Impact factor: 2.565