Lauren V Huckaby1, Anthony R Cyr1, Robert M Handzel1, Eliza Beth Littleton1, Lawrence R Crist2, James D Luketich3, Kenneth K Lee1, Rajeev Dhupar4. 1. Department of Surgery, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania. 2. Department of Cardiothoracic Surgery, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania; Surgical Services Division, VA Pittsburgh Healthcare System, Pittsburgh, Pennsylvania. 3. Department of Cardiothoracic Surgery, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania. 4. Department of Cardiothoracic Surgery, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania; Surgical Services Division, VA Pittsburgh Healthcare System, Pittsburgh, Pennsylvania. Electronic address: dhuparr2@upmc.edu.
Abstract
BACKGROUND: Methods to assess competency in cardiothoracic training are essential. Here, we report a system that allows us to better assess competency from the perspective of both the trainee and educator. We hypothesized that postprocedural cognitive burden measurement (by the trainee) with immediate feedback (from the educator) could aid in identifying barriers to the acquisition of skills and knowledge so that training curricula can be individualized. METHODS: The National Aeronautics and Space Administration Task Load Index (NASA-TLX), a validated instrument to measure cognitive load, was administered with an online platform after bronchoscopy, esophagogastroduodenoscopy, and video-assisted thoracoscopic surgery for 11 residents. Immediate postprocedure feedback and standardized debriefing occurred for each procedure. RESULTS: Mean NASA-TLX scores were highest (indicating greater cognitive load) for esophagogastroduodenoscopy and video-assisted thoracoscopic surgery (P < .001). When comparing subscale measures, mental demand was significantly higher for video-assisted thoracoscopic surgery (P = .026) compared with the other procedures, whereas physical demand was highest for esophagogastroduodenoscopy (P = .018). Self-reported frustration was similar for all case types (P = .247). Cognitive burden decreased with a greater number of procedures for bronchoscopy (P = .027). Significant improvement was noted by the trainee at the end of the rotation in self-assessed procedural competency and preparedness for thoracic board topics (all P < .05). Postprocedure feedback by the attending surgeon correlated with more frequent completion of self-evaluations by the residents. CONCLUSIONS: Longitudinal assessment of cognitive load in combination with postprocedural feedback identified barriers to skill acquisition for both residents and educators. This information allows for individualized rotation development as a step toward a competency-based curriculum.
BACKGROUND: Methods to assess competency in cardiothoracic training are essential. Here, we report a system that allows us to better assess competency from the perspective of both the trainee and educator. We hypothesized that postprocedural cognitive burden measurement (by the trainee) with immediate feedback (from the educator) could aid in identifying barriers to the acquisition of skills and knowledge so that training curricula can be individualized. METHODS: The National Aeronautics and Space Administration Task Load Index (NASA-TLX), a validated instrument to measure cognitive load, was administered with an online platform after bronchoscopy, esophagogastroduodenoscopy, and video-assisted thoracoscopic surgery for 11 residents. Immediate postprocedure feedback and standardized debriefing occurred for each procedure. RESULTS: Mean NASA-TLX scores were highest (indicating greater cognitive load) for esophagogastroduodenoscopy and video-assisted thoracoscopic surgery (P < .001). When comparing subscale measures, mental demand was significantly higher for video-assisted thoracoscopic surgery (P = .026) compared with the other procedures, whereas physical demand was highest for esophagogastroduodenoscopy (P = .018). Self-reported frustration was similar for all case types (P = .247). Cognitive burden decreased with a greater number of procedures for bronchoscopy (P = .027). Significant improvement was noted by the trainee at the end of the rotation in self-assessed procedural competency and preparedness for thoracic board topics (all P < .05). Postprocedure feedback by the attending surgeon correlated with more frequent completion of self-evaluations by the residents. CONCLUSIONS: Longitudinal assessment of cognitive load in combination with postprocedural feedback identified barriers to skill acquisition for both residents and educators. This information allows for individualized rotation development as a step toward a competency-based curriculum.
Authors: Mackenzie R Cook; Jennifer M Watters; Jeffrey S Barton; Carol Kamin; Sarah N Brown; Karen E Deveney; Laszlo N Kiraly Journal: J Am Coll Surg Date: 2015-01-16 Impact factor: 6.113
Authors: Justin P Wagner; Catherine E Lewis; Areti Tillou; Vatche G Agopian; Chi Quach; Timothy R Donahue; O Joe Hines Journal: JAMA Surg Date: 2018-04-01 Impact factor: 14.766
Authors: Karl Y Bilimoria; Jeanette W Chung; Larry V Hedges; Allison R Dahlke; Remi Love; Mark E Cohen; David B Hoyt; Anthony D Yang; John L Tarpley; John D Mellinger; David M Mahvi; Rachel R Kelz; Clifford Y Ko; David D Odell; Jonah J Stulberg; Frank R Lewis Journal: N Engl J Med Date: 2016-02-02 Impact factor: 91.245