Ricardo J Bello1, Melanie R Major2, Damon S Cooney3, Gedge D Rosson4, Scott D Lifchez5, Carisa M Cooney6. 1. Department of Plastic and Reconstructive Surgery, Johns Hopkins University School of Medicine, 601N. Caroline St., JHOC 2114A, Baltimore, MD 21287, USA. Electronic address: rbello@jhmi.edu. 2. Department of Plastic and Reconstructive Surgery, Johns Hopkins University School of Medicine, 601N. Caroline St., JHOC 2114A, Baltimore, MD 21287, USA. Electronic address: mmajor1@jhmi.edu. 3. Department of Plastic and Reconstructive Surgery, Johns Hopkins University School of Medicine, 601N. Caroline St., JHOC 2114A, Baltimore, MD 21287, USA. Electronic address: dcooney2@jhmi.edu. 4. Department of Plastic and Reconstructive Surgery, Johns Hopkins University School of Medicine, 601N. Caroline St., JHOC 2114A, Baltimore, MD 21287, USA. Electronic address: gedge@jhmi.edu. 5. Department of Plastic and Reconstructive Surgery, Johns Hopkins University School of Medicine, 601N. Caroline St., JHOC 2114A, Baltimore, MD 21287, USA. Electronic address: slifche1@jhmi.edu. 6. Department of Plastic and Reconstructive Surgery, Johns Hopkins University School of Medicine, 601N. Caroline St., JHOC 2114A, Baltimore, MD 21287, USA. Electronic address: ccooney3@jhmi.edu.
Abstract
BACKGROUND: In 2013, we developed the Operative Entrustability Assessment (OEA) to facilitate evaluation and documentation of resident operative skills. This web-based tool provides real-time, transparent feedback to residents on operative performance. This study evaluated the construct validity of the OEA, assessing its association with operative time. METHODS: We used simple and multiple linear regression to estimate associations between OEA scores and operative time in selected procedures performed. RESULTS: OEAs were completed for 93 autologous breast reconstructions and 185 hand procedures. Self-assessed OEA was associated with shorter operative time in breast (p = 0.008) and hand (p = 0.036) cases. Evaluator OEA was associated with shorter operative time in breast (p = 0.018), but not hand cases (p = 0.377). Post-graduate year was not associated. CONCLUSIONS: The OEA demonstrates construct validity: increasing scores are associated with shorter operative time and are better predictors of operative time than post-graduate year, making it an option for documenting competence prior to graduation.
BACKGROUND: In 2013, we developed the Operative Entrustability Assessment (OEA) to facilitate evaluation and documentation of resident operative skills. This web-based tool provides real-time, transparent feedback to residents on operative performance. This study evaluated the construct validity of the OEA, assessing its association with operative time. METHODS: We used simple and multiple linear regression to estimate associations between OEA scores and operative time in selected procedures performed. RESULTS: OEAs were completed for 93 autologous breast reconstructions and 185 hand procedures. Self-assessed OEA was associated with shorter operative time in breast (p = 0.008) and hand (p = 0.036) cases. Evaluator OEA was associated with shorter operative time in breast (p = 0.018), but not hand cases (p = 0.377). Post-graduate year was not associated. CONCLUSIONS: The OEA demonstrates construct validity: increasing scores are associated with shorter operative time and are better predictors of operative time than post-graduate year, making it an option for documenting competence prior to graduation.
Authors: Carisa M Cooney; Pathik Aravind; C Scott Hultman; Kristen P Broderick; Robert A Weber; Sebastian Brooke; Damon S Cooney; Scott D Lifchez Journal: J Grad Med Educ Date: 2021-08-13