Dana Sall1,2,3, Eric J Warm4, Benjamin Kinnear4,5, Matthew Kelleher4,5, Roman Jandarov6, Jennifer O'Toole4,5. 1. Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, OH, USA. dana.sall@gmail.com. 2. Cincinnati Veteran's Affairs Medical Center, Cincinnati, OH, USA. dana.sall@gmail.com. 3. HonorHealth Scottsdale Thompson Peak Medical Center, Scottsdale, AZ, United States. dana.sall@gmail.com. 4. Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, OH, USA. 5. Department of Pediatrics, Cincinnati Children's Hospital Medicine Center, University of Cincinnati College of Medicine, Cincinnati, OH, USA. 6. Department of Environmental Health, University of Cincinnati College of Medicine, Cincinnati, OH, USA.
Abstract
INTRODUCTION: Internal medicine residents perform paracentesis, but programs lack standard methods for assessing competence or maintenance of competence and instead rely on number of procedures completed. This study describes differences in resident competence in paracentesis over time. METHODS: From 2016 to 2017, internal medicine residents (n = 118) underwent paracentesis simulation training. Competence was assessed using the Paracentesis Competency Assessment Tool (PCAT), which combines a checklist, global scale, and entrustment score. The PCAT also delineates two categorical cut-point scores: the Minimum Passing Standard (MPS) and the Unsupervised Practice Standard (UPS). Residents were randomized to return to the simulation lab at 3 and 6 months (group A, n = 60) or only 6 months (group B, n = 58). At each session, faculty raters assessed resident performance. Data were analyzed to compare resident performance at each session compared with initial training scores, and performance between groups at 6 months. RESULTS: After initial training, all residents met the MPS. The number achieving UPS did not differ between groups: group A = 24 (40%), group B = 20 (34.5%), p = 0.67. When group A was retested at 3 months, performance on each PCAT component significantly declined, as did the proportion of residents meeting the MPS and UPS. At the 6-month test, residents in group A performed significantly better than residents in group B, with 52 (89.7%) and 20 (34.5%) achieving the MPS and UPS, respectively, in group A compared with 25 (46.3%) and 2 (3.70%) in group B (p < .001 for both comparison). DISCUSSION: Skill in paracentesis declines as early as 3 months after training. However, retraining may help interrupt skill decay. Only a small proportion of residents met the UPS 6 months after training. This suggests using the PCAT to objectively measure competence would reclassify residents from being permitted to perform paracentesis independently to needing further supervision.
INTRODUCTION: Internal medicine residents perform paracentesis, but programs lack standard methods for assessing competence or maintenance of competence and instead rely on number of procedures completed. This study describes differences in resident competence in paracentesis over time. METHODS: From 2016 to 2017, internal medicine residents (n = 118) underwent paracentesis simulation training. Competence was assessed using the Paracentesis Competency Assessment Tool (PCAT), which combines a checklist, global scale, and entrustment score. The PCAT also delineates two categorical cut-point scores: the Minimum Passing Standard (MPS) and the Unsupervised Practice Standard (UPS). Residents were randomized to return to the simulation lab at 3 and 6 months (group A, n = 60) or only 6 months (group B, n = 58). At each session, faculty raters assessed resident performance. Data were analyzed to compare resident performance at each session compared with initial training scores, and performance between groups at 6 months. RESULTS: After initial training, all residents met the MPS. The number achieving UPS did not differ between groups: group A = 24 (40%), group B = 20 (34.5%), p = 0.67. When group A was retested at 3 months, performance on each PCAT component significantly declined, as did the proportion of residents meeting the MPS and UPS. At the 6-month test, residents in group A performed significantly better than residents in group B, with 52 (89.7%) and 20 (34.5%) achieving the MPS and UPS, respectively, in group A compared with 25 (46.3%) and 2 (3.70%) in group B (p < .001 for both comparison). DISCUSSION: Skill in paracentesis declines as early as 3 months after training. However, retraining may help interrupt skill decay. Only a small proportion of residents met the UPS 6 months after training. This suggests using the PCAT to objectively measure competence would reclassify residents from being permitted to perform paracentesis independently to needing further supervision.
Entities:
Keywords:
assessment; competency-based medical education; paracentesis; procedures; skill decay
Authors: Jeffrey H Barsuk; Elaine R Cohen; Timothy Caprio; William C McGaghie; Tanya Simuni; Diane B Wayne Journal: Neurology Date: 2012-06-06 Impact factor: 9.910
Authors: Grace C Huang; C Christopher Smith; Craig E Gordon; David J Feller-Kopman; Roger B Davis; Russell S Phillips; Saul N Weingart Journal: Am J Med Date: 2006-01 Impact factor: 4.965
Authors: Ryo Yamamoto; David Clanton; Ross E Willis; Rachelle Babbitt Jonas; Ramon F Cestero Journal: J Surg Educ Date: 2017-07-21 Impact factor: 2.891
Authors: Kathy Boutis; Martin Pecaric; Benoit Carrière; Jennifer Stimec; Andrew Willan; Julie Chan; Martin Pusic Journal: Med Teach Date: 2019-05-02 Impact factor: 3.650
Authors: Aashish Didwania; William C McGaghie; Elaine R Cohen; John Butter; Jeffrey H Barsuk; Leonard D Wade; Rozanna Chester; Diane B Wayne Journal: J Grad Med Educ Date: 2011-06
Authors: Jeffrey H Barsuk; Joe Feinglass; Sarah E Kozmic; Samuel F Hohmann; Daniel Ganger; Diane B Wayne Journal: J Hosp Med Date: 2014-02-03 Impact factor: 2.960
Authors: Dana Sall; Eric J Warm; Benjamin Kinnear; Matthew Kelleher; Roman Jandarov; Jennifer O'Toole Journal: J Gen Intern Med Date: 2021-04-05 Impact factor: 6.473