BACKGROUND: Many medical certifying bodies require that a minimum number of clinical procedures be completed during residency training to obtain board eligibility. However, little is known about the relationship between the number of procedures residents perform and their clinical competence. OBJECTIVE: This study evaluated associations between residents' medical procedure skills measured in a simulation laboratory and self-reported procedure experience and year of training. METHODS: This research synthesis extracted and summarized data from multiple cohorts of internal medicine, emergency medicine, anesthesiology, and neurology resident physicians who performed simulated clinical procedures. The procedures were central venous catheter insertion, lumbar puncture, paracentesis, and thoracentesis. We compared residents' baseline simulated performance to their self-reported procedure experience using data from 7 research reports written by Northwestern University investigators between 2006 and 2016. We also evaluated how performance differed by postgraduate year (PGY). RESULTS: A total of 588 simulated procedures were performed during the study period. We found significant associations between passing the skills examinations and higher number of self-reported procedures performed (P = .011) and higher PGY (P < .001). However, performance for all procedures was poor, as only 10% of residents passed the assessments with a mean of 48% of checklist items correct (SD = 24.2). The association between passing the skills examination and year of training was mostly due to differences between PGY-1 and subsequent years of training. CONCLUSIONS: Despite positive associations between self-reported experience and simulated procedure performance, overall performance was poor. Residents' clinical experience is not a proxy for skill.
BACKGROUND: Many medical certifying bodies require that a minimum number of clinical procedures be completed during residency training to obtain board eligibility. However, little is known about the relationship between the number of procedures residents perform and their clinical competence. OBJECTIVE: This study evaluated associations between residents' medical procedure skills measured in a simulation laboratory and self-reported procedure experience and year of training. METHODS: This research synthesis extracted and summarized data from multiple cohorts of internal medicine, emergency medicine, anesthesiology, and neurology resident physicians who performed simulated clinical procedures. The procedures were central venous catheter insertion, lumbar puncture, paracentesis, and thoracentesis. We compared residents' baseline simulated performance to their self-reported procedure experience using data from 7 research reports written by Northwestern University investigators between 2006 and 2016. We also evaluated how performance differed by postgraduate year (PGY). RESULTS: A total of 588 simulated procedures were performed during the study period. We found significant associations between passing the skills examinations and higher number of self-reported procedures performed (P = .011) and higher PGY (P < .001). However, performance for all procedures was poor, as only 10% of residents passed the assessments with a mean of 48% of checklist items correct (SD = 24.2). The association between passing the skills examination and year of training was mostly due to differences between PGY-1 and subsequent years of training. CONCLUSIONS: Despite positive associations between self-reported experience and simulated procedure performance, overall performance was poor. Residents' clinical experience is not a proxy for skill.
Authors: Samer G Mattar; Adnan A Alseidi; Daniel B Jones; D Rohan Jeyarajah; Lee L Swanstrom; Ralph W Aye; Steven D Wexner; José M Martinez; Sharona B Ross; Michael M Awad; Morris E Franklin; Maurice E Arregui; Bruce D Schirmer; Rebecca M Minter Journal: Ann Surg Date: 2013-09 Impact factor: 12.969
Authors: Jeffrey H Barsuk; Elaine R Cohen; John A Vozenilek; Lanty M O'Connor; William C McGaghie; Diane B Wayne Journal: J Grad Med Educ Date: 2012-03
Authors: Jeffrey H Barsuk; Elaine R Cohen; Steven Potts; Hany Demo; Shanu Gupta; Joe Feinglass; William C McGaghie; Diane B Wayne Journal: BMJ Qual Saf Date: 2014-03-14 Impact factor: 7.035
Authors: Elaine R Cohen; Joe Feinglass; Jeffrey H Barsuk; Cynthia Barnard; Anna O'Donnell; William C McGaghie; Diane B Wayne Journal: Simul Healthc Date: 2010-04 Impact factor: 1.929
Authors: Elaine R Cohen; Jeffrey H Barsuk; Farzad Moazed; Timothy Caprio; Aashish Didwania; William C McGaghie; Diane B Wayne Journal: Acad Med Date: 2013-02 Impact factor: 6.893
Authors: Tomoko Mizota; Nicholas E Anton; Elizabeth M Huffman; Michael J Guzman; Frederick Lane; Jennifer N Choi; Dimitrios Stefanidis Journal: Surg Endosc Date: 2019-05-17 Impact factor: 4.584
Authors: Mia Louise Østergaard; Kristina Rue Nielsen; Elisabeth Albrecht-Beste; Annette Kjær Ersbøll; Lars Konge; Michael Bachmann Nielsen Journal: Eur Radiol Date: 2019-01-07 Impact factor: 5.315
Authors: Nicholas Pokrajac; Kimberly Schertzer; Kelly N Roszczynialski; Ashley Rider; Sarah R Williams; Cori M Poffenberger; Michael A Gisondi Journal: AEM Educ Train Date: 2021-08-01
Authors: Dana Sall; Eric J Warm; Benjamin Kinnear; Matthew Kelleher; Roman Jandarov; Jennifer O'Toole Journal: J Gen Intern Med Date: 2020-09-23 Impact factor: 5.128
Authors: Yara Mikhaeil-Demo; Eric Holmboe; Elizabeth E Gerard; Diane B Wayne; Elaine R Cohen; Kenji Yamazaki; Jessica W Templer; Danny Bega; George W Culler; Amar B Bhatt; Neelofer Shafi; Jeffrey H Barsuk Journal: J Grad Med Educ Date: 2021-04-16
Authors: Jeffrey H Barsuk; Elaine R Cohen; Kenzie A Cameron; Kathleen L Grady; Jane E Wilcox; Kerry B Shanklin; Rebecca S Harap; Gretchen P Nonog; Diane B Wayne Journal: Clin Simul Nurs Date: 2021-02-15 Impact factor: 2.391