Elif Bilgic1, Pepa Kaneva1, Allan Okrainec2, E Matthew Ritter3, Steven D Schwaitzberg4, Melina C Vassiliou5,6. 1. Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, QC, Canada. 2. Department of Surgery, University Health Network, University of Toronto, Toronto, ON, Canada. 3. Department of Surgery, Uniformed Services University of the Health Sciences and Walter Reed National Military Medical Center, Bethesda, MD, USA. 4. Department of Surgery, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA. 5. Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, QC, Canada. melina.vassiliou@mcgill.ca. 6. Montreal General Hospital, McGill University Health Centre, 1650 Cedar Avenue, L9-313, Montreal, QC, H3G 1A4, Canada. melina.vassiliou@mcgill.ca.
Abstract
BACKGROUND: The Fundamentals of Laparoscopic Surgery® (FLS) certification exam assesses both cognitive and manual skills, and has been administered for over a decade. The purpose of this study is to report results over the past 9 years of testing in order to identify trends over time and evaluate the need to update scoring practices. This is a quality initiative of the SAGES FLS committee. METHODS: A representative sample of FLS exam data from 2008 to 2016 was analyzed. The de-identified data included demographics and scores for the cognitive and manual tests. Standard descriptive statistics were used to compare trends over the years, training levels, and to assess the pass/fail rate. RESULTS: A total of 7232 FLS tests were analyzed [64% male, 6.4% junior (postgraduate year-PGY1-2), 84% senior (PGY3-5), 2.8% fellows (PGY6), and 6.7% attending surgeons (PGY7)]. Specialties included 93% general surgery (GS), 6.2% gynecology, and 0.9% urology. The Pearson correlation between cognitive and manual scores was 0.09. For the cognitive exam, there was an increase in scores over the years, and the most junior residents scored the lowest. For the manual skills, there were marginal differences in scores over the years, and junior residents scored the highest. The odds ratio of PGY3+ passing was 1.8 (CI 1.2-2.8) times higher than that of a PGY1-2. The internal consistency between tasks on the manual skills exam was 0.73. If any one of the tasks was removed, the Cronbach's alpha dropped to between 0.65 and 0.71, depending on the task being removed. CONCLUSION: The cognitive and manual components of FLS test different aspects of laparoscopy and demonstrate evidence for reliability and validity. More experienced trainees have a higher likelihood of passing the exam and tend to perform better on the cognitive skills. Each component of the manual skills contributes to the exam and should continue to be part of the test.
BACKGROUND: The Fundamentals of Laparoscopic Surgery® (FLS) certification exam assesses both cognitive and manual skills, and has been administered for over a decade. The purpose of this study is to report results over the past 9 years of testing in order to identify trends over time and evaluate the need to update scoring practices. This is a quality initiative of the SAGES FLS committee. METHODS: A representative sample of FLS exam data from 2008 to 2016 was analyzed. The de-identified data included demographics and scores for the cognitive and manual tests. Standard descriptive statistics were used to compare trends over the years, training levels, and to assess the pass/fail rate. RESULTS: A total of 7232 FLS tests were analyzed [64% male, 6.4% junior (postgraduate year-PGY1-2), 84% senior (PGY3-5), 2.8% fellows (PGY6), and 6.7% attending surgeons (PGY7)]. Specialties included 93% general surgery (GS), 6.2% gynecology, and 0.9% urology. The Pearson correlation between cognitive and manual scores was 0.09. For the cognitive exam, there was an increase in scores over the years, and the most junior residents scored the lowest. For the manual skills, there were marginal differences in scores over the years, and junior residents scored the highest. The odds ratio of PGY3+ passing was 1.8 (CI 1.2-2.8) times higher than that of a PGY1-2. The internal consistency between tasks on the manual skills exam was 0.73. If any one of the tasks was removed, the Cronbach's alpha dropped to between 0.65 and 0.71, depending on the task being removed. CONCLUSION: The cognitive and manual components of FLS test different aspects of laparoscopy and demonstrate evidence for reliability and validity. More experienced trainees have a higher likelihood of passing the exam and tend to perform better on the cognitive skills. Each component of the manual skills contributes to the exam and should continue to be part of the test.
Entities:
Keywords:
Fundamentals of Laparoscopic Surgery; Laparoscopy; Simulation; Skill assessment
Authors: Jeffrey H Peters; Gerald M Fried; Lee L Swanstrom; Nathaniel J Soper; Lelan F Sillin; Bruce Schirmer; Kaaren Hoffman Journal: Surgery Date: 2004-01 Impact factor: 3.982
Authors: Gerald M Fried; Liane S Feldman; Melina C Vassiliou; Shannon A Fraser; Donna Stanbridge; Gabriela Ghitulescu; Christopher G Andrew Journal: Ann Surg Date: 2004-09 Impact factor: 12.969
Authors: M C Vassiliou; G A Ghitulescu; L S Feldman; D Stanbridge; K Leffondré; H H Sigman; G M Fried Journal: Surg Endosc Date: 2006-02-27 Impact factor: 4.584
Authors: Daniel J Scott; E Matt Ritter; Seifu T Tesfay; Elisabeth A Pimentel; Alykhan Nagji; Gerald M Fried Journal: Surg Endosc Date: 2008-02-13 Impact factor: 4.584
Authors: Emily D Dubina; Xuan-Binh D Pham; Alexander C Schwed; Hoover Wu; Imani McElroy; Amy H Kaji; Christian de Virgilio Journal: JAMA Surg Date: 2018-12-01 Impact factor: 14.766
Authors: Carolyn R Rogers-Vizena; Caroline A Yao; Georgios D Sideridis; Lindsey Minahan; Francesca Y L Saldanha; Katie A Livingston; Peter H Weinstock Journal: Plast Reconstr Surg Glob Open Date: 2022-07-22
Authors: Rami S Kantar; Allyson R Alfonso; Elie P Ramly; J Rodrigo Diaz-Siso; Corstiaan C Breugem; Roberto L Flores Journal: Plast Reconstr Surg Glob Open Date: 2019-09-23