Benjamin Zendejas1, James W Jakub2, Alicia M Terando3, Amod Sarnaik4, Charlotte E Ariyan5, Mark B Faries6, Sabino Zani7, Heather B Neuman8, Nabil Wasif9, Jeffrey M Farma10, Bruce J Averbook11, Karl Y Bilimoria12, Douglas Tyler13, Mary Sue Brady5,12, David R Farley1. 1. Department of Surgery, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA. 2. Department of Surgery, Mayo Clinic, 200 First Street SW, Rochester, MN, 55905, USA. jakub.james@mayo.edu. 3. Department of Surgery, Ohio State University Medical Center, Columbus, OH, USA. 4. Department of Surgery, H. Lee Moffitt Cancer Center, Tampa, FL, USA. 5. Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA. 6. Department of Surgical Oncology, John Wayne Cancer Institute, Santa Monica, CA, USA. 7. Department of Surgery, Duke University School of Medicine, Durham, NC, USA. 8. Division of General Surgery, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA. 9. Department of Surgery, Mayo Clinic, Phoenix, AZ, USA. 10. Department of Surgery, Fox Chase Cancer Center, Philadelphia, PA, USA. 11. Department of Surgery, MetroHealth Medical Center, Cleveland, OH, USA. 12. Department of Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA. 13. Department of Surgery, University of Texas Medical Branch, Galveston, TX, USA.
Abstract
BACKGROUND: Outcomes of surgical trials hinge on surgeon selection and their underlying expertise. Assessment of expertise is paramount. We investigated whether surgeons' performance measured by the fundamentals of laparoscopic surgery (FLS) assessment program could predict their performance in a surgical trial. METHODS: As part of a prospective multi-institutional study of minimally invasive inguinal lymphadenectomy (MILND) for melanoma, surgical oncologists with no prior MILND experience underwent pre-trial FLS assessment. Surgeons completed MILND training, began enrolling patients, and submitted videos of each MILND case performed. Videos were scored with the global operative assessment of laparoscopic skills (GOALS) tool. Associations between baseline FLS scores and participant's trial performance metrics were assessed. RESULTS: Twelve surgeons enrolled patients; their median total baseline FLS score was 332 (range 275-380, max possible 500, passing >270). Participants enrolled 87 patients in the study (median 6 per surgeon, range 1-24), of which 72 (83%) videos were adequate for scoring. Baseline GOALS score was 17.1 (range 9.6-21.2, max possible score 30). Inter-rater reliability was excellent (ICC = 0.85). FLS scores correlated with improved GOALS scores (r = 0.57, p = 0.05) and with decreased operative time (r = -0.6, p = 0.02). No associations were found with the degree of patient recruitment (r = 0.02, p = 0.7), lymph node count (r = 0.01, p = 0.07), conversion rate (r = -0.06, p = 0.38) or major complications(r = -0.14, p = 0.6). CONCLUSIONS: FLS skill assessment of surgeons prior to their enrollment in a surgical trial is feasible. Although better FLS scores predicted improved operative performance and operative time, other trial outcome measures showed no difference. Our findings have implications for the documentation of laparoscopic expertise of surgeons in practice and may allow more appropriate selection of surgeons to participate in clinical trials.
BACKGROUND: Outcomes of surgical trials hinge on surgeon selection and their underlying expertise. Assessment of expertise is paramount. We investigated whether surgeons' performance measured by the fundamentals of laparoscopic surgery (FLS) assessment program could predict their performance in a surgical trial. METHODS: As part of a prospective multi-institutional study of minimally invasive inguinal lymphadenectomy (MILND) for melanoma, surgical oncologists with no prior MILND experience underwent pre-trial FLS assessment. Surgeons completed MILND training, began enrolling patients, and submitted videos of each MILND case performed. Videos were scored with the global operative assessment of laparoscopic skills (GOALS) tool. Associations between baseline FLS scores and participant's trial performance metrics were assessed. RESULTS: Twelve surgeons enrolled patients; their median total baseline FLS score was 332 (range 275-380, max possible 500, passing >270). Participants enrolled 87 patients in the study (median 6 per surgeon, range 1-24), of which 72 (83%) videos were adequate for scoring. Baseline GOALS score was 17.1 (range 9.6-21.2, max possible score 30). Inter-rater reliability was excellent (ICC = 0.85). FLS scores correlated with improved GOALS scores (r = 0.57, p = 0.05) and with decreased operative time (r = -0.6, p = 0.02). No associations were found with the degree of patient recruitment (r = 0.02, p = 0.7), lymph node count (r = 0.01, p = 0.07), conversion rate (r = -0.06, p = 0.38) or major complications(r = -0.14, p = 0.6). CONCLUSIONS: FLS skill assessment of surgeons prior to their enrollment in a surgical trial is feasible. Although better FLS scores predicted improved operative performance and operative time, other trial outcome measures showed no difference. Our findings have implications for the documentation of laparoscopic expertise of surgeons in practice and may allow more appropriate selection of surgeons to participate in clinical trials.
Authors: Melina C Vassiliou; Liane S Feldman; Christopher G Andrew; Simon Bergman; Karen Leffondré; Donna Stanbridge; Gerald M Fried Journal: Am J Surg Date: 2005-07 Impact factor: 2.565
Authors: M C Vassiliou; G A Ghitulescu; L S Feldman; D Stanbridge; K Leffondré; H H Sigman; G M Fried Journal: Surg Endosc Date: 2006-02-27 Impact factor: 4.584
Authors: Benjamin Zendejas; David A Cook; Juliane Bingener; Marianne Huebner; William F Dunn; Michael G Sarr; David R Farley Journal: Ann Surg Date: 2011-09 Impact factor: 12.969
Authors: James W Jakub; Alicia M Terando; Amod Sarnaik; Charlotte E Ariyan; Mark B Faries; Sabino Zani; Heather B Neuman; Nabil Wasif; Jeffrey M Farma; Bruce J Averbook; Karl Y Bilimoria; Jacob B Jake Allred; Vera J Suman; Travis E Grotz; Benjamin Zendejas; Jeffrey D Wayne; Douglas S Tyler Journal: J Am Coll Surg Date: 2015-11-25 Impact factor: 6.113
Authors: Leigh Neumayer; Anita Giobbie-Hurder; Olga Jonasson; Robert Fitzgibbons; Dorothy Dunlop; James Gibbs; Domenic Reda; William Henderson Journal: N Engl J Med Date: 2004-04-25 Impact factor: 91.245
Authors: James Fleshman; Daniel J Sargent; Erin Green; Mehran Anvari; Steven J Stryker; Robert W Beart; Michael Hellinger; Richard Flanagan; Walter Peters; Heidi Nelson Journal: Ann Surg Date: 2007-10 Impact factor: 12.969