Gregory Shepherd1, Dirk von Delft2, Johannes Truck3, Rainer Kubiak4, Khaled Ashour5, Hugh Grant6. 1. Department of Paediatric Surgery, Oxford Children's Hospital, John Radcliffe Hospital, Headley Way, Oxford, OX3 9DU, UK. gshepherd@me.com. 2. Red Cross War Memorial Children's Hospital, Rondebosch, Cape Town, South Africa. 3. Department of Paediatrics, John Radcliffe Hospital, Oxford, UK. 4. Department of Paediatric Surgery, Mannheim Medical School (UMM), University of Heidelberg, Heidelberg, Germany. 5. Department of Paediatric Surgery, Faculty of Medicine, Alexandria University, Alexandria, Egypt. 6. Department of Paediatric Surgery, Oxford Children's Hospital, John Radcliffe Hospital, Headley Way, Oxford, OX3 9DU, UK.
Abstract
AIM: To develop and validate a scoring system for a training assessment tool using a box trainer which can objectively demonstrate progression in laparoscopic skills. METHOD: 170 assessments were performed over a 5-year period by doctors working in a busy paediatric surgical department. Each participant was scored based on experience and then undertook six laparoscopic tasks in a box trainer in a dry skills lab. The quicker and more accurate the performance, the lower the score. Validity and reliability tests were applied. RESULTS: Pearson correlation coefficient demonstrated that more experienced surgeons performed better than novices with an r of -0.63 (p < 0.001). The mean assessment scores improved (reduced) with increasing experience score [4140 (0-20), 2696 (21-40), 1969 (>40) p < 0.001]. Improvement in score was seen at all experience levels with greatest improvement seen in the less experienced (2315, 1820, 1571 p < 0.001). Cronbach's alpha was 0.70 and the intraclass correlation coefficient for test-retest reliability was 0.81. CONCLUSION: Construct validity with adequate reliability has been demonstrated for this simple training tool and scoring system. All experience levels demonstrated improvement in their laparoscopic skills by simulation training in a laparoscopic box trainer.
AIM: To develop and validate a scoring system for a training assessment tool using a box trainer which can objectively demonstrate progression in laparoscopic skills. METHOD: 170 assessments were performed over a 5-year period by doctors working in a busy paediatric surgical department. Each participant was scored based on experience and then undertook six laparoscopic tasks in a box trainer in a dry skills lab. The quicker and more accurate the performance, the lower the score. Validity and reliability tests were applied. RESULTS: Pearson correlation coefficient demonstrated that more experienced surgeons performed better than novices with an r of -0.63 (p < 0.001). The mean assessment scores improved (reduced) with increasing experience score [4140 (0-20), 2696 (21-40), 1969 (>40) p < 0.001]. Improvement in score was seen at all experience levels with greatest improvement seen in the less experienced (2315, 1820, 1571 p < 0.001). Cronbach's alpha was 0.70 and the intraclass correlation coefficient for test-retest reliability was 0.81. CONCLUSION: Construct validity with adequate reliability has been demonstrated for this simple training tool and scoring system. All experience levels demonstrated improvement in their laparoscopic skills by simulation training in a laparoscopic box trainer.
Entities:
Keywords:
Assessment tool; Laparoscopy; Simulation; Training
Authors: D J Scott; P C Bergen; R V Rege; R Laycock; S T Tesfay; R J Valentine; D M Euhus; D R Jeyarajah; W M Thompson; D B Jones Journal: J Am Coll Surg Date: 2000-09 Impact factor: 6.113
Authors: Jeffrey H Peters; Gerald M Fried; Lee L Swanstrom; Nathaniel J Soper; Lelan F Sillin; Bruce Schirmer; Kaaren Hoffman Journal: Surgery Date: 2004-01 Impact factor: 3.982
Authors: Gerald M Fried; Liane S Feldman; Melina C Vassiliou; Shannon A Fraser; Donna Stanbridge; Gabriela Ghitulescu; Christopher G Andrew Journal: Ann Surg Date: 2004-09 Impact factor: 12.969
Authors: Melina C Vassiliou; Liane S Feldman; Christopher G Andrew; Simon Bergman; Karen Leffondré; Donna Stanbridge; Gerald M Fried Journal: Am J Surg Date: 2005-07 Impact factor: 2.565
Authors: M C Vassiliou; G A Ghitulescu; L S Feldman; D Stanbridge; K Leffondré; H H Sigman; G M Fried Journal: Surg Endosc Date: 2006-02-27 Impact factor: 4.584