| Literature DB >> 33748639 |
Jeffrey J Olson1, Bo Zhang2, Diana Zhu2, Evan T Zheng3, George S M Dyer4, Tamara D Rozental5, Dawn M LaPorte6.
Abstract
The Surgical Training and Educational Platform (STEP) was developed by the American Society for Surgery of the Hand (ASSH) as a cost-effective set of surgical simulation modules designed to assess critical skills in hand surgery. Previous study demonstrated that STEP can differentiate between novice trainees and board-certified, certificate of added qualification hand surgeons. The purpose of this study was to assess construct validity of STEP by testing its ability to differentiate psychomotor skill level among intermediate trainees.Entities:
Year: 2021 PMID: 33748639 PMCID: PMC7963499 DOI: 10.2106/JBJS.OA.20.00123
Source DB: PubMed Journal: JB JS Open Access ISSN: 2472-7245
Fig. 1Photograph of the bicortical lag screw of an oblique fracture simulation module.
Fig. 2Photograph of the depth of plunge simulation module.
Fig. 3Photograph of the flexor tendon repair simulation model and testing jig.
Fig. 4Photograph of the central axis scaphoid pinning simulation model using 2D video camera to simulate fluoroscopy.
Fig. 5Photograph of the phalangeal pinning simulation model using 2D video camera to simulate fluoroscopy.
Fig. 6Photograph of the microsurgical suturing simulation model using a desktop microscope.
Fig. 7Photograph of the full-thickness skin graft simulation module.
Fig. 8Photograph of the wrist arthroscopy module with a laptop screen showing real-time feed of the simulated arthoscopic camera.
Performance and Scoring Criteria of Individual Surgical Training and Educational Platform Tasks
| Task | Starting Score | Penalty—Time | Performance Criteria and Relevant Penalties | ||||
| Depth of plunge | 120 | Total time (s) | −5 point per 1 mm of plunge per drill hole (×3) | ||||
| Lag screw | 1,000 | Total time (s) | −5 point per 1 mm of fracture malreduction | −50 points per lag screw not erpendicular to fracture line | −50 points if gap between screws < 8 mm | −100 points per screw < 4 mm from fracture edge | |
| Flexor tendon repair | 1,200 | Total time (s) | <4 strand repair = automatic task failure (task score= 0) | −120 points if no epitendinous repair performed | −1 point per 1 N of force below minimum 20 N | ||
| Phalangeal fracture pinning | 750 | Total time (s) | Penalty for pin holes too close to fracture (<10 mm): (−4 points per 1 mm less than 10 mm) | Penalty for redirection attempts (i.e., extra holes): proximal 1/3 fracture: −10 per hole; distal 1/3 fracture: −20 per hole | |||
| Scaphoid pinning | 180 | Total time (s) | −5 point for each 1 mm away from target exit point | −20 point for penetration of volar cortex | |||
| Skin graft | 230 | Total time (s) | −10 points for inefficient instrument handling | −20 points for clumsy or poor technique | Fat harvest penalty: 0 point for no residual fat (yellow mango pulp); −10 points for 25%-50% residual fat; −20 points for >50% residual fat | ||
| Microsurgery | 1,800 | Total time (s) | −90 point per suture passed <1 mm from wound edge | −180 points per suture with <3 throws | −90 points per suture that is not square or appears loose | ||
| Wrist arthroscopy | 1,000 | Total time (s) | Distance from center of bullseye on 2nd pass (−20 point for every 1 mm away from center) | Sum of deviation from each line on triangle (5 point per 1 mm deviation × 3 sides) | |||
Baseline Comparisons of Residents from 2 Training Programs*†
| Program 1 (n = 19) | Program 2 (n = 11) | p | |
| PGY |
| ||
| 2 | 10 (53%) | 0 | |
| 3 | 5 (46%) | ||
| 4 | 2 (11%) | ||
| 5 | 7 (36%) | 6 (54%) | |
| Level of training | 0.71 | ||
| “Senior” resident | 9 (47%) | 6 (55%) | |
| “Junior” resident | 10 (53%) | 5 (45%) | |
| Months in training | 33.8 (17.5) | 40.1 (12.5) | 0.26 |
| Hand rotations | 1.4 (1.2) | 1.1 (1.0) | 0.52 |
| Total cases | 89.6 (66.9) | 74.9 (53.1) | 0.54 |
| Lag screw | 28.5 (23.1) | 23.4 (17.4) | 0.53 |
| Depth of plunge | 49.0 (37.6) | 41.1 (26.7) | 0.55 |
| Tendon repair | 0.8 (1.2) | 1.9 (3.0) | 0.18 |
| Scaphoid fixation | 2.2 (1.9) | 1.8 (1.9) | 0.64 |
| Phalangeal pinning | 4.3 (4.7) | 3.0 (3.7) | 0.45 |
| Microsurgery | 2.6 (3.1) | 2.7 (4.5) | 0.95 |
| Skin graft | 0.2 (0.4) | 0.5 (1.0) | 0.22 |
| Wrist arthroscopy | 2.0 (2.1) | 0.5 (1.2) |
|
PGY = postgrade year.
Data are presented as mean (SD) and number (%) for continuous and categorical data, respectively. Bold denotes significant p-values.
Baseline Comparisons of Senior and Junior Resident Participants*†
| Total (n = 30) | Senior (n = 15) | Junior (n = 15) | p | |
| PGY |
| |||
| 2 | 10 (33%) | 0 | 10 (67%) | |
| 3 | 5 (17%) | 0 | 5 (33%) | |
| 4 | 2 (6%) | 2 (13%) | 0 | |
| 5 | 13 (44%) | 13 (87%) | 0 | |
| Months in training | 36.1 (15.9) | 51.2 (4.0) | 21.0 (4.4) |
|
| Hand rotations | 1.2 (1.1) | 2.2 (0.7) | 0.3 (0.5) |
|
| Total cases | 84.2 (61.7) | 132.3 (51.8) | 36.1 (15.7) |
|
| Lag screw | 26.6 (21.0) | 42.5 (18.6) | 10.7 (4.9) |
|
| Depth of plunge | 46.1 (33.7) | 71.3 (30.4) | 20.9 (8.8) |
|
| Tendon repair | 1.2 (2.1) | 2.2 (2.6) | 0.3 (0.6) |
|
| Scaphoid fixation | 2.0(1.9) | 3.1 (1.9) | 1.0 (1.2) |
|
| Phalangeal pinning | 3.8 (4.3) | 6.7 (4.4) | 0.9 (1.1) |
|
| Microsurgery | 2.7 (3.6) | 3.1 (1.9) | 1.4 (1.9) |
|
| Skin graft | 0.3 (0.7) | 0.6 (0.9) | 0.1 (0.3) | 0.06 |
| Wrist arthroscopy | 1.4 (1.9) | 2.0 (2.3) | 0.9 (1.3) | 0.11 |
PGY = postgrade year.
Data are presented as mean (SD) and number (%) for continuous and categorical data, respectively. Bold denotes significant p-values.
T-test Comparison of Scores, Juniors Vs. Seniors*
| Score (Junior) | Score (Senior) | Mean Difference | p | |
| Lag screw | 485 | 530 | 45 | 0.56 |
| Depth of plunge | −54 | −40 | 14 | 0.58 |
| Tendon repair | 109 | 404 | 294 |
|
| Phalangeal pinning | 265 | 326 | 61 | 0.45 |
| Scaphoid fixation | −133 | 31 | 165 | 0.06 |
| Skin graft | 42 | 76 | 34 | 0.26 |
| Microsurgery | −1,194 | −448 | 746 | 0.06 |
| Wrist arthroscopy | 604 | 678 | 74 | 0.16 |
| Total | 124 | 1,559 | 1,435 |
|
Data are presented as mean scores. Bold denotes significant p-value.
Spearman Correlation of Scores*†
| rs (Cases) | 95% CI | p | rs (mo) | 95% CI | p | rs (Rotation) | 95% CI | p | |
| Lag screw | 0.04 | −0.33 to 0.39 | 0.81 | 0.063 | −0.30 to 0.41 | 0.74 | 0.164 | −0.21 to 0.50 | 0.39 |
| Depth of plunge | 0.096 | −0.27 to 0.44 | 0.62 | 0.130 | −0.24 to 0.47 | 0.49 | 0.136 | −0.24 to 0.47 | 0.48 |
| Tendon repair | 0.144 | −0.23 to 0.48 | 0.45 | 0.312 | −0.06 to 0.61 | 0.09 |
| − |
|
| Phalangeal pinning | −0.051 | −0.40 to 0.32 | 0.79 | 0.176 | −0.20 to 0.51 | 0.35 | 0.104 | −0.27 to 0.45 | 0.59 |
| Scaphoid fixation |
|
|
|
|
|
|
|
|
|
| Skin graft | 0.153 | −0.22 to 0.49 | 0.42 | 0.341 | −0.03 to 0.63 | 0.07 |
|
|
|
| Microsurgery | 0.009 | −0.35 to 0.37 | 0.96 |
|
|
|
|
|
|
| Wrist arthroscopy | 0.134 | −0.24 to 0.47 | 0.48 | 0.159 | −0.22 to 0.49 | 0.40 |
|
|
|
| Total | 0.584 | 0.25 to 0.79 | <0.01 | 0.656 | 0.35 to 0.83 | <0.01 | 0.670 | 0.37 to 0.84 | <0.01 |
CI = confidence interval.
Bold indicates moderate or greater correlation.
rs (cases): Spearman coefficient correlating scores to case log numbers.
rs (months): Spearman coefficient correlating scores to months in residency.
rs (rotations): Spearman coefficient correlating scores to number of hand rotations.