Literature DB >> 33748639

Do Resident Surgical Volumes and Level of Training Correlate with Improved Performance on Psychomotor Skills Tasks: Construct Validity Testing of an ASSH Training Platform (STEP)?

Jeffrey J Olson1, Bo Zhang2, Diana Zhu2, Evan T Zheng3, George S M Dyer4, Tamara D Rozental5, Dawn M LaPorte6.   

Abstract

The Surgical Training and Educational Platform (STEP) was developed by the American Society for Surgery of the Hand (ASSH) as a cost-effective set of surgical simulation modules designed to assess critical skills in hand surgery. Previous study demonstrated that STEP can differentiate between novice trainees and board-certified, certificate of added qualification hand surgeons. The purpose of this study was to assess construct validity of STEP by testing its ability to differentiate psychomotor skill level among intermediate trainees.
METHODS: We evaluated 30 residents from 2 orthopaedic residency programs on 8 modules: (1) lag screw fixation, (2) depth of plunge during bicortical drilling, (3) flexor tendon repair, (4) phalangeal fracture pinning, (5) central axis scaphoid fixation, (6) full-thickness skin graft harvest, (7) microsurgery, and (8) wrist arthroscopy. Spearman correlation was used to correlate total and task-specific scores to case log numbers, months in training, and number of hand surgery rotations.
RESULTS: Senior residents had significantly higher mean number of total cases in their total case log (mean difference 96.2, 95% confidence interval [CI] 67.5-124.8, p < 0.01) and number of task-specific cases. Moderate correlation was observed between case log numbers and scaphoid fixation score (rs = 0.423, 95% CI 0.07-0.69) and total score (rs = 0.584, 95% CI 0.25-0.79). Moderate correlation was observed between months in training with: scaphoid fixation (rs = 0.377, 95% CI 0.01-0.66) and microsurgery (rs = 0.483, 95% CI 0.13-0.73); strong correlation was seen with total score (rs = 0.656, 95% CI 0.35-0.83). Moderate correlation with number of hand surgery rotations was observed with tendon repair (rs = 0.362, 95% CI -0.01 to 0.65), skin graft (rs = 0.385, 95% CI 0.01-0.66), wrist arthroscopy (rs = 0.391, 95% CI 0.02-0.67), microsurgery (rs = 0.461, 95% CI 0.10-0.71), and scaphoid fixation (rs = 0.578, 95% CI 0.25-0.79); and strong correlation was seen with total score (rs = 0.670, 95% CI 0.37-0.84). DISCUSSION/
CONCLUSION: The STEP is a validated ASSH education tool that provides a cost-effective simulation for the assessment of fundamental psychomotor skills in hand surgery. Total STEP score correlated with total task-related case volumes as well as months in training and number of hand rotations. Scoring could be modified to improve the fidelity of assessing surgical performance. And, while both time and human resource consuming to perform, administer, and score, this study demonstrates construct validity of STEP in assessing the progression of surgical skill through residency.
Copyright © 2021 The Authors. Published by The Journal of Bone and Joint Surgery, Incorporated. All rights reserved.

Entities:  

Year:  2021        PMID: 33748639      PMCID: PMC7963499          DOI: 10.2106/JBJS.OA.20.00123

Source DB:  PubMed          Journal:  JB JS Open Access        ISSN: 2472-7245


In 2003, the Accreditation Council for Graduate Medical Education (ACGME) implemented national work-hour restrictions in response to concern over an increase in sleep deprivation–related resident medical errors[1]. Since implementation, studies have demonstrated decreased trainee operative case volume and decreased satisfaction with surgical training among attendings and residents alike[2,3]. Subsequently, educators in orthopaedic surgery have sought to expand resident and fellow education outside of the operating room to focus on improving skill and increasing trainees repetitions without sacrificing patient safety. Arthroscopy and other task-based simulators, cadaveric dissections, and virtual reality simulators have been developed and implemented to address this need[4-8]. To date, adjunctive training in hand surgery has been limited to microsurgical simulation[9-12]. Furthermore, no platform has been formally recognized by the American Board of Orthopaedic Surgery or the American Academy of Orthopaedic Surgery as a reliable training or assessment tool. High costs, challenges with consensus, and lack of rigorous validation and objective measure of skill are cited as reasons for difficulty in gaining broad acceptance[13-17]. From 2017 to 2019, the American Society for Surgery of the Hand (ASSH) created a taskforce that developed Surgical Training and Educational Platform (STEP) in an effort to create a comprehensive psychomotor training and assessment tool for fundamental skills of hand surgery. Recognizing the limitations of previous platforms, STEP involved low-cost, high-fidelity simulation tasks, an objective metric-based scoring system inspired by the Foundations of Laparoscopic Surgery (FLS), and rigorous validation predicated on Messick validity framework[18,19]. Face (does the simulator reproduce the real-world skills) and content (does the simulator represent all facets of what it aims to measure) validity of the platform have since been demonstrated[20]. The initial study results demonstrated that board-certified (CAQ) hand surgeons significantly outperformed novice (postgrade year [PGY]-1) trainees in all simulation tasks[20]. Additional efforts have been made to use STEP for assessment with the hopes of establishing threshold levels for each task. To do this, carefully designed experiments are required to be performed to establish STEP in this new role. Toward that end, construct validity must be firmly established before next establishing inter-rater reliability and transfer validity, that is, evidence of responsiveness to training. The purpose of this study was to assess construct validity of STEP by testing its ability to differentiate psychomotor skill level between intermediate trainees: junior and senior residents. We hypothesized that senior residents would outperform junior residents on simulation tasks, and further, that the residents' surgical case volume and length of training would positively correlate with their performance on the tasks.

Materials and Methods

Study Design

Residents from the Johns Hopkins and Harvard combined orthopaedic surgery residency programs participated in the STEP simulator testing. Both junior (PGY 2-3) and senior residents (PGY 4-5) participated. Junior residents had completed 0 to 1 hand surgery rotations while senior residents had completed 2 to 3 rotations. Participation was voluntary, and all residents in each program were encouraged to participate. Resident operative experience was quantified by ACGME case log volume, duration (months) in residency, and number of hand surgery rotations. The ASSH surgical simulation taskforce identified current procedural terminology codes for procedures related to each of the 8 surgical tasks (see Appendix). Case logs relevant to each task were summated for a task-specific total and together were summated for a grand total of all tasks.

Description of STEP, Individual Tasks, and Performance Criteria

The STEP program is a validated tool developed by the ASSH surgical simulation taskforce for the purpose of resident and fellow education. STEP consists of 8 modules: (1) lag screw fixation, (2) depth of plunge during bicortical drilling (3) flexor tendon repair, (4) scaphoid fixation, (5) phalangeal fracture pinning, (6) microsurgery, (7) full-thickness skin graft harvest, and (8) wrist arthroscopy. The overall start-up cost and cost per trainee assessment were ∼$600 and $25, respectively. Assuming a 2-person assembly team with materials available, start-up time of 1 full 8-hour work day should be expected to construct the modules and test stations. Additional time (∼1 hour) is needed to prepare for each test day (i.e., slicing and marking mangos, dissecting flexor tendons, etc.).

Lag Screw Fixation of an Oblique Fracture

This task simulated drilling and lag screw fixation of a bicortical wood model of an oblique fracture, constructed by gluing together pine corner and quarter-round molding (Fig. 1). A 4-cm segment of the quarter-round molding was chiseled out to simulate the intramedullary canal and bicortical model.
Fig. 1

Photograph of the bicortical lag screw of an oblique fracture simulation module.

Photograph of the bicortical lag screw of an oblique fracture simulation module.

Depth of Plunge

This task used the same bicortical wood model, secured on top of a foam block (Fig. 2). The participant drilled 3 consecutive holes bicortical, limiting the depth of plunge into the underlying foam. The foam was sliced in half, and the depth of the plunge was measured.
Fig. 2

Photograph of the depth of plunge simulation module.

Photograph of the depth of plunge simulation module.

Flexor Tendon Repair

Participants repaired a whole pig-foot flexor tendon laceration, simulating a zone II flexor tendon injury (Fig. 3). 3-0 Ethibond and 6-0 Prolene suture were provided for the repair technique of their choice. The repairs were then tested biomechanically, measuring strength of repair with a tensiometer (target goal 20 Newtons before gapping, simulating requirements for early active motion protocol).
Fig. 3

Photograph of the flexor tendon repair simulation model and testing jig.

Photograph of the flexor tendon repair simulation model and testing jig.

Scaphoid Fracture Fixation

This task simulated placement of a central-axis scaphoid pin using a sawbones hand model with a mobile proximal carpal row (Fig. 4). K-wire pinning was performed under 2D viewing through a phone camera to simulate fluoroscopy.
Fig. 4

Photograph of the central axis scaphoid pinning simulation model using 2D video camera to simulate fluoroscopy.

Photograph of the central axis scaphoid pinning simulation model using 2D video camera to simulate fluoroscopy. Photograph of the phalangeal pinning simulation model using 2D video camera to simulate fluoroscopy.

Phalangeal Fracture Pinning

This task simulated cross-pinning of both proximal-third proximal phalanx and distal-third middle phalanx fracture of the index and long fingers, respectively (Fig. 5). K-wire pinning was similarly conducted under 2D viewing through a phone camera.
Fig. 5

Photograph of the phalangeal pinning simulation model using 2D video camera to simulate fluoroscopy.

Microsurgical Suturing

The participant performed microsurgical suturing of a 2-cm laceration of a latex glove taped over a Petri dish (Fig. 6). Ten simple interrupted sutures with 8-0 nylon suture were performed under a table-top dissection microscope.
Fig. 6

Photograph of the microsurgical suturing simulation model using a desktop microscope.

Photograph of the microsurgical suturing simulation model using a desktop microscope.

Full-Thickness Skin Graft

This task simulated harvest of a full-thickness skin graft using an unripened mango (Fig. 7). A 2-cm × 4-cm diamond was harvested using a #10 blade and iris scissors. The green peel represented the skin while the yellow flesh of the fruit represented fat.
Fig. 7

Photograph of the full-thickness skin graft simulation module.

Photograph of the full-thickness skin graft simulation module.

Wrist Arthroscopy

This station was constructed using a 3 × 5 index card box with 1 to 2, 3 to 4, 4 to 5, and 6-U portals, cardstock paper with printed bullseye targets and triangles, 2 pegs, a rubber washer, and a Desptech endoscope, simulating a wrist arthroscopy (Fig. 8). Portal establishment was simulated by aiming and puncturing the red bullseye with a 18-gauge spinal needle passed from behind the index card box, through an area cut out, and replaced with foam gutter guard material. A free pass was given to orient the needle; the second pass was counted and scored. Probing a structure was simulated by tracing 1 triangle with dotted lines with a fine tip Sharpie pen. Object translation was simulated by transferring the rubber washer from one peg to the other, releasing it, then transferring it back using a 3.5-mm arthroscopic grasper.
Fig. 8

Photograph of the wrist arthroscopy module with a laptop screen showing real-time feed of the simulated arthoscopic camera.

Photograph of the wrist arthroscopy module with a laptop screen showing real-time feed of the simulated arthoscopic camera. All modules were constructed, administered, and scored by 6 trained examiners, per previously established protocol in the original validation study of STEP[20]. Scoring was modeled after the FLS scoring system which used time, accuracy, and various performance metrics to score each task[21]. Scoring, performance criteria, and penalties for each task are detailed in Table I. The total time to test and score 1 individual is approximately 1.5 to 2 hours. Performance and Scoring Criteria of Individual Surgical Training and Educational Platform Tasks

Statistical Analysis

Data were analyzed for normal distribution and linearity. Continuous and categorical data were reported as mean (SD), median (interquartile range), and frequency (percentage) where appropriate. Student t test and χ2 analyses were performed on continuous and categorical data, respectively. Spearman correlations were performed between task scores and case log numbers, months in residency, and number of hand rotations given the nonlinear, monotonic relationship of the data being tested. Strength of correlation was categorized as none (rs = 0), weak (0 < rs ≤ 0.29), moderate (0.30 ≤ rs ≤ 0.59), strong (0.60 ≤ rs ≤ 0.79), or very strong (0.80 ≤ rs ≤ 1.00).

Results

Thirty residents from 2 orthopaedic residency programs completed all 8 surgical simulation tasks of the STEP. There were 15 senior residents and 15 junior residents. The 2 programs demonstrated similar number of senior/junior residents, mean months in training, and mean number of hand rotations (Table II). Total case logs and task-specific case log numbers were similar between the 2 programs, except for wrist arthroscopy. Detailed comparisons of senior and junior residents are demonstrated in Table III. Overall, seniors had significantly higher mean number of total case logs (mean difference 96.2, 95% confidence interval [CI] 67.5-124.8, p < 0.01). Seniors also had significantly higher number of task-specific cases except for skin graft and wrist arthroscopy (Table III). Baseline Comparisons of Residents from 2 Training Programs*† PGY = postgrade year. Data are presented as mean (SD) and number (%) for continuous and categorical data, respectively. Bold denotes significant p-values. Baseline Comparisons of Senior and Junior Resident Participants*† PGY = postgrade year. Data are presented as mean (SD) and number (%) for continuous and categorical data, respectively. Bold denotes significant p-values. Seniors achieved significantly higher mean scores in tendon repair (p = 0.03) and in total (p < 0.01), as well as higher mean scores approaching significance in scaphoid fixation (p = 0.06) and microsurgery (p = 0.06) (Table IV). Moderate correlation was observed between case log numbers and scaphoid fixation score (rs = 0.423, 95% CI 0.07-0.69) and total score (rs = 0.584, 95% CI 0.25-0.79). Moderate correlation was observed between months in residency and scaphoid fixation (rs = 0.377, 95% CI 0.01-0.66) and microsurgery (rs = 0.483, 95% CI 0.13-0.73); strong correlation with total score (rs = 0.656, 95% CI 0.35-0.83). Moderate correlation was observed between number of hand rotations and tendon repair (rs = 0.362, 95% CI −0.01 to 0.65), skin graft (rs = 0.385, 95% CI 0.01-0.66), wrist arthroscopy (rs = 0.391, 95% CI 0.02-0.67), microsurgery (rs = 0.461, 95% CI 0.10-0.71), and scaphoid fixation (rs = 0.578, 95% CI 0.25-0.79); strong correlation with total score (rs = 0.670, 95% CI 0.37-0.84) (Table V). T-test Comparison of Scores, Juniors Vs. Seniors* Data are presented as mean scores. Bold denotes significant p-value. Spearman Correlation of Scores*† CI = confidence interval. Bold indicates moderate or greater correlation. rs (cases): Spearman coefficient correlating scores to case log numbers. rs (months): Spearman coefficient correlating scores to months in residency. rs (rotations): Spearman coefficient correlating scores to number of hand rotations.

Discussion

Simulation is becoming a critical part of learning in orthopaedic residency, including hand subspecialty[4,5,8,15,17]. Simulation provides an opportunity to build fundamental psychomotor skills outside of the operating room and to test for improvement throughout the course of residency training. To date, there exists only one widely accepted surgical simulation platform, FLS, developed by the Society of American Gastrointestinal Endoscopic Surgery[18]. It is a well-validated psychomotor skills assessment tool with objective, metric-based scoring used as both a learning tool throughout training and as prerequisite for board eligibility[18,22]. Recognizing the need for a similarly robust learning and assessment tool tailored to hand surgery trainees, the ASSH surgical simulation committee developed STEP, a platform focused on testing the critical psychomotor skills that translate across a wide variety of hand surgery operations. The purpose of this study was to further validate the platform through testing construct validity by correlating resident performance with case log numbers and level of training. In 2001 the ACGME established the case log system, implementing minimum case number requirements to ensure competency is achieved in core surgical cases before residency graduation. Previous studies have called into question the effectiveness of the case log system on predicting readiness, confidence, and surgical competency of graduating residents[23,24]. Furthermore, a recent survey of orthopaedic surgery residencies indicated that case log reporting may underestimate the actual number of cases performed during residency by as much as a 24%[25]. Yet, this is currently the only objective metric of surgical performance consistently available for evaluation. In our study, we found performance on most individual STEP tasks correlated weakly with task-specific case log numbers. One possible explanation for the limited correlation may actually be the small sample size of cases. The 2018 to 2019 ACGME National Data Report for orthopaedic surgery cases logs found the median number of cases logged among all residents nationwide was 2 for skin graft, nerve repair, and wrist arthroscopy and 9 for microsurgery. Such a small sample size makes it difficult to correlate scores[26]. However, we found a strong correlation between residents' total scores and total case log numbers. This supports our hypothesis that performance on a simulated psychomotor task would improve with increased case log numbers. We hypothesized that longer duration of training and greater number of hand surgery rotations would predict better performance on individual tasks and overall. For specific tasks, we found moderate correlation between task-specific score and months of training for scaphoid fixation, microsurgery, skin graft, and tendon repair tasks. Predictably, there was strong correlation between overall score and number of months in residency. We found moderate correlations between score and number of rotations for tendon repair, skin graft, wrist arthroscopy, scaphoid fixation, and microsurgery, and strong correlation with total score. We acknowledge limitations in this study. First, correlation of individual task scores with task-specific case log numbers was weak. However, total score correlated well with total case logs and correlations improved when duration of training or number of hand rotations was considered. The explanation for this is likely multifactorial. First, scoring is based on an established scoring protocol for FLS which may not be optimal for the purpose of STEP. Most notably, time to complete individual tasks is weighed heavily in individual task scores. The data suggest that for certain tasks (i.e., flexor tendon repair), a more experienced trainee might spend more time on this task. With experience, a trainee might know enough to invest time to use a more complex tendon repair technique, perhaps involving more strands or incorporating an epitendinous repair. A less experienced trainee, lacking knowledge of these techniques, might perform a quicker, more haphazard repair but score better because of the time factor. The scoring system proved sufficient to detect differences in skill level between CAQ hand surgeons and novice trainees (interns)[20]. However, it seems the scoring system in its current format is less effective in detecting more subtle differences in skill among intermediate trainees. This project serves to further gather and compile data for each of the psychomotor tasks and provides insight as to how the scoring system might be modified in the future with regards to weighing time and penalizing errors in performance. Given the substantial time and resource investment it took to complete this project, we did not feel it was feasible nor reasonable to retest our subjects under a modified scoring system. Score modification remains a future goal in the plan to improve and refine STEP. Second, low case log numbers for certain tasks limits the ability to correlate with those task-specific scores. Although case numbers were more robust for tasks related to bony fixation (depth of plunge and lag screw drilling), hand surgery–specific task-related case numbers (tendon repair, scaphoid and phalangeal, skin graft, microsurgery, and wrist arthroscopy) were low. Residents are likely more exposed to trauma-related cases than subspecialized cases throughout residency. With greater exposure (time in residency and hand surgical rotations), number of hand-specific cases improved modestly. Extrapolating, a comparison group of hand fellowship trainees may demonstrate higher number of task-related cases and improved correlation with scores. Three tasks (lag screw fixation, depth of plunge drilling, and phalangeal pinning) failed to demonstrate any correlation between score and case log volume or duration of training or number of hand surgery rotations. These tasks test basic orthopaedic psychomotor skills learned early during residency training thus may offer the least opportunity to differentiate skill among trainees at different points in their career. This study further establishes construct validity of STEP and also highlights some of the limitations of the testing in its current format. The psychomotor tasks have face and content validity and construct validity. However, correlation between STEP scoring and performance in the operating room still needs to be established. Furthermore, in its current form, STEP is not a feasible tool for widespread application. Although start-up cost is minimal (∼$600), the time and human resource investment for initial construction of the stations, testing and scoring applicants, is significant and requires adequate support staff to complete. In addition, it requires time away from clinical obligations for trainees to be tested. In this pilot, a very small number of observers were trained to administer and score the tests, and even so, it was sometimes difficult to reliably agree on the scores awarded. We foresee problems with inter-rater reliability and the length of time allotted to testing as barriers to wider adoption. Additional work is required to establish STEP as a validated tool based on the Messick validity framework.

Conclusion

STEP is a cost-effective simulation for the assessment of fundamental psychomotor skills in hand surgery. Previous study demonstrated construct validity between interns and CAQ hand surgeons. This study supports that STEP can differentiate between the proficiency of junior and senior residents. Furthermore, it shows that the total STEP score correlated with the total task-related case volumes, months in training, and number of hand rotations. Scoring could be modified to improve the fidelity of assessing surgical performance. Although it is both time and human resource consuming to perform, administer, and score, this study demonstrates construct validity of STEP in assessing the progression of surgical skill through residency.

Appendix

Supporting material provided by the authors is posted with the online version of this article as a data supplement at jbjs.org (http://links.lww.com/JBJSOA/A252).
TABLE I

Performance and Scoring Criteria of Individual Surgical Training and Educational Platform Tasks

TaskStarting ScorePenalty—TimePerformance Criteria and Relevant Penalties
Depth of plunge120Total time (s)−5 point per 1 mm of plunge per drill hole (×3)
Lag screw1,000Total time (s)−5 point per 1 mm of fracture malreduction−50 points per lag screw not erpendicular to fracture line−50 points if gap between screws < 8 mm−100 points per screw < 4 mm from fracture edge
Flexor tendon repair1,200Total time (s)<4 strand repair = automatic task failure (task score= 0)−120 points if no epitendinous repair performed−1 point per 1 N of force below minimum 20 N
Phalangeal fracture pinning750Total time (s)Penalty for pin holes too close to fracture (<10 mm): (−4 points per 1 mm less than 10 mm)Penalty for redirection attempts (i.e., extra holes): proximal 1/3 fracture: −10 per hole; distal 1/3 fracture: −20 per hole
Scaphoid pinning180Total time (s)−5 point for each 1 mm away from target exit point−20 point for penetration of volar cortex
Skin graft230Total time (s)−10 points for inefficient instrument handling−20 points for clumsy or poor techniqueFat harvest penalty: 0 point for no residual fat (yellow mango pulp); −10 points for 25%-50% residual fat; −20 points for >50% residual fat
Microsurgery1,800Total time (s)−90 point per suture passed <1 mm from wound edge−180 points per suture with <3 throws−90 points per suture that is not square or appears loose
Wrist arthroscopy1,000Total time (s)Distance from center of bullseye on 2nd pass (−20 point for every 1 mm away from center)Sum of deviation from each line on triangle (5 point per 1 mm deviation × 3 sides)
TABLE II

Baseline Comparisons of Residents from 2 Training Programs*†

Program 1 (n = 19)Program 2 (n = 11)p
PGY <0.01
 210 (53%)0
 35 (46%)
 42 (11%)
 57 (36%)6 (54%)
Level of training0.71
 “Senior” resident9 (47%)6 (55%)
 “Junior” resident10 (53%)5 (45%)
Months in training33.8 (17.5)40.1 (12.5)0.26
Hand rotations1.4 (1.2)1.1 (1.0)0.52
Total cases89.6 (66.9)74.9 (53.1)0.54
 Lag screw28.5 (23.1)23.4 (17.4)0.53
 Depth of plunge49.0 (37.6)41.1 (26.7)0.55
 Tendon repair0.8 (1.2)1.9 (3.0)0.18
 Scaphoid fixation2.2 (1.9)1.8 (1.9)0.64
 Phalangeal pinning4.3 (4.7)3.0 (3.7)0.45
 Microsurgery2.6 (3.1)2.7 (4.5)0.95
 Skin graft0.2 (0.4)0.5 (1.0)0.22
 Wrist arthroscopy2.0 (2.1)0.5 (1.2) 0.03

PGY = postgrade year.

Data are presented as mean (SD) and number (%) for continuous and categorical data, respectively. Bold denotes significant p-values.

TABLE III

Baseline Comparisons of Senior and Junior Resident Participants*†

Total (n = 30)Senior (n = 15)Junior (n = 15)p
PGY <0.01
 210 (33%)010 (67%)
 35 (17%)05 (33%)
 42 (6%)2 (13%)0
 513 (44%)13 (87%)0
Months in training36.1 (15.9)51.2 (4.0)21.0 (4.4) <0.01
Hand rotations1.2 (1.1)2.2 (0.7)0.3 (0.5) <0.01
Total cases84.2 (61.7)132.3 (51.8)36.1 (15.7) <0.01
 Lag screw26.6 (21.0)42.5 (18.6)10.7 (4.9) <0.01
 Depth of plunge46.1 (33.7)71.3 (30.4)20.9 (8.8) <0.01
 Tendon repair1.2 (2.1)2.2 (2.6)0.3 (0.6) 0.01
 Scaphoid fixation2.0(1.9)3.1 (1.9)1.0 (1.2) <0.01
 Phalangeal pinning3.8 (4.3)6.7 (4.4)0.9 (1.1) <0.01
 Microsurgery2.7 (3.6)3.1 (1.9)1.4 (1.9) 0.04
 Skin graft0.3 (0.7)0.6 (0.9)0.1 (0.3)0.06
 Wrist arthroscopy1.4 (1.9)2.0 (2.3)0.9 (1.3)0.11

PGY = postgrade year.

Data are presented as mean (SD) and number (%) for continuous and categorical data, respectively. Bold denotes significant p-values.

TABLE IV

T-test Comparison of Scores, Juniors Vs. Seniors*

Score (Junior)Score (Senior)Mean Differencep
Lag screw485530450.56
Depth of plunge−54−40140.58
Tendon repair109404294 0.03
Phalangeal pinning265326610.45
Scaphoid fixation−133311650.06
Skin graft4276340.26
Microsurgery−1,194−4487460.06
Wrist arthroscopy604678740.16
Total1241,5591,435 <0.01

Data are presented as mean scores. Bold denotes significant p-value.

TABLE V

Spearman Correlation of Scores*†

rs (Cases)95% CIprs (mo)§95% CIprs (Rotation)#95% CIp
Lag screw0.04−0.33 to 0.390.810.063−0.30 to 0.410.740.164−0.21 to 0.500.39
Depth of plunge0.096−0.27 to 0.440.620.130−0.24 to 0.470.490.136−0.24 to 0.470.48
Tendon repair0.144−0.23 to 0.480.450.312−0.06 to 0.610.09 0.362 0.01 to 0.65 0.05
Phalangeal pinning−0.051−0.40 to 0.320.790.176−0.20 to 0.510.350.104−0.27 to 0.450.59
Scaphoid fixation 0.423 0.07 to 0.69 0.02 0.377 0.01 to 0.66 0.04 0.578 0.25 to 0.79 <0.01
Skin graft0.153−0.22 to 0.490.420.341−0.03 to 0.630.07 0.385 0.01 to 0.66 0.04
Microsurgery0.009−0.35 to 0.370.96 0.483 0.13 to 0.73 <0.01 0.461 0.10 to 0.71 0.01
Wrist arthroscopy0.134−0.24 to 0.470.480.159−0.22 to 0.490.40 0.391 0.02 to 0.67 0.03
Total0.5840.25 to 0.79<0.010.6560.35 to 0.83<0.010.6700.37 to 0.84<0.01

CI = confidence interval.

Bold indicates moderate or greater correlation.

rs (cases): Spearman coefficient correlating scores to case log numbers.

rs (months): Spearman coefficient correlating scores to months in residency.

rs (rotations): Spearman coefficient correlating scores to number of hand rotations.

  23 in total

Review 1.  Work-hour restrictions and orthopaedic resident education: a systematic review.

Authors:  Nathan S Mauser; James D Michelson; Hannah Gissel; Corey Henderson; Cyril Mauffrey
Journal:  Int Orthop       Date:  2015-11-16       Impact factor: 3.075

2.  A cost-effective junior resident training and assessment simulator for orthopaedic surgical skills via fundamentals of orthopaedic surgery: AAOS exhibit selection.

Authors:  Gregory Lopez; Rick Wright; David Martin; James Jung; Daniel Bracey; Ranjan Gupta
Journal:  J Bone Joint Surg Am       Date:  2015-04-15       Impact factor: 5.284

Review 3.  Assessment of microsurgery competency-where are we now?

Authors:  Savitha Ramachandran; Ali M Ghanem; Simon R Myers
Journal:  Microsurgery       Date:  2013-05-24       Impact factor: 2.425

Review 4.  The Role of Simulation in Microsurgical Training.

Authors:  Evgenios Evgeniou; Harriet Walker; Sameer Gujral
Journal:  J Surg Educ       Date:  2017-07-31       Impact factor: 2.891

5.  The Role of Mixed Reality Simulation for Surgical Training in Spine: Phase 1 Validation.

Authors:  Giselle Coelho; Helton L A Defino
Journal:  Spine (Phila Pa 1976)       Date:  2018-11-15       Impact factor: 3.468

6.  Reliability and Validity of 3 Methods of Assessing Orthopedic Resident Skill in Shoulder Surgery.

Authors:  Johnathan A Bernard; Jonathan R Dattilo; Uma Srikumaran; Bashir A Zikria; Amit Jain; Dawn M LaPorte
Journal:  J Surg Educ       Date:  2016-06-03       Impact factor: 2.891

7.  Establishing Validity of a Comprehensive Hand Surgical Training and Educational Platform (STEP).

Authors:  David J Wright; Jennifer Uong
Journal:  J Hand Surg Am       Date:  2020-09-30       Impact factor: 2.230

8.  Construct Validity for a Cost-effective Arthroscopic Surgery Simulator for Resident Education.

Authors:  Gregory Lopez; David F Martin; Rick Wright; James Jung; Peter Hahn; Nickul Jain; Daniel N Bracey; Ranjan Gupta
Journal:  J Am Acad Orthop Surg       Date:  2016-12       Impact factor: 3.020

9.  A survey of resident perspectives on surgical case minimums and the impact on milestones, graduation, credentialing, and preparation for practice: AOA critical issues.

Authors:  Kyle J Jeray; Steven L Frick
Journal:  J Bone Joint Surg Am       Date:  2014-12-03       Impact factor: 5.284

10.  Case Reporting, Competence, and Confidence: A Discrepancy in the Numbers.

Authors:  Deepa Shah; Carl E Haisch; Seth L Noland
Journal:  J Surg Educ       Date:  2018-02-01       Impact factor: 2.891

View more
  1 in total

1.  Impact of autonomic regulation on burnout and performance in thoracic surgery residents.

Authors:  Lauren K Barron; Marc R Moon
Journal:  JTCVS Open       Date:  2022-05-17
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.