Video Game Warm-Up May Suggest Improvement in Ophthalmic Surgical Simulator Performance in Surgically Naïve Students.

Purpose: Long-term video game play and its effects on the skills used in surgical simulators have been previously studied, but little information is available about short-term video game warm-ups and subsequent ophthalmic surgical simulation performance. In this study, we hypothesize that a video game warm-up will improve performance on the Eyesi Ophthalmic Surgical Simulator.
Methods: Twenty medical students with no prior surgical simulation experience were recruited for the study. Information regarding prior video game experience was gathered, and half of the participants were then randomly assigned to play a video game session prior to Eyesi performance. All subjects completed three sets of Eyesi modules, and the scores and time to completion were recorded. Bivariate analysis including Fisher's Exact test and Wilcoxon rank-sum test were used for statistical analysis.
Results: The warm-up group scored higher in Navigation, Bimanual, and Forceps modules (33.6, 39.7, 7.2, respectively) compared to non-warm-up group (27.3, 27.3, 3.6, respectively). In addition, average times (sec) were lower (310.5, 117.4, 229.2, respectively) compared to non-warm-up group (321.9, 163.3, 235.8, respectively). It was also observed that significantly more participants in the warm-up group had reported a history of spending >15 hours per week playing video games compared to the non-warm-up group (80% vs 20%, p=0.0402).
Conclusion: In our pilot study, there appears to be a positive trend between video game warm-up and Eyesi simulation performance; however, no statistically significant difference was observed due to lower power. This trend can be explained by a greater collective video game experience within the warm-up group, mechanical factors (increased flexibility and grip strength after playing video games) and feeling more relaxed after the video game warm-up. Larger follow-up studies are needed to further investigate the relationship between short-term video game use on ophthalmic surgical simulation performance.

Introduction

Video games are a very common form of entertainment around the world and the percentage of individuals that enjoy gaming as a hobby continues to increase every year.1 A 2020 survey by the Entertainment Software Association found that 64% of the adults in the United States over the age of 18 played video games, and 75% of the American households contained at least one video game player.1 Given their ubiquity, video games have received significant attention in the media. Consequently, video games can have a negative impact on its users, such as propensity for violence.2 Conversely, certain benefits have been seen with gaming, including increased creativity, visual-spatial skills, hand–eye coordination, depth perception, and attention.3–6 Thus, gaming seems to have potential to increase performance in other tasks that require similar skills.

Surgery is a skill-dependent practice.7–10 Surgeons may benefit from the use of video games as they rely highly on hand–eye coordination.11,12 Ophthalmology surgery is one such discipline that requires a high degree of depth perception, precise hand–eye coordination and higher order of visual-spatial skills that are essentially obtained during residency training. Cataract surgery is the most common ophthalmic surgery performed in the United States,13 and proficiency in cataract extraction is a critical part of residency training given an aging population. The use of surgical simulators is a frequent means of resident training and has been shown to improve intraoperative performance.14–17 Within ophthalmology, the Eyesi Surgical simulator has gained popularity and has been validated as an effective surgical training tool, even as effective as wet lab training.18–22 The Eyesi equips residents with basic surgical techniques while reducing surgeon anxiety, surgeon fatigue, and errors in the operating room, thereby improving patient safety.

Prior studies have shown preoperative surgery warm-up to improve surgical performance on laparoscopic surgeries.23–34 With the advent of electronic simulators within surgical training, the question arises of whether experience with other warm-up systems, such as video games, may offer advantages to trainees. Pike et al reviewed 13 studies, 2 of which involved video game warm-ups, and all of which overall concluded that preoperative simulation improves surgical performance.35 Numerous other studies have examined the effects of video gaming on laparoscopic and endoscopic simulator performance,36–38 and one such study indicated that those who trained on video games outperformed those who trained on the laparoscopic surgical simulator.38

While there is evidence of the benefits of long-term video game use, there is little reported evidence of short term or warm-up video game use. More importantly, to our knowledge, there is no reported study evaluating the effect of preoperative warm-up on ophthalmic surgical performance. This pilot study will primarily evaluate the effects of video game warm-up on Eyesi Ophthalmic Surgical Simulator performance. Secondary objectives will include evaluation of prior video game or musical instrument experience on surgical simulator performance.

Materials and Methods

Participants

This clinical trial was approved by the institutional review board of the University of Texas Medical Branch, Texas (UTMB, approval number 19-0110), and was conducted in accordance with Good Clinical Practice and the tenets of Helsinki Declaration. The small experimental study was set at the UTMB Ophthalmology Department and took 2 years to complete. Twenty current medical students were recruited from the UTMB School of Medicine from all years of training through email invitation and provided signed informed consent. Participants were included in the study if they were between ages 18–40 and had no prior experience on the Eyesi. Initial power calculations utilizing an alpha of 0.05 and power of 80% with expected means of 80 ± 15 and 60 ± 11.6 for intervention vs control groups determined that a sample size of at least 18 would be required (9 for each group).

Questionnaire and Training

Prior to performing Eyesi modules or being informed of their group, all participants filled out a questionnaire regarding any prior experience with video game and/or musical instruments. Information was gathered regarding the number of years and hours per week of playing video game and musical instruments, as well as the number of musical instruments played. Additionally, all participants received a brief instructional video for the Eyesi simulator software (Eyesi Surgical 2.11 SN441, Eyesi Gold Software Plan 36M MO-003-36).

Experimental Group Procedure

Participants were randomly assigned numbers associated with either the warm-up or no warm-up group prior to arrival. Half of the participants (n = 10) were assigned to the experimental video game warm-up group but were unaware of their group until they began the warm-up portion of the procedure. They played Super Smash Bros on the Nintendo 64 console for 10 minutes prior to performing Eyesi modules. Super Smash Bros is a fast-paced single or multi-player game in which the player can defeat an opponent by inputting attack combinations through the handheld controller. Participants had the option to play against the computer or with a human player.

Eyesi Procedure

Participants were instructed, under observation by, to complete three sets of Eyesi modules in the following order: Navigation, Bimanual, and Forceps. Each module was repeated three times for a total of nine tasks per participant. The scores (value between 0 and 100 for all modules) and times to completion (in seconds) were recorded. The maximum completion time was capped at 7 minutes per task.

Data Analysis Methods

Wilcoxon rank-sum test and Fisher’s Exact test were conducted with a p-value of 0.05. Bivariate analysis including Fisher’s Exact test and Wilcoxon rank-sum test was used to detect any statistically significant differences across total score averages for Navigation, Bimanual, and Forceps tasks in the two groups, as well as identify association with questionnaire responses between within each group.

Results

Data from 20 participants were included in the final analysis, of which 10 subjects were in the video game warm-up group. Participants in the video game warm-up group were more likely to have higher average scores than the non-warm-up group in the Navigation module (33.6 vs 27.3, p=0.2257), Bimanual module (39.7 vs 27.3, p=0.2116), and Forceps module (7.2 vs 3.6, p=0.2673), although no significant difference was observed between the two groups (Table 1 and Figure 1). Participants in the video game warm-up group also spent a shorter time (in seconds) compared to the non-warm-up group to complete the Navigation module (310.5 vs 321.9, p=0.3659), Bimanual module (117.4 vs 163.3, p=0.3256), and Forceps module (229.2 vs 235.8, p=1.000), although no significant difference was observed between the two groups (Table 1 and Figure 1). Interestingly, participants in the video game warm-up group were found to have more hours of video game experience (8697 vs 6708, p=0.4956) (Table 1). Significantly, more participants in the video game warm-up group had a history of spending >15 hours per week playing video games compared to the non-warm-up group (80% vs 20%, p=0.0402) (Table 1). There was no statistical difference observed in the number and frequency of playing musical instruments between the two groups.

Table 1

Descriptive Statistics by Study Groups

	Video Game Warm-Up Group (N=10)	Video Game Non-Warm-up Group (N=10)	P-value
Variables
Navigation average score, mean (SD)	33.6 (18.8)	27.3 (20.8)	0.2257*
Navigation average time in sec, mean (SD)	310.5 (84.9)	321.9 (26.8)	0.3659*
Bimanual average score, mean (SD)	39.7 (21.4)	27.3 (30.0)	0.2116*
Bimanual average time in sec, mean (SD)	117.4 (13.2)	163.3 (29.3)	0.3256*
Forceps average score, mean (SD)	7.2 (8.6)	3.6 (8.3)	0.2673*
Forceps average time in sec, mean (SD)	229.2 (115.4)	235.8 (101.5)	1.0000*
Total hours of video game, mean (SD)	8697 (4871.3)	6708 (5623.4)	0.4956*
Total hours playing musical instruments, mean (SD)	1612.0 (2894.1)	4186.0 (7158.0)	0.1923*
Hours per week playing video game, n (%)
0–5	1 (10)	4 (40)	0.0402**
5–10	1 (10)	2 (20)
>15	8 (80)	4 (20)
Hours per week playing musical instruments, n (%)
0–5	8 (80)	6 (60)	0.1463**
5–10	1 (10)	2 (20)
>15	1 (10)	2 (20)
Number of musical instruments played, n (%)
0	4 (40)	2 (20)	0.1023**
1	4 (40)	6 (60)
2	2 (20)	2 (20)

Notes: *Wilcoxon rank-sum test. **Fisher’s exact test. P<0.05 indicates statistical significance.

Figure 1

Boxplot distribution of average time and scores for (A) navigation, (B) bimanual, and (C) forceps modules in the warm-up and non-warm up study groups.

Discussion

This pilot study evaluated the effects of preoperative video game warm-up on performance on the Eyesi Ophthalmic Surgical Simulator. The study found a trend showing participants in the video game warm-up group with higher scores and less completion time for all three modules (Navigation, Bimanual, and Forceps) on the Eyesi simulator. Since no significant difference was observed between the two groups, it cannot be reliably concluded that video game warm-up improves Eyesi simulation performance.

Interestingly, even though the participants were randomly assigned to the two groups, participants in the video game warm-up group were more likely to have played >15 hours of video games per week (p = 0.0402) compared to the other group. This finding may have acted as a confounding factor on the Eyesi scores, and although it is still in favor of the hypothesis suggesting that playing video games may improve surgical simulator performance, the distinction between short-term warm-up and long-term play is now difficult to make. Other suggested explanations for the higher performance in the warm-up group include mechanical factors. Increased flexibility and grip strength after the warm-up could have led to better scores, especially on the earlier tasks. Another factor to be considered for both groups is how being observed may have impacted students’ performances, as stress or adrenaline may have affected hand-steadiness.39,40 Conversely, some students may have felt more relaxed from the warm-up itself which could have helped with performance. These possibilities leave room for further investigations on the effects of warm-ups on Eyesi performance.

Furthermore, it can be implied that the effects of prior video game experience on ophthalmic surgery will be similar to its effects on Eyesi simulation performance shown by the pilot study. All Eyesi modules used in this study correlate to basic skills required for performing cataract surgery. The Navigation module develops stereopsis and instrument stability in the anterior chamber of the eye. The Bimanual module develops manual dexterity in the non-dominant hand, allowing users to perform various cataract surgery steps requiring simultaneous use of both hands. The Forceps module develops skills for performing the capsulorhexis step of the cataract surgery, which requires precision in instrument control, and this seemed to be the most technically challenging of the three modules based off the low scores. However, since the participants were all medical students and not surgeons, it can be said that each module appeared relatively independent in terms of difficulty (essentially, all students received below a passing score of 60), though a more experienced Eyesi user may consider certain modules easier/harder. However, almost all participants in both groups improved performance between the first and third tasks of each module. This is consistent with the idea that deliberate practice improves performance.10,41 The study was unable to directly assess the effects of the video game warm-up on ophthalmic surgical performance. However, follow-up studies can be performed on eye surgeons or surgeons-in-training to confirm this relationship.

Prior studies have supported correlation between video game experiences and laparoscopic surgical skills. Both Sammut et al and Datta et al found the video game experience to be advantageous to laparoscopic performance.42,43 Rosser et al analyzed laparoscopic surgical performance of 33 surgical residents with video game exercises and past video game experiences.44 Video game experience of >3 hours per week correlated with 37% fewer errors and 27% faster completion.44 Past video game experiences and video game skills were found to be significant predictors of laparoscopic skills.44 In another study, Richey et al analyzed the effects of past athletic experiences on medical students’ performance on an arthroscopic simulator.45 Students with prior athletic experiences were more likely to achieve competence on the arthroscopic surgical simulator.45 No such studies have been conducted for ophthalmic surgical training, and our pilot study serves as the first known study evaluating the relationship between both, prior video game experiences and video game warm-up, and performance on an ophthalmic surgical simulator.

Limitations

One of the major limitations of the study is the small sample size (N = 20). However, the trend between prior video game exposure and higher performance on the surgical simulator suggests that future studies with a larger study group may show statistically significant associations, supporting our results. Additional factors that may have affected Eyesi performance include improvement on the later tasks with repetition, and conversely, increasing hand fatigue towards the later modules. Secondly, the Eyesi tasks were limited to 7 minutes each, which may have limited the information gathered. For example, even though spending more time on an Eyesi module results in a lower score, some subjects may still have scored higher if provided with more time. Thirdly, some video game participants experienced an increased amount of time between watching the simulator tutorial and performing on the simulator. This time gap may have impacted their performance on the Eyesi simulator.  Lastly, although all participants had no prior simulator or ophthalmic surgery experience, the study did not control for exposure to ophthalmology. Participants with greater knowledge of the eye anatomy and cataract surgery may have performed better.

Conclusion

Although the results of the study were not statistically significant due to low power, a positive trend was found which can be considered consistent with prior studies reporting enhanced simulator performance in the context of prior video game experience.  The positive trend can also be explained by a greater collective video game experience within the warm-up group, which introduced an important confounding. Other explanations include mechanical factors (increased flexibility and grip strength after playing video games) and feeling more relaxed after the video game warm-up. However, the technical skills of laparoscopic simulation differ from microsurgical ophthalmic simulation and may not be completely comparable. No prior studies have evaluated the effects of video game experience on ophthalmic surgical training specifically. Future studies with more participants as well as longer trial periods could be beneficial in providing more significant results.