Surgeon satisfaction and outcomes of tele-proctoring for robotic gynecologic surgery.

Surgical proctoring requires increasing resources in growing healthcare systems. In addition, travel has become less safe in the era of COVID-19. This study demonstrates surgeon satisfaction and safety with tele-proctoring in robotic gynecologic surgery. This pilot study assesses surgeon satisfaction and operative outcomes with a novel operative tele-proctoring system with a continuous two-way video-audio feed that allows the off-site surgeon to see the operating room, surgical field, and hands of the robotic surgeon. After thorough system testing, two experienced surgeons underwent tele-proctoring for hospital credentialing, completing 7 total cases. Each completed pre- and post-surveys developed from the Michigan Standard Simulation Experience Scale. Surgical characteristics were compared between tele-proctored cases and 59 historical cases proctored in-person over the last 8 years. Surgeons reported unanimous high satisfaction with tele-proctoring (5 ± 0). There were no major technologic issues. Five of the tele-proctored cases and 35 of controls were hysterectomies. Mean age was 48.2 ± 1.4 years, mean BMI was 29.6 ± 0.9 kg/m2, and mean uterine weight was 152 ± 112.3 g. Two-thirds had prior abdominal surgery (P > 0.1). Tele-proctored hysterectomies were 58 ± 6.5 min shorter than controls (P = 0.001). There were no differences in EBL or complication rates (P > 0.1). Tele-proctoring resulted in high surgeon satisfaction rates with no difference in EBL or complications. Tele-mentoring is a natural extension of tele-proctoring that could provide advanced surgical expertise far beyond where we can physically reach.

Introduction

Since the inception of formalized postgraduate surgical training by Halstead in 1889, surgical training has sought to pass on knowledge, skills and techniques, primarily through an apprenticeship model [1]. After completing residency, surgeons continue to encounter new technologies and must constantly adapt their skillset to these new opportunities. For example, laparoscopy revolutionized general and gynecologic surgery, allowing patients to recover more quickly with fewer complications [2]. More recently, robotic surgery has allowed surgeons to perform surgeries in a minimally invasive fashion for conditions that previously required open surgery.

As with any new technology, hospitals must ensure that surgeons have adequate experience and skills to safely utilize new technologies. Surgical proctoring by expert surgeons allows hospitals to link credentialing to a standardized quality of surgical care across multiple sites [3]. The Society for Gynecologic Surgeons recommends ongoing quality assurance for robotic surgeons to ensure safe patient care and the American College of Obstetricians and Gynecologists recommends that a surgeon undergo proctoring to ensure competency before being granted privileges for new technology [4, 5]. In addition, proctoring should allow for assessment of the surgical team, environment, and ability to troubleshoot technical failures. This proctoring should be done by someone who has already proven to be competent in the new procedure or technology [5].

Certified expert proctors are a limited resource, and due to the small number in our region, it is the current practice at our institution to send expert robotic surgeons to communities up to 3 h away to provide surgical proctoring. Health care systems will only continue to grow, with the largest 5% of hospital systems in the United States having 18 or more hospitals. In addition, 43% of hospitals in the United States are part of one of these large hospital systems [6]. Finally, with the risk of COVID-19 varying dramatically by region, travel has become less safe and in some cases, inadvisable. With these increasing burdens on proctors, a more cost- and time-effective solution that minimizes travel is needed. Tele-proctoring uses telemedicine technology to provide surgical oversight from a remote expert surgeon to an on-site surgeon [7]. Studies looking at tele-proctoring in other fields have found this to be feasible, although widespread acceptance is lacking [3, 8–10]. A 2020 literature review found no studies focused on the use of robotic surgery for tele-mentoring or tele-proctoring in gynecology, thus this represents a critical literature gap [11].

We aim to determine feasibility and surgeon satisfaction with novel tele-proctoring services in gynecologic surgery and compare operative outcomes from tele-proctored cases to historical controls, with the ultimate goal of expanding outreach and reducing the burden on expert robotic surgeons.

Methods

This is a pilot quality-improvement project to develop and implement tele-proctoring of robotic gynecologic surgery. Approval was obtained from the Quality Improvement Review Committee and thus this study does not require additional Institutional Review Board oversight.

Using principles of telemedicine technology and available componentry, we developed a proprietary system for tele-proctoring. A camera is mounted in the operative room that allows the proctor to move the camera and pan the operative room. This affords the expert surgeon a view of the operating room table and the hands of the surgeon at the robotic console (Fig. 1). The surgeon’s view also includes input from the robotic camera, allowing a clear picture of the surgical field. The video feed is continuous, two-way and includes audio feed for optimal communication. Similar telecommunication systems can be constructed using previously described technology [12]. The total cost was approximately $14,000, covered by our hospital as an investment in remote proctoring. Initial testing consisted of a trainee suturing on a DaVinci robot simulator (Intuitive Surgical, Sunnyvale CA) while an expert surgeon provided feedback from a remote location. Testing was then performed in a cadaver lab, where gynecology residents and fellows performed laparoscopic entry, robotic docking, and robotic hysterectomy under “tele-guidance.” Finally, the tele-proctoring system was utilized to proctor a surgeon undergoing formalized surgical proctoring during a robotic hysterectomy on a live person. Here, the expert robotic surgeon utilized tele-proctoring but was available on-site for concerns or system failure. In the event of system failure during live surgery, the proctored surgeon could complete the case in a laparoscopic fashion.

Fig. 1

Tele-proctoring views seen by a proctoring surgeon and operating room team. Tele-proctoring system allows the proctoring surgeon and surgical team in the room to see the robotic camera view (A), the proctor (B), the surgeon’s hands at the console (C) and the operating room (D)

After optimizing the technology in a simulator, cadaver lab and onsite testing, surgeons requesting robotic privileges were invited to participate in tele-proctoring rather than in-person proctoring. Each surgeon underwent one in-person proctoring session prior to initiating tele-proctoring. Each surgeon then underwent 3-5 proctoring sessions depending on their skill level before being credentialed. Pre- and post-surveys were developed from the validated Michigan Standard Simulation Experience Scale (MiSSES) to evaluate surgeon confidence in the procedure and satisfaction with the proctoring process. The MiSSES scale uses a 5-point Likert scale with 5 = strongly agree, 4 = agree, 3 = neither agree nor disagree, 2 = disagree, 1 = strongly disagree [13].

Global Evaluative Assessment of Robotic Skills (GEARS) scores were assigned by the proctoring surgeon. The GEARS scale is a 5-point scale which rates surgeons on depth perception, bimanual dexterity, efficiency, force sensitivity, autonomy and robotic control. A low score of 1 in each category represents poor surgical technique such as “unable to complete entire task” or “poor coordination” and a high score of 5 represents mastery, including “expertly uses both hands in a complementary way,” and “confident, efficient and safe conduct”[14].

Historical controls consisted of all cases proctored in-person by the same surgeon over the last 8 years. Patient demographics, medical and surgical history, and case characteristics were collected for both tele-proctoring cases and historical controls. All data were deidentified and entered into a secure database (REDCap® 9.7.8, Vanderbilt University).

Statistics

Demographics, clinical characteristics, and MISSeS and GEARS scores are presented as averages with standard deviations. T tests were used for continuous variables between tele-proctored cases to historical controls and Fisher’s Exact tests were used for categorical variables. Statistical analysis was performed at the 0.05 significance level with STATA software (version 15.1; StataCorp, College Station, Texas).

Results

The 2 surgeon subjects in the study successfully completed robotic credentialing after tele-proctoring. The surgeons were advanced laparoscopists having had completed between 5 and 30 robotic procedures this year and have extensive prior laparoscopic experience, reporting 50–100 laparoscopic procedures per year prior to tele-proctoring. After tele-proctoring, the surgeons reported increased confidence in the procedure (4.3 ± 0.8), satisfaction with accessibility of the proctor (4.6 ± 0.5), and unanimous high satisfaction with proctoring (5 ± 0; Fig. 2). Although one surgeon initially reported a preference for in-person proctoring, this preference was reversed after the first tele-proctoring session. There were no safety concerns reported by the surgeons during tele-proctoring, and the proctor was successfully able to provide feedback and assess safety during the cases. There were no major technologic issues including any interruption in the stream, loss of video or audio, poor resolution, or significant lag time. At the completion of their tele-proctoring, both surgeons demonstrated excellent robotic skills with a GEARS assessment average of 4.3/5.

Fig. 2

Proctored surgeon perception of Tele-proctoring. Surgeons demonstrated high levels of confidence in the procedure after proctoring, satisfaction with accessibility of the proctor, and satisfaction with proctoring

In comparing tele-proctored cases with historical controls, five of the tele-proctored cases and 35 of controls were total hysterectomies (Table 1). Mean age was 48.2 ± 1.4 years, mean BMI was 29.6 ± 0.9, and mean uterine weight was 152 ± 112.3 with no differences between the groups (P > 0.1). Two-thirds had prior abdominal surgery with no differences between the groups (P = 0.52). Tele-proctored hysterectomies (n = 5) were 58 ± 6.5 min shorter than in-person cases (n = 35, P = 0.001). There was no difference in estimated blood loss for hysterectomies. One complication was noted for the tele-proctored cases, requiring a return to the OR for a vaginal cuff separation 1 month postoperatively. Postoperative complications in the historical cohort included 1 conversion to open surgery, 1 case of re-excision of granulation tissue 1 year postoperatively, 3 cases of surgical site infection, 1 case of urinary retention, and 1 urinary tract infection. These complication rates were similar between groups (P > 0.9).

Table 1

Characteristics of tele-proctored versus in-person proctored cases

	Tele-proctored (n = 7)	In-person (n = 59)	P value
Age (years)	41.9 ± 13.3a	48.9 ± 11.2	0.12
BMI (kg/m2)	31.0 ± 11.7	29.4 ± 6.8	0.73
Prior abdominal surgery	4 (57%)	41 (70%)	0.52
Surgery
Total hysterectomy	5 (71.4%)	35 (59.3%)	0.77
Adnexal surgery only	2 (28.6%)	5 (8.5%)	0.21
Sacrocolpopexy	0	16 (27.1%)	0.33
Myomectomy	0	2 (3.4%)	0.80
Excision endometriosis	0	1 (1.7%)	0.90
Uterine weight (grams)	145.2 ± 124.4	153.6 ± 112.4	0.88
Estimated blood loss (mL)b
All cases	27.1 ± 17.0	46.5 ± 32.9	0.13
Hysterectomy only	34.0 ± 15.2	50.1 ± 35.6	0.33
Operating time (min)
All cases	110.3 ± 26.8	187.5 ± 70.6	< 0.0001
Hysterectomy only	124.2 ± 14.6	182.2 ± 68.2	0.001

aAll data presented as mean ± SD or n (%), P < 0.05 statistically significant (bolded)

bMyomectomies were excluded in EBL analysis as they are clinically different and numerical outliers

Discussion

We provide one of the first studies to demonstrate the feasibility and surgeon satisfaction of robotic tele-proctoring in gynecology. Proctoring surgeons for credentialing in new technology is necessary for hospitals to ensure delivery of high-quality care but is time-intensive and expensive. Our surgeons routinely drive up to 3 h away to provide this proctoring, resulting in lost productivity of expert surgeons. the high surgeon satisfaction of tele-proctoring using a system that allows assessment of the surgeon’s robotic surgical skill and team functioning. There were no differences in estimated blood loss or rates of surgical complications. Tele-proctored cases were shorter, but this is likely due to variation in surgeon skills and experience and the presence of trainees. All cases were performed within an academic center. Trainees were not present for tele-proctoring cases but may have participated in trocar placement, uterine manipulation and docking for historical cases. We anticipate that using this system would also provide significant cost savings as equipment used for telemedicine can often be repurposed for tele-proctoring and would avoid the lost productivity and cost of expert surgeon travel [12]. Even when only accounting for travel costs, it is estimated that $2446 was saved over 7 tele-proctoring sessions. It is expected, therefore, that the cost of the telementoring equipment would be equaled within 6 years.

Limitations of the study include the small sample size of tele-proctored cases with 2 surgeons. Surgeons included in this pilot study are also high-volume surgeons with excellent laparoscopic experience, an ideal population to pilot this technology in. However, more extensive backup planning may be necessary for surgeons with more limited skills. We currently envision this technology being used to proctor surgeons in new modalities, rather than new procedures, allowing surgeons to fall back on other modalities (laparoscopic, open) in which they are already credentialed if needed. Robotic tele-proctoring may also be appropriate for new graduates after in-person proctoring in these other modalities. In addition, although these cases were all using the Da Vinci robotic system, we have now also demonstrated success with a second robotic system, the Senhance (TransEnterix, Morrisville, NC), increasing the applicability of tele-proctoring across multiple robotic technologies.

Tele-proctoring generally is performed merely for credentialing purposes, with the proctor having no legal responsibility to intervene in the setting of a potential complication [3, 15]. However, tele-mentoring allows the expert surgeon to guide the mentored surgeon to develop new or further develop current skills. Tele-mentoring is a natural extension of the tele-proctoring system that we have developed, and limited studies on tele-mentoring in laparoscopic and robotic surgery in other fields have demonstrated safety and feasibility [16-18]. In our experience, the amount of mentoring needed for each person is very individualized and can range from one to a more extensive mentoring experience over many cases.

A minority of the currently practicing surgeons had the opportunity to learn robotic surgical skills during residency and must now learn these skills by a combination of surgical simulation, which includes the use of models, simulated surgical environments and cadavers, and individual surgical mentoring by an experienced robotic surgeon [4]. As tele-surgery technology develops, tele-mentoring would allow the extension of expertise from large centers to outlying communities while minimizing travel for expert surgeons. This may be especially important now when limiting travel and in-person contact may help decrease the risk of COVID-19 [16, 19]. Current limitations of tele-mentoring include the potential need for a baseline skills assessment to demonstrate the ability of the surgeon to complete the case (perhaps in another modality such as laparoscopic) in the setting of system failure and the inability to physically demonstrate a technique, requiring excellent verbal communication and instruction. New developments such as telestration and remote physical guidance using the movement of a laparoscopic camera or the operation of robotic arms would make tele-mentoring even more feasible [16, 20]. There is technologically no limit to the physical range between the surgeon and the telementor, allowing resources to be available to high need and underserved areas, including international and military applications [21, 22].

Conclusion

Tele-proctoring is a feasible and safe way to provide proctoring in a large healthcare system while minimizing travel, was associated with high satisfaction in both surgeon and proctor, and may have advantages in cost over traditional in-person proctoring. Tele-proctored cases had similar EBL and complication rates to in-person proctored cases. Tele-mentoring is a natural extension of tele-proctoring and could allow us to extend advanced surgical expertise far beyond where we can physically reach.