Arun Sivananthan1, Alexandros Kogkas2, Ben Glover3, Ara Darzi3,2, George Mylonas2, Nisha Patel3. 1. Imperial College Healthcare NHS Trust, London, W2 1NY, UK. arun.sivananthan@nhs.net. 2. The Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK. 3. Imperial College Healthcare NHS Trust, London, W2 1NY, UK.
Abstract
BACKGROUND: Interventional endoluminal therapy is rapidly advancing as a minimally invasive surgical technique. The expanding remit of endoscopic therapy necessitates precision control. Eye tracking is an emerging technology which allows intuitive control of devices. This was a feasibility study to establish if a novel eye gaze-controlled endoscopic system could be used to intuitively control an endoscope. METHODS: An eye gaze-control system consisting of eye tracking glasses, specialist cameras and a joystick was used to control a robotically driven endoscope allowing steering, advancement, withdrawal and retroflexion. Eight experienced and eight non-endoscopists used both the eye gaze system and a conventional endoscope to identify ten targets in two simulated environments: a sphere and an upper gastrointestinal (UGI) model. Completion of tasks was timed. Subjective feedback was collected from each participant on task load (NASA Task Load Index) and acceptance of technology (Van der Laan scale). RESULTS: When using gaze-control endoscopy, non-endoscopists were significantly quicker when using gaze-control rather than conventional endoscopy (sphere task 3:54 ± 1:17 vs. 9:05 ± 5:40 min, p = 0.012, and UGI model task 1:59 ± 0:24 vs 3:45 ± 0:53 min, p < .001). Non-endoscopists reported significantly higher NASA-TLX workload total scores using conventional endoscopy versus gaze-control (80.6 ± 11.3 vs 22.5 ± 13.8, p < .001). Endoscopists reported significantly higher total NASA-TLX workload scores using gaze control versus conventional endoscopy (54.2 ± 16 vs 26.9 ± 15.3, p = 0.012). All subjects reported that the gaze-control had positive 'usefulness' and 'satisfaction' score of 0.56 ± 0.83 and 1.43 ± 0.51 respectively. CONCLUSIONS: The novel eye gaze-control system was significantly quicker to use and subjectively lower in workload when used by non-endoscopists. Further work is needed to see if this would translate into a shallower learning curve to proficiency versus conventional endoscopy. The eye gaze-control system appears feasible as an intuitive endoscope control system. Hybrid gaze and hand control may prove a beneficial technology to evolving endoscopic platforms.
BACKGROUND: Interventional endoluminal therapy is rapidly advancing as a minimally invasive surgical technique. The expanding remit of endoscopic therapy necessitates precision control. Eye tracking is an emerging technology which allows intuitive control of devices. This was a feasibility study to establish if a novel eye gaze-controlled endoscopic system could be used to intuitively control an endoscope. METHODS: An eye gaze-control system consisting of eye tracking glasses, specialist cameras and a joystick was used to control a robotically driven endoscope allowing steering, advancement, withdrawal and retroflexion. Eight experienced and eight non-endoscopists used both the eye gaze system and a conventional endoscope to identify ten targets in two simulated environments: a sphere and an upper gastrointestinal (UGI) model. Completion of tasks was timed. Subjective feedback was collected from each participant on task load (NASA Task Load Index) and acceptance of technology (Van der Laan scale). RESULTS: When using gaze-control endoscopy, non-endoscopists were significantly quicker when using gaze-control rather than conventional endoscopy (sphere task 3:54 ± 1:17 vs. 9:05 ± 5:40 min, p = 0.012, and UGI model task 1:59 ± 0:24 vs 3:45 ± 0:53 min, p < .001). Non-endoscopists reported significantly higher NASA-TLX workload total scores using conventional endoscopy versus gaze-control (80.6 ± 11.3 vs 22.5 ± 13.8, p < .001). Endoscopists reported significantly higher total NASA-TLX workload scores using gaze control versus conventional endoscopy (54.2 ± 16 vs 26.9 ± 15.3, p = 0.012). All subjects reported that the gaze-control had positive 'usefulness' and 'satisfaction' score of 0.56 ± 0.83 and 1.43 ± 0.51 respectively. CONCLUSIONS: The novel eye gaze-control system was significantly quicker to use and subjectively lower in workload when used by non-endoscopists. Further work is needed to see if this would translate into a shallower learning curve to proficiency versus conventional endoscopy. The eye gaze-control system appears feasible as an intuitive endoscope control system. Hybrid gaze and hand control may prove a beneficial technology to evolving endoscopic platforms.
Authors: George P Mylonas; Ka-Wai Kwok; David R C James; Daniel Leff; Felipe Orihuela-Espina; Ara Darzi; Guang-Zhong Yang Journal: Med Image Anal Date: 2010-08-01 Impact factor: 8.545
Authors: Anthony Yuen Bun Teoh; Shannon Melissa Chan; Hon Chi Yip; Vivien Wai Yin Wong; Philip Wai Yan Chiu; Enders Kwok Wai Ng Journal: Surg Endosc Date: 2017-08-11 Impact factor: 4.584
Authors: Mariam Lami; Harsimrat Singh; James H Dilley; Hajra Ashraf; Matthew Edmondon; Felipe Orihuela-Espina; Jonathan Hoare; Ara Darzi; Mikael H Sodergren Journal: Endoscopy Date: 2018-02-07 Impact factor: 10.093
Authors: Susan Mallett; Peter Phillips; Thomas R Fanshawe; Emma Helbren; Darren Boone; Alastair Gale; Stuart A Taylor; David Manning; Douglas G Altman; Steve Halligan Journal: Radiology Date: 2014-07-15 Impact factor: 11.105