Patrick Garfjeld Roberts1, Paul Guyver2, Mathew Baldwin3, Kash Akhtar4, Abtin Alvand5, Andrew J Price5, Jonathan L Rees5. 1. Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK. patrick.garfjeldroberts@ndorms.ox.ac.uk. 2. MDHU Derriford, Plymouth Hospitals NHS Trust, Oxford, UK. 3. Health Education Thames Valley, Oxford, UK. 4. The Blizard Institute, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, UK. 5. Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK.
Abstract
PURPOSE: To assess the construct and face validity of ArthroS, a passive haptic VR simulator. A secondary aim was to evaluate the novel performance metrics produced by this simulator. METHODS: Two groups of 30 participants, each divided into novice, intermediate or expert based on arthroscopic experience, completed three separate tasks on either the knee or shoulder module of the simulator. Performance was recorded using 12 automatically generated performance metrics and video footage of the arthroscopic procedures. The videos were blindly assessed using a validated global rating scale (GRS). Participants completed a survey about the simulator's realism and training utility. RESULTS: This new simulator demonstrated construct validity of its tasks when evaluated against a GRS (p ≤ 0.003 in all cases). Regarding it's automatically generated performance metrics, established outputs such as time taken (p ≤ 0.001) and instrument path length (p ≤ 0.007) also demonstrated good construct validity. However, two-thirds of the proposed 'novel metrics' the simulator reports could not distinguish participants based on arthroscopic experience. Face validity assessment rated the simulator as a realistic and useful tool for trainees, but the passive haptic feedback (a key feature of this simulator) is rated as less realistic. CONCLUSION: The ArthroS simulator has good task construct validity based on established objective outputs, but some of the novel performance metrics could not distinguish between surgical experience. The passive haptic feedback of the simulator also needs improvement. If simulators could offer automated and validated performance feedback, this would facilitate improvements in the delivery of training by allowing trainees to practise and self-assess.
PURPOSE: To assess the construct and face validity of ArthroS, a passive haptic VR simulator. A secondary aim was to evaluate the novel performance metrics produced by this simulator. METHODS: Two groups of 30 participants, each divided into novice, intermediate or expert based on arthroscopic experience, completed three separate tasks on either the knee or shoulder module of the simulator. Performance was recorded using 12 automatically generated performance metrics and video footage of the arthroscopic procedures. The videos were blindly assessed using a validated global rating scale (GRS). Participants completed a survey about the simulator's realism and training utility. RESULTS: This new simulator demonstrated construct validity of its tasks when evaluated against a GRS (p ≤ 0.003 in all cases). Regarding it's automatically generated performance metrics, established outputs such as time taken (p ≤ 0.001) and instrument path length (p ≤ 0.007) also demonstrated good construct validity. However, two-thirds of the proposed 'novel metrics' the simulator reports could not distinguish participants based on arthroscopic experience. Face validity assessment rated the simulator as a realistic and useful tool for trainees, but the passive haptic feedback (a key feature of this simulator) is rated as less realistic. CONCLUSION: The ArthroS simulator has good task construct validity based on established objective outputs, but some of the novel performance metrics could not distinguish between surgical experience. The passive haptic feedback of the simulator also needs improvement. If simulators could offer automated and validated performance feedback, this would facilitate improvements in the delivery of training by allowing trainees to practise and self-assess.
Authors: Robert A Pedowitz; Gregg T Nicandri; Richard L Angelo; Richard K N Ryu; Anthony G Gallagher Journal: Arthroscopy Date: 2015-08-19 Impact factor: 4.772
Authors: W Dilworth Cannon; Gregg T Nicandri; Karl Reinig; Howard Mevis; Jocelyn Wittstein Journal: J Bone Joint Surg Am Date: 2014-04-02 Impact factor: 5.284
Authors: Ryan J Koehler; Simon Amsdell; Elizabeth A Arendt; Leslie J Bisson; Jonathan P Braman; Jonathan P Bramen; Aaron Butler; Andrew J Cosgarea; Christopher D Harner; William E Garrett; Tyson Olson; Winston J Warme; Gregg T Nicandri Journal: Am J Sports Med Date: 2013-04-02 Impact factor: 6.202
Authors: Sandro F Fucentese; Stefan Rahm; Karl Wieser; Jonas Spillmann; Matthias Harders; Peter P Koch Journal: Knee Surg Sports Traumatol Arthrosc Date: 2014-02-12 Impact factor: 4.342
Authors: J J Stunt; G M M J Kerkhoffs; T Horeman; C N van Dijk; G J M Tuijthof Journal: Knee Surg Sports Traumatol Arthrosc Date: 2014-08-08 Impact factor: 4.342
Authors: Stephan Reppenhagen; Manuel Weißenberger; Thomas Barthel; Maximilian Rudert; Hermann Anetzberger Journal: Unfallchirurg Date: 2019-06 Impact factor: 1.000
Authors: Behnaz Poursartip; Marie-Eve LeBel; Laura C McCracken; Abelardo Escoto; Rajni V Patel; Michael D Naish; Ana Luisa Trejos Journal: Sensors (Basel) Date: 2017-08-05 Impact factor: 3.576