| Literature DB >> 35294716 |
Reinhard Fuchs1, Karel M Van Praet2,3, Richard Bieck4, Jörg Kempfert2,3, David Holzhey5, Markus Kofler2,3, Michael A Borger5, Stephan Jacobs2,3, Volkmar Falk2,3,6,7, Thomas Neumuth4.
Abstract
PURPOSE: For an in-depth analysis of the learning benefits that a stereoscopic view presents during endoscopic training, surgeons required a custom surgical evaluation system enabling simulator independent evaluation of endoscopic skills. Automated surgical skill assessment is in dire need since supervised training sessions and video analysis of recorded endoscope data are very time-consuming. This paper presents a first step towards a multimodal training evaluation system, which is not restricted to certain training setups and fixed evaluation metrics.Entities:
Keywords: Electromyography; Endoscopic training; Endoscopy; Kinect; Myo armband
Mesh:
Year: 2022 PMID: 35294716 PMCID: PMC9463288 DOI: 10.1007/s11548-022-02588-1
Source DB: PubMed Journal: Int J Comput Assist Radiol Surg ISSN: 1861-6410 Impact factor: 3.421
Fig. 1Overview of exercises performed on the phantom module during training study; a first exercise, bimanual carrying of 2 pegs over one lower needle each, afterwards restack one peg over one upper needle b second exercise, needle passing through the artificial leather of the phantom c needle passing with suture thread through the artificial leather and subsequent thread mounting on the outside
Fig. 2System design for multivariate laparoscopic training evaluation
Fig. 3Right-Hand-Y-Position-Curve of 3 exercise attempts, recorded in one file; the curve (blue) of the right hand Y-position in the Kinect recording shows the synchronization gesture, i.e. hand raises, as an increase in the Y-position (red rectangles with dashed lines) at the beginning and end of each attempt (green rectangles with straight lines)
Calculated features for exercise rating per attempt
| Myo armband features per sEMG channel | Description |
|---|---|
| The most powerful frequency in the filtered frequency spectrum | |
| The least powerful frequency in the filtered frequency spectrum | |
| The distance between the most and the least powerful frequency of the sEMG spectrum | |
| The value of the most powerful frequency in the filtered frequency spectrum | |
| The value of the least powerful frequency in the filtered frequency spectrum | |
| The highest sEMG amplitude | |
| The lowest sEMG amplitude | |
| The difference between the highest and the lowest sEMG value | |
| The Root-Mean-Square over the collected sEMG values | |
| The number of Sign-Slope-Changes in the sEMG curve | |
| The number of Zero-Crossings in the sEMG curve | |
| The sEMG Waveform-Length | |
| The variance of the sEMG signal | |
| RollAUC | The Area-Under-Curve of the Roll values |
| PitchAUC | The Area-Under-Curve of the Pitch values |
| YawAUC | The Area-Under-Curve of the Yaw values |
| FES | The ratio between maximum frequency location (fMax) and the averaged Are-Under-Curve (AUC) of Roll, Pitch and Yaw |
Fig. 4Boxplots representing RANOVA p-Value calculation results for each session of exercise 1, representing significance depending on time and the combination of time and the used endoscope type; outliers circled with dashed orange lines represent the reoccurring high p-Value of the feature Velocity Elbow
Fig. 5Heatmap visualizing the averaged Euclidean distances between 2D values and 3D values of the features for the exercise 3 dataset; Y-Axis contains the averaged 2D metric-specific feature vector which were used for element-wise comparison with the 3D metric-specific feature vector
Fig. 6Heatmap visualizing the averaged Mahalanobis distances between 2D values and 3D values of the features for the exercise 3 dataset; Y-Axis contains the averaged 2D metric-specific feature vector which were used for element-wise comparison with the 3D metric-specific feature vector
Accuracy rates of endoscope classification models for each exercise and the used feature selections
| Classification learner | Exercise 1 | Exercise 2 | Exercise 3 | |||
|---|---|---|---|---|---|---|
| All | 15% | All | 15% | All | 15% | |
| SVM Linear | 91.7 | 77.8 | 84.3 | 73.1 | 84.3 | 88.9 |
| SVM Quadratic | 94.4 | 88.9 | 93.5 | 78.7 | 87.0 | 87.0 |
| SVM Cubic | 96.3 | 88.0 | 91.7 | 79.6 | 87.0 | 88.9 |
| SVM Fine Gaussian | 64.8 | 75.0 | 66.7 | 61.1 | 52.8 | 62.0 |
| SVM Medium Gaussian | 89.8 | 88.9 | 93.5 | 81.5 | 87.0 | 86.1 |
| SVM Coarse Gaussian | 83.3 | 71.3 | 79.6 | 73.1 | 80.6 | 85.2 |
| KNN Fine | 89.8 | 88.9 | 89.8 | 81.5 | 88.0 | 84.3 |
| KNN Medium | 89.8 | 82.4 | 82.4 | 79.6 | 83.3 | 84.3 |
| KNN Coarse | 49.1 | 49.1 | 49.1 | 49.1 | 49.1 | 49.1 |
| KNN Cosine | 88.0 | 74.1 | 85.2 | 77.8 | 81.5 | 81.5 |
| KNN Cubic | 84.3 | 77.8 | 82.4 | 79.6 | 77.8 | 81.5 |
| KNN Weighted | 88.9 | 83.3 | 88.0 | 79.6 | 85.2 | 85.2 |
| Boosted Trees | 49.1 | 49.1 | 49.1 | 49.1 | 49.1 | 49.1 |
| Bagged Trees | 98.1 | 86.1 | 93.5 | 82.4 | 93.5 | 92.6 |
| Subspace Discriminant Ensemble | 88.0 | 87.0 | 87.0 | 75.9 | 84.3 | 90.7 |
| KNN Subspace | 87.0 | 82.4 | 79.6 | 73.1 | 83.3 | 84.3 |
| RUS Boosted Trees | 57.4 | 49.1 | 56.5 | 52.8 | 49.1 | 57.4 |