| Literature DB >> 36135414 |
Emily N Boice1, Sofia I Hernandez Torres1, Zechariah J Knowlton1, David Berard1, Jose M Gonzalez1, Guy Avital1,2,3, Eric J Snider1.
Abstract
Ultrasound (US) imaging is a critical tool in emergency and military medicine because of its portability and immediate nature. However, proper image interpretation requires skill, limiting its utility in remote applications for conditions such as pneumothorax (PTX) which requires rapid intervention. Artificial intelligence has the potential to automate ultrasound image analysis for various pathophysiological conditions. Training models require large data sets and a means of troubleshooting in real-time for ultrasound integration deployment, and they also require large animal models or clinical testing. Here, we detail the development of a dynamic synthetic tissue phantom model for PTX and its use in training image classification algorithms. The model comprises a synthetic gelatin phantom cast in a custom 3D-printed rib mold and a lung mimicking phantom. When compared to PTX images acquired in swine, images from the phantom were similar in both PTX negative and positive mimicking scenarios. We then used a deep learning image classification algorithm, which we previously developed for shrapnel detection, to accurately predict the presence of PTX in swine images by only training on phantom image sets, highlighting the utility for a tissue phantom for AI applications.Entities:
Keywords: artificial intelligence; automation; deep learning; human; model development; pneumothorax; porcine; tissue phantom; ultrasound
Year: 2022 PMID: 36135414 PMCID: PMC9502699 DOI: 10.3390/jimaging8090249
Source DB: PubMed Journal: J Imaging ISSN: 2313-433X
Figure 1Synthetic platform for pneumothorax image acquisition: (A) CAD rendering of the thoracic cavity with a dimensioned cross-section view of one variation; (B) Image acquisition platform incorporating (top to bottom): ultrasound probe manually held in place and connected to the ultrasound unit, synthetic skin positioned atop the rib phantom that was held in place by the ring stand, and the lung phantom located on the bed of the orbital shaker.
Figure 2Image processing and algorithm training pathway. M-mode images were obtained from the synthetic phantom, and coordinates of the time capture window were identified. A rolling window method was performed to isolate 100 individual panels from each capture window. The individual panels were used as the initial training set (No Data Aug box). A basic augmentation step was performed to the original dataset to create the second training set (+X-Y Flip, +Zoom Aug box). The third image preprocessing step used a porcine M-mode image to normalize the histogram for the phantom panels (+Histogram Normalization box). The final augmentation step included brightness and contrast augmentation to generate additional images (+Brightness, +Contrast Aug box).
Figure 3B-mode image comparison with euthanized porcine subjects and synthetic phantom: (A) Baseline thoracic image acquired from porcine subject; (B) Baseline image acquired from rib and lung phantom apparatus; (C) Post-injury image acquired from same porcine subject; (D) Pneumothorax positive image acquired from synthetic phantom apparatus.
Figure 4M-mode image comparison with porcine subjects and synthetic phantoms: (A) Baseline thoracic image acquired from porcine subject; (B) Baseline image acquired from synthetic phantom apparatus; (C) Post-injury image acquired from same porcine subject; (D) Pneumothorax positive image acquired from synthetic phantom apparatus.
Figure 5Confusion matrix results for swine image predictions using four image augmentation approaches. Average confusion matrix results are shown for (A) no image augmentation (n = 3 independent trained models), (B) using zoom and flip image augmentation (n = 3 trained models), (C) further including image histogram swine/phantom matching (n = 5 trained models), and (D) finally including contrast and brightness image augmentation (n = 5 trained models). All models were trained on processed M-mode segments collected in the synthetic phantom apparatus, and confusion matrix test results are shown for swine M-mode image sets (n = 400 total image segments, equal number of positive and negative PTX images). Results are shown as mean percent across replicate trained models for each confusion matrix category.
Summary of model performance metrics. Results are shown for each image augmentation methodology for phantom split test data sets and swine test image sets. Augmentation steps follow the pathway described in Figure 2.
| Augmentation | Testing Type | Accuracy | Precision | Recall | Specificity | F1 |
|---|---|---|---|---|---|---|
| None | Split | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
| Swine | 0.500 | - | - | 1.000 | - | |
| Only X-Y Flip and Zoom | Split | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
| Swine | 0.500 | - | - | 1.000 | - | |
| + Histogram Normalization | Split | 0.999 | 0.999 | 1.000 | 0.999 | 0.999 |
| Swine | 0.825 | 0.792 | 0.969 | 0.68 | 0.862 | |
| + Contrast/Brightness | Split | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
| Swine | 0.936 | 0.898 | 0.998 | 0.873 | 0.942 |