Paul H Yi1,2, Tae Kyung Kim1,2, Jinchi Wei2, Xinning Li3, Gregory D Hager2, Haris I Sair1,2, Jan Fritz4. 1. The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA. 2. Radiology Artificial Intelligence Lab (RAIL), Malone Center for Engineering in Healthcare, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA. 3. Department of Orthopaedic Surgery, Boston University School of Medicine, Boston, MA, USA. 4. Department of Radiology, Division of Musculoskeletal Radiology, New York University Grossman School of Medicine, 660 1st Ave, 3rd Floor, Rm #313, New York, NY, 10016, USA. jan.fritz@nyulangone.org.
Abstract
OBJECTIVE: To develop and evaluate the performance of deep convolutional neural networks (DCNN) to detect and identify specific total shoulder arthroplasty (TSA) models. MATERIALS AND METHODS: We included 482 radiography studies obtained from publicly available image repositories with native shoulders, reverse TSA (RTSA) implants, and five different TSA models. We trained separate ResNet DCNN-based binary classifiers to (1) detect the presence of shoulder arthroplasty implants, (2) differentiate between TSA and RTSA, and (3) differentiate between the five TSA models, using five individual classifiers for each model, respectively. Datasets were divided into training, validation, and test datasets. Training and validation datasets were 20-fold augmented. Test performances were assessed with area under the receiver-operating characteristic curves (AUC-ROC) analyses. Class activation mapping was used to identify distinguishing imaging features used for DCNN classification decisions. RESULTS: The DCNN for the detection of the presence of shoulder arthroplasty implants achieved an AUC-ROC of 1.0, whereas the AUC-ROC for differentiation between TSA and RTSA was 0.97. Class activation map analysis demonstrated the emphasis on the characteristic arthroplasty components in decision-making. DCNNs trained to distinguish between the five TSA models achieved AUC-ROCs ranging from 0.86 for Stryker Solar to 1.0 for Zimmer Bigliani-Flatow with class activation map analysis demonstrating an emphasis on unique implant design features. CONCLUSION: DCNNs can accurately identify the presence of and distinguish between TSA & RTSA, and classify five specific TSA models with high accuracy. The proof of concept of these DCNNs may set the foundation for an automated arthroplasty atlas for rapid and comprehensive model identification.
OBJECTIVE: To develop and evaluate the performance of deep convolutional neural networks (DCNN) to detect and identify specific total shoulder arthroplasty (TSA) models. MATERIALS AND METHODS: We included 482 radiography studies obtained from publicly available image repositories with native shoulders, reverse TSA (RTSA) implants, and five different TSA models. We trained separate ResNet DCNN-based binary classifiers to (1) detect the presence of shoulder arthroplasty implants, (2) differentiate between TSA and RTSA, and (3) differentiate between the five TSA models, using five individual classifiers for each model, respectively. Datasets were divided into training, validation, and test datasets. Training and validation datasets were 20-fold augmented. Test performances were assessed with area under the receiver-operating characteristic curves (AUC-ROC) analyses. Class activation mapping was used to identify distinguishing imaging features used for DCNN classification decisions. RESULTS: The DCNN for the detection of the presence of shoulder arthroplasty implants achieved an AUC-ROC of 1.0, whereas the AUC-ROC for differentiation between TSA and RTSA was 0.97. Class activation map analysis demonstrated the emphasis on the characteristic arthroplasty components in decision-making. DCNNs trained to distinguish between the five TSA models achieved AUC-ROCs ranging from 0.86 for Stryker Solar to 1.0 for Zimmer Bigliani-Flatow with class activation map analysis demonstrating an emphasis on unique implant design features. CONCLUSION: DCNNs can accurately identify the presence of and distinguish between TSA & RTSA, and classify five specific TSA models with high accuracy. The proof of concept of these DCNNs may set the foundation for an automated arthroplasty atlas for rapid and comprehensive model identification.
Entities:
Keywords:
Artificial intelligence; Deep learning; Implant identification; Shoulder arthroplasty
Authors: Paul H Yi; Tae Kyung Kim; Jinchi Wei; Jiwon Shin; Ferdinand K Hui; Haris I Sair; Gregory D Hager; Jan Fritz Journal: Pediatr Radiol Date: 2019-04-30
Authors: Gabriel Chartrand; Phillip M Cheng; Eugene Vorontsov; Michal Drozdzal; Simon Turcotte; Christopher J Pal; Samuel Kadoury; An Tang Journal: Radiographics Date: 2017 Nov-Dec Impact factor: 5.333
Authors: Philippe M Burlina; Neil J Joshi; Elise Ng; Seth D Billings; Alison W Rebman; John N Aucott Journal: Comput Biol Med Date: 2018-12-18 Impact factor: 4.589
Authors: Andre Esteva; Brett Kuprel; Roberto A Novoa; Justin Ko; Susan M Swetter; Helen M Blau; Sebastian Thrun Journal: Nature Date: 2017-01-25 Impact factor: 49.962
Authors: Catherine C Roberts; Anders L Ekelund; Kevin J Renfree; Patrick T Liu; Felix S Chew Journal: Radiographics Date: 2007 Jan-Feb Impact factor: 5.333
Authors: Jakub Olczak; Niklas Fahlberg; Atsuto Maki; Ali Sharif Razavian; Anthony Jilert; André Stark; Olof Sköldenberg; Max Gordon Journal: Acta Orthop Date: 2017-07-06 Impact factor: 3.717
Authors: Robert Lindsey; Aaron Daluiski; Sumit Chopra; Alexander Lachapelle; Michael Mozer; Serge Sicular; Douglas Hanel; Michael Gardner; Anurag Gupta; Robert Hotchkiss; Hollis Potter Journal: Proc Natl Acad Sci U S A Date: 2018-10-22 Impact factor: 11.205
Authors: Nils F Grauhan; Stefan M Niehues; Robert A Gaudin; Sarah Keller; Janis L Vahldiek; Lisa C Adams; Keno K Bressem Journal: Skeletal Radiol Date: 2021-02-20 Impact factor: 2.199