| Literature DB >> 35919046 |
Ben-Heng Xiao1, Michael S Y Zhu2, Er-Zhu Du3, Wei-Hong Liu4, Jian-Bing Ma5, Hua Huang6, Jing-Shan Gong7, Davide Diacinti8,9, Kun Zhang10, Bo Gao11, Heng Liu12, Ri-Feng Jiang13, Zhong-You Ji14, Xiao-Bao Xiong15, Lai-Chang He16, Lei Wu17, Chuan-Jun Xu18, Mei-Mei Du19, Xiao-Rong Wang20, Li-Mei Chen1, Kong-Yang Wu1,21, Liu Yang1, Mao-Sheng Xu17, Daniele Diacinti8, Qi Dou22, Timothy Y C Kwok23, Yì Xiáng J Wáng1.
Abstract
Background: Because osteoporotic vertebral fracture (OVF) on chest radiographs is commonly missed in radiological reports, we aimed to develop a software program which offers automated detection of compressive vertebral fracture (CVF) on lateral chest radiographs, and which emphasizes CVF detection specificity with a low false positivity rate.Entities:
Keywords: Osteoporosis; artificial intelligence; chest; deep learning; radiograph; vertebral fracture
Year: 2022 PMID: 35919046 PMCID: PMC9338385 DOI: 10.21037/qims-22-433
Source DB: PubMed Journal: Quant Imaging Med Surg ISSN: 2223-4306
Information of image data used for ‘base-model’ training and testing
| Hospital | Total cases | Age | OVF cases | X-ray region | Image format |
|---|---|---|---|---|---|
| Training data 1 | 1,994 | ≥65 years | 308 | T and L spine | Scanned PNG |
| Training data 2 | 1,531 | ≥69 years | 249 | T and L spine | Scanned PNG |
| Training data 3 | 761 | ≥65 years | 273 | Chest | DICOM |
| Training data 4 | 127 | ≥65 years | 25 | Chest | DICOM |
| Training data 5 | 109 | ≥65 years | 32 | Chest | DICOM |
| Training data 6 | 99 | ≥65 years | 11 | Chest | DICOM |
| Training data 7 | 100 | ≥65 years | 38 | Chest | DICOM |
| Training data 8 | 101 | ≥65 years | 36 | Chest | DICOM |
| Training data 9 | 146 | ≥65 years | 35 | Chest | DICOM |
| Training data 10 | 284 | ≥65 years | 52 | Chest | DICOM |
| Training data 11 | 112 | ≥65 years | 27 | Chest | DICOM |
| Training data 12 | 31 | No limitation | 31 | Spine* | DICOM |
| Training data 13 | 132 | ≥55 years | 58 | Spine** | DICOM |
| Training data 14 | 102 | ≥65 years | 34 | Chest | DICOM |
| Training data 15 # | 303 | ≥60 years | 176 | T and L spine | Exported PNG |
| Training data 16 | 38 | ≥65 years | 19 | Chest | DICOM |
| Total for Training | 5,970 | 1404 | |||
| Testing data 1 | 144 | ≥65 years | 49 | Chest | DICOM |
| Testing data 2 | 164 | ≥65 years | 40 | Chest | DICOM |
| Testing data 3 | 162 | ≥85 years | 52 | T and L spine | Scanned PNG |
| Testing data 4 ## | 234 | ≥65 years | 74 | Chest | Reduced DICOM |
| Total for testing | 704 | 215 |
Training data 1 and data 2 were acquired for MsOS (Hong Kong) study with 4 years apart, and with different acquisition radiography machines applied, thus equivalent to data from two sources. *, spine traumatic fracture patients (lateral and frontal view radiographs available); **, spine radiograph for back pain patients (lateral and frontal view radiographs available); #, Caucasian subjects from Italy, in DICOM exported PNG format. ##, data in PACS downloaded reduced resolution DICOM format. Only lateral view radiographs available for training data 1, 2, and 15, while all chest radiographs have both lateral and frontal views. OVF, osteoporotic vertebral fracture; scanned PNG, hard film scanned image; DICOM, Digital Imaging and Communications in Medicine; PNG, Portable Network Graphics; PACS, Picture Archiving and Communications System .
Figure 1The main operation window of Ofeye 1.0. The image on the left is an original lateral chest radiograph. With the image on the right, three CVFs were labelled on this lateral chest radiograph, with a probability of 0.90, 0.91, and 0.83, respectively. Reference reading confirms these three OVFs. One further minimal grade OVF was missed in this case. OVF, osteoporotic vertebral fracture; CVF, compressive vertebral fracture.
Vertebral fracture detection performance of base-model 1.0 (counting cases)
| Data | Total | TP case | FP case | TN case | FN case | Sensitivity | Specificity | Accuracy |
|---|---|---|---|---|---|---|---|---|
| Data 1 | 144 | 43 | 1 | 94 | 6 | 0.878 | 0.989 | 0.951 |
| Data 2 | 164 | 34 | 1 | 123 | 6 | 0.85 | 0.992 | 0.957 |
| Data 3 | 162 | 46 | 6 | 104 | 6 | 0.885 | 0.945 | 0.926 |
| Data 4 | 234 | 62 | 5 | 155 | 12 | 0.838 | 0.969 | 0.927 |
| Total | 704 | 185 | 13 | 476 | 30 | 0.860 | 0.973 | 0.938 |
TP, true positive; FP, false positive; TN, true negative; FN, false negative.
Details of ≥ moderate grade OVFs missed in the independent testing data
| Case number | OVF number | Grade | Explanation for the false negativity |
|---|---|---|---|
| 4 | 4 | Moderate | OVF close to a border of the image |
| 1 | 1 | Moderate | OVF overlay with diagram line |
| 1 | 2 | Moderate | OVF together with osteoarthritis |
| 1 | 3 | Moderate | OVF together with osteoarthritis and disappearance of disc space |
| 1 | 1 | Moderate | Oblique filming to the X-ray beam |
| 3 | 3 | Moderate | n/a |
| 2 | 2 | Severe | n/a |
| 1 | 1 | Collapsed | Vertebra totally collapsed |
| 1 | 1 | Collapsed | Vertebra collapsed + rotation |
OVFs, osteoporotic vertebral fractures; n/a, not available.
Details of false positively labelled vertebrae in the independent testing data
| Case number | OVF number | Explanation for the false positivity |
|---|---|---|
| 3 | 3 | Labeled vertebra above T4 |
| 3 | 3 | Labeled vertebra had rotation to X-ray beam |
| 5 | 5 | Labeled vertebra looks like minimal CVF |
| 1 | 1 | Labeled vertebra looks like minimal CVF + diagram line overlaying |
| 1 | 1 | n/a |
OVF, osteoporotic vertebral fracture; CVF, compressive vertebral fracture; n/a, not available.
Figure 2A false positive labelling of vertebra T7 in a study subject. The case was from testing data 3 with hard film scanned image. The image was of sub-optimal quality. (A) shows vertebra T7 is labelled as CVF with a relatively low probability of 0.67. (B) is the original image, scoliosis was suspected with multiple thoracic vertebrae showing apparent oval endplate rings. On the other hand, the anterior vertebral height of T7 appears to be similar to the adjacent vertebrae. T7 was not considered to have OVF by reference reading. OVF, osteoporotic vertebral fracture; CVF, compressive vertebral fracture.