Literature DB >> 34185175

Workload of diagnostic radiologists in the foreseeable future based on recent scientific advances: growth expectations and role of artificial intelligence.

Thomas C Kwee1, Robert M Kwee2.   

Abstract

OBJECTIVE: To determine the anticipated contribution of recently published medical imaging literature, including artificial intelligence (AI), on the workload of diagnostic radiologists.
METHODS: This study included a random sample of 440 medical imaging studies published in 2019. The direct contribution of each study to patient care and its effect on the workload of diagnostic radiologists (i.e., number of examinations performed per time unit) was assessed. Separate analyses were done for an academic tertiary care center and a non-academic general teaching hospital.
RESULTS: In the academic tertiary care center setting, 65.0% (286/440) of studies could directly contribute to patient care, of which 48.3% (138/286) would increase workload, 46.2% (132/286) would not change workload, 4.5% (13/286) would decrease workload, and 1.0% (3/286) had an unclear effect on workload. In the non-academic general teaching hospital setting, 63.0% (277/240) of studies could directly contribute to patient care, of which 48.7% (135/277) would increase workload, 46.2% (128/277) would not change workload, 4.3% (12/277) would decrease workload, and 0.7% (2/277) had an unclear effect on workload. Studies with AI as primary research area were significantly associated with an increased workload (p < 0.001), with an odds ratio (OR) of 10.64 (95% confidence interval (CI) 3.25-34.80) in the academic tertiary care center setting and an OR of 10.45 (95% CI 3.19-34.21) in the non-academic general teaching hospital setting.
CONCLUSIONS: Recently published medical imaging studies often add value to radiological patient care. However, they likely increase the overall workload of diagnostic radiologists, and this particularly applies to AI studies.

Entities:  

Keywords:  Artificial intelligence; Radiologists; Radiology; Research; Workload

Year:  2021        PMID: 34185175      PMCID: PMC8241957          DOI: 10.1186/s13244-021-01031-4

Source DB:  PubMed          Journal:  Insights Imaging        ISSN: 1869-4101


Key points

In an academic tertiary care center, 65.0% of recently published medical imaging studies could directly contribute to patient care, of which 48.3% would increase and 4.5% would decrease workload. In a non-academic general teaching hospital, 63.0% of recently published medical imaging studies could directly contribute to patient care, of which 48.7% would increase and 4.3% would decrease workload. Recently published medical imaging studies with AI as primary research area are significantly associated with an increased workload.

Introduction

The workload of radiologists (i.e., the product of the number and complexity of examinations performed per time unit) has increased considerably over the past decades. This is largely due to the growth in the number of cross-sectional imaging examinations (particularly CT and MRI), increased complexity of image interpretation because of the acquisition of larger datasets, and declining imaging reimbursements [1-4]. The latter forces radiology practices to increase productivity to maintain income levels, while limiting their financial possibilities to employ new staff. Consequently, the overall workload per radiologist has considerably increased over the past years. Not surprisingly, burnout is recognized as an increasingly important problem among radiologists [5, 6]. Work overload may also compromise the quality and safety of patient care that can be provided by radiologists [7-9]. There are many factors that influence the utilization of medical imaging [10]. Scientific evidence can be considered as perhaps the most important driver, because research-based advances shape the way how radiology practice is performed in the future. Currently, however, it is unclear how recently published literature contributes to the workload in the field of radiology. This information would be important to radiologists and other stakeholders (including healthcare systems and governmental bodies) who aim to maintain a radiology workforce that is sufficiently large to meet clinical demands at high standards. Meanwhile, there are also voices that speculate that artificial intelligence (AI) is expected to speed up scan time, make more accurate diagnoses, and ease the workload of radiologists [11]. Although the speculation that AI will decrease workload has not yet been supported by evidence, it can already have an important impact on political and strategic decisions. Based on this speculation, policy makers may already decide not to increase or even to limit the number of residents that can be enrolled into radiology training programs, may limit financial resources to employ (new) radiologists, and may further cut reimbursements for imaging procedures. This may have detrimental effects that cannot be rapidly reversed when the workload of radiologists actually proves to keep on increasing. Interestingly, in a recent survey among European Society of Radiology (ESR) members, 74.7% (504/675) expected an impact of AI on total reporting workload, with 50.8% (256/504) of them expecting a reduced reporting workload and 49.2% (248/504) expecting the opposite scenario [12]. Since the effect of AI on future workload remains unclear, and associated practical consequences are very relevant, it is crucial to fill in this knowledge gap. It is hypothesized that most recent scientific evidence increases workload in radiology practice, while there is no net effect of AI on radiologists’ workload based on the recent ESR survey results [12]. The purpose of this study was therefore to determine the anticipated contribution of recently published medical imaging literature on the workload of diagnostic radiologists.

Materials and methods

Study design

This study used literature data and did not require ethical review board approval or patient consent. Studies that were published in any of the 20 highly ranked clinical imaging journals and 20 highly ranked general medicine and clinical specialty journals (according to impact factor in the Journal Citation reports [13], that are listed in Table 1, were considered for inclusion in this study. All studies that were published in these 40 clinical journals in 2019 were retrieved from PubMed/Medline using the search term that is displayed in Additional file 1: Appendix 1. Using the random number generator in Microsoft Excel (Microsoft Corporation), a random sample of 1,000 studies was drawn from the studies that were retrieved by the PubMed/Medline search. These 1,000 studies were reviewed for eligibility by consensus of two radiologists (T.C.K. & R.M.K.). Studies were included if they concerned diagnostic imaging studies. Only original studies, systematic reviews and meta-analyses, were included. Case reports, conference proceedings, editorials, errata, guidelines/society statements, studies dealing with interventional radiology, letters to the editor, meeting summaries, non-systematic reviews, and studies clearly not related to medical imaging, were excluded. Studies dealing with imaging procedures that are not performed by radiologists in the authors’ institutions, such as cardiac ultrasonography or endoscopic ultrasonography, were also excluded. Studies were excluded if clearly ineligible based on title and abstract; otherwise, the full text version was evaluated.
Table 1

Overview of 20 clinical imaging journals and 20 general medicine and clinical specialty journals whose studies were potentially eligible for inclusion

Imaging journalsGeneral medicine and clinical specialty journals
JACC: Cardiovascular ImagingNew England Journal of Medicine
RadiologyLancet
Journal of Nuclear MedicineJournal of the American Medical Association
European Journal of Nuclear Medicine and Molecular ImagingLancet Oncology
Clinical Nuclear MedicineJournal of Clinical Oncology
Journal of Cardiovascular Magnetic ResonanceBMJ
Investigative RadiologyLancet Neurology
European Heart Journal—Cardiovascular ImagingLancet Diabetes & Endocrinology
Journal of the American College of RadiologyLancet Respiratory Medicine
European RadiologyJAMA Oncology
Journal of Magnetic Resonance ImagingLancet Infectious Diseases
Insights into ImagingCirculation
American Journal of NeuroradiologyEuropean Heart Journal
Journal of Nuclear CardiologyAnnals of Internal Medicine
Quantitative Imaging in Medicine and SurgeryJournal of the American College of Cardiology
Clinical NeuroradiologyGut
Korean Journal of RadiologyEuropean Urology
Journal of Vascular and Interventional RadiologyJAMA Internal Medicine
American Journal of RoentgenologyAnnals of Oncology
European Journal of RadiologyBlood
Overview of 20 clinical imaging journals and 20 general medicine and clinical specialty journals whose studies were potentially eligible for inclusion

Study analysis

One radiologist affiliated to an academic tertiary care center in the north of the Netherlands (T.C.K., radiologist 1), and another radiologist affiliated to a non-academic general teaching hospital in the south of the Netherlands (R.M.K., radiologist 2), independently reviewed the full text of each included study. Radiologist 1 had 5 years of post-residency clinical radiology experience and radiologist 2 had 6 years of post-residency clinical radiology experience, and both radiologists had 15 years of experience in critically appraising scientific literature in radiology. The radiology departments in both institutions, which are among the largest in The Netherlands, are regularly audited by the Radiological Society of the Netherlands to fulfill quality standards of radiological care [14]. Both radiologists assessed whether the results of each individual study could directly contribute to patient care in their radiology practice (i.e., whether the results may be directly implemented in practice for the purpose of enhancing patient care). If this was the case, this contribution was then categorized as concerning: a completely new imaging application in their radiology practice. another type of imaging as an alternative for an existing imaging application in their radiology practice. an elaboration of on an existing imaging application in their radiology practice. For contributions in category (2), it was qualitatively determined if the acquisition, post-processing, and interpretation times of the alternative type of imaging would be shorter than, as long as, or longer than that of the existing imaging application, or whether this remained unclear. Similarly, for contributions in category (3), it was qualitatively determined if the acquisition, post-processing, and interpretation times of the existing imaging application would decrease, remain stable, increase, or whether this remained unclear. Note that acquisition time refers to the time required to obtain images of the human body with a certain imaging modality, post-processing time refers to the time required for the manipulation of medical images to derive additional qualitative or quantitative data [15], and interpretation time refers to the time required to analyze and interpret the acquired and post-processed imaging data. All studies in category (1) and any study in categories (2) or (3) with a net increase in acquisition, post-processing, and/or interpretation time were considered to increase workload. Any study in categories (2) or (3) with a net decrease in acquisition, post-processing, and/or interpretation time was considered to decrease workload. Any study in categories (2) or (3) without a net change in acquisition, post-processing, and/or interpretation time was considered to have no effect on workload. All other studies were considered to have an unclear impact on workload. Study examples are shown in Tables 2 and 3 [16-26].
Table 2

Examples of studies with a direct contribution to patient carea,b

ReferencesPrimary research areaDescription studyCategoryWorkload
[16]Neuroradiology

Study purpose:

“To assess diagnostic accuracy of MR neurography in the differential diagnosis of amyotrophic lateral sclerosis (ALS) and multifocal motor neuropathy (MMN)”

Study conclusion:

“MR neurography is an accurate method for assisting in the differential diagnosis of ALS and MMN”

Completely new imaging applicationIncreases (new imaging application)
[17]Chest

Study purpose:

“This study analyzed phantom and human chronic obstructive pulmonary disease (COPD) data to test the hypothesis that ultra-high-resolution computed tomography (U-HRCT) can accurately measure peripheral airways that are difficult to measure with conventional CT”

Study conclusion:

“U-HRCT enables accurate and direct evaluation of peripheral airways 1–2 mm in diameter. The 6th generation airways are commonly < 2 mm in diameter, and the sum-LA can be a useful CT biomarker that reflects airflow limitation in COPD”

Another type of imaging as an alternative for an existing imaging applicationIncreases (longer interpretation time than conventional HRCT)
[18]Nuclear medicine

Study purpose:

“The aim of this study was to investigate the diagnostic performance of whole-body [C]acetate PET/CT in less aggressive or indolent lymphomas, wherein [F]FDG PET/CT would exhibit limited sensitivity”

Study conclusion: “[C]acetate PET/CT exhibited greater sensitivity than [F]FDG PET/CT for lesion detection in patients with less aggressive or indolent lymphomas, thus promising applicability as a physiological tracer in the study of such lesions”

Another type of imaging as an alternative for an existing imaging applicationNo change
[19]AI

Study purpose:

“Focal pattern in multiple myeloma (MM) seems to be related to poorer survival and differentiation from diffuse to focal pattern on CT has inter-reader variability. We postulated that a radiomic approach could help radiologists in differentiating diffuse from focal patterns on CT”

Study conclusion:

“A radiomics approach improves radiological evaluation of focal and diffuse pattern of MM on CT”

Elaboration of an existing imaging applicationIncreases (longer post-processing and interpretation time)
[20]Musculoskeletal

Study purpose:

“To assess how many and which CT reformats of long bone non-unions should be analyzed to best approximate the analysis of a larger number of CT reformats obtained in the three orthogonal planes”

Study conclusion:

“Semi-quantitative analysis of the two paramedian sagittal and coronal CT reformats is an acceptable alternative to the analysis of more numerous reformats”

Elaboration of an existing imaging applicationDecreases (shorter interpretation time)
[21]Cardiac

Study purpose:

“To investigate the clinical utility of our newly developed contrast enhancement optimizer (CEO) software for coronary CT angiography (CCTA)”

Study conclusion:

“The use of our CEO for CCTA studies yielded optimal aortic contrast enhancement in significantly more patients than the standard protocol based on the body weight”

Elaboration of an existing imaging applicationNo change

aBased on the applicability of the methods, results, interpretations, and conclusions, as described in each study, to the patient spectrum and radiology practice in the institutions of each of the two observers. Study quality was not a factor that influenced this decision

bThe examples shown in this table study could directly contribute to patient care in the radiology practices of both observers 1 and 2

Table 3

Examples of studies without a direct contribution to patient carea,b

ReferencesPrimary research areaDescription study
[22]Nuclear medicine

Study purpose:

“The aim of this study is to measure acute changes in NaF uptake in human bone due to exercise-induced loading”

Study conclusion:

“Bone loading induces an acute response in bone physiology as quantified by [18F]NaF PET kinetics. Dynamic imaging after bone loading using [18F]NaF PET is a promising diagnostic tool in bone physiology and imaging of biomechanics”

[23]Magnetic resonance

Study purpose:

“To qualitatively and quantitatively compare the image quality between single-shot echo-planar (SS-EPI) and multi-shot echo-planar (IMS-EPI) diffusion-weighted imaging (DWI) in female pelvis”

Study conclusion:

“IMS-EPI showed better image quality with lower geometric distortion without affecting the quantification of apparent diffusion coefficient, though the signal-to-noise ratio and contrast-to-noise ratio decreased due to post-processing limitations”

[24]Breast

Study purpose:

“To develop a fast three-dimensional method for simultaneous T1 and T2 quantification for breast imaging by using MR fingerprinting”

Study conclusion:

“A method was developed for breast imaging by using the MR fingerprinting technique, which allows simultaneous and volumetric quantification of T1 and T2 relaxation times for breast tissues”

[25]Gastrointestinal–abdominal

Study purpose:

“To compare patient acceptability and burden of magnetic resonance enterography (MRE) and ultrasound (US) to each other, and to other enteric investigations, particularly colonoscopy.”

Study conclusion:

“MRE and US are well tolerated. Although MRE generates greater burden, longer recovery and is less preferred than US, it is more acceptable than colonoscopy. Patients, however, place greater emphasis on diagnostic accuracy than burden”

[26]Urogenital

Study purpose:

“The objectives of this study were to assess whether the accuracy of urologists in identifying the presence of clinically significant cancer based on a standardized multiparametric MRI set could be improved by completion of a 2-d training course”

Study conclusion:

“Whilst we require expert radiologists to report prostate MRI, this study has demonstrated that identification of clinically significant cancer on prostate MRI by urologists is improved following exposure to a 2-d teaching course. These results would support efforts to integrate prostate MRI teaching courses into the training of urologists managing patients with prostate cancer”

aBased on the applicability of the methods, results, interpretations, and conclusions, as described in each study, to the patient spectrum and radiology practice in the institutions of each of the two observers. Study quality was not a factor that influenced this decision

bThe examples shown in this table study could not directly contribute to patient care in the radiology practices of both observers 1 and 2

Examples of studies with a direct contribution to patient carea,b Study purpose: “To assess diagnostic accuracy of MR neurography in the differential diagnosis of amyotrophic lateral sclerosis (ALS) and multifocal motor neuropathy (MMN)” Study conclusion: “MR neurography is an accurate method for assisting in the differential diagnosis of ALS and MMN” Study purpose: “This study analyzed phantom and human chronic obstructive pulmonary disease (COPD) data to test the hypothesis that ultra-high-resolution computed tomography (U-HRCT) can accurately measure peripheral airways that are difficult to measure with conventional CT” Study conclusion: “U-HRCT enables accurate and direct evaluation of peripheral airways 1–2 mm in diameter. The 6th generation airways are commonly < 2 mm in diameter, and the sum-LA can be a useful CT biomarker that reflects airflow limitation in COPD Study purpose: “The aim of this study was to investigate the diagnostic performance of whole-body [C]acetate PET/CT in less aggressive or indolent lymphomas, wherein [F]FDG PET/CT would exhibit limited sensitivity” Study conclusion: “[C]acetate PET/CT exhibited greater sensitivity than [F]FDG PET/CT for lesion detection in patients with less aggressive or indolent lymphomas, thus promising applicability as a physiological tracer in the study of such lesions” Study purpose: “Focal pattern in multiple myeloma (MM) seems to be related to poorer survival and differentiation from diffuse to focal pattern on CT has inter-reader variability. We postulated that a radiomic approach could help radiologists in differentiating diffuse from focal patterns on CT” Study conclusion: “A radiomics approach improves radiological evaluation of focal and diffuse pattern of MM on CT” Study purpose: “To assess how many and which CT reformats of long bone non-unions should be analyzed to best approximate the analysis of a larger number of CT reformats obtained in the three orthogonal planes” Study conclusion: “Semi-quantitative analysis of the two paramedian sagittal and coronal CT reformats is an acceptable alternative to the analysis of more numerous reformats” Study purpose: “To investigate the clinical utility of our newly developed contrast enhancement optimizer (CEO) software for coronary CT angiography (CCTA)” Study conclusion: “The use of our CEO for CCTA studies yielded optimal aortic contrast enhancement in significantly more patients than the standard protocol based on the body weight” aBased on the applicability of the methods, results, interpretations, and conclusions, as described in each study, to the patient spectrum and radiology practice in the institutions of each of the two observers. Study quality was not a factor that influenced this decision bThe examples shown in this table study could directly contribute to patient care in the radiology practices of both observers 1 and 2 Examples of studies without a direct contribution to patient carea,b Study purpose: “The aim of this study is to measure acute changes in NaF uptake in human bone due to exercise-induced loading” Study conclusion: “Bone loading induces an acute response in bone physiology as quantified by [18F]NaF PET kinetics. Dynamic imaging after bone loading using [18F]NaF PET is a promising diagnostic tool in bone physiology and imaging of biomechanics” Study purpose: “To qualitatively and quantitatively compare the image quality between single-shot echo-planar (SS-EPI) and multi-shot echo-planar (IMS-EPI) diffusion-weighted imaging (DWI) in female pelvis Study conclusion: “IMS-EPI showed better image quality with lower geometric distortion without affecting the quantification of apparent diffusion coefficient, though the signal-to-noise ratio and contrast-to-noise ratio decreased due to post-processing limitations” Study purpose: “To develop a fast three-dimensional method for simultaneous T1 and T2 quantification for breast imaging by using MR fingerprinting” Study conclusion: “A method was developed for breast imaging by using the MR fingerprinting technique, which allows simultaneous and volumetric quantification of T1 and T2 relaxation times for breast tissues” Study purpose: “To compare patient acceptability and burden of magnetic resonance enterography (MRE) and ultrasound (US) to each other, and to other enteric investigations, particularly colonoscopy.” Study conclusion: “MRE and US are well tolerated. Although MRE generates greater burden, longer recovery and is less preferred than US, it is more acceptable than colonoscopy. Patients, however, place greater emphasis on diagnostic accuracy than burden” Study purpose: “The objectives of this study were to assess whether the accuracy of urologists in identifying the presence of clinically significant cancer based on a standardized multiparametric MRI set could be improved by completion of a 2-d training course” Study conclusion: “Whilst we require expert radiologists to report prostate MRI, this study has demonstrated that identification of clinically significant cancer on prostate MRI by urologists is improved following exposure to a 2-d teaching course. These results would support efforts to integrate prostate MRI teaching courses into the training of urologists managing patients with prostate cancer aBased on the applicability of the methods, results, interpretations, and conclusions, as described in each study, to the patient spectrum and radiology practice in the institutions of each of the two observers. Study quality was not a factor that influenced this decision bThe examples shown in this table study could not directly contribute to patient care in the radiology practices of both observers 1 and 2

Statistical analysis

Separate analyses were done for the previously mentioned academic tertiary care center and non-academic general teaching hospital settings. The proportions of studies that could directly contribute to patient care, and those concerning (1) a completely new imaging application, (2) another type of imaging as an alternative for an existing imaging application, and (3) an elaboration of on an existing imaging application were calculated. Subsequently, the proportions of studies that would increase workload, decrease workload, have no effect on workload, and with an unclear impact on workload were calculated. Logistic regression analyses were performed to determine the association of increased workload with a study’s primary research area (AI, breast, cardiac, chest, computed tomography, contrast media, emergency, experimental, gastrointestinal–abdominal, head–neck, magnetic resonance, multisystem, musculoskeletal, neuroradiology, nuclear medicine, oncology, pediatric, ultrasonography, urogenital, or vascular) and impact factor of the journal in which the study was published (according to the 2019 Journal Citation reports (13)). Studies that would increase workload were coded as “1” and studies that would not change or decrease workload were calculated as “0” for this purpose. The largest category was used as reference for the variable “study’s research area.” p values less than 0.05 were considered statistically significant. Statistical analyses were executed using MedCalc version 17.2 Software (MedCalc).

Results

Eligible studies

Of the 1000 studies that were evaluated, 560 studies were excluded (Fig. 1). Finally, 440 studies remained for inclusion (Additional file 1: Appendix 2).
Fig. 1

Flow diagram of the study selection process. Notes:*in the authors’ institutions

Flow diagram of the study selection process. Notes:*in the authors’ institutions

Academic tertiary care center setting

65.9% (286/440) of studies could directly contribute to patient care, of which 84.6% (242/286) concerned an elaboration of an existing imaging application, 11.2% (32/286) concerned a new imaging application, and 4.2% (12/286) concerned another type of imaging as an alternative for an existing imaging application. Of the 286 studies that could directly contribute to patient care, 48.3% (138/286) would increase workload, 46.2% (132/286) would not change workload, 4.5% (13/286) would decrease workload, and 1.0% (3/286) had an unclear effect on workload. Causes of increased workload are detailed in Fig. 2. The main cause of increased workload was an increase in interpretation time of an existing imaging application (74.6%, 103/138), often combined with an increase in post-processing time and acquisition time. The second main cause of increased workload was the introduction of a completely new imaging application (23.2%, 32/138).
Fig. 2

Causes of increased workload in an academic tertiary care center

Causes of increased workload in an academic tertiary care center On univariate analysis, both AI as research area and a lower impact factor of the journal in which the study was published were significantly associated with an increased workload (Table 4). On multivariate analysis, only AI as primary research area remained significantly associated with an increased workload (p < 0.001), with an odds ratio (OR) of 10.64 (95% confidence interval (CI) 3.25–34.80) (Table 4). Of 38 AI studies with a potential direct contribution to patient care, 33 (86.5%) would increase workload (of which 32 due to increased post-processing and interpretation time and 1 due to increased post-processing time), 3 (7.9%) would decrease workload, 1 (2.6%) would not change workload, and 1 (2.6%) had an unclear effect on workload.
Table 4

Logistic regression analyses on the association of increased workload with a study’s research area and impact factor of the journal in which the study was published, for an academic tertiary care center

VariableUnivariate analysisMultivariate analysis
OR95% CIp valueOR95% CIp value
Study’s research areaa11.79b3.64–38.28b < 0.001b10.64b3.25–34.80b < 0.001b
Impact factor of the journal in which the study was publishedc0.93d0.86–1.00d0.0200.93d0.85–1.02d0.110

CI: confidence interval, OR: odds ratio

aBased on 286 studies with the following primary research areas: artificial intelligence (n = 38), breast (n = 16), cardiac (n = 32), chest (n = 20), computed tomography (n = 4), emergency (n = 1), gastrointestinal–abdominal (n = 21), head–neck (n = 6), magnetic resonance (n = 3), multisystem (n = 1), musculoskeletal (n = 18), neuroradiology (n = 46), nuclear medicine (n = 51), oncology (n = 2), pediatric (n = 2), ultrasonography (n = 2), urogenital (n = 17), and vascular (n = 6)

bStudies with artificial intelligence as research area were significantly associated with increased workload

cBased on 26 individual journals with a median impact factor of 5.061 (range: 2.687–33.752)

dPer unit increase in impact factor

Logistic regression analyses on the association of increased workload with a study’s research area and impact factor of the journal in which the study was published, for an academic tertiary care center CI: confidence interval, OR: odds ratio aBased on 286 studies with the following primary research areas: artificial intelligence (n = 38), breast (n = 16), cardiac (n = 32), chest (n = 20), computed tomography (n = 4), emergency (n = 1), gastrointestinal–abdominal (n = 21), head–neck (n = 6), magnetic resonance (n = 3), multisystem (n = 1), musculoskeletal (n = 18), neuroradiology (n = 46), nuclear medicine (n = 51), oncology (n = 2), pediatric (n = 2), ultrasonography (n = 2), urogenital (n = 17), and vascular (n = 6) bStudies with artificial intelligence as research area were significantly associated with increased workload cBased on 26 individual journals with a median impact factor of 5.061 (range: 2.687–33.752) dPer unit increase in impact factor

Non-academic general teaching hospital setting

63.0% (277/440) of studies could directly contribute to patient care, of which 84.8% (235/277) concerned an elaboration of on an existing imaging application, 10.8% (30/277) concerned a new imaging application, and 4.3% (12/277) concerned another type of imaging as an alternative for an existing imaging application. Of the 277 studies that could directly contribute to patient care, 48.7% (135/277) would increase workload, 46.2% (128/277) would not change workload, 4.3% (12/277) would decrease workload, and for 0.7% (2/277) the effect on workload was unclear. Causes of increased workload are detailed in Fig. 3. The main cause of increased workload was an increase in interpretation time of an existing imaging application (74.1%, 100/135), often combined with an increase in post-processing time and acquisition time. The second main cause of increased workload was the introduction of a completely new imaging application (22.2%, 30/135).
Fig. 3

Causes of increased workload in a non-academic general teaching hospital

Causes of increased workload in a non-academic general teaching hospital On both univariate and multivariate analyses, only AI as primary research area was significantly associated with an increased workload (p < 0.001), with a multivariate OR of 10.45 (95% CI 3.19–34.21) (Table 5). Of 37 AI studies with a potential direct contribution to patient care, 32 (86.8%) would increase workload (of which 29 due to increased post-processing and interpretation time, 2 due to increased post-processing time, and 1 due to increased interpretation time), 3 (8.1%) would decrease workload, 1 (2.7%) would not change workload, and for 1 (2.7%) the effect on workload was unclear.
Table 5

Logistic regression analyses on the association of increased workload with a study’s research area and impact factor of the journal in which the study was published, for a non-academic general teaching hospital

VariableUnivariate analysisMultivariate analysis
OR95% CIp valueOR95% CIp value
Study’s research areaa11.05b3.39–36.01b < 0.001b10.45b3.19–34.21b < 0.001b
Impact factor of the journal in which the study was publishedc0.94d0.87–1.01d0.0650.950d0.87–1.04d0.268

CI: confidence interval, OR: odds ratio

aBased on 277 studies with the following primary research areas: artificial intelligence (n = 37), breast (n = 16), cardiac (n = 32), chest (n = 18), computed tomography (n = 4), emergency (n = 1), gastrointestinal–abdominal (n = 20), head–neck (n = 6), magnetic resonance (n = 3), multisystem (n = 1), musculoskeletal (n = 18), neuroradiology (n = 44), nuclear medicine (n = 50), oncology (n = 1), pediatric (n = 2), ultrasonography (n = 2), urogenital (n = 17), and vascular (n = 5)

bStudies with artificial intelligence as research area were significantly associated with increased workload

cBased on 25 individual journals with a median impact factor of 4.966 (range 2.687–33.752)

dPer unit increase in impact factor

Logistic regression analyses on the association of increased workload with a study’s research area and impact factor of the journal in which the study was published, for a non-academic general teaching hospital CI: confidence interval, OR: odds ratio aBased on 277 studies with the following primary research areas: artificial intelligence (n = 37), breast (n = 16), cardiac (n = 32), chest (n = 18), computed tomography (n = 4), emergency (n = 1), gastrointestinal–abdominal (n = 20), head–neck (n = 6), magnetic resonance (n = 3), multisystem (n = 1), musculoskeletal (n = 18), neuroradiology (n = 44), nuclear medicine (n = 50), oncology (n = 1), pediatric (n = 2), ultrasonography (n = 2), urogenital (n = 17), and vascular (n = 5) bStudies with artificial intelligence as research area were significantly associated with increased workload cBased on 25 individual journals with a median impact factor of 4.966 (range 2.687–33.752) dPer unit increase in impact factor

Discussion

The results of this study show that > 60% of recent scientific evidence in the medical imaging field may be directly implemented in diagnostic radiology practice for the purpose of enhancing patient care. However, nearly 50% of these studies would increase workload, while less than 5% would decrease workload. Therefore, the projected overall workload of diagnostic radiologists is expected to rise. Increased workload was due to an increase in interpretation time of an existing imaging application in nearly 75% (often combined with an increase in post-processing time and acquisition time) and due to the introduction of a completely new imaging application in 20–25%. Interestingly, studies with AI as primary research area were significantly associated with an increased workload; > 86% of AI studies increased workload, of which the far majority due to an increase in both post-processing and interpretation time. Over the past decades, the workload of radiologists has already risen considerably [1-4], with a concomitant increase in the number of studies reporting high rates of burnout among radiology staff [5, 6, 27]. Implementing recent scientific innovations and advances in knowledge in diagnostic radiology practice may benefit patient care, but, as demonstrated by the present study, further increases workload. Maintaining the same radiology workforce while increasing the intensity of work (i.e., number of procedures per time unit) and/or extending working hours has been a common phenomenon among radiology practices in the past years [28-30]. However, this strategy is not a sustainable solution considering the fact that medical imaging keeps on evolving at a rapid pace, which continuously adds to the net workload of radiologists. Without any intervention, the continuous addition of workload that aims to improve patient care will eventually turn into work overload that may jeopardize the quality and safety of patient care [7-9]. AI is regarded as a potential solution to increase efficiency and ease the workload of radiologists [11, 31]. However, the present study suggests that most current AI applications in medical imaging have the opposite effect, because they commonly require additional post-processing and interpretation time rather than being seamlessly integrated in the workflow and taking over tasks of the diagnostic radiologist. Therefore, we believe that there is currently no scientific basis for policy makers to use AI as a reason to refrain from expanding the radiology workforce or to cut reimbursements for imaging procedures. To reverse the (looming) shortage of radiologists [32, 33], it may be necessary to enroll more residents into radiology training programs, train and employ radiologist assistants [34], and/or increase financial resources to employ (new) radiology staff. The present study had some limitations. First, the results only apply to the scientific literature published in 2019. Given the lack of previous studies on this topic, the current findings can be considered as a baseline measurement to which future developments can be compared. Second, because of the lack of quantitative data on workload in almost all studies that were included in our analysis, only a qualitative analysis could be done. Third, only the direct impact of each study on workload was assessed. However, scientific innovations and advances in knowledge may allow for more reliable and accurate diagnoses, which may theoretically decrease additional imaging examinations and associated workload. Fourth, besides interpretation time, acquisition and post-processing time were also regarded to have a potential impact on workload, although it can be argued that they may not be the primary tasks of a radiologist. However, the radiologist bears the final responsibility for these processes, and they contribute to the overall workload of a radiology practice. Fifth, the implementation of the findings of the studies that were included in our analysis was based on a theoretical scenario. Whether or not the findings of these studies will eventually be incorporated in guidelines and experience widespread clinical implementation remains unclear. Nevertheless, the results of the present study indicate that there is no reason to assume that workload for radiologists will stabilize let alone decrease. Sixth, our findings apply to both an academic tertiary care center and a non-academic general teaching hospital in the Netherlands, as independently assessed by two radiologists. The quality of healthcare in the Netherlands ranks among the best in Europe [35]. Therefore, the results of this study are likely also applicable to modern radiology departments in other developed countries. However, further research by more radiologists, in other institutions, and in other countries, is necessary to confirm the generalizability of our results.

Conclusions

In conclusion, recently published medical imaging studies often add value to radiological patient care. However, they likely increase the overall workload of diagnostic radiologists, and this particularly applies to AI studies. Additional file 1: Appendix 1. Search term used to retrieve studies from PubMed/Medline that were considered for inclusion. Appendix 2. Overview of 440 studies that remained after excluding 560 ineligible studies from the initial sample of 1000 studies.
  32 in total

1.  The effects of changes in utilization and technological advancements of cross-sectional imaging on radiologist workload.

Authors:  Robert J McDonald; Kara M Schwartz; Laurence J Eckel; Felix E Diehn; Christopher H Hunt; Brian J Bartholmai; Bradley J Erickson; David F Kallmes
Journal:  Acad Radiol       Date:  2015-07-22       Impact factor: 3.173

2.  Computed tomography use in a large Italian region: trend analysis 2004-2014 of emergency and outpatient CT examinations in children and adults.

Authors:  Andrea Pola; Daniela Corbella; Andrea Righini; Alberto Torresin; Paola E Colombo; Luigi Vismara; Luca Trombetta; Michele Maddalo; Maria Vittoria Introini; Daniela Tinelli; Laura Strohmenger; Giovanna Garattini; Angelica Munari; Fabio Triulzi
Journal:  Eur Radiol       Date:  2018-01-09       Impact factor: 5.315

3.  Determinants of radiologists' desired workloads.

Authors:  Cristian Meghea; Jonathan H Sunshine
Journal:  J Am Coll Radiol       Date:  2007-03       Impact factor: 5.532

4.  Current radiologist workload and the shortages in Japan: how many full-time radiologists are required?

Authors:  Akihiro Nishie; Daisuke Kakihara; Takeshi Nojo; Katsumasa Nakamura; Sachio Kuribayashi; Masumi Kadoya; Kuni Ohtomo; Kazuro Sugimura; Hiroshi Honda
Journal:  Jpn J Radiol       Date:  2015-03-19       Impact factor: 2.374

5.  Semi-quantitative CT assessment of fracture healing: How many and which CT reformats should be analyzed?

Authors:  Vasiliki Perlepe; Nicolas Michoux; Guy Heynen; Bruno Vande Berg
Journal:  Eur J Radiol       Date:  2019-07-19       Impact factor: 3.528

6.  Radiologist shortage leaves patient care at risk, warns royal college.

Authors:  Abi Rimmer
Journal:  BMJ       Date:  2017-10-11

7.  Minimizing individual variations in arterial enhancement on coronary CT angiographs using "contrast enhancement optimizer": a prospective randomized single-center study.

Authors:  Yoriaki Matsumoto; Toru Higaki; Takanori Masuda; Tomoyasu Sato; Yuko Nakamura; Fuminari Tatsugami; Kazuo Awai
Journal:  Eur Radiol       Date:  2018-11-12       Impact factor: 5.315

8.  Differentiating diffuse from focal pattern on Computed Tomography in multiple myeloma: Added value of a Radiomics approach.

Authors:  Alberto Stefano Tagliafico; Michele Cea; Federica Rossi; Francesca Valdora; Bianca Bignotti; Giulia Succio; Stefano Gualco; Alessio Conte; Alida Dominietto
Journal:  Eur J Radiol       Date:  2019-11-07       Impact factor: 3.528

Review 9.  Artificial intelligence in radiology.

Authors:  Ahmed Hosny; Chintan Parmar; John Quackenbush; Lawrence H Schwartz; Hugo J W L Aerts
Journal:  Nat Rev Cancer       Date:  2018-08       Impact factor: 60.716

10.  Trends in Use of Medical Imaging in US Health Care Systems and in Ontario, Canada, 2000-2016.

Authors:  Rebecca Smith-Bindman; Marilyn L Kwan; Emily C Marlow; Mary Kay Theis; Wesley Bolch; Stephanie Y Cheng; Erin J A Bowles; James R Duncan; Robert T Greenlee; Lawrence H Kushi; Jason D Pole; Alanna K Rahm; Natasha K Stout; Sheila Weinmann; Diana L Miglioretti
Journal:  JAMA       Date:  2019-09-03       Impact factor: 157.335

View more
  5 in total

1.  Current practical experience with artificial intelligence in clinical radiology: a survey of the European Society of Radiology.

Authors: 
Journal:  Insights Imaging       Date:  2022-06-21

2.  Course Corrections for Clinical AI.

Authors:  Alex J DeGrave; Joseph D Janizek; Su-In Lee
Journal:  Kidney360       Date:  2021-09-27

3.  Learning rate of students detecting and annotating pediatric wrist fractures in supervised artificial intelligence dataset preparations.

Authors:  Eszter Nagy; Robert Marterer; Franko Hržić; Erich Sorantin; Sebastian Tschauner
Journal:  PLoS One       Date:  2022-10-20       Impact factor: 3.752

4.  On-call abdominal ultrasonography: the rate of negative examinations and incidentalomas in a European tertiary care center.

Authors:  Tim E Sluijter; Derya Yakar; Thomas C Kwee
Journal:  Abdom Radiol (NY)       Date:  2022-04-29

5.  Performance of a deep learning tool to detect missed aortic dilatation in a large chest CT cohort.

Authors:  Maurice Pradella; Rita Achermann; Jonathan I Sperl; Rainer Kärgel; Saikiran Rapaka; Joshy Cyriac; Shan Yang; Gregor Sommer; Bram Stieltjes; Jens Bremerich; Philipp Brantner; Alexander W Sauter
Journal:  Front Cardiovasc Med       Date:  2022-08-22
  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.