Ivan K Ip1,2,3, Ronilda Lacson1,2, Keith Hentel4, Sameer Malhotra5, Jonathan Darer6, Curtis Langlotz7, Jonathan Weiss1,2, Ali S Raja1,2, Ramin Khorasani1,2. 1. 1 Center for Evidence-Based Imaging, Brigham and Women's Hospital, 20 Kent St, 2nd Fl, Brookline, MA 02445. 2. 2 Department of Radiology, Brigham and Women's Hospital, Boston, MA. 3. 3 Department of Medicine, Brigham and Women's Hospital, Boston, MA. 4. 4 Department of Radiology, Weill Cornell Medical College and New York Presbyterian Hospital, New York, NY. 5. 5 Department of Healthcare Policy and Research, Weill Cornell Medical College, New York, NY. 6. 6 Geisinger Health System, Danville, PA. 7. 7 Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, PA.
Abstract
OBJECTIVE: The efficacy of imaging clinical decision support (CDS) varies. Our objective was to identify CDS factors contributing to imaging order cancellation or modification. SUBJECTS AND METHODS: This pre-post study was performed across four institutions participating in the Medicare Imaging Demonstration. The intervention was CDS at order entry for selected outpatient imaging procedures. On the basis of the information entered, computerized alerts indicated to providers whether orders were not covered by guidelines, appropriate, of uncertain appropriateness, or inappropriate according to professional society guidelines. Ordering providers could override or accept CDS. We considered actionable alerts to be those that could generate an immediate order behavior change in the ordering physician (i.e., cancellation of inappropriate orders or modification of orders of uncertain appropriateness that had a recommended alternative). Chi-square and logistic regression identified predictors of order cancellation or modification after an alert. RESULTS: A total of 98,894 radiology orders were entered (83,114 after the intervention). Providers ignored 98.9%, modified 1.1%, and cancelled 0.03% of orders in response to alerts. Actionable alerts had a 10 fold higher rate of modification (8.1% vs 0.7%; p < 0.0001) or cancellation (0.2% vs 0.02%; p < 0.0001) orders compared with nonactionable alerts. Orders from institutions with preexisting imaging CDS had a sevenfold lower rate of cancellation or modification than was seen at sites with newly implemented CDS (1.4% vs 0.2%; p < 0.0001). In multivariate analysis, actionable alerts were 12 times more likely to result in order cancellation or modification. Orders at sites with preexisting CDS were 7.7 times less likely to be cancelled or modified (p < 0.0001). CONCLUSION: Using results from the Medicare Imaging Demonstration project, we identified potential factors that were associated with CDS effect on provider imaging ordering; these findings may have implications for future design of such computerized systems.
OBJECTIVE: The efficacy of imaging clinical decision support (CDS) varies. Our objective was to identify CDS factors contributing to imaging order cancellation or modification. SUBJECTS AND METHODS: This pre-post study was performed across four institutions participating in the Medicare Imaging Demonstration. The intervention was CDS at order entry for selected outpatient imaging procedures. On the basis of the information entered, computerized alerts indicated to providers whether orders were not covered by guidelines, appropriate, of uncertain appropriateness, or inappropriate according to professional society guidelines. Ordering providers could override or accept CDS. We considered actionable alerts to be those that could generate an immediate order behavior change in the ordering physician (i.e., cancellation of inappropriate orders or modification of orders of uncertain appropriateness that had a recommended alternative). Chi-square and logistic regression identified predictors of order cancellation or modification after an alert. RESULTS: A total of 98,894 radiology orders were entered (83,114 after the intervention). Providers ignored 98.9%, modified 1.1%, and cancelled 0.03% of orders in response to alerts. Actionable alerts had a 10 fold higher rate of modification (8.1% vs 0.7%; p < 0.0001) or cancellation (0.2% vs 0.02%; p < 0.0001) orders compared with nonactionable alerts. Orders from institutions with preexisting imaging CDS had a sevenfold lower rate of cancellation or modification than was seen at sites with newly implemented CDS (1.4% vs 0.2%; p < 0.0001). In multivariate analysis, actionable alerts were 12 times more likely to result in order cancellation or modification. Orders at sites with preexisting CDS were 7.7 times less likely to be cancelled or modified (p < 0.0001). CONCLUSION: Using results from the Medicare Imaging Demonstration project, we identified potential factors that were associated with CDS effect on provider imaging ordering; these findings may have implications for future design of such computerized systems.
Authors: Marilyn M Schapira; William E Barlow; Emily F Conant; Brian L Sprague; Anna N A Tosteson; Jennifer S Haas; Tracy Onega; Elisabeth F Beaber; Martha Goodrich; Anne Marie McCarthy; Sally D Herschorn; Celette Sugg Skinner; Tory O Harrington; Berta Geller Journal: Acad Radiol Date: 2018-02-09 Impact factor: 3.173
Authors: Michael C Brunner; Scott E Sheehan; Eric M Yanke; Dean F Sittig; Nasia Safdar; Barbara Hill; Kenneth S Lee; John F Orwin; David J Vanness; Christopher J Hildebrand; Michael A Bruno; Timothy J Erickson; Ryan Zea; D Paul Moberg Journal: Appl Clin Inform Date: 2020-02-19 Impact factor: 2.342
Authors: Vladimir I Valtchinov; Shawn N Murphy; Ronilda Lacson; Nikolay Ikonomov; Bingxue K Zhai; Katherine Andriole; Justin Rousseau; Dick Hanson; Isaac S Kohane; Ramin Khorasani Journal: J Am Med Inform Assoc Date: 2022-10-07 Impact factor: 7.942
Authors: Monica Tung; Ritu Sharma; Jeremiah S Hinson; Stephanie Nothelle; Jean Pannikottu; Jodi B Segal Journal: Am J Emerg Med Date: 2017-10-25 Impact factor: 2.469
Authors: Paul G Barnett; Josephine C Jacobs; Jeffrey G Jarvik; Roger Chou; Derek Boothroyd; Jeanie Lo; Andrea Nevedal Journal: JAMA Netw Open Date: 2020-07-01