Christopher McMaster1,2, David Liew3,4, Claire Keith5, Parnaz Aminian5, Albert Frauman3,4. 1. Department of Clinical Pharmacology, Austin Health, Level 5, Lance Townsend Building, Studley Rd, Heidelberg, VIC, 3084, Australia. christopher.mcmaster@austin.org.au. 2. Department of Medicine, University of Melbourne, Parkville, VIC, Australia. christopher.mcmaster@austin.org.au. 3. Department of Clinical Pharmacology, Austin Health, Level 5, Lance Townsend Building, Studley Rd, Heidelberg, VIC, 3084, Australia. 4. Department of Medicine, University of Melbourne, Parkville, VIC, Australia. 5. Department of Pharmacy, Austin Health, Heidelberg, VIC, Australia.
Abstract
INTRODUCTION: Adverse drug reaction (ADR) detection in hospitals is heavily reliant on spontaneous reporting by clinical staff, with studies in the literature pointing to high rates of underreporting [1]. International Classification of Diseases, 10th Revision (ICD-10) codes have been used in epidemiological studies of ADRs and offer the potential for automated ADR detection systems. OBJECTIVE: The aim of this study was to develop an automated ADR detection system based on ICD-10 codes, using machine-learning algorithms to improve accuracy and efficiency. METHODS: For a 12-month period from December 2016 to November 2017, every inpatient episode receiving an ICD-10 code in the range Y40.0-Y59.9 (ADR code) was flagged for review as a potential ADR. Each flagged admission was assessed by an expert pharmacist and, if needed, reviewed at regular ADR committee meetings. For each report, a determination was made about ADR probability and severity. The dataset was randomly split into training and test sets. A machine-learning model using the random forest algorithm was developed on the training set to discriminate between true and false ADR reports. The model was then applied to the test set to assess accuracy using the area under the receiver operating characteristic (AUC). RESULTS: In the study period, 2917 Y40.0-Y59.9 codes were applied to admissions, resulting in 245 ADR reports after review. These 245 reports accounted for 44.5% of all ADR reporting in our hospital in the study period. A random forest model built on the training set was able to discriminate between true and false reports on the test set with an AUC of 0.803. CONCLUSIONS: Automated ADR detection using ICD-10 coding significantly improved ADR detection in the study period, with improved discrimination between true and false reports by applying a machine-learning model.
INTRODUCTION: Adverse drug reaction (ADR) detection in hospitals is heavily reliant on spontaneous reporting by clinical staff, with studies in the literature pointing to high rates of underreporting [1]. International Classification of Diseases, 10th Revision (ICD-10) codes have been used in epidemiological studies of ADRs and offer the potential for automated ADR detection systems. OBJECTIVE: The aim of this study was to develop an automated ADR detection system based on ICD-10 codes, using machine-learning algorithms to improve accuracy and efficiency. METHODS: For a 12-month period from December 2016 to November 2017, every inpatient episode receiving an ICD-10 code in the range Y40.0-Y59.9 (ADR code) was flagged for review as a potential ADR. Each flagged admission was assessed by an expert pharmacist and, if needed, reviewed at regular ADR committee meetings. For each report, a determination was made about ADR probability and severity. The dataset was randomly split into training and test sets. A machine-learning model using the random forest algorithm was developed on the training set to discriminate between true and false ADR reports. The model was then applied to the test set to assess accuracy using the area under the receiver operating characteristic (AUC). RESULTS: In the study period, 2917 Y40.0-Y59.9 codes were applied to admissions, resulting in 245 ADR reports after review. These 245 reports accounted for 44.5% of all ADR reporting in our hospital in the study period. A random forest model built on the training set was able to discriminate between true and false reports on the test set with an AUC of 0.803. CONCLUSIONS: Automated ADR detection using ICD-10 coding significantly improved ADR detection in the study period, with improved discrimination between true and false reports by applying a machine-learning model.
Authors: C A Naranjo; U Busto; E M Sellers; P Sandor; I Ruiz; E A Roberts; E Janecek; C Domecq; D J Greenblatt Journal: Clin Pharmacol Ther Date: 1981-08 Impact factor: 6.875
Authors: Corinne M Hohl; Andrei Karpov; Lisa Reddekopp; Mimi Doyle-Waters; Jürgen Stausberg Journal: J Am Med Inform Assoc Date: 2013-11-12 Impact factor: 4.497
Authors: Jarinda A Poppe; Willem van Weteringen; Lotte L G Sebek; Catherijne A J Knibbe; Irwin K M Reiss; Sinno H P Simons; Robert B Flint Journal: Front Pharmacol Date: 2020-05-12 Impact factor: 5.810
Authors: Amina El Saghir; Georgios Dimitriou; Miriam Scholer; Ioanna Istampoulouoglou; Patrick Heinrich; Klaus Baumgartl; René Schwendimann; Stefano Bassetti; Anne Leuppi-Taegtmeyer Journal: Drug Healthc Patient Saf Date: 2021-12-24
Authors: Girish Dwivedi; Frank M Sanfilippo; Juan Lu; Ling Wang; Mohammed Bennamoun; Isaac Ward; Senjian An; Ferdous Sohel; Benjamin J W Chow Journal: Sci Rep Date: 2021-09-15 Impact factor: 4.379