BACKGROUND: Electronic reporting and processing of suspected adverse drug reactions (ADRs) is increasing and has facilitated automated screening procedures. It is crucial for healthcare professionals to understand the nature and proper use of data available in pharmacovigilance practice. OBJECTIVES: To (a) compare performance of EU-ADR [electronic healthcare record (EHR) exemplar] and FAERS [spontaneous reporting system (SRS) exemplar] databases in detecting signals using "positive" and "negative" drug-event reference sets; and (b) evaluate the impact of timing bias on sensitivity thresholds by comparing all data to data restricted to the time before a warning/regulatory action. METHODS: Ten events with known positive and negative reference sets were selected. Signals were identified when respective statistics exceeded defined thresholds. Main outcome measure Performance metrics, including sensitivity, specificity, positive predictive value and accuracy were calculated. In addition, the effect of regulatory action on the performance of signal detection in each data source was evaluated. RESULTS: The sensitivity for detecting signals in EHR data varied depending on the nature of the adverse events and increased substantially if the analyses were restricted to the period preceding the first regulatory action. Across all events, using data from all years, a sensitivity of 45-73 % was observed for EU-ADR and 77 % for FAERS. The specificity was high and similar for EU-ADR (82-96 %) and FAERS (98 %). EU-ADR data showed range of PPV (78-91 %) and accuracy (78-72 %) and FAERS data yielded a PPV of 97 % with 88 % accuracy. CONCLUSION: Using all cumulative data, signal detection in SRS data achieved higher specificity and sensitivity than EHR data. However, when data were restricted to time prior to a regulatory action, performance characteristics changed in a manner consistent with both the type of data and nature of the ADR. Further research focusing on prospective validation of is necessary to learn more about the performance and utility of these databases in modern pharmacovigilance practice.
BACKGROUND: Electronic reporting and processing of suspected adverse drug reactions (ADRs) is increasing and has facilitated automated screening procedures. It is crucial for healthcare professionals to understand the nature and proper use of data available in pharmacovigilance practice. OBJECTIVES: To (a) compare performance of EU-ADR [electronic healthcare record (EHR) exemplar] and FAERS [spontaneous reporting system (SRS) exemplar] databases in detecting signals using "positive" and "negative" drug-event reference sets; and (b) evaluate the impact of timing bias on sensitivity thresholds by comparing all data to data restricted to the time before a warning/regulatory action. METHODS: Ten events with known positive and negative reference sets were selected. Signals were identified when respective statistics exceeded defined thresholds. Main outcome measure Performance metrics, including sensitivity, specificity, positive predictive value and accuracy were calculated. In addition, the effect of regulatory action on the performance of signal detection in each data source was evaluated. RESULTS: The sensitivity for detecting signals in EHR data varied depending on the nature of the adverse events and increased substantially if the analyses were restricted to the period preceding the first regulatory action. Across all events, using data from all years, a sensitivity of 45-73 % was observed for EU-ADR and 77 % for FAERS. The specificity was high and similar for EU-ADR (82-96 %) and FAERS (98 %). EU-ADR data showed range of PPV (78-91 %) and accuracy (78-72 %) and FAERS data yielded a PPV of 97 % with 88 % accuracy. CONCLUSION: Using all cumulative data, signal detection in SRS data achieved higher specificity and sensitivity than EHR data. However, when data were restricted to time prior to a regulatory action, performance characteristics changed in a manner consistent with both the type of data and nature of the ADR. Further research focusing on prospective validation of is necessary to learn more about the performance and utility of these databases in modern pharmacovigilance practice.
Authors: Abraham G Hartzema; Judith A Racoosin; Thomas E MaCurdy; Jonathan M Gibbs; Jeffrey A Kelman Journal: Pharmacoepidemiol Drug Saf Date: 2011-07 Impact factor: 2.890
Authors: Paul Avillach; Preciosa M Coloma; Rosa Gini; Martijn Schuemie; Fleur Mougin; Jean-Charles Dufour; Giampiero Mazzaglia; Carlo Giaquinto; Carla Fornari; Ron Herings; Mariam Molokhia; Lars Pedersen; Annie Fourrier-Réglat; Marius Fieschi; Miriam Sturkenboom; Johan van der Lei; Antoine Pariente; Gianluca Trifirò Journal: J Am Med Inform Assoc Date: 2012-09-06 Impact factor: 4.497
Authors: Preciosa M Coloma; Paul Avillach; Francesco Salvo; Martijn J Schuemie; Carmen Ferrajolo; Antoine Pariente; Annie Fourrier-Réglat; Mariam Molokhia; Vaishali Patadia; Johan van der Lei; Miriam Sturkenboom; Gianluca Trifirò Journal: Drug Saf Date: 2013-01 Impact factor: 5.606
Authors: Alexandra C Pacurariu; Sabine M Straus; Gianluca Trifirò; Martijn J Schuemie; Rosa Gini; Ron Herings; Giampiero Mazzaglia; Gino Picelli; Lorenza Scotti; Lars Pedersen; Peter Arlett; Johan van der Lei; Miriam C Sturkenboom; Preciosa M Coloma Journal: Drug Saf Date: 2015-12 Impact factor: 5.606
Authors: Seyed Hamidreza Mahmoudpour; Folkert W Asselbergs; Catherine E de Keyser; Patrick C Souverein; Albert Hofman; Bruno H Stricker; Anthonius de Boer; Anke-Hilse Maitland-van der Zee Journal: Int J Clin Pharm Date: 2015-07-10
Authors: Simon de Lusignan; Stacy Shinneman; Ivelina Yonova; Jeremy van Vlymen; Alex J Elliot; Frederick Bolton; Gillian E Smith; Sarah O'Brien Journal: JMIR Med Inform Date: 2017-09-28
Authors: Vaishali K Patadia; Martijn J Schuemie; Preciosa M Coloma; Ron Herings; Johan van der Lei; Miriam Sturkenboom; Gianluca Trifirò Journal: Front Pharmacol Date: 2018-06-06 Impact factor: 5.810
Authors: Esmé J Baan; Veronique A de Smet; Christina E Hoeve; Alexandra C Pacurariu; Miriam C J M Sturkenboom; Johan C de Jongste; Hettie M Janssens; Katia M C Verhamme Journal: Drug Saf Date: 2020-01 Impact factor: 5.606