Suzie Seabroke1, Gianmario Candore2, Kristina Juhlin3, Naashika Quarcoo4, Antoni Wisniewski5, Ramin Arani5, Jeffery Painter4, Philip Tregunno6, G Niklas Norén3, Jim Slattery2. 1. UK Medicines and Healthcare Products Regulatory Agency (MHRA), 151 Buckingham Palace Road, London, SW1W 9SZ, UK. suzie.seabroke@mhra.gsi.gov.uk. 2. European Medicines Agency, London, UK. 3. Uppsala Monitoring Centre, Uppsala, Sweden. 4. GlaxoSmithKline, London, UK. 5. AstraZeneca, Alderley Park, UK. 6. UK Medicines and Healthcare Products Regulatory Agency (MHRA), 151 Buckingham Palace Road, London, SW1W 9SZ, UK.
Abstract
INTRODUCTION: Disproportionality analyses are used in many organisations to identify adverse drug reactions (ADRs) from spontaneous report data. Reporting patterns vary over time, with patient demographics, and between different geographical regions, and therefore subgroup analyses or adjustment by stratification may be beneficial. OBJECTIVE: The objective of this study was to evaluate the performance of subgroup and stratified disproportionality analyses for a number of key covariates within spontaneous report databases of differing sizes and characteristics. METHODS: Using a reference set of established ADRs, signal detection performance (sensitivity and precision) was compared for stratified, subgroup and crude (unadjusted) analyses within five spontaneous report databases (two company, one national and two international databases). Analyses were repeated for a range of covariates: age, sex, country/region of origin, calendar time period, event seriousness, vaccine/non-vaccine, reporter qualification and report source. RESULTS: Subgroup analyses consistently performed better than stratified analyses in all databases. Subgroup analyses also showed benefits in both sensitivity and precision over crude analyses for the larger international databases, whilst for the smaller databases a gain in precision tended to result in some loss of sensitivity. Additionally, stratified analyses did not increase sensitivity or precision beyond that associated with analytical artefacts of the analysis. The most promising subgroup covariates were age and region/country of origin, although this varied between databases. CONCLUSIONS: Subgroup analyses perform better than stratified analyses and should be considered over the latter in routine first-pass signal detection. Subgroup analyses are also clearly beneficial over crude analyses for larger databases, but further validation is required for smaller databases.
INTRODUCTION: Disproportionality analyses are used in many organisations to identify adverse drug reactions (ADRs) from spontaneous report data. Reporting patterns vary over time, with patient demographics, and between different geographical regions, and therefore subgroup analyses or adjustment by stratification may be beneficial. OBJECTIVE: The objective of this study was to evaluate the performance of subgroup and stratified disproportionality analyses for a number of key covariates within spontaneous report databases of differing sizes and characteristics. METHODS: Using a reference set of established ADRs, signal detection performance (sensitivity and precision) was compared for stratified, subgroup and crude (unadjusted) analyses within five spontaneous report databases (two company, one national and two international databases). Analyses were repeated for a range of covariates: age, sex, country/region of origin, calendar time period, event seriousness, vaccine/non-vaccine, reporter qualification and report source. RESULTS: Subgroup analyses consistently performed better than stratified analyses in all databases. Subgroup analyses also showed benefits in both sensitivity and precision over crude analyses for the larger international databases, whilst for the smaller databases a gain in precision tended to result in some loss of sensitivity. Additionally, stratified analyses did not increase sensitivity or precision beyond that associated with analytical artefacts of the analysis. The most promising subgroup covariates were age and region/country of origin, although this varied between databases. CONCLUSIONS: Subgroup analyses perform better than stratified analyses and should be considered over the latter in routine first-pass signal detection. Subgroup analyses are also clearly beneficial over crude analyses for larger databases, but further validation is required for smaller databases.
Authors: Sandra de Bie; Katia M C Verhamme; Sabine M J M Straus; Bruno H Ch Stricker; Miriam C J M Sturkenboom Journal: Drug Saf Date: 2012-04-01 Impact factor: 5.606
Authors: A Bate; M Lindquist; I R Edwards; S Olsson; R Orre; A Lansner; R M De Freitas Journal: Eur J Clin Pharmacol Date: 1998-06 Impact factor: 2.953
Authors: Kristina Star; Lovisa Sandberg; Tomas Bergvall; Imti Choonara; Pia Caduff-Janosa; I Ralph Edwards Journal: Pharmacoepidemiol Drug Saf Date: 2019-02-15 Impact factor: 2.890
Authors: Gianmario Candore; Sebastian Monzon; Jim Slattery; Loris Piccolo; Rodrigo Postigo; Xavier Xurz; Sabine Strauss; Peter Arlett Journal: Drug Saf Date: 2021-12-08 Impact factor: 5.606
Authors: Antoni F Z Wisniewski; Andrew Bate; Cedric Bousquet; Andreas Brueckner; Gianmario Candore; Kristina Juhlin; Miguel A Macia-Martinez; Katrin Manlik; Naashika Quarcoo; Suzie Seabroke; Jim Slattery; Harry Southworth; Bharat Thakrar; Phil Tregunno; Lionel Van Holle; Michael Kayser; G Niklas Norén Journal: Drug Saf Date: 2016-06 Impact factor: 5.606