Ju Hwan Kim1, Hyesung Lee2, Ju-Young Shin3. 1. School of Pharmacy, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do 16419, Republic of Korea. Electronic address: napa928@hotmail.com. 2. School of Pharmacy, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do 16419, Republic of Korea. Electronic address: gul2@skku.edu. 3. School of Pharmacy, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon, Gyeonggi-do 16419, Republic of Korea. Electronic address: shin.jy@skku.edu.
Abstract
BACKGROUND: Substantial variations in the safety profiles of different formulations of the bacillus Calmette-Guérin (BCG) vaccine exist. Therefore, we aimed to detect safety signals of BCG vaccine for intradermal injection (BCG-ID) and percutaneous injection (BCG-PC) in the Korea Adverse Event Reporting System (KAERS). METHODS: We conducted a vaccine safety surveillance study from the adverse events (AEs) reported following BCG vaccine in the Korea Institute of Drug Safety and Risk Management KAERS Database (KIDS-KD) between 2005 and 2017. We used the tree-based scan statistic (TSS) and four disproportionality-based algorithms for signal detection: empirical Bayesian geometric mean; proportional reporting ratio; reporting odds ratio; and information component. The detected signals from each algorithm was compared with the known AEs of BCG vaccine (reference standard) to present positive predictive value (PPV) and area under the receiver operating curve (AUC). RESULTS: From the total of 52,191 vaccine-related AE pairs, 963 AE pairs were reported following the BCG vaccine, in which BCG-ID and -PC accounted for 71.1% and 28.9%, respectively. Overall, 97.2% of AE reports were non-serious; lymphadenopathy (583/963; 50.3%) and injection site discharge (193/963; 20.0%) were the most commonly reported AEs detected by all algorithms. Tuberculous osteitis was reported solely from BCG-PC (15/279; 5.4%), while most of the AEs from BCG-ID were related to injection site complications. The TSS demonstrated the best balance of the performance measures, with PPV and AUC of 66.7% and 63.1%, respectively. CONCLUSIONS: TSS was successfully applied in the KAERS to detect safety signals of BCG vaccine. In addition, difference in the safety profiles of BCG-ID and BCG-PC warrants further investigation to confirm our findings. Although TSS performed the best in our study, caution should be taken when interpreting the results owing to the lack of a robust "gold standard" and the relatively small number of reports for data mining.
BACKGROUND: Substantial variations in the safety profiles of different formulations of the bacillus Calmette-Guérin (BCG) vaccine exist. Therefore, we aimed to detect safety signals of BCG vaccine for intradermal injection (BCG-ID) and percutaneous injection (BCG-PC) in the Korea Adverse Event Reporting System (KAERS). METHODS: We conducted a vaccine safety surveillance study from the adverse events (AEs) reported following BCG vaccine in the Korea Institute of Drug Safety and Risk Management KAERS Database (KIDS-KD) between 2005 and 2017. We used the tree-based scan statistic (TSS) and four disproportionality-based algorithms for signal detection: empirical Bayesian geometric mean; proportional reporting ratio; reporting odds ratio; and information component. The detected signals from each algorithm was compared with the known AEs of BCG vaccine (reference standard) to present positive predictive value (PPV) and area under the receiver operating curve (AUC). RESULTS: From the total of 52,191 vaccine-related AE pairs, 963 AE pairs were reported following the BCG vaccine, in which BCG-ID and -PC accounted for 71.1% and 28.9%, respectively. Overall, 97.2% of AE reports were non-serious; lymphadenopathy (583/963; 50.3%) and injection site discharge (193/963; 20.0%) were the most commonly reported AEs detected by all algorithms. Tuberculous osteitis was reported solely from BCG-PC (15/279; 5.4%), while most of the AEs from BCG-ID were related to injection site complications. The TSS demonstrated the best balance of the performance measures, with PPV and AUC of 66.7% and 63.1%, respectively. CONCLUSIONS: TSS was successfully applied in the KAERS to detect safety signals of BCG vaccine. In addition, difference in the safety profiles of BCG-ID and BCG-PC warrants further investigation to confirm our findings. Although TSS performed the best in our study, caution should be taken when interpreting the results owing to the lack of a robust "gold standard" and the relatively small number of reports for data mining.