| Literature DB >> 36033771 |
Qinyu Wei1, Peng Wang1, Ping Yin1.
Abstract
This article focuses on the construction of a confidence interval for vaccine efficacy against contagious coronavirus disease-2019 (COVID-19) in a fixed number of events design. Five different approaches are presented, and their performance is investigated in terms of the two-sided coverage probability, non-coverage probability at the lower tail, and expected confidence interval width. Furthermore, the effect of under-sensitivity of diagnosis tests on vaccine efficacy estimation was evaluated. Except for the exact conditional method, the non-coverage probability of the remaining methods may exceed the nominal significance level, e.g., 5%, even for a large number of total confirmed COVID-19 cases. The narrower confidence interval width from the Bayesian, approximate Poisson, and mid-P methods are on the cost of increased instability of coverage probability. When the sensitivity of diagnosis test in the vaccine group is lower than that in the placebo group, the reported vaccine efficacy tends to be overly optimistic. The exact conditional method is preferable to other methods in COVID-19 vaccine efficacy trials when the total number of cases reaches 60; otherwise, mid-p method can be used to obtain a narrower interval width.Entities:
Keywords: COVID-19; coverage probability; fixed number of events design; under-sensitivity; vaccine efficacy
Mesh:
Substances:
Year: 2022 PMID: 36033771 PMCID: PMC9411791 DOI: 10.3389/fpubh.2022.848120
Source DB: PubMed Journal: Front Public Health ISSN: 2296-2565
Figure 1Line plot of coverage probability for different VE intervals.
Figure 2Line plot of non-coverage probability at lower tail for different VE intervals.
Summary of coverage probability, non-coverage at lower tail, and expected interval width.
|
|
|
|
|
| ||
|---|---|---|---|---|---|---|
|
|
|
|
| |||
| Jeffreys | 10 | 95.4 | 86.8 | 1.9 | 8.6 | 1.01 |
| 20 | 95.1 | 89.4 | 2.2 | 8.2 | 0.64 | |
| 60 | 95.0 | 88.3 | 2.4 | 8 | 0.33 | |
| 100 | 95.0 | 88.1 | 2.5 | 7.7 | 0.25 | |
| 300 | 95.0 | 91.3 | 2.5 | 6.8 | 0.14 | |
| 500 | 95.0 | 91.8 | 2.5 | 5 | 0.11 | |
| Pfizer | 10 | 96.0 | 86.2 | 1.2 | 6.2 | 1.00 |
| 20 | 95.5 | 87.0 | 1.7 | 5.5 | 0.63 | |
| 60 | 95.2 | 88.7 | 2.1 | 5.1 | 0.33 | |
| 100 | 95.1 | 90.5 | 2.2 | 4.7 | 0.25 | |
| 300 | 95.1 | 91.5 | 2.4 | 3.9 | 0.14 | |
| 500 | 95.0 | 93.2 | 2.4 | 3.2 | 0.11 | |
| Approximate Poisson | 10 | 96.8 | 87.0 | 0.2 | 2.5 | 1.17 |
| 20 | 96.4 | 87.0 | 0.5 | 2.5 | 0.70 | |
| 60 | 95.7 | 88.7 | 1.3 | 2.8 | 0.34 | |
| 100 | 95.5 | 90.5 | 1.6 | 2.8 | 0.26 | |
| 300 | 95.2 | 93.6 | 2 | 2.7 | 0.14 | |
| 500 | 95.1 | 91.0 | 2.1 | 2.7 | 0.11 | |
| Mid-p | 10 | 97.1 | 92.7 | 0.9 | 5 | 1.09 |
| 20 | 96.2 | 93.5 | 1.6 | 5 | 0.67 | |
| 60 | 95.5 | 92.4 | 2.1 | 4.8 | 0.34 | |
| 100 | 95.3 | 92.1 | 2.3 | 4.7 | 0.25 | |
| 300 | 95.1 | 93.0 | 2.4 | 3.9 | 0.14 | |
| 500 | 95.1 | 92.9 | 2.4 | 4.1 | 0.11 | |
| Exact | 10 | 98.6 | 96.3 | 0.2 | 2.5 | 1.24 |
| 20 | 97.9 | 96.0 | 0.7 | 2.5 | 0.75 | |
| 60 | 96.9 | 95.1 | 1.4 | 2.5 | 0.36 | |
| 100 | 96.5 | 95.0 | 1.6 | 2.5 | 0.27 | |
| 300 | 96.0 | 95.1 | 2 | 2.5 | 0.15 | |
| 500 | 95.8 | 95.0 | 2.1 | 2.5 | 0.11 | |
Figure 3Box plot of expected two-sided interval width for different VE intervals.
Figure 4Cumulative percentage plot of one-sided non-coverage probability at lower tail with variable ratio of sensitivity (exact conditional method).
Figure 5Expected lower limit of observed VE interval with variable ratio of sensitivity (exact conditional method).
COVID-19 vaccine efficacy against symptomatic Covid-19 in three case studies.
|
|
|
|
|
|---|---|---|---|
| Example 1 (BNT162b2 vaccine) | N | 17511 | 17411 |
| Number of cases | 162 | 8 | |
| Incidence rate per 1000 person-years | 72.91 | 3.61 | |
| Estimated VE% | 95.0 | ||
| 95% CI | |||
| Approximate Poisson method | 89.9, 97.6 | ||
| Bayesian Jeffreys prior | 90.5, 97.7 | ||
| Bayesian Pfizer prior | 90.3, 97.6 | ||
| Mid-p method | 90.4, 97.7 | ||
| Exact Conditional method | 90.0, 97.9 | ||
| Example 2 (ChAdOx1 vaccine) | N | 2025 | 2063 |
| Number of cases | 33 | 12 | |
| Incidence rate per 1000 person-years | 156.98 | 56.24 | |
| Estimated VE% | 64.2 | ||
| 95% CI | |||
| Approximate Poisson method | 30.7, 81.5 | ||
| Bayesian Jeffreys prior | 32.3, 81.5 | ||
| Bayesian Pfizer prior | 32.5, 81.8 | ||
| Mid-p method | 31.8, 82.2 | ||
| Exact Conditional method | 28.9, 83.2 | ||
| Example 3 (HBO2 vaccine) | N | 12737 | 12726 |
| Number of cases | 95 | 21 | |
| Incidence rate per 1000 person-years | 44.70 | 9.80 | |
| Estimated VE% | 78.1 | ||
| 95% CI | |||
| Approximate Poisson method | 64.8, 86.3 | ||
| Bayesian Jeffreys prior | 65.4, 86.6 | ||
| Bayesian Pfizer prior | 65.3, 86.6 | ||
| Mid-p method | 65.3, 86.6 | ||
| Exact Conditional method | 64.5, 87.0 |
N, number of participants in each group.
The reported 95% CI for vaccine efficacy by the developer.