Risks of serious complications and death from smallpox vaccination: a systematic review of the United States experience, 1963-1968.

BACKGROUND: The United States (US) has re-instituted smallpox vaccinations to prepare for an intentional release of the smallpox virus into the civilian population. In an outbreak, people of all ages will be vaccinated. To prepare for the impact of large-scale ring and mass vaccinations, we conducted a systematic review of the complication and mortality risks of smallpox vaccination. We summarized these risks for post-vaccinial encephalitis, vaccinia necrosum (progressive vaccinia), eczema vaccinatum, generalized vaccinia, and accidental infection (inadvertant autoinoculation).
METHODS: Using a MEDLINE search strategy, we identified 348 articles, of which seven studies met our inclusion criteria (the number of primary vaccinations and re-vaccinations were reported, sufficient data were provided to calculate complication or case-fatality risks, and comparable case definitions were used). For each complication, we estimated of the complication, death, and case-fatality risks.
RESULTS: The life-threatening complications of post-vaccinial encephalitis and vaccinia necrosum were at least 3 and 1 per million primary vaccinations, respectively. Twenty-nine percent of vaccinees with post-vaccinial encephalitis died and 15% with vaccinia necrosum died. There were no deaths among vaccinees that developed eczema vaccinatum; however, 2.3% of non-vaccinated contacts with eczema vaccinatum died. Among re-vaccinees, the risk of post-vaccinial encephalitis was reduced 26-fold, the risk of generalized vaccinia was reduced 29-fold, and the risk of eczema vaccinatum was reduced 12-fold. However, the risk reductions of accidental infection and vaccinia necrosum were modest (3.8 and 1.5 fold respectively).

Background

In the United States (US) routine smallpox vaccination of the general population ended in 1972 [1]. The last known case of naturally-acquired smallpox occurred in Somalia in 1977, and in 1980 the World Health Organization (WHO) declared that smallpox had been eradicated from the world [2]. Today, most of the US and the world's population is considered susceptible to smallpox infection. Since the September 2001 airplane attacks on the World Trade Center and the anthrax spore attacks using the US mail, the US has taken several steps to mitigate a possible intentional release of variola major (smallpox) virus [3-6], including re-instituting a national smallpox vaccination program [7]. For Phase 1 of this program, the Advisory Committee on Immunization Practices (ACIP) recommended voluntary vaccination of 500,000 members of public health response and hospital health care teams [8]. In Phase 2, up to 10 million first responders such as police, fire, paramedics, and other health care staff would be offered voluntary smallpox vaccination.

However, the implementation the smallpox vaccination program is not without controversy [9]. Vaccinating individuals against smallpox infection, even voluntarily, means exposing vaccinees and their contacts to the risks of serious adverse reactions without the clear benefit of protection against an infection which does not exist and may never exist again. Volunteers must balance their individual risks and benefits of smallpox vaccination. The individual risks and benefits from being vaccinated before an intentional release depends on the probability of an adverse vaccine reaction, the probability that smallpox virus will be released, and the probability that an individual would be directly exposed to a release or an unrecognized case of smallpox [10]. Once an outbreak occurs, ring and mass vaccination would result in a large number of primary vaccinees of all ages, including some with underlying or unrecognized risks for vaccine adverse reactions. In this scenario, we would expect to see an increased number and risk of vaccine complications. Estimation of the vaccine complication risks by age, including their precision and estimation biases, are necessary to formulate policies and inform individual choice regarding the risks and benefits of pre-outbreak smallpox vaccination, and to estimate the burden of vaccine complications from ring and mass vaccination during an smallpox outbreak in the general population.

Recent publications [11-16] have summarized or cited the complication risks associated with receiving smallpox vaccination; however, to our knowledge, no systematic review of this older literature has been conducted. The purpose of this systematic review is to review and summarize the age-specific complication and case fatality risks of post-vaccinial encephalitis, vaccinia necrosum (progressive vaccinia), eczema vaccinatum, generalized vaccinia, and accidental infection (inadvertant autoinoculation) from smallpox vaccinations conducted in the US. We restricted our review to US studies because the New York City Board of Health vaccinia strain, which was the only strain used in the US, is the strain in current use by the the national vaccination program (and will be in the future) [11].

Methods

Searching

Two reviewers (T.J.A., S.U.) conducted the literature searches, selection of studies, and data extraction. To identify potential studies we searched MEDLINE which covered 1965 through November 2002. We entered the following search string: ((Smallpox Vaccine/*adverse effects [MeSH terms] AND "English" [Language]) OR ((Vaccination/*adverse effects [MeSH terms] AND "vaccinia" [MeSH terms]) AND "English" [Language])). From this search result, potentially relevant studies on smallpox vaccine complications were identified, screened, and retrieved. The reference lists in all retrieved articles, including reviews, were evaluated to identify, screen, and retrieve additional articles not identified in the MEDLINE search. Selected primary authors were contacted to identify additional studies we may have missed [17,18]. Based on this consultation and our inclusion criteria (described below) we did not pursue articles published before 1965 or from additional US databases.

Selection criteria

All US studies of smallpox vaccine complications were included for further review. Articles were screened further based on the following criteria: (1) the number of persons vaccinated and whether the vaccine complications were reported by vaccination status; that is, whether it was a primary vaccination or a re-vaccination, (2) sufficient data were provided to calculate complication or case-fatality risks, and (3) one or more vaccination complications were consistent with case definitions as defined by Neff and colleagues [19]. Prior to this publication there were no consistent case definitions of smallpox vaccine complications. The following summarizes the Neff criteria:

• Encephalitis: post-vaccinial central nervous system involvement, including separately or in combination, the following symptoms: meningeal signs, ataxia, muscular weakness, paralysis, lethargy, coma or convulsions,

• Vaccinia necrosum (progressive vaccinia): spreading necrosis at the site of the vaccination, with or without metastatic necrotic lesions occurring elsewhere on the body,

• Eczema vaccinatum: generalized spread of vaccinial lesions or local implantation of vaccinia in a person who has eczema or a past history of eczema,

• Generalized vaccinia: generalized vaccinial lesions, with no eczema or other pre-existing lesion,

• Accidental infection: vaccinial lesions resulting from accidental autoinoculation of vaccinia virus in the eye or mouth or on other parts of the body, with no eczema or other pre-existing skin lesions.

Validity assessment

For this review we did not develop a quality score. Instead, we collected relevant information that might bias the complication and case fatality risk estimates from each article. This included information on the study location, whether potential vaccinees were screened (e.g., history of eczema/atopic dermatitis), reporting source of vaccine complications and deaths (numerators), and source of numbers of persons vaccinated (denominators). This information was summarized to help the reader interpret the findings.

Data abstraction

Data from each article were abstracted separately by the two primary reviewers. For quality control, two additional staff independently abstracted the data, and any disagreements were resolved by the primary reviewers.

Study characteristics

The selected studies were published in English. They had the type and number of vaccine complications, and an estimate of the number of persons vaccinated. The type and number of complications came from several sources which are summarized in Table 1. The number of persons vaccinated were either known as in the US cohort studies [20,21], or were estimated using data from US national or state immunization surveys [19,22-25].

Table 1

Comparison of smallpox vaccination adverse effects studies meeting selection criteria for this systematic review

Study and year published [Ref]	Source	Number of primary and re-vaccinations	Screening occurred	Complications	Numerator source		Denominator source
					Complication	Death
Neff 1967a [19]	United States, 1963	6,239,0007,775,000	NR	PVE, VN, EV, GV, AI	Red Cross VIG distribution system, CDC, National Survey of pediatrician and general practitioners	Deaths certificates	Estimated by National Bureau of Census Immunization Survey
Neff 1967b [22]	United States, 1963 (North Carolina, Rhode Island, Washington, Wyoming)	298,000370,000	NR	PVE, VN, EV, GV, AI	Retrospective physician survey, Local health officers, Records at major medical centers	Death certificates	Estimated by National Bureau of Census Immunization Survey
Lane 1969 [24]	United States, 1968	5,594,0008,574,000	NR	PVE, VN, EV, GV, AI	Red Cross VIG distribution system, Red Cross consultants, State & Territorial Epidemiologists, Burroughs-Wellcome Co., Vaccine manufacturers, NCDC Encephalitic Surveillance Unit, NCDC Viral Exanthems Unit	Death certificates	Estimated by National Bureau of Census Immunization Survey
Lane 1970 [25]	United States, 1968 (Alabama, Alaska, Iowa, Kentucky, Maine, Maryland, Rhode Island, South Carolina, Washington, West Virginia)	596,000998,000	NR	PVE, VN, EV, GV, AI	Prospective physician survey, Public health nurse survey (2 states)	NR	Estimated by National Bureau of Census Immunization Survey
Mellin 1970 [23]	United States, 1968 (Maryland)	109,000166,000	NR	PVE, VN, EV, GV, AI	Medical and chirurgical faculty, County health officers, Chief pediatricians in general hospitals, Red Cross VIG distribution system, General hospitals, Public health nurses	NR	Estimated by National Bureau of Census Immunization Survey
Ratner 1970 [21]	Puerto Rico, 1967	369,546465,926	Yesa	PVE, VN, EV, GV, AI	Physician survey, Immunization nurses, University hospital dermatologists, Red Cross VIG distribution system	NR	National smallpox vaccination campaign
Neff 1972 [20]	United States, 1968 (Baltimore pediatric clinic)	549433	NR	PVE, VN, EV, GV, AI	Pediatric clinic chart review	NR	Clinic chart review

NR = Not reported, PVE = post-vaccinial encephalitis, VN = vaccinia necrosum, EV = eczema vaccinatum, GV = generalized vaccinia, AI = accidental infection (inadvertant autoinoculation), VIG = Vaccinia immune globulin, NCDC = National Communicable Disease Center. aVaccinations withheld from persons aged less than 1 year or greater than 60 years, and persons with acute illness, blood dyscrasia, malignancy, pregnancy, eczema or infectious skin disease, eczema in household contacts, steroid therapy, radiation therapy; cerebral damage, or seizure disorder. bWyeth Dryvax product licensed and is use during this period [11]

Quantitative data synthesis

Data in all the studies, except the Ratner study, were stratified by vaccination status and by the following age groups (age <1 year, ages 1 to 4 years, ages 5 to 19 years, ages 20+ years, and all ages combined). For the Ratner study [21], data in the age groups "Age 5 to 14" and "Age 15+" were counted in the groups "Age 5 to 19" and "Age 20+," respectively.

For primary vaccinations, and for each complication, the study risk estimates were stratified by age group and by study, and combined across age groups and studies. First, the age-specific risk of each complication was calculated as the number of reported complications divided by the number vaccinated for that age group. Second, the age-specific risk of death from post-vaccinial encephalitis, vaccinia necrosum, and eczema vaccinatum was calculated as the number of deaths from each complication divided by the number vaccinated for that age group. Third, the age-specific case fatality risks from post-vaccinial encephalitis, vaccinia necrosum, and eczema vaccinatum were calculated as the number of deaths from a specific complication divided by the number with that specific complication. For all risk estimates, exact 95% confidence intervals were calculated based on the binomial distribution using R, a freely available open source programming language for statistical computing and graphics [26].

Although contact vaccinia was not the focus of this review, for non-vaccinees with contact-acquired eczema vaccinatum that was reported, we calculated the case fatality risk.

For re-vaccinations, the same risk estimates were calculated as for primary vaccinations. However, because the risk of complications was much lower for revaccinations, the risks estimates were stratified by study only and summarized in one table.

Results

Our search yielded a total of 348 studies: 342 from the MEDLINE search, 2 from the reference lists review [27,28], 2 from author communications [29,30], and 2 from our files [27,31]. From this pool, 18 articles of smallpox vaccination complications were identified for further review. Using our selection criteria we excluded 11 studies: 3 did not use the Neff criteria [31-33], 3 did not report complications by vaccination status [34-36], 3 did not report the total number of vaccinations by vaccination status [27,37,38], and 2 studies' results [39,40] were reported in another article [25]. The remaining 7 articles form the basis of this systematic review and represent data from approximately 13,206,095 primary vaccinations and 18,349,359 re-vaccinations [19-25] (Table 1).

The US studies covered the years 1963, 1967, and 1968. Five of the 7 studies were period analyses [19,22-25]. For a period analysis, the number of vaccine complications for a selected geographic location and period of time were ascertained from a variety of sources (Table 1, columns 6 and 7). The at-risk population was the number of persons vaccinated in that location during the same time period. This number was estimated from a variety of sources including population-based regional and national surveys (Table 1, column 8). One study was a prospective cohort study [21] and the other was a clinic-based retrospective cohort study [20].

Primary vaccination

Post-vaccinial encephalitis

The risk of post-vaccinial encephalitis (complication risk, CR), the risk of a post-vaccinial encephalitis death (mortality risk, MR), and the individual risk of dying of post-vaccinial encephalitis (case fatality risk, CFR) by age group are displayed in Table 2. The highest risk for developing post-vaccinial encephalitis was among infants aged <1 year old (risk ratio, 2.80, compared to vaccinees aged 1 year or older). Although the summary risk in this age group was 6.8 cases per million vaccinations, the 1970 Lane et al. study [25] that prospectively surveyed physicians estimated a much higher risk (CR, 176.5 cases per million; 95% CI, 36.4–515). The risk in vaccinees aged >1 year was much lower and did not change with age.

Table 2

Risk of post-vaccinial encephalitis (P.V.E.) and death from primary smallpox vaccinations, Stratified by age and study, 1963–1968

Age group and studies	Number vaccinated	P.V.E. No.	Deaths No.	Risk of complication per million (95% C.I.)a		Risk of death per million (95% C.I.)a		Case fatality risk per hundred (95% C.I.)a
Age <1
Neff 1967a	654,000	1	0	1.5	(0.04, 8.5)	0.0	(0.0, 5.6)	0.0	(0.0, 97.5)
Neff 1967b	31,000	1	0	32.3	(0.8, 180)	0.0	(0.0, 119)	0.0	(0.0, 97.5)
Lane 1969	614,000	4	3	6.5	(1.8, 167)	4.9	(1.0, 14.3)	75.0	(19.4, 99.4)
Lane 1970	17,000	3	1	176.5	(36.4, 515)	58.8	(1.5, 328)	33.3	(0.84, 90.6)
Ratner 1970	1	0	0	n/c	n/c	n/c	n/c	n/a	n/a
Neff 1972	32	0	0	n/c	n/c	n/c	n/c	n/a	n/a
Summary	1,316,033	9	4	6.8	(3.1, 13.0)	3.0	(0.8, 7.8)	44.4	(13.7, 78.8)
Age 1 to 4
Neff 1967a	2,973,000	2	1	0.7	(0.08, 2.4)	0.3	(0.008, 1.9)	50.0	(1.3, 98.7)
Neff 1967b	142,000	0	0	0.0	(0.0, 26.0)	0.0	(0.0, 26.0)	n/a	n/a
Lane 1969	2,733,000	6	0	2.2	(0.8, 4.8)	0.0	(0.0, 1.3)	0.0	(0.0, 45.9)
Lane 1970	317,000	3	0	9.5	(2.0, 27.6)	0.0	(0.0, 11.6)	0.0	(0.0, 70.8)
Ratner 1970	68,002	0	0	0.0	(0.0, 54.2)	0.0	(0.0, 54.2)	n/a	n/a
Neff 1972	517	0	0	0.0	(0.0, 7110)	0.0	(0.0, 7110)	n/a	n/a
Summary	6,233,519	11	1	1.8	(0.9, 3.2)	0.2	(0.004, 0.9)	9.1	(0.23, 41.3)
Age 5 to 19
Neff 1967a	2,295,000	8	4	3.5	(1.5, 6.9)	1.7	(0.5, 4.5)	50.0	(15.7, 84.3)
Neff 1967b	110,000	0	0	0.0	(0.0, 33.5)	0.0	(0.0, 33.5)	n/a	n/a
Lane 1969	1,959,000	5	1	2.6	(0.8, 6.0)	0.5	(0.01, 2.8)	20.0	(0.50, 71.6)
Lane 1970	229,000	2	0	8.7	(1.1, 31.5)	0.0	(0.0, 16.1)	0.0	(0.0, 84.2)
Ratner 1970b	193,721	1	1	5.2	(0.1, 28.8)	5.2	(0.1, 28.8)	100.0	(2.5, 100)
Summary	4,786,721	16	6	3.3	(1.9, 5.4)	1.2	(0.5, 2.7)	37.5	(15.2, 64.6)
Age 20 +
Neff 1967a	317,000	1	0	3.2	(0.1, 17.6)	0.0	(0.0, 11.6)	0.0	(0.0, 97.5)
Neff 1967b	15,000	0	0	0.0	(0.0, 246)	0.0	(0.0, 246)	n/a	n/a
Lane 1969	288,000	1	0	3.5	(0.1, 19.3)	0.0	(0.0, 12.8)	0.0	(0.0, 97.5)
Lane 1970	33,000	0	0	0.0	(0.0, 112)	0.0	(0.0, 112)	n/a	n/a
Ratner 1970b	107,822	0	0	0.0	(0.0, 34.2)	0.0	(0.0, 34.2)	n/a	n/a
Summary	760,822	2	0	2.6	(0.3, 9.5)	0.0	(0.0, 4.8)	0.0	(0.0, 84.2)
All agesc
Neff 1967a	6,239,000	12	5	1.9	(0.2, 3.4)	0.8	(0.3, 1.9)	41.7	(15.2, 72.3)
Neff 1967b	298,000	1	0	3.4	(0.1, 18.7)	0.0	(0.0, 12.2)	0.0	(0.0, 97.5)
Lane 1969	5,594,000	16	4	2.9	(1.6, 4.6)	0.7	(0.2, 1.8)	25.0	(7.3, 52.4)
Lane 1970	596,000	8	1	13.4	(5.8, 26.4)	1.7	(0.04, 9.3)	12.5	(0.3, 52.6)
Mellin 1970	109,000	0	0	0.0	(0.0, 33.8)	0.0	(0.0, 33.8)	n/a	n/a
Ratner 1970	369,546	1	1	2.7	(0.07, 15.1)	2.7	(0.1, 15.1)	100.0	(2.5, 100)
Neff 1972	549	0	0	0.0	(0.0, 6697)	0.0	(0.0, 6697)	n/a	n/a
Summary	13,206,095	38	11	2.9	(2.0, 3.9)	0.8	(0.4, 1.5)	28.9	(15.4, 45.9)

n/c = not calculated, n/a = not assessable aRisk and confidence intervals not calculated (n/c) for less that 100 vaccinations. Exact confidence intervals based on the binomial distribution. bThe Ratner study age groups, "Age 5 to 14" and "Age 15+", were counted in the Table age groups "Age 5 to 19" and "Age 20+", respectively. cAll ages group may includes subjects whose age was unknown

The summary case fatality risk for post-vaccinial encephalitis was highest in infants aged <1 year (CFR, 44.4 deaths per 100 cases; 95% CI, 13.7–78.8), however, it was not statistically different from the other age groups (P value = 0.21). For all ages groups, combined there were 11 deaths among 38 cases of post-vaccinial encephalitis (CFR, 28.9 deaths per 100 cases; 95% CI, 15.4–45.9).

Vaccinia necrosum (progressive vaccinia)

The risk of vaccinia necrosum, the risk of a vaccinia necrosum death, and the individual risk of dying from vaccinia necrosum by age group are displayed in Table 3. The highest summary risks for developing vaccinia necrosum were among vaccinees aged 20 years or older (CR, 5.3 cases per million; 95% CI, 1.4–13.5). For all ages combined, there were 13 cases of vaccinia necrosum from over 13 million vaccinations (CR, 1.0 cases per million; 95% CI, 0.5–1.7) Almost all cases of vaccinia necrosum occurred in persons with a previously diagnosed hematopoetic malignancy or immunodeficiency condition [24].

Table 3

Risk of vaccinia necrosum (V.N.) (progressive vaccinia) and death from primary smallpox vaccinations, Stratified by age and study, 1963–1968

Age group and studies	Number vaccinated	V.N. No.	Deaths No.	Risk of complication per million (95% C.I.)a		Risk of death per million (95% C.I.)a		Case fatality risk per hundred (95% C.I.)a
Age <1
Neff 1967a	654,000	1	0	1.5	(0.04, 8.5)	0.0	(0.0, 5.6)	0.0	(0.0, 97.5)
Neff 1967b	31,000	0	0	0.0	(0.0, 122)	0.0	(0.0, 119.0)	n/a	n/a
Lane 1969	614,000	0	0	0.0	(0.0, 6.0)	0.0	(0.0, 6.0)	n/a	n/a
Lane 1970	17,000	0	0	0.0	(0.0, 217)	0.0	(0.0, 217)	n/a	n/a
Ratner 1970	1	0	0	n/c	n/c	n/c	n/c	n/a	n/a
Neff 1972	32	0	0	n/c	n/c	n/c	n/c	n/a	n/a
Summary	1,316,033	1	0	0.8	(0.02, 4.2)	0.0	(0.0, 2.8)	0.0	(0.0, 97.5)
Age 1 to 4
Neff 1967a	2,973,000	1	0	0.3	(0.01, 1.9)	0.0	(0.0, 1.2)	0.0	(0.0, 97.5)
Neff 1967b	142,000	0	0	0.0	(0.0, 26.0)	0.0	(0.0, 26.0)	n/a	n/a
Lane 1969	2,733,000	1	0	0.4	(0.01, 2.0)	0.0	(0.0, 1.3)	0.0	(0.0, 97.5)
Lane 1970	317,000	1	0	3.2	(0.08, 17.6)	0.0	(0.0, 11.6)	0.0	(0.0, 97.5)
Ratner 1970	68,002	0	0	0.0	(0.0, 54.2)	0.0	(0.0, 54.2)	n/a	n/a
Neff 1972	517	0	0	0.0	(0.0, 7110)	0.0	(0.0, 7110)	n/a	n/a
Summary	6,233,519	3	0	0.5	(0.1, 1.4)	0.0	(0.0, 0.6)	0.0	(0.0, 70.8)
Age 5 to 19
Neff 1967a	2,295,000	3	0	1.3	(0.3, 3.8)	0.0	(0.0, 1.6)	0.0	(0.0, 70.6)
Neff 1967b	110,000	0	0	0	(0.0, 33.5)	0.0	(0.0, 33.5)	n/a	n/a
Lane 1969	1,959,000	2	2	1.0	(0.1, 3.7)	1.0	(0.1, 3.7)	100	(15.8, 100)
Lane 1970	229,000	0	0	0	(0.0, 16.1)	0.0	(0.0, 16.1)	n/a	n/a
Ratner 1970b	193,721	0	0	0	(0.0, 19.0)	0.0	(0.0, 19.0)	n/a	n/a
Summary	4,786,721	5	2	1.0	(0.34, 2.44)	0.4	(0.05, 1.5)	40.0	(5.3, 85.3)
Age 20 +
Neff 1967a	317,000	2	0	6.3	(0.8, 22.8)	0.0	(0.0, 11.6)	0.0	(0.0, 84.2)
Neff 1967b	15,000	0	0	0.0	(0.0, 246)	0.0	(0.0, 246)	n/a	n/a
Lane 1969	288,000	2	0	6.9	(0.8, 25.1)	0.0	(0.0, 12.8)	0.0	(0.0, 84.2)
Lane 1970	33,000	0	0	0.0	(0.0, 112)	0.0	(0.0, 112)	n/a	n/a
Ratner 1970b	107,822	0	0	0.0	(0.0, 34.2)	0.0	(0.0, 34.2)	n/a	n/a
Summary	760,822	4	0	5.3	(1.4, 13.5)	0.0	(0.0, 4.8)	0.0	(0.0, 60.2)
All agesc
Neff 1967a	6,239,000	7	0	1.1	(0.4, 2.3)	0.0	(0.0, 0.6)	0.0	(0.0, 41.1)
Neff 1967b	298,000	0	0	0.0	(0.0, 12.4)	0.0	(0.0, 12.4)	n/a	n/a
Lane 1969	5,594,000	5	2	0.9	(0.3, 2.1)	0.4	(0.04, 1.3)	40.0	(5.3, 85.3)
Lane 1970	596,000	1	0	1.7	(0.04, 9.3)	0.0	(0.0, 6.2)	0.0	(0.0, 97.5
Mellin 1970	109,000	0	0	0.0	(0.0, 33.8)	0.0	(0.0, 33.8)	n/a	n/a
Ratner 1970	369,546	0	0	0.0	(0.0, 10.0)	0.0	(0.0, 10.0)	n/a	n/a
Neff 1972	549	0	0	0.0	(0.0, 6697)	0.0	(0.0, 6697)	n/a	n/a
Summary	13,206,095	13	2	1.0	(0.5, 1.7)	0.2	(0.02, 0.5)	15.4	(1.9, 45.4)

n/c = not calculated, n/a = not assessable aRisk and confidence intervals not calculated (n/c) for less that 100 vaccinations. Exact confidence intervals based on the binomial distribution. bThe Ratner study age groups, "Age 5 to 14" and "Age 15+", were counted in the Table age groups "Age 5 to 19" and "Age 20+", respectively. cAll ages group includes subjects whose age was unknown

For all age groups combined, there were 2 deaths among 13 cases of vaccinia necrosum (CFR, 15.4 deaths per 100 cases; 95% CI, 1.9–45.4).

Eczema vaccinatum

The risk of eczema vaccinatum, the risk of a eczema vaccinatum death, and the individual risk of dying from eczema vaccinatum by age group are displayed in Table 4. For all age groups combined, there were 169 cases of eczema vaccinatum from over 13 million vaccinations (CR, 12.8 cases per 1 million vaccinations; 95% CI, 10.9–14.9). The summary risks of eczema vaccinatum did not differ across age groups. However, within age groups, the highest risks were recorded from the US studies that used physician surveys to ascertain complications not captured by other reporting mechanisms [22,25]. In these two studies, the risks of eczema vaccinatum ranged from 30.3 to 96.8 cases per million vaccinations, and were higher in infants <1 year, although not statistically significant.

Table 4

Risk of eczema vaccinatum (E.V.) and death from primary smallpox vaccinations, Stratified by age and study, 1963–1968

Age group and studies	Number vaccinated	E.V. No.	Deaths No.	Risk of complication per million (95% C.I.)a		Risk of death per million (95% C.I.)a		Case fatality risk per hundred (95% C.I.)a
Age <1
Neff 1967a	654,000	16	0	24.5	(14.0, 39.7)	0.0	(0.0, 5.6)	0.0	(0.0, 20.6)
Neff 1967b	31,000	3	0	96.8	(20.0, 283)	0.0	(0.0, 119)	0.0	(0.0, 70.8)
Lane 1969	614,000	5	0	8.1	(2.6, 19.0)	0.0	(0.0, 6.0)	0.0	(0.0, 52.2)
Lane 1970	17,000	1	0	58.8	(1.5, 328)	0.0	(0.0, 217)	0.0	(0.0, 97.5)
Ratner 1970	1	0	0	n/c	n/c	n/c	n/c	n/a	n/a
Neff 1972	32	0	0	n/c	n/c	n/c	n/c	n/a	n/a
Summary	1,316,033	25	0	19.0	(12.3, 28.0)	0.0	(0.0, 2.8)	0.0	(0.0, 13.7)
Age 1 to 4
Neff 1967a	2,973,000	22	0	7.4	(4.6, 11.2)	0.0	(0.0, 1.2)	0.0	(0.0, 15.4)
Neff 1967b	142,000	9	0	63.4	(29.0, 120)	0.0	(0.0, 26.0)	0.0	(0.0, 33.6)
Lane 1969	2,733,000	31	0	11.3	(7.7, 16.1)	0.0	(0.0, 1.3)	0.0	(0.0, 11.2)
Lane 1970	317,000	14	0	44.2	(24.1, 74.1)	0.0	(0.0, 11.6)	0.0	(0.0, 23.2)
Ratner 1970	68,002	0	0	0.0	(0.0, 54.2)	0.0	(0.0, 54.2)	n/a	n/a
Neff 1972	517	0	0	0.0	(0.0, 7110)	0.0	(0.0, 7110)	n/a	n/a
Summary	6,233,519	76	0	12.2	(9.6, 15.3)	0.0	(0.0, 0.6)	0.0	(0.0, 4.7)
Age 5 to 19
Neff 1967a	2,295,000	15	0	6.5	(3.7, 10.8)	0.0	(0.3, 1.6)	0.0	(0.0, 21.8)
Neff 1967b	110,000	8	0	72.7	(31.4, 143)	0.0	(0.3, 33.5)	0.0	(0.0, 36.9)
Lane 1969	1,959,000	14	0	7.1	(3.9, 12.0)	0.0	(0.3, 1.9)	0.0	(0.0, 23.2)
Lane 1970	229,000	8	0	34.9	(15.1, 68.8)	0.0	(0.3, 16.1)	0.0	(0.0, 36.9)
Ratner 1970b	193,721	3	0	15.5	(3.2, 45.3)	0.0	(0.3, 19.0)	0.0	(0.0, 70.8)
Summary	4,786,721	48	0	10.0	(7.4, 13.3)	0.0	(0.0, 0.8)	0.0	(0.0, 7.4)
Age 20 +
Neff 1967a	317,000	1	0	3.2	(0.1, 17.6)	0.0	(0.3, 11.6)	0.0	(0.0, 97.5)
Neff 1967b	15,000	1	0	66.7	(1.7, 371)	0.0	(0.3, 246	0.0	(0.0, 97.5)
Lane 1969	288,000	7	0	24.3	(9.8, 50.1)	0.0	(0.3, 12.8)	0.0	(0.0, 41.0)
Lane 1970	33,000	1	0	30.3	(0.8, 169)	0.0	(0.3, 112	0.0	(0.0, 97.5)
Ratner 1970b	107,822	0	0	0.0	(0.0, 34.2)	0.0	(0.3, 34.2)	n/a	n/a
Summary	760,822	10	0	13.1	(6.3, 24.2)	0.0	(0.0, 4.8)	0.0	(0.0, 30.8)
All agesc
Neff 1967a	6,239,000	54	0	8.6	(6.5, 11.3)	0.0	(0.0, 0.6)	0.0	(0.0, 6.6)
Neff 1967b	298,000	24	0	80.5	(51.6, 120)	0.0	(0.0, 12.4)	0.0	(0.0, 14.2)
Lane 1969	5,594,000	58	0	10.4	(7.9, 13.4)	0.0	(0.0, 0.7)	0.0	(0.0, 6.2)
Lane 1970	596,000	25	0	41.9	(27.1, 61.9)	0.0	(0.0, 6.2)	0.0	(0.0, 13.7)
Mellin 1970	109,000	5	0	45.9	(14.9, 107)	0.0	(0.0, 33.8)	0.0	(0.0, 52.2)
Ratner 1970	369,546	3	0	8.1	(1.7, 23.7)	0.0	(0.0, 10.0)	0.0	(0.0, 70.8)
Neff 1972	549	0	0	0.0	(0.0, 6697)	0.0	(0.0, 6697)	n/a	n/a
Summary	13,206,095	169	0	12.8	(10.9, 14.9)	0.0	(0.0, 0.3)	0.0	(0.0, 2.2)

n/c = not calculated, n/a = not assessable aRisk and confidence intervals not calculated (n/c) for less that 100 vaccinations. Exact confidence intervals based on the binomial distribution. bThe Ratner study age groups, "Age 5 to 14" and "Age 15+", were counted in the Table age groups "Age 5 to 19" and "Age 20+", respectively. cAll ages group includes subjects whose age was unknown

For all age groups combined, there were no deaths among 169 cases of eczema vaccinatum (CFR, 0 deaths per 100 cases; 95% CI, 0.0–2.2). However, among non-vaccinees that developed eczema vaccinatum after contact transmission from a recent vaccinee, 3 of 132 cases died (2.3 deaths per 100 cases; 95% CI, 0.5–6.5) [19,22,24,25].

Generalized vaccinia

The risk of generalized vaccinia is displayed in Table 5. The summary risk of developing generalized vaccinia was highest among infants aged <1 year (103.3 cases per million vaccinations; 95% CI, 86.7–122.2). However, within age groups, the highest risks were recorded from the US studies that used physician surveys to ascertain complications not captured by other reporting mechanisms [22,25]. The complication risks ranged from 133.3 to 1647 cases per million vaccinations and were highest in infants aged <1 year. The highest risks were reported from the study that prospectively surveyed physicians [25].

Table 5

Risk of generalized vaccinia (G.V.) and accidental infection (A.I.) from primary smallpox vaccinations, Stratified by age and study, 1963–1968

		Generalized vaccinia				Accidental infection
Age group and studies	Number vaccinated	G.V. No.	Deaths No.	Risk of complication per million (95% C.I.)a		Number vaccinated	A.I. No.	Deaths No.	Risk of complication per million (95% C.I.)a
Age <1
Neff 1967a	654,000	52	0	79.5	(59.4, 104)	654,000	7	0	10.7	(4.3, 22.0)
Neff 1967b	31,000	12	0	387.1	(200, 676)	n/a	n/a	n/a	n/a	n/a
Lane 1969	614,000	43	0	70.0	(50.7, 94.3)	614,000	7	0	11.4	(4.6, 23.5)
Lane 1970	17,000	28	0	1647	(1095, 2380)	17,000	36	0	2117.6	(1484, 2930)
Ratner 1970	1	1	0	n/c	n/c	1	0	0	n/c	n/c
Neff 1972	32	0	0	n/c	n/c	32	0	0	n/c	n/c
Summary	1,316,033	136	0	103.3	(86.7, 122.2)	1,285,033	50	0	38.9	(28.9, 51.3)
Age 1 to 4
Neff 1967a	2,973,000	46	0	15.5	(11.3, 20.6)	2,973,000	40	0	13.4	(9.6, 18.3)
Neff 1967b	142,000	24	0	169.0	(108, 251)	n/a	n/a	n/a	n/a	n/a
Lane 1969	2,733,000	47	0	17.2	(12.6, 22.9)	2,733,000	91	0	33.3	(26.8, 40.9)
Lane 1970	317,000	74	0	233.4	(183, 293)	317,000	183	0	577.3	(497, 667)
Ratner 1970	68,002	6	0	88.2	(32.4, 192)	68,002	3	0	44.1	(9.1, 129)
Neff 1972	517	0	0	0.0	(0.0, 7110)	517	3	0	5802.7	(1198, 16,864)
Summary	6,233,519	197	0	31.6	(27.3, 36.3)	6,091,519	320	0	52.5	(46.9, 58.6)
Age 5 to 19
Neff 1967a	2,295,000	24	0	10.5	(6.7, 15.6)	2,295,000	33	0	14.4	(9.9, 20.2)
Neff 1967b	110,000	17	0	154.5	(90.0, 247)	n/a	n/a	n/a	n/a	n/a
Lane 1969	1,959,000	25	0	12.8	(8.3, 18.8)	1,959,000	35	0	17.9	(12.4, 24.8)
Lane 1970	229,000	32	0	139.7	(95.6, 197)	229,000	85	0	371.2	(296, 459)
Ratner 1970b	193,721	9	0	46.5	(21.2, 88.2)	193,721	2	0	10.3	(1.2, 37.3)
Summary	4,786,721	107	0	22.4	(18.3, 27.0)	4,676,721	155	0	33.1	(28.1, 38.8)
Age 20 +
Neff 1967a	317,000	6	0	18.9	(6.9, 41.2)	317,000	4	0	12.6	(3.4, 32.3)
Neff 1967b	15,000	2	0	133.3	(16.1, 482)	n/a	n/a	n/a	n/a	n/a
Lane 1969	288,000	13	0	45.1	(24.0, 77.2)	288,000	4	0	13.9	(3.8, 35.6)
Lane 1970	33,000	7	0	212.1	(85.3, 437)	33,000	20	0	606.1	(370, 936)
Ratner 1970b	107,822	10	0	92.7	(44.5, 171)	107,822	8	0	74.2	(32.0, 146)
Summary	760,822	38	0	49.9	(35.3, 68.6)	745,822	36	0	48.3	(33.8, 66.8)
All agesc
Neff 1967a	6,239,000	130	0	20.8	(17.4, 24.7)	6,239,000	85	0	13.6	(10.9, 16.8)
Neff 1967b	298,000	71	0	238.3	(186.1, 300)	298,000	250	0	838.9	(738, 950)
Lane 1969	5,594,000	131	0	23.4	(19.6, 27.8)	5,594,000	142	0	25.4	(21.4, 23.0)
Lane 1970	596,000	157	0	263.4	(224, 308)	596,000	344	0	577.2	(518, 641)
Mellin 1970	109,000	12	0	110.1	(56.9, 192)	109,000	20	0	183.5	(112, 283)
Ratner 1970	369,546	26	0	70.4	(46.0, 103)	369,546	13	0	35.2	(18.7, 60.1)
Neff 1972	549	0	0	0.0	(0.0, 6697)	549	3	0	5464.5	(1128, 15,885)
Summary	13,206,095	527	0	39.9	(36.6, 43.5)	13,206,095	857	0	64.9	(60.6, 69.4)

n/c = not calculated, n/a = not available from this study aRisk and confidence intervals not calculated (n/c) for less that 100 vaccinations. Exact confidence intervals based on the binomial distribution. bThe Ratner study age groups, "Age 5 to 14" and "Age 15+", were counted in the Table age groups "Age 5 to 19" and "Age 20+", respectively. cAll ages group includes subjects whose age was unknown

For all age groups combined, there were no deaths among 527 cases of generalized vaccinia (CFR, 0 deaths per 100 cases; 95% CI, 0.0–0.7).

Accidental infection (inadvertent autoinoculation)

The risk of accidental infection is displayed in Table 5. For all age groups combined, there were 857 cases of accidental infection from over 13 million vaccinations (CR, 64.9 cases per 1 million vaccinations; 95% CI, 60.6–69.4). The summary risks of accidental infection did not differ across age groups. However, within age groups, the highest risks were recorded from two US studies: the Lane study [25] that prospectively surveyed physicians and the Neff pediatric clinic study [20]. In the Lane study, the risk ranged from 371.2 to 2118 cases per million vaccinations, and was highest in infants aged <1 year. The Neff study reported 3 accidental infections from 517 vaccinations in the age group 1 to 4 years (CR, 5803 cases per million; 95% CI, 1198–16,863).

For all age groups combined, there were no deaths among 857 cases of accidental infection (CFR, 0 deaths per 100 cases; 95% CI, 0.0–0.4).

Re-vaccination

For smallpox vaccine re-vaccinations, the risks of developing specific complications, the risks of a specific complication death, and the individual risks of dying from specific complications by age group are displayed in Table 6. Because the risks were so low compared to primary vaccination, the risks were not stratified by age group. Compared to primary vaccinations, the summary risk of post-vaccinial encephalitis was 26 times lower in re-vaccinations, vaccinia necrosum was 1.5 times lower, eczema vaccinatum was 12 times lower, generalized vaccinia was 29 times lower, and accidental infection was 3.8 times lower. Only 2 deaths occurred from over 19.5 million re-vaccinations (MR, 0.1 deaths per million; 95% CI, 0.01–0.4). These two deaths occurred among 12 cases of vaccinia necrosum (CFR 16.7 deaths per 100 cases; 95% CI, 2.1–48.4).

Table 6

Risk of serious complications (S.C.) and death from smallpox re-vaccinations for ages greater than 1, 1963–1968

Complication and studies	Number vaccinated	S.C. No.	Deaths No.	Risk of complication per million (95% C.I.)a		Risk of death per million (95% C.I.)a		Case fatality risk per hundred (95% C.I.)a
Post-vaccinial encephalitis
Neff 1967a	7,775,000	0	0	0.0	(0.0, 0.5)	0.0	(0.0, 0.5)	n/a	n/a
Neff 1967b	370,000	0	0	0.0	(0.0, 10.0)	0.0	(0.0, 10.0)	n/a	n/a
Lane 1969	8,574,000	0	0	0.0	(0.0, 0.4)	0.0	(0.0, 0.4)	n/a	n/a
Lane 1970	998,000	2	0	2.0	(0.2, 7.3)	0.0	(0.0, 3.7)	0.0	(0.0, 84.2)
Mellin 1970	166,000	0	0	0.0	(0.0, 22.2)	0.0	(0.0, 22.2)	n/a	n/a
Ratner 1970	465,926	0	0	0.0	(0.0, 7.9)	0.0	(0.0, 7.9)	n/a	n/a
Neff 1972	433	0	0	0.0	(0.0, 8483)	0.0	(0.0, 8483)	n/a	n/a
Summary	18,349,359	2	0	0.1	(0.01, 0.4)	0.0	(0.0, 0.2)	0.0	(0, 84.2)
Vaccinia necrosum
Neff 1967a	7,775,000	2	0	0.3	(0.03, 0.9)	0.0	(0.0, 0.5)	0.0	(0.0, 84.2)
Neff 1967b	370,000	0	0	0.0	(0.0, 10.0)	0.0	(0.0, 10.0)	n/a	n/a
Lane 1969	8,574,000	6	2	0.7	(0.3, 1.5)	0.2	(0.03, 0.8)	33.3	(4.3, 77.7)
Lane 1970	998,000	3	0	3.0	(0.6, 8.8)	0.0	(0.0, 3.7)	0.0	(0.0, 70.8)
Mellin 1970	166,000	1	0	6.0	(0.2, 33.6)	0.0	(0.0, 22.2)	0.0	(0.0, 97.5)
Ratner 1970	465,926	0	0	0.0	(0.0, 7.9)	0.0	(0.0, 7.9)	n/a	n/a
Neff 1972	433	0	0	0.0	(0.0, 8483)	0.0	(0.0, 8483)	n/a	n/a
Summary	18,349,359	12	2	0.7	(0.3, 1.1)	0.1	(0.01, 0.4)	16.7	(2.1, 48.4)
Eczema vaccinatum
Neff 1967a	7,775,000	3	0	0.4	(0.1, 1.1)	0.0	(0.0, 0.5)	0.0	(0.0, 70.8)
Neff 1967b	370,000	5	0	13.5	(4.4, 31.5)	0.0	(0.0, 10.0)	0.0	(0.0, 52.2)
Lane 1969	8,574,000	8	0	0.9	(0.4, 1.8)	0.0	(0.0, 0.4)	0.0	(0.0, 36.9)
Lane 1970	998,000	3	0	3.0	(0.6, 8.8)	0.0	(0.0, 3.7)	0.0	(0.0, 70.8)
Mellin 1970	166,000	0	0	0.0	(0.0, 22.2)	n/a	n/a	n/a	n/a
Ratner 1970	465,926	0	0	0.0	(0.0, 7.9)	n/a	n/a	n/a	n/a
Neff 1972	433	0	0	0.0	(0.0, 8483)	n/a	n/a	n/a	n/a
Summary	18,349,359	19	0	1.0	(0.6, 1.6)	0.0	(0.0, 0.2)	0.0	(0.0, 17.6)
Generalized vaccinia
Neff 1967a	7,775,000	3	0	0.4	(0.1, 1.1)	n/c	n/c	n/c	n/c
Neff 1967b	370,000	1	0	2.7	(0.1, 15.1)	n/c	n/c	n/c	n/c
Lane 1969	8,574,000	10	0	1.2	(0.6, 2.1)	n/c	n/c	n/c	n/c
Lane 1970	998,000	9	0	9.0	(4.1, 17.1)	n/c	n/c	n/c	n/c
Mellin 1970	166,000	1	0	6.0	(0.2, 33.6)	n/c	n/c	n/c	n/c
Ratner 1970	465,926	1	0	2.1	(0.05, 12.0)	n/c	n/c	n/c	n/c
Neff 1972	433	0	0	0.0	(0.0, 8483)	n/a	n/a	n/a	n/a
Summary	18,349,359	25	0	1.4	(0.9, 2.0)	n/c	n/c	n/c	n/c
Accidental inoculation
Neff 1967a	7,775,000	8	0	1.0	(0.4, 2.0)	n/c	n/c	n/c	n/c
Neff 1967b	370,000	250	0	675.7	(594, 765)	n/c	n/c	n/c	n/c
Lane 1969	8,574,000	7	0	0.8	(0.3, 1.7)	n/c	n/c	n/c	n/c
Lane 1970	998,000	42	0	42.1	(30.3, 56.9)	n/c	n/c	n/c	n/c
Mellin 1970	166,000	3	0	18.1	(3.7, 52.8)	n/c	n/c	n/c	n/c
Ratner 1970	465,926	1	0	2.1	(0.05, 12.0)	n/c	n/c	n/c	n/c
Neff 1972	433	0	0	0.0	(0.0, 8483)	n/a	n/a	n/a	n/a
Summary	18,349,359	311	0	16.9	(15.1, 18.9)	n/c	n/c	n/c	n/c

n/a = not assessable, n/c = not calculated aExact confidence intervals based on the binomial distribution

Discussion

To our knowledge, this is the first systematic review of the severe complications of smallpox vaccination in the USA. In addition to the age-specific complication and mortality risks, the case fatality risks were summarized. Using pooled summary measures, for every million primary vaccinations there were 60 cases of accidental infection, 40 cases generalized vaccinia, 13 cases of eczema vaccinatum, 3 cases of post-vaccinial encephalitis, and 1 case of vaccinia necrosum. However, complications for which vaccinia immune globulin (VIG) was not used (post-vaccinial encephalitis) or not generally required (accidental infection, generalized vaccinia) were significantly underreported because they were not captured by the VIG distribution program that was used by investigators to ascertain complications. In contrast, the US studies that used direct physician surveys [22,25] reported significantly higher complication risks. For example, the number of complications per million primary vaccinations for all ages combined was 13.4 cases of post-vaccinial encephalitis [25], 263.4 cases of generalized vaccinia [25], and 838.9 cases of accidental infection [22].

The complications with the highest summary case fatality risks were post-vaccinial encephalitis (CFR, 28.9%) and vaccinia necrosum (CFR, 15.4%). There were no recorded deaths among vaccinees from other major complications, including eczema vaccinatum. Deaths from eczema vaccinatum were observed only among non-vaccinees that acquired the disease after contact to a recent vaccinee [38]. Neff et al. reported that contact-acquired eczema vaccinatum resulted in 3 (2.3%) deaths among the 132 cases in the US studies [41]. In contrast, in the United Kingdom (UK) studies contact-acquired eczema vaccinatum resulted in 9 (7.9%) deaths among 89 cases; however, the UK vaccinations occurred in the 1950s using a different vaccinia strain [29,30].

Compared to primary vaccinees, in re-vaccinees the summary risk was 26-fold lower for post-vaccinial encephalitis, 29-fold lower for generalized vaccinia, 12-fold lower for eczema vaccinatum, 3.8-fold lower for accidental infection, and 1.5-fold lower for vaccinia necrosum. Prior vaccination predicted much lower risks for only 3 of the 5 major complications. Therefore, rather than the risks being significantly modified by prior vaccination status, the risk for accidental infection is more likely linked to behavior (autoinoculation) and the risk of vaccinia necrosum is more likely determined by immune status at the time of vaccination. This is consistent with the observation that vaccinia necrosum occurred almost exclusively in vaccinees with an severe cell-mediated immunodeficiency [42].

A strength of this systematic review is that the data were analyzed and summarized by age groups. The complication risks from each study, or combined, can be compared within and across age groups. For example, compared to vaccinees aged 1 year or older, infants aged <1 year had higher summary risks of post-vaccinial encephalitis (risk ratio, 2.80) and generalized vaccinia (risk ratio, 3.14). In contrast, compared to vaccinees aged <20 years, vaccinees aged 20 or older had a higher summary risk of vaccinia necrosum (risk ratio, 7.27).

There are several limitations to this systematic review. First, the studies reviewed were conducted in the 1960s, and routine smallpox vaccination in the United States ended in the early 1970s. Before routine smallpox vaccinations ceased, the characteristics of those persons vaccinated changed as the vaccination risks became better known and potential vaccinees were screened (e.g., infants aged <1 year, history of eczema). To the extent that routine screening for risk factors was occurring, this would have reduced the vaccine complication risks. Only the Ratner prospective cohort study that was conducted in 1967 was able to report vaccination screening criteria [21].

Second, the methods for ascertaining vaccine complications and deaths (i.e., the numerator in the risk estimates) differed between studies. The number of complications ascertained increased as the quantity and quality of ascertainment methods increased. For example, the studies that used direct physician surveys [22,25] recorded more complications that were less severe (generalized vaccinia, accidental infection) or for which VIG was not used (post-vaccinial encephalitis). Therefore, the Lane et al. study [25] that used a prospective physician survey to enhance reporting yielded the highest (and likely the most accurate) vaccine complication risks for that study period. With respect to complications deaths, only 3 studies [19,22,24] reviewed death certificates for this outcome. So it is possible that the other studies underestimated deaths due to vaccine complications.

Third, in the Lane and Neff studies reviewed, the investigators were unable to verify the clinical diagnosis from the reports of adverse events. For example, generalized non-viremic rashes were sometimes misclassified as generalized vaccinia, possibly resulting in an overestimation of the risk of generalized vaccinia [17,18].

Fourth, the methods for estimating the number of primary and repeat vaccinations (i.e., the denominator in risk estimates) differed between studies. Two studies had data on the actual number of vaccinations given [20,21], and in the remaining studies the number of vaccinations were estimated from national or state immunization surveys [19,22,24,25]. Because the complications evaluated for this review were infrequent, the complication risk estimates are more sensitive to variability in the numerator than in the denominator. Therefore, inaccuracies in the estimations of the populations vaccinated would not likely account for the observed heterogeneity in risk estimates.

Fifth, geographical and temporal factors may have influenced the heterogeneity of risk estimates. Pre-vaccination screening practices and the diagnosis and treatment of complications differed across regions and changed over time. Because these sources of bias likely contribute more to the heterogeneity of risk estimates than random error, the pooled summary measures presented may not be appropriate. For example, the Centers for Disease Control and Prevention (CDC) cite, but do not combine, risks estimates from the two Lane studies [24,25] in their report on smallpox vaccination and adverse reactions [13] in order to provide a range of risk estimates. Based on this review, the CDC approach seems appropriate.

Finally, over the past 40 years many factors have changed that might have affected these studies and their interpretation, including the design and conduct of epidemiologic surveillance studies, the diagnosis and treatment of vaccine complications, and a change in the distributions of risk factors (e.g., atopic dermatitis, immunocompromised) among populations that might undergo vaccinations. In spite of all the study limitations, these are the best available US studies of sufficient size to estimate the complication and case fatality risks for each major complication among vaccinees.

This systematic review summarizes the major smallpox vaccine complication and case fatality risks for predicting the age-specific burden of vaccine complications in the event of widespread ring and mass vaccinations. Because atopic dermatitis and immune compromised states are more common today than when these studies were conducted [12,43-45], higher vaccine complication rates may be observed in an outbreak. In comparison, in the current pre-event smallpox vaccination program, rigorous screening of almost 500,000 vaccinees has resulted in no cases of eczema vaccinatum and progressive vaccinia [46,47]; however, very high rates of myopericarditis (about 1:1,700 in civilian vaccinees and 1 per 12,800 in military vaccinees) and possibly myocardial ischemia have been observed [48,47,49]. Both potential primary and re-vaccinees are at risk for myopericarditis. Similar to post-vaccinial encephalitis, there is no screening criteria to reduce complications rates. For these reasons, and because the long term effects of myopericarditis are not known, the ACIP has recommended a "pause" in the USA smallpox vaccination program until the risks and benefits can be studied more carefully [50]. Unless there is a smallpox outbreak, at the current time, the individual risks of pre-event smallpox vaccination outweigh the potential benefits.

Competing interests

None declared.

Authors' contribution

TJA directed the study, co-extracted data, conducted data entry and statistical analyses, and prepared, revised, and finalized the manuscript, including revisions. SU conceived and designed the study, screened the articles for inclusion, and co-extracted data. GWR and SF consulted on study design, methods, analyses, and manuscript preparation. All authors extensively contributed to manuscript editing and revisions. All authors read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here: