| Literature DB >> 33575426 |
Chengyi Zheng1, Lina S Sy1, Hilary Tanenbaum1, Yun Tian1, Yi Luo1, Bradley Ackerson2, Hung Fu Tseng1.
Abstract
BACKGROUND: Diagnosis codes are inadequate for accurately identifying herpes zoster ophthalmicus (HZO). Manual review of medical records is expensive and time-consuming, resulting in a lack of population-based data on HZO.Entities:
Keywords: herpes zoster ophthalmicus; natural language processing; retrospective cohort study; shingles
Year: 2021 PMID: 33575426 PMCID: PMC7863871 DOI: 10.1093/ofid/ofaa652
Source DB: PubMed Journal: Open Forum Infect Dis ISSN: 2328-8957 Impact factor: 3.835
Cross Table for Comparing NLP Results and Chart Review Reference Standard for Identification of Ocular HZO Cases
| Reference Standard | |||
|---|---|---|---|
| NLP Result | Positive | Negative | Total |
| NLP Positive | 92 | 6 | 98 |
| NLP Negative | 5 | 97 | 102 |
| Total | 97 | 103 | 200 |
Abbreviations: HZO, herpes zoster ophthalmicus, NLP, natural language processing.
Accuracy Measurements of NLP in identifying ocular HZO cases
| Evaluation Statistics % (95% CI) | Validation Dataset | Adjusted for Population Prevalence |
|---|---|---|
| Sensitivity | 94.9 (88.4–98.3) | - |
| Specificity | 94.2 (87.8–97.8) | - |
| Positive Likelihood Ratio | 16.3 (7.5–35.4) | - |
| Negative Likelihood Ratio | 0.05 (0.02–0.13) | - |
| Positive Predictive Valuea | 93.9 (87.6–97.1) | 61.7 (42.5–77.8) |
| Negative Predictive Valuea | 95.1 (89.2–97.9) | 99.5 (98.7–99.8) |
Abbreviations: CI, confidence interval; HZO, herpes zoster ophthalmicus, NLP, natural language processing.
aPositive and negative predictive values are dependent on disease prevalence. Based on this study, the prevalence of ocular HZO disease among HZ cases was 9%.
Comparison of NLP to ICD Codes for Identification of Ocular HZO Cases
| ICD Codes | ||||
|---|---|---|---|---|
| Ocular HZO | Yes | No | Total | |
| NLP | Yes | 1910 (2.2%) | 5943 (6.8%) | 7853 (9.0%) |
| No | 78 (0.1%) | 79 742 (91.0%) | 79 820 (91.0%) | |
| Total | 1988 (2.3%) | 85 685 (97.7%) | 87 673 (100.0%) | |
Abbreviations: HZO, herpes zoster ophthalmicus; ICD, International Classification of Diseases; NLP, natural language processing.
NOTE: This table lists the numbers and percentages of ocular HZO cases identified by NLP and/or ICD codes. The total number of cases (n = 87 673) included all patients aged ≥50 years with incident HZ identified using ICD codes and medications. One patient could have multiple HZ-related ICD codes for the same encounter. The case was marked as Yes for the ICD codes column if at least one of the HZ codes was an ocular HZO ICD code (053.2x, B02.3x).
Baseline Characteristics of Ocular HZO, Nonocular HZO, and Non-HZO Herpes Zoster Patients
| HZOa | ||||
|---|---|---|---|---|
| Characteristics | Ocular | Nonocular | Non-HZO HZb |
|
| Total | 7853 (9.0) | 3095 (3.5) | 76 725 (87.5) | |
| Age in Years | <.001 | |||
| 50–59 | 2386 (7.9) | 1117 (3.7) | 26 653 (88.4) | |
| 60–69 | 2519 (8.7) | 1012 (3.5) | 25 305 (87.8) | |
| 70–79 | 1819 (9.7) | 660 (3.5) | 16 253 (86.8) | |
| ≥80 | 1129 (11.3) | 306 (3.1) | 8514 (85.6) | |
| Mean (SD) | 66.8 (10.7) | 64.8 (10.1) | 65.3 (10.3) | |
| Sex | <.001 | |||
| Female | 4611 (8.6) | 1771 (3.3) | 47 010 (88) | |
| Male | 3242 (9.5) | 1324 (3.9) | 29 715 (86.7) | |
| Race/Ethnicity | <.001 | |||
| Non-Hispanic white | 4160 (10.3) | 1753 (4.3) | 34 474 (85.4) | |
| Hispanic | 1946 (6.8) | 744 (2.6) | 25 751 (90.5) | |
| Asian | 612 (9) | 176 (2.6) | 5985 (88.4) | |
| Black | 978 (9.6) | 341 (3.3) | 8902 (87.1) | |
| Otherd | 157 (8.5) | 81 (4.4) | 1613 (87.1) | |
| BMI, kg/m2 | <.001 | |||
| <18.5 | 68 (10.9) | 14 (2.2) | 541 (86.8) | |
| 18.5–24.9 | 1877 (9.6) | 698 (3.6) | 17 015 (86.9) | |
| 25.0–29.9 | 2363 (8.9) | 934 (3.5) | 23 228 (87.6) | |
| 30.0–34.9 | 1369 (8.8) | 502 (3.2) | 13 755 (88) | |
| ≥35.0 | 911 (9.2) | 353 (3.6) | 8629 (87.2) | |
| Missing | 1265 (8.2) | 594 (3.9) | 13 557 (87.9) | |
| Smoking History | <.001 | |||
| Current/passive smoker | 1720 (9.3) | 668 (3.6) | 16 090 (87.1) | |
| Former smoker | 885 (9.3) | 319 (3.3) | 8320 (87.4) | |
| Never smoker | 3870 (9.1) | 1467 (3.4) | 37 419 (87.5) | |
| Unknown | 1378 (8.1) | 641 (3.8) | 14 896 (88.1) | |
| Marital Status | .34 | |||
| Married | 4151 (8.9) | 1643 (3.5) | 40 796 (87.6) | |
| Never married | 987 (8.9) | 384 (3.5) | 9674 (87.6) | |
| Previously marriede | 1220 (9.4) | 434 (3.3) | 11 331 (87.3) | |
| Other/Missing | 1495 (8.8) | 634 (3.7) | 14 924 (87.5) | |
| Outpatient Visits in 6 Months Before Herpes Zoster Diagnosis Date | <.001 | |||
| 0 | 836 (8.2) | 375 (3.7) | 8978 (88.1) | |
| 1–5 | 4005 (8.8) | 1632 (3.6) | 40 018 (87.7) | |
| ≥6 | 3012 (9.5) | 1088 (3.4) | 27 729 (87.1) | |
| Mean (SD) | 6.3 (7.6) | 5.8 (7.4) | 5.9 (7.0) | |
| Emergency department visits in 6 Months Before Herpes Zoster Diagnosis Date | <.001 | |||
| 0 | 6495 (8.8) | 2675 (3.6) | 64 532 (87.6) | |
| ≥1 | 1358 (9.7) | 420 (3) | 12 193 (87.3) | |
| Mean (SD) | 0.2 (0.7) | 0.2 (0.6) | 0.2 (0.7) | |
| Hospitalizations in 6 Months Before Herpes Zoster Diagnosis Date | .05 | |||
| 0 | 7383 (8.9) | 2946 (3.6) | 72 279 (87.5) | |
| ≥1 | 470 (9.3) | 149 (2.9) | 4446 (87.8) | |
| Mean (SD) | 0.1 (0.5) | 0.1 (0.4) | 0.1 (0.4) | |
| Comorbidity | ||||
| Allergic rhinitis | 333 (9.3) | 111 (3.1) | 3141 (87.6) | .29 |
| Asthma | 605 (9.6) | 191 (3) | 5510 (87.4) | .02 |
| Atopic dermatitis | 34 (10.1) | 10 (3) | 292 (86.9) | .67 |
| Cancer (solid) | 434 (9.3) | 152 (3.3) | 4088 (87.5) | .43 |
| Cancer (nonsolid) | 154 (10.1) | 60 (3.9) | 1309 (85.9) | .18 |
| Cerebrovascular disease | 275 (11.2) | 77 (3.1) | 2101 (85.7) | <.001 |
| Chronic kidney disease | 1111 (10.1) | 337 (3.1) | 9578 (86.9) | <.001 |
| Chronic obstructive pulmonary disease | 348 (10.5) | 92 (2.8) | 2887 (86.8) | <.001 |
| Coronary artery disease | 674 (10.9) | 195 (3.2) | 5287 (85.9) | <.001 |
| Dementia | 151 (10.9) | 47 (3.4) | 1186 (85.7) | .04 |
| Depression | 892 (8.9) | 376 (3.8) | 8756 (87.4) | .44 |
| Diabetes | 1664 (9.1) | 573 (3.1) | 15 962 (87.7) | .01 |
| Hypertension | 3370 (9.6) | 1165 (3.3) | 30 506 (87.1) | <.001 |
| Inflammatory bowel disease | 153 (9.2) | 61 (3.7) | 1442 (87.1) | .86 |
| Obstructive sleep apnea | 297 (9.7) | 111 (3.6) | 2645 (86.6) | .29 |
| Peripheral vascular disorder | 140 (10.6) | 35 (2.7) | 1144 (86.7) | .03 |
| Rheumatoid arthritis | 141 (8.2) | 52 (3) | 1520 (88.7) | .28 |
| Systemic lupus erythematosus | 28 (8.4) | 9 (2.7) | 298 (89) | .64 |
Abbreviations: BMI,body mass index; HZO,herpes zoster ophthalmicus; SD, standard deviation.
NOTE: Values are mean ± standard deviation (SD) or n (%), unless otherwise indicated.
aHZO cases were identified by natural language processing (NLP).
bNon-HZO HZ cases were coded HZ cases not identified as HZO by NLP.
c P value was calculated using χ 2 test.
d“Other” includes Native American, mixed, or unknown race/ethnicity.
e“Previously married” includes divorced, separated, or widowed.
Figure 1.Proportion of ocular herpes zoster ophthalmicus (HZO) and nonocular HZO among HZ patients by age group. The lines show the proportion of ocular HZO and nonocular HZO cases among all HZ cases by age group. The accompanying linear trendlines demonstrate an approximately linear increase of ocular HZO by age and a slight downward trend for nonocular HZO.
Prevalence Ratio of Ocular HZO vs All Other Herpes Zoster Cases
| Adjusted Prevalence Ratio (95% CI) | |
|---|---|
| Characteristic | Ocular HZO vs All Other Herpes Zoster |
| Age in Years | |
| 50–59 | 1 [Reference] |
| 60–69 | 1.07 (1.01–1.13) |
| 70–79 | 1.16 (1.09–1.23) |
| ≥80 | 1.31 (1.22–1.41) |
| Sex | |
| Male vs female | 1.10 (1.05–1.15) |
| Race/Ethnicity | |
| White | 1 [Reference] |
| Hispanic | 0.68 (0.64–0.72) |
| Black | 0.89 (0.82–0.97) |
| Asian/Pacific Islander | 0.94 (0.88–1.01) |
| Other | 0.87 (0.74–1.02) |
Abbreviations: CI, confidence interval; HZO, herpes zoster ophthalmicus.
NOTE: The Poisson regression model was selected based on stepwise variable selection, with entry-level P = .05 and stay-level P = .1. All variables listed in Table 4 were considered in the multivariate model. Only variables with statistically significant adjusted prevalence ratios in the final model are displayed.