| Literature DB >> 36151305 |
Salvatore Crisafulli1, Andrea Fontana2, Luca L'Abbate3, Valentina Ientile4, Daniele Gianfrilli5, Alessia Cozzolino5, Maria Cristina De Martino6, Marta Ragonese7, Janet Sultana8, Francesco Barone-Adesi9,10, Gianluca Trifirò11.
Abstract
Acromegaly is a rare disease characterized by an excessive production of growth-hormone and insulin-like growth factor 1, typically resulting from a GH-secreting pituitary adenoma. This study was aimed at comparing and measuring accuracy of newly and previously developed coding algorithms for the identification of acromegaly using Italian claims databases. This study was conducted between January 2015 and December 2018, using data from the claims databases of Caserta Local Health Unit (LHU) and Sicily Region in Southern Italy. To detect acromegaly cases from the general target population, four algorithms were developed using combinations of diagnostic, surgical procedure and co-payment exemption codes, pharmacy claims and specialist's visits. Algorithm accuracy was assessed by measuring the Youden Index, sensitivity, specificity, positive and negative predictive values. The percentage of positive cases for each algorithm ranged from 7.9 (95% CI 6.4-9.8) to 13.8 (95% CI 11.7-16.2) per 100,000 inhabitants in Caserta LHU and from 7.8 (95% CI 7.1-8.6) to 16.4 (95% CI 15.3-17.5) in Sicily Region. Sensitivity of the different algorithms ranged from 71.1% (95% CI 54.1-84.6%) to 84.2% (95% CI 68.8-94.0%), while specificity was always higher than 99.9%. The algorithm based on the presence of claims suggestive of acromegaly in ≥ 2 different databases (i.e., hospital discharge records, copayment exemptions registry, pharmacy claims and specialist visits registry) achieved the highest Youden Index (84.2) and the highest positive predictive value (34.8; 95% CI 28.6-41.6). We tested four algorithms to identify acromegaly cases using claims databases with high sensitivity and Youden Index. Despite identifying rare diseases using real-world data is challenging, this study showed that robust validity testing may yield the identification of accurate coding algorithms.Entities:
Mesh:
Substances:
Year: 2022 PMID: 36151305 PMCID: PMC9508179 DOI: 10.1038/s41598-022-20295-4
Source DB: PubMed Journal: Sci Rep ISSN: 2045-2322 Impact factor: 4.996
Inclusion and exclusion criteria for each proposed algorithm for the identification of acromegaly cases. *Italian coding system.
| Algorithm 1 | |
| Subjects who had claims suggestive of acromegaly in ≥ 2 of these databases: | |
| 1. Hospital discharge records (ICD-9 CM code: 253.0) | |
| 2. Exemption from co-payment (exemption code: 001) | |
| 3. Prescription or dispensing of any of these drugs: octreotide (ATC: H01CB02), lanreotide (ATC: H01CB03), pegvisomant (ATC: H01AX01), pasireotide (ATC: H01CB05) | |
| 4. Prescriptions for any of the following tests: facial bone nuclear magnetic resonance (88.91.3–88.91.4), cranial computed tomography (87.03–87.03.1) | |
| Algorithm 2 | |
| Subjects who had claims suggestive of acromegaly in ≥ 2 of these databases | |
| 1. Hospital discharge records (ICD-9 CM code: 253.0) | |
| 2. Exemption from co-payment (exemption codes: 001, 253.0) | |
| 3. Prescription or dispensing of any of these drugs: octreotide (ATC: H01CB02), lanreotide (ATC: H01CB03), pegvisomant (ATC: H01AX01), pasireotide (ATC: H01CB05) | |
| 4. Prescriptions for any of the following tests: facial bone nuclear magnetic resonance (88.91.3–88.91.4), cranial computed tomography (87.03–87.03.1), 88.97, 90.35.1 (somatotropic hormone measurement), 90.40.6 (IGF-1 levels measurement) | |
| Algorithm 3 | |
| 1. Hospital discharge records: ≥ 2 diagnostic codes for acromegaly (ICD-9 CM: 253.0) | |
| 2. Exemption from co-payment: ≥ 1 exemption code for acromegaly (exemption codes: 001, 253.0) | |
| 3. ≥ 1 prescription or dispensing of any of these drugs: octreotide (ATC: H01CB02), lanreotide (ATC: H01CB03), pegvisomant (ATC: H01AX01), pasireotide (ATC: H01CB05) AND ≥ 1 surgical procedure code for acromegaly (07.6*: Hypophysectomy; 92.3*: Stereotactic radiosurgery) | |
| 4. ≥ 1 prescription or dispensing of any of these drugs: octreotide (ATC: H01CB02), lanreotide (ATC: H01CB03), pegvisomant (ATC: H01AX01), pasireotide (ATC: H01CB05) AND ≥ 1 prescription for any of the following tests: facial bone nuclear magnetic resonance (88.91.3–88.91.4), cranial computed tomography (87.03–87.03.1), 88.97, 90.35.1 (somatotropic hormone measurement), 90.40.6 (IGF-1 levels measurement) | |
| Algorithm 4 | |
| 1. Hospital discharge records: ≥ 1 diagnostic code for acromegaly (ICD-9 CM: 253.0) | |
| 2. Exemption from co-payment: ≥ 1 exemption code for acromegaly (exemption codes: 001, 253.0) | |
| 3. ≥ 1 prescription or dispensing of any of these drugs: octreotide (ATC: H01CB02), lanreotide (ATC: H01CB03), pegvisomant (ATC: H01AX01), pasireotide (ATC: H01CB05) AND ≥ 1 surgical procedure code for acromegaly (07.6*: Hypophysectomy; 92.3*: Stereotactic radiosurgery) | |
| 4. ≥ 1 prescription or dispensing of any of these drugs: octreotide (ATC: H01CB02), lanreotide (ATC: H01CB03), pegvisomant (ATC: H01AX01), pasireotide (ATC: H01CB05) AND ≥ 1 prescription for any of the following tests*: facial bone nuclear magnetic resonance (88.91.3–88.91.4), cranial computed tomography (87.03–87.03.1), 88.97, 90.35.1 (somatotropic hormone measurement), 90.40.6 (IGF-1 levels measurement) | |
| Pharmacy claims were not taken into consideration if: | |
| 1. Patients had received less than three separate drug prescriptions for the treatment of acromegaly (occasional drug users) | |
| 2. The medications were not long-acting release formulations | |
| 3. Patients taking octreotide or lanreotide had a hospitalization with a diagnosis different from acromegaly, among those for which there is an indication for the use these drugs, as reported in the summary of product characteristics [malignant neoplasms (ICD-9 CM: 140–209, 230–239), liver disorders (ICD-9 CM: 570–573), gastrointestinal bleeding (ICD-9 CM: 578), esophageal varices (ICD-9 CM: 42), Cushing’s disease (ICD-9 CM: 255; 255.0)] | |
| 4. Patients had an exemption code for Cushing’s disease (code: 032) | |
Number of subjects identified by each proposed algorithm as having acromegaly (cases) in Caserta Local Health Unit (period January 2015–December 2018) and in Sicily Region (period January 2011–December 2018). CI = confidence interval calculated using the exact Clopper–Pearson method for a binomial proportion.
| Algorithm 1 | Algorithm 2 | Algorithm 3 | Algorithm 4 | |
|---|---|---|---|---|
| N. identified cases/total population | 84/1,060,904 | 92/1,060,904 | 116/1,060,904 | 146/1,060,904 |
| N. identified cases per 100,000 inhabitants (95% CI) | 7.9 (6.4–9.8) | 8.7 (7.1–10.6) | 11.0 (9.1–13.1) | 13.8 (11.7–16.2) |
| N. identified cases/total population | 394/5,031,655 | 533/5,031,655 | 768/5,031,655 | 824/5,031,655 |
| N. identified cases per 100,000 inhabitants (95% CI) | 7.8 (7.1–8.6) | 10.6 (9.7–11.5) | 15.3 (14.2–16.4) | 16.4 (15.3–17.5) |
Figure 1Frequency distribution (Venn diagrams) of the number subjects identified by each proposed algorithm as having acromegaly, with respect to different data sources (i.e. databases of Caserta Local Health Unit and Sicily Region) during the study period.
Number of subjects with at least one diagnosis code for acromegaly in the electronic therapeutic plans databases from Caserta Local Health Unit (cases) and other subjects registered in Caserta Local Health Unit (non-cases) in the period January 2015–December 2018, as well as number of true and false positive/negative counts, diagnostic and predictive accuracy measures with respect to each proposed algorithm. ^PPV and NPV were computed taking into account that the disease prevalence in Caserta Local Health Unit was 3.61 cases per 100,000 persons (i.e. 38 true cases over a total sample of 1,051,943 subjects); °CI calculated using the exact Clopper–Pearson method for a binomial proportion; §CI calculated using the standard logit confidence intervals. Predictive measures are dependent on disease prevalence; *The Youden Index is computed as the sum of SE (%) and SP (%) minus 100% and denote the accuracy of each considered algorithm; #The algorithm with the highest accuracy. TP True Positive, FP False Positive, FN False Negative, TN True Negative, SE sensitivity, SP specificity, PPV Positive Predictive Value, NPV Negative Predictive Value, CI confidence interval.
| Counts | Accuracy measures (95% CI°) | Youden index (%)* | Predictive accuracy measures (95% CI§) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TP | FP | FN | TN | Cases | Non-cases | Positive | Negative | SE (%) | SP (%) | PPV (%)^ | NPV (%)^ | ||
| (TP + FN) | (FP + TN) | (TP + FP) | (TN + FN) | ||||||||||
| Algorithm 1 | 27 | 57 | 11 | 1,060,809 | 38 | 1,060,866 | 84 | 1,060,820 | 71.05 (54.10–84.58) | 99.995 (99.99–100.00) | 71.047 | 32.1 (25.4–39.7) | 99.999 (99.999–100) |
| Algorithm 2 | 32 | 60 | 6 | 1,060,806 | 38 | 1,060,866 | 92 | 1,060,812 | 84.21 (68.75–93.98) | 99.994 (99.99–100.00) | 84.205# | 34.8# (28.6–41.6) | 99.999 (99.999–100) |
| Algorithm 3 | 30 | 86 | 8 | 1,060,780 | 38 | 1,060,866 | 116 | 1,060,788 | 78.95 (68.68–90.45) | 99.992 (99.99–100.00) | 78.939 | 25.9 (21.1–31.3) | 99.999 (99.999–100) |
| Algorithm 4 | 32 | 114 | 6 | 1,060,752 | 38 | 1,060,866 | 146 | 1,060,758 | 84.21 (68.75–93.98) | 99.989 (99.99–100.00) | 84.200 | 21.9 (18.2–26.1) | 99.999 (99.999–100) |
Figure 2Network plots showing the chronological occurrence of each acromegalic-specific code included in the algorithm 2 in both Caserta Local Health Unit and Sicily Region. Each node represents each claims database (i.e., diagnostic codes, co-payment exemption codes, specialist’s visits and pharmacy claims). Edges define the chronological direction to follow to identify a specific pathway. In panel (a) the frequencies (defined with respect to the number of patients in the start node) of different criteria of acromegalic patients’ identification are reported along the edges. For instance, starting from the specialist visit records in Caserta Local Health Unit, 12 patients (20.7%) having both a first acromegaly diagnosis recorded in that dataset plus a later additional acromegaly-specific code in the co-payment exemptions database were counted. In panel (b) the corresponding median lag time (days) among different criteria of acromegalic patients’ identification is reported for each pathway identified. For instance, starting from the specialist visit records in Caserta Local Health Unit, for the 12 patients (20.7%), a median time of 567 necessary days to be identified also by a later additional acromegaly-specific code in the co-payment exemptions database was observed.