Identification of Childhood-Onset Inflammatory Bowel Disease in Swedish Healthcare Registers: A Validation Study.

Purpose: The Swedish National Patient Register (NPR) is often used in observational studies of childhood-onset inflammatory bowel disease (IBD) (<18 years of age) and its subtypes, but the validity of previously used register-based algorithms for capturing childhood-onset IBD has never been examined.
Methods: We identified a random sample of 233 individuals with at least two first ever diagnostic listings of IBD in the NPR between 2002 and 2014. We calculated the test characteristics for different register-based definitions of IBD and its subtypes using the Copenhagen criteria and the revised Porto criteria as gold standard, both based on medical chart review. We made assumptions of the occurrence of undiagnosed IBD in the general child population based on available literature.
Results: Out of 233 individuals with at least two diagnostic listings of IBD, 216 had true IBD, resulting in a positive predictive value (PPV) = 93% (95% confidence interval (CI) 89-96), sensitivity = 88% (95% CI 83-92), specificity = 100% (95% CI 100-100), and negative predictive value (NPV) = 100% (95% CI 100-100). The PPV for the NPR-based definitions of IBD subtypes at time of first IBD diagnosis and at end of follow-up were 78% (95% CI 69-86) and 88% (95% CI 80-94), respectively, for Crohn's disease and 74% (95% CI 63-83) and 71% (95% CI 60-80), respectively, for ulcerative colitis.
Conclusion: The validity of register-based definitions of childhood-onset IBD in the Swedish NPR is high and can be used to identify patients in observational research.

Plain Language Summary

What is new?

Validity of register-based definitions of childhood-onset IBD and its subtypes in the Swedish National Patient Register is excellent and acceptable, respectively.

What is adds to what was known?

Previous Swedish validation studies found high positive predictive value for register-based definitions of inflammatory bowel disease in adults. We can now confirm that the validity of the corresponding definitions in children is similar.

What is the implication?

Swedish registers can be used to perform high-quality observational research regarding pediatric IBD.

Introduction

Inflammatory bowel disease (IBD) is a chronic disease characterized by inflammation in the gastrointestinal tract with diverse clinical presentation and prognosis. Approximately 10% of IBD patients are diagnosed in childhood.1–3 Globally rising rates of childhood-onset IBD have been demonstrated, and the highest incidence rates have been reported from Scandinavia and Canada.3–7

Healthcare registers enable researchers to conduct large population-based observational studies in real-world data (collected prospectively in routine medical practice) for research questions where randomized controlled trials are challenging for practical reasons.8–10 In a recent validation study by Jakobsson et al, the validity of the most commonly used IBD definition in the Swedish National Patient Register (NPR) was found to be high (a positive predictive value [PPV] of 93% (95% CI 87–97)).11 When data from the NPR (≥1 record) were combined with data from the Swedish national quality register for IBD (SWIBREG) (≥1 record), the PPV of any IBD listing in both registers was 99% (95% 97–100) for any IBD. However, this validation study included almost exclusively adult-onset IBD patients.

Algorithms developed in adults are not necessarily optimal for the identification of children with the same disease.12 In the IBD context, it is plausible that the validity of the register-based definition of IBD in NPR differs between children and adults, since childhood-onset IBD patients more often have extensive colitis and more aggressive disease compared to adult-onset IBD patients, fewer differential diagnoses are plausible in childhood and children are generally seen more often by their physician.3,13,14

We therefore applied a commonly used register-based algorithm to identify a random sample of potential childhood-onset IBD patients in the NPR and performed a review of their medical records with the main objective to validate the aforementioned algorithm. Our secondary objective was to assess the validity of register-based definitions of IBD subtypes.

Methods

Study Design

We calculated test characteristics of previously used register-based definitions of IBD and IBD subtypes9,15,16 by comparing them with definitions based on medical charts (all of which are described comprehensively below).

Setting and Data Sources

In Sweden, patients with childhood-onset IBD are diagnosed and treated by pediatric gastroenterologists until the age of 18 years.17 Sweden is a high-income country with publicly funded health care almost exclusively provided by physicians employed by the state or region. In Sweden, a large number of mandatory healthcare registers with close to complete coverage are available for medical research. It is possible to use the personal identity number, assigned to all Swedish residents, to link data from different data sources.18 Detailed information about healthcare registries used in this study can be found in the .19–22

Study Population

We checked the NPR for suspected incident cases of childhood-onset IBD (defined by relevant ICD-codes []) between 2002 and 2014 and found 6158 cases with at least one first ever diagnostic listing of IBD (4963 of which had ≥2 diagnostic listings). According to Statistics Sweden, 3,243,845 children without any IBD diagnostic listings resided in Sweden during the study period (Figure 1). The National Board of Health and Welfare provided personal identity numbers for a random sample of individuals with at least one diagnostic listing of IBD. We were able to acquire 288/289 medical records, of which 8 were excluded because of incomplete records. The included 280 individuals represented both inpatients and outpatients as well as regional and university hospitals in Sweden (Karolinska University Hospital and Södersjukhuset, Stockholm, Akademiska sjukhuset, Uppsala, Sahlgrenska University Hospital Göteborg, Umeå University Hospital, Skåne University Hospital in Lund and Malmö, Västmanland Hospital Västerås, Eskilstuna Hospital, and Sundsvall Hospital).

Figure 1

Flow chart.

Register-Based Definitions

Patients needed to have ≥2 first ever diagnostic listings of IBD with the first listing before the 18th birthday recorded in the NPR by a physician on two separate occasions during the study period to fulfil the register-based definition that we aimed to validate.11 Patients were further categorized as ulcerative colitis (UC), Crohn's disease (CD), or IBD-unclassified (IBD-U) either according to the first two diagnostic codes ([incident definition] ) or according to all information available at end of follow-up ([prevalent definition] ).16 As supplementary information, we have also described the transition of IBD subtypes according to ICD-10 codes in NPR and based on Porto criteria in medical notes from first diagnosis of IBD to end of follow-up (last visit in pediatric clinic).

Medical Record-Based Definitions

IBD was defined according to the Copenhagen criteria,23,24 and IBD subtypes were categorized according to the revised Porto criteria, using the IBD classes smartphone app () which guides clinicians to make objective diagnostic decisions (, ).25 The Copenhagen criteria consider clinical picture, radiology, macroscopic and microscopic findings to establish the IBD diagnosis ().26 Data collection was performed by four experienced pediatric gastroenterologists (NM, ULF, VS, OS) who entered information needed to fulfill Copenhagen and Porto criteria into a pre-specified REDCap database that was possible to link to the register-based data. They reviewed medical notes including information about radiology, endoscopy, pathology, and surgical notes. The same notes were not reviewed by more than one person, and thus kappa statistic could not be calculated. The readers of the reference standard were not blinded to the subtype classification in the medical records. As supplementary information, both information on diagnostic delay and progression of IBD subtype was extracted from medical records. We defined diagnostic delay as the time between the first symptoms suggestive of IBD (eg, abdominal pain, weight loss, diarrhea as described in medical records) to the date of diagnostic endoscopy.27,28

Statistical Methods

Given the previously reported PPV of 85–95% in the earlier validation study of the same definition in Swedish (predominantly) adult patients11 and thus expecting similar PPV in our study, we needed approximately 230 individuals in order to estimate the PPV with a confidence interval less than ±5%. Since our experience from earlier validation studies is that some 20% of medical records can be very hard or even impossible to acquire (because the original medical record has disappeared [mainly in older calendar periods that had to rely on paper] or because of lack of willingness or time to cooperate at the hospital in question), we identified a random sample of 289 individuals from seven Swedish healthcare regions with at least one diagnostic listing of IBD in the NPR before the 18th birthday between 1 January 2002 and 1 January 2014 using relevant ICD-codes (). The National Board of Health and Welfare provided personal identity numbers for sampled individuals.

We estimated the proportion of patients who fulfilled the register-based definitions of IBD and IBD subtypes who also fulfilled the corresponding criteria on medical chart review. We calculated the PPV for definitions of IBD diagnosis and IBD subtype both in NPR and Swibreg. Since we only performed medical chart review of individuals with at least one diagnostic IBD listing (ie, medical records of children without IBD listings were not reviewed), other test characteristics than PPV must be based on assumptions. Earlier literature has reported a prevalence of childhood-onset IBD in Sweden of approximately 0.08%.29 In order not to overestimate test characteristics, we assumed that the prevalence of undiagnosed IBD among individuals with no IBD diagnostic listings was at least not higher than a quarter of the prevalence of diagnosed IBD, thus 0.02%. Please see and for a detailed review of the literature that formed the basis for the assumptions made.

Diagnostic delay was presented as median (IQR). Transition of IBD subtypes from diagnosis to end of follow-up (defined as last visit to a pediatric clinic) was estimated through medical records in all patients with a post-diagnostic endoscopy. If the information about investigations was missing, we regarded them as not having undergone the investigations. Statistical analyses were performed using R statistical software (version 4.0.4, R Foundation for Statistical Computing, Vienna, Austria) and Stata/IC 16.1.

This project was approved by the Stockholm Ethics Review Board (2007/785-31/5, 2014/1288-31/4, 2017/1959-32, and 2018/1865-32). The data accessed complied with relevant data protection and privacy regulations.

Results

Validity of Our Previously Used Register-Based Definition of IBD

We identified 280 patients with ≥1 diagnostic listing of IBD in NPR and whose medical charts contained relevant information (Figure 1, Table 1). Among 280 patients with ≥1 diagnostic listing of IBD in NPR, 47 (17%) had only 1 diagnostic listing, of which none had IBD according to medical records.

Table 1

Validity of Different Register-Based Definitions of Inflammatory Bowel Disease. N (%) if Not Otherwise Stated

Register-Based Definitions	Proportion True IBD	PPV (95% CI)
2 or more diagnostic listings of IBD in the NPRa	216/233	93% (89–96)
IBD diagnosis according to SWIBREGb	58/58	100% (94–100)
1 or more diagnostic listings of IBD in the NPR and a pathology code suggestive of IBDc	202/212	95% (91–98)
2 or more diagnostic listings of IBD in the NPR and a pathology code suggestive of IBDc	202/208	97% (94–99)

Notes: aProportion of patients who fulfilled the Copenhagen criteria for an IBD diagnosis (n=209), OR who did not fulfil the above criteria but were very likely to have IBD according to the medical chart review (n=7) among individuals with at least two diagnostic listings of IBD in the NPR (n=233). bProportion of patients who fulfilled the Copenhagen criteria among patients with at least two diagnostic listings of IBD in the NPR and an IBD diagnosis according to SWIBREG (Swedish Quality Register for inflammatory bowel disease). cPathology codes suggestive of IBD are listed in .

Abbreviations: NPR, National Patient Register; IBD, Inflammatory Bowel Disease.

Out of the remaining 233 patients with at least two diagnostic listings of IBD, 216 fulfilled the Copenhagen criteria for IBD on medical chart review, resulting in a PPV of 93% (95% confidence interval [CI] 89–96), sensitivity (88% [95% confidence interval [CI] 59–70]), specificity (100% [95% CI 100–100], and NPV (100% [95% CI 100–100]).

Seventeen (17/233=7%) of the patients with ≥2 diagnostic listings did not have IBD (Table 1). Most of these non-IBD patients had received their ICD codes by mistake or turned out to have functional gastrointestinal disorders (eg, irritable bowel syndrome, functional abdominal pain, constipation, etc.), food allergies or eosinophilic disease.

All patients registered in SWIBREG (n = 58) were confirmed to have IBD, resulting in a PPV of 100% (95% CI 94–100) for this subpopulation (Table 1). A combination of ≥1 IBD listing of IBD with a pathology code for IBD (which has been used in several previous papers including childhood-onset IBD data30,31) resulted in a PPV of 95% (95% CI 91–98).31 Furthermore, combining ≥2 IBD listings and ≥1 pathology code suggestive of IBD increased the PPV to 97% (95% CI 94–99).

Median diagnostic delay was longer in CD than in UC (5 versus 3 months p = 0.03) ().

Validity of IBD Subtypes

Compared to the revised Porto criteria (based on medical chart review and the app “IBD classes”), the PPV for the NPR-based “incident” definitions of IBD subtypes at first diagnosis were 78% (95% CI 69–86) for CD, 74% (95% CI 63–83) for UC and 23% for IBD-U (95% CI 10–40) (Table 2). Corresponding figures for subtypes according to Swibreg at start of follow-up were 75% (95% CI 57–89) for CD and 85% for UC (95% CI 62–97). At end of follow-up, the “prevalent” definitions of IBD subtypes resulted in PPVs of 88% (95% CI 80–94) for CD, 71% (95% CI 60–80) for UC and 21% for IBD-U (95% CI 10–35) but individuals with IBD-U were few.

Table 2

Inflammatory Bowel Disease (IBD) Subtype According to Incident and Prevalent Definition in the National Patient Register (NPR) Compared with IBD Subtype According to Medical Chart Review Expressed as Positive Predictive Values. N (%) if Not Otherwise Specified

At diagnosis		Total	IBD Subtype According to Medical Records			Non-IBD
			CD	UC	IBD-U
IBD subtype in NPRa	CD	102 (100%)	80 (78%)	7 (7%)	11 (11%)	4 (4%)
	UC	88 (100%)	0 (0%)	65 (74%)	15 (17%)	8 (9%)
	IBD-U	35 (100%)	13 (37%)	9 (26%)	8 (23%)	5 (14%)
Total		225
At end of follow-up			IBD Subtype According to Medical Recordsc
IBD subtype in NPRb	CD	92 (100%)	81 (88%)	1 (1%)	6 (7%)	4 (4%)
	UC	85 (100%)	4 (5%)	60 (71%)	13 (15%)	8 (9%)
	IBD-U	48 (100)	13 (27%)	20 (42%)	10 (21%)	5 (10%)
Total		225

Notes: aPatients with ≥2 IBD listings in the NPR, subtype according to first two diagnostic listings only, ie “incident” definition. bSubtype according to all available information at end of follow-up (See also , ie, “prevalent” definition).cAt the discretion of the pediatric gastroenterologist reviewing the medical record in question (since all information required to fulfil the PIBD-classes algorithm was often not available at end of follow-up).

Abbreviations: IBD, inflammatory bowel disease; CD, Crohn´s disease; UC, Ulcerative colitis; IBD-U, inflammatory bowel disease unclassified.

Change of IBD Subtypes During Follow-Up

In total, 147 patients also performed additional endoscopies before the end of follow-up (). Change in IBD subtypes of these patients based on medical notes and NPR during follow-up are demonstrated in and .

Discussion

Main Findings

We found the PPV of a commonly used register-based definition of childhood-onset IBD in the National Patient Register (≥2 diagnostic listings of IBD) to be high (PPV = 93%) when using the Copenhagen criteria based on medical chart review as gold standard.23,24 The PPV for a definition also using pathology reports suggestive of IBD was even higher (95–97%) and 100% for patients that were also registered in SWIBREG. When using the revised Porto criteria as gold standard (albeit published after the study period),25 the PPV for different IBD subtypes based on ICD-codes in the NPR at the start of follow-up (incident definition) was 78% for CD and 74% for UC and somewhat higher for CD at the end of follow-up (prevalent definition: 88% for CD and 71% for UC). PPV for IBD-U was low both at diagnosis and at end of follow-up (23% [95% CI 10–40] and 21% [95% CI 10–35] respectively).

Findings Compared to Earlier Studies

A definition of IBD as ≥2 diagnostic listings of IBD in NPR resulted in a high PPV for an IBD diagnosis in general (according to the Copenhagen criteria) and also reasonably high PPV for subtypes (according to the Porto criteria or medical notes). Our findings in the studied pediatric population are almost identical to earlier Swedish and Danish studies, assessing PPVs of the same register-based IBD definition in mostly or exclusively adult populations.11,32 Two previous studies from Sweden and Denmark found markedly higher PPVs for IBD subtypes in adult patients (PPV = 89–97%), but these studies only included patients with confirmed IBD.33,34

Two earlier studies from Canada and Israel validating register-based IBD definitions in childhood-onset IBD have chosen not to test an already established register-based definition of IBD (as we did) but instead tested a wide range of combinations to identify register-based definitions optimal for different scenarios.35,36 Both studies found considerably lower PPVs for incident IBD compared to our study.

In the Canadian study, the algorithm was developed using the PIBD database (183 children <15 years) at Toronto SickKids’ as the positive controls. All other children residing in Toronto at the time were negative controls (936,514 children <15 years). Billing claims for physician services provided by the Ontario Health Insurance Plan (including both specialised and primary care) were used as variables in the algorithm.35 The most accurate algorithm required either an endoscopy followed by four physician contacts or two hospitalizations with an IBD diagnosis within three years (or, in case of no endoscopy, seven physician contacts or three hospitalizations) which resulted in a PPV of 59% (95% CI 53–65). The algorithm was then validated in another dataset generated from 12 medical practices (six paediatric gastroenterology, five adult gastroenterology, and one general paediatrics) consisting of 593 PIBD patients and 1241 controls, confirming the high sensitivity (91% [95% CI 88–93]) and specificity (100% [99-100]) from the algorithm development phase.

In a similar Israeli study, an IBD defining algorithm was developed and validated in datasets derived from the compulsory Israeli Health Insurance System.36 The algorithm development cohort included 216 children with confirmed childhood-onset IBD and 170 confirmed non-IBD patients from gastroenterology clinics, but test characteristics were not reported for childhood-onset IBD separately. The algorithm found to perform best was based on at least five diagnostic IBD codes or at least one diagnostic IBD code in combination with purchases of IBD-related medications. They reported a pooled PPV for a prevalent IBD diagnosis of 92% (95% CI 90–94), a sensitivity of 89% (95% CI 87–92), a specificity 99% (95% CI 99–100), and an NPV of 99% (95% CI 99–100), but considerably lower values for the incident algorithm (PPV 82%). When using the three most recent codes, or the most recent code when only one or two codes were available, PPV for IBD subtypes (CD/UC) was 97% (IBD-U was coded as UC or CD) though only true IBD cases were included.

Why Algorithms and Test Characteristics Might Differ Between Countries

The need for much more complex algorithms to identify IBD in Canada and Israel35,36 compared to the corresponding Danish and Swedish algorithms11,32,34 is likely due to several differences between the healthcare systems and databases used. The Canadian algorithms were created based on billing claims in systems where diagnostic codes for IBD seem to have been used also before a definitive diagnosis had been confirmed. In Ontario, there was incentive to code for IBD during the study period, since a fee-for-service physician would get a chronic disease premium for seeing these patients (rather than using unspecific codes such as diarrhoea during work-up) (personal communication, Dr Eric Benchimol, October 18, 2021). Swedish physicians have monthly salaries, which are not affected by diagnostic codes used. Swedish physicians also seem to use codes for gastrointestinal symptoms during work-up of IBD, and the actual codes for IBD only after the diagnosis have been confirmed by say endoscopy (). Moreover, the Canadian and Israeli algorithms were developed in databases including both primary care and specialised care while in Sweden IBD patients are seen exclusively by specialists in medical and/or surgical gastroenterology (adults) or pediatric gastroenterologists/paediatricians, not in the primary care, likely resulting in a need for less complex algorithms.

The PPV for prevalent subtype of Crohn’s disease was relatively high in our study similarly to both the Canadian and the Israeli studies, whereas the PPV for our incident definition of subtypes was lower. This was expected since we know that subtypes can be hard to determine at diagnosis and that subtypes change during follow-up in as much as 18% of cases.16 Additionally, unique features of Crohn’s disease could make it easier to assign the patient to subtype. The lower PPV for subtype definitions in our study can also be partly explained by the fact that the gold standard was based on the updated Porto criteria (which was not even published when the most recent patient in this study was diagnosed with IBD).

Strengths and Limitations

Our study has several strengths: In this validation study, pediatric patients were sampled from the National Patient Register covering all Swedish children and including both regional hospitals and university hospitals, inpatients and outpatients, regardless of disease severity and residence. Very few patients had to be excluded due to missing information, thus ensuring high generalizability. We used well-accepted international definitions to define IBD and its subtypes during meticulous medical chart review by paediatric gastroenterologists, which should reduce the risk of misclassification. We analyzed both prevalent and incident IBD subtype definitions, since both have been previously used in the literature.16 We followed STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) as well as RECORD statement (REporting of studies Conducted using Observational Routinely collected health Data) checklists which expand STROBE to report our findings.37,38 We also followed guidelines for validation studies of health administrative data.12

This study also has some limitations that need to be mentioned. Due to retrospective study design, some of the information could be not found in the notes, though it applied to very few patients. The same medical records were not reviewed by more than one pediatric gastroenterologist, and thus kappa statistic could not be cited. The readers reviewing the notes were also not blinded to the subtype classification in the medical records. However, only experienced pediatric gastroenterologists evaluated the notes and they used standardized Porto criteria and the IBD classes smartphone app to classify the patients.

We cannot know for sure how many individuals in our source population without IBD codes who actually had IBD (false negatives). Of course, it was impossible to perform endoscopies on all these children, but knowing that prevalence of pediatric IBD is low and based on a previous Swedish adult study39 we could make reasonable assumptions of the proportion of false negatives in the source population. When a disease is rare, the NPV is expected to be close to 100%, which is in accordance with our assumptions.

Clinical Significance

The markedly different need for complexity in algorithms used to identify IBD in registers in, eg, Denmark, Sweden, Canada, and Israel makes it obvious that the healthcare system and types of registers need to be considered when developing accurate definitions. In accordance with previous studies, our study confirmed that having only one diagnostic listing of IBD would result in a very high proportion of false positives IBD cases and should not be used. The NPR-based definitions of IBD (two or more diagnostic listings) have hitherto been used in many observational register-based studies that have the potential to inform clinical decision-making and guidelines. It is reassuring that even with a PPV on par with the lower limit of the 95% CI that we found in the current study, reported relative risks in observational studies based on this definition of IBD would not underestimate the true relative risk in IBD more than marginally (). In studies where it is of utmost importance not to have any false-positive IBD cases, the register-based definitions combining SWIBREG data or at least one or two diagnostic IBD listings with a pathology code suggestive of IBD may be used instead.

Conclusion

Our study showed that the validity of ICD-based definitions of childhood-onset IBD and its subtypes in the NPR is excellent and acceptable, respectively, with the exception of IBD-U.