Improving performance in the detection and management of cystic fibrosis-related diabetes in the Mountain West Cystic Fibrosis Consortium.

OBJECTIVE: Cystic fibrosis (CF)-related diabetes (CFRD) is associated with increased morbidity and mortality. Improved detection and management may improve outcomes; however, actual practice falls short of published guidelines. We studied efforts to improve CFRD screening and management in the Mountain West CF Consortium (MWCFC). RESEARCH DESIGN AND METHODS: This is a prospective observational cohort study evaluating quality improvement by accredited CF centers in Arizona, Colorado, New Mexico, and Utah performed between 2002 and 2008. After Institutional Review Board (IRB) approval, centers evaluated adherence with CF Foundation guidelines for CFRD. Each center developed and implemented quality improvement plans to improve both screening and management. Centers were reassessed 1 year later.
RESULTS: Initially, each CF center had low adherence with screening recommendations (26.5% of eligible patients) that did not improve during the study. However, patients with confirmed CFRD markedly increased (141 (12% of MWCFC patients) to 224 (17%), p<0.001), and with improved adherence to management guidelines, patients with CFRD had increased weight (56.8-58.9 kg, p<0.001), body mass index (21.1-21.4, p=0.003), and weight-for-age z-score (-1.42 to -0.84, p<0.001). Quality improvement methods were specific to the practice settings of each center but shared the common goal of adhering to CFRD care guidelines. 1 year after implementation, no center significantly differed from any other in level of adherence to guidelines.
CONCLUSIONS: Improving adherence with CFRD care guidelines requires substantial effort and may be incompletely successful, particularly for CFRD screening, but the effort may significantly improve patient monitoring and clinically relevant outcomes such as weight.

Adherence to cystic fibrosis-related diabetes guidelines requires improvement.

Quality improvement efforts tailored to specific performance sites differ in details but offer the best chance of successful implementation.

Improved adherence produces objective improvement in outcomes that are clinically relevant to patients with cystic fibrosis.

Cystic fibrosis (CF) is the most common genetically determined disease among those of northern European descent in the USA. Protein malabsorption, progressive lung disease, and early death characterize the disease,1 2 but CF-related diabetes (CFRD) is an increasingly common complication with substantial morbidity and negative survival effects.3–6

Approximately 15% of patients with CF are affected by CFRD, often developing the disease in adolescence or young adulthood.3 4 7 CFRD is distinct from type I and type II diabetes.4 Patients have relative insulin deficiency but no immunological markers typical of type I diabetes, and ketoacidosis is rare. Compared with type II diabetes, obesity is infrequent, but some degree of insulin resistance is common. CFRD is associated with female gender, pancreatic insufficiency, worsened lung disease, more frequent pulmonary exacerbations, poorer nutritional status, and decreased survival.5 6

Because of the large clinical impact, the US CF Foundation, in association with the American Diabetes Association, maintains guidelines for the diagnosis and care of patients with CFRD, most recently updated in 2010.8 Implementation of these guidelines was uneven across the more than 110 accredited CF care centers in the USA at the time of initiation of our quality improvement (QI) project and remains uneven despite years of effort.9 10 Recognizing the need to improve guideline adherence by CF care centers, we performed a prospective, observational, QI cohort study with two major goals. First, we sought to measure and improve the completeness of recommended screening of patients with CF for CFRD among participating centers. Second, we sought to measure and improve the level of adherence by CF care centers with guidelines for the care of patients with CFRD.

Research design and methods

Trial participation

The personnel at accredited CF care centers in the Mountain West CF Consortium (MWCFC) agreed to participate in the trial. All trial procedures were reviewed and approved by the Investigational Review Board (IRB) at the host institution of each participating center and were also reviewed by the CF Foundation. The institutions included the University of Arizona, Tucson, Arizona, USA; Phoenix Children's Hospital, Phoenix, Arizona, USA; National Jewish Health, Denver, Colorado, USA; Children's Hospital Colorado, Aurora, Colorado, USA; the University of New Mexico, Albuquerque, New Mexico, USA; and the University of Utah, Salt Lake City, Utah, USA.

Each center developed plans to increase screening for CFRD and to improve monitoring and management of patients already diagnosed with CFRD. Every center tailored plans for each specific practice environment and agreed to external surveillance.11 Investigators from the University of Utah visited each center and performed audits of CFRD screening and monitoring prior to implementation of local QI plans. One full year after implementation, the audits were repeated.

Informed consent was not required to assess the completeness of screening for CFRD at participating centers. However, informed consent was required for patients with CFRD who were included in the assessments of adherence with CFRD guidelines by each participating center and for whom we collected patient-specific data. Informed consent was obtained from all patients of majority age. Assent and informed consent were obtained from patients with CF of minority age and their parents, respectively. Patient recruitment was initiated in January of 2003 and completed by April of 2005. Follow-up for the study was completed in 2007, and the data set was finalized in early 2008.

CF Foundation Patient Registry Data

To provide a background for interpretation of MWCFC results, we obtained permission from the CF Foundation to access CF Foundation Patient Registry (CFFPR) data to examine screening efforts for accredited centers in the USA. The data allow comparison between MWCFC centers participating in the study with all other accredited centers for the time period of the study.

Data collection for the CFFPR is approved annually by the IRB at each participating center. Written informed consent is obtained from each patient or guardian for each year of participation, and data obtained may be deleted both prospectively and retrospectively by patient request. Our use of CFFPR data was reviewed by the IRB at the University of Utah and was granted a waiver for additional informed consent.

Data collection

Research coordinators at each center identified all patients for whom screening for CFRD had been performed in 2002 in adherence with CF care guidelines.8 To derive a screening rate for each institution, the coordinators identified all patients followed at each institution in 2002. A repeat assessment of screening for CFRD in 2004 was performed for comparison of screening rates at each center before and after QI efforts.

To assess adherence with CFRD guidelines concerning care of individual patients with CFRD, we recruited patients 6 years and older at the participating centers that met one of four diagnostic criteria: (1) a documented oral glucose tolerance test (OGTT) result at 2 h after oral glucose load ≥200 mg/dL, or (2) a fasting blood glucose (FBG) level >126 mg/dL on two or more occasions, or (3) a FBG level >126 mg/dL on one occasion with a random glucose level of 200 mg/dL or more, or (4) random glucose levels of 200 mg/dL or more on two or more occasions with symptoms attributable to hyperglycemia. Patients that were unable or unwilling to give consent, unwilling to undergo study procedures, already enrolled in another investigational study, pregnant, prisoners, or prior organ transplant recipients were excluded. Patients were censored for the second chart review if information was unavailable due to loss to follow-up, organ transplantation, or death prior to the end of the second review period.

We created a data collection tool using Access (Microsoft Corp, Bellevue, Washington, USA) to record data about patients with CFRD within each center pertinent to measuring outcomes and adherence of centers with CFRD care guidelines. A single investigator visited all sites in 2003 to review patient charts and collect data reflective of CFRD management. Patient information was collected on age, gender, insulin usage, height, weight, glycated hemoglobin (HbA1c), forced expiratory volume in 1 s (FEV1), ethnicity and race, number of clinic visits, hospitalizations, and number of acute exacerbations. FEV1 was normalized to percent of predicted FEV1 (FEV1%) using National Health and Nutritional Evaluation Survey III equations.12 Information was gathered to determine whether the physical examinations and laboratory testing suggested by CF Foundation CFRD guidelines were performed on patients. These procedures included blood pressure, weight, height, retinal and foot examinations, and testing for HbA1c, lung function, sputum cultures, fasting hyperglycemia, urinalyses, and lipid profiles. Within 6 months of completion of the first round of chart reviews, each center devised a QI plan partially based on center-specific results and implemented a center-specific plan for improving adherence (tables 1 and 2). One year after each plan implementation, an investigator traveled to each site and performed a second chart review.

Table 1

QI plans by CF center for CFRD screening

Programme	Plan elements
Children's Hospital Colorado (Pediatric)	Random glucose was included in routine laboratory obtained annually on all patients (at the clinic visit closest to their birthdays). During weekly team meetings, the team reviewed all charts for patients scheduled for clinic that week. OGTT was then discussed with all patients over 10 years old who had not completed one in the prior year. During team meetings in November, the team also reviewed and contacted all patients over 10 years old who had not completed an OGTT during the preceding year.
National Jewish Health (Adult)	The team reviewed all patient charts the day prior to visits to identify patients unscreened by random glucose. The team notified the providers who would offer random glucose and OGTT screening to all non-diabetes patients.
Phoenix Children’s Hospital (Pediatric)	OGTT was added to annual laboratories in patients 10 years of age and older. The team reviewed all patient charts prior to visits for annual laboratories to identify patients unscreened by random glucose during the prior year and also identified patients with poor weight gain or loss of lung function as needing CFRD screening. The CF team notified the providers which patients needed screening. Providers would offer random glucose and OGTT screening to those and all non-diabetes patients that were older than 10 years of age. Patients that needed screening were notified by mail prior to clinic to obtain an OGTT at an outside laboratory. If it was not performed by the clinic visit, patients were asked again to obtain the OGTT at an outside laboratory. The staff revised the patient assessment form for clinic visits to flag the need for CFRD screening. Patients would undergo fasting and 2 h postprandial glucose checks during the first 48 h of any hospital admission.
University of Arizona (combined Adult and Pediatric)	All adolescent and adult patients admitted for pulmonary exacerbations were screened with premeal, bedtime and 0200 finger-stick glucose measurements for the first 48 h of hospitalization to detect illness-associated impaired glucose tolerance to prompt additional screening later.
University of Utah (Primary Children’s Medical Center, Pediatric)	OGTT was added to the usual tests and procedures during annual visits. The nurse coordinator or dietician notified families to come to clinic with the patient fasting as part of clinic preparations the week prior to the visit. The clinic tried to schedule visits with fasting OGTT in the morning, preferably as a first appointment. OGTT was rescheduled whenever planned but not performed.
University of Utah (Adult)	OGTT was planned for posthospitalization visits to maximize the chance that patients were stable at the time of testing. The nurse coordinator identified patients without CFRD or OGTT within a year of a clinic visit during clinic prep and called to ask each patient to come to clinic fasting. When not performed at clinic, the physician and staff gave patients prescriptions to complete the test either at the clinic on another day or at a facility convenient to the patient.
University of New Mexico (combined Pediatric and Adult)	OGTT was added as a test for annual visits in clinic. The CF dietician kept track of patients in need of OGTT and made sure to tell patients prior to the clinic date to come fasting. OGTT was limited to approximately 3/week to facilitate first morning appointments.

CF, cystic fibrosis; CFRD, CF-related diabetes; OGTT, oral glucose tolerance test; QI, quality improvement.

Table 2

QI plans by CF center to improve CFRD care

Programme	Plan elements
Children's Hospital Colorado (Pediatric)	All patients with an abnormal OGTT were referred to the Barbara Davis Diabetes Center. Routine diabetes care was then coordinated by that clinic. The CF dietician met with all patients to help coordinate care with the Barbara Davis Center dietician.
National Jewish Health (Adult)	At time of diagnosis of CFRD and for all patients with previously diagnosed CFRD, clinic staff offered urine microalbumin-to-creatinine ratio testing and recommended an annual dilated retinal examination. Clinic staff offered insulin therapy to patients with diagnosed CFRD and recorded the decision to initiate the therapy. Staff recorded the number of acute pulmonary exacerbations, pulmonary function tests and measurements of BMI for the year before and the year after a diagnosis of CFRD.
Phoenix Children's Hospital (Pediatric)	The dietician or other personnel would track that patients were getting tests and referrals. At preclinic team meetings, the staff notified physician providers which patients needed CFRD follow-up care. The staff revised the patient assessment form for clinic visits to flag the need for CFRD-focused physical examinations and referrals and provided a check box to indicate that tests were actually performed in the prior year. Laboratory testing was ordered prior to clinic visits, and patients were asked to obtain testing prior to clinic. At clinic, patients were reminded to obtain the tests if they had not been performed. The team generally increased the discussion and education about CFRD with patients at every visit and explained the need for testing. Patients that failed to get tests were provided additional education.
University of Arizona (combined Adult and Pediatric)	Physicians were reminded by clinic staff to perform appropriate CFRD-related physical examinations. Patients were referred annually for dilated eye examinations. Physicians were reminded by clinic staff to include urinary microalbumin and serum fructosamine in annual laboratories.
University of Utah (Primary Children’s Medical Center, Pediatric)	Dietician counted the procedures performed for CFRD follow-up and informed the clinicians. CFRD follow-up measures were included as part of the annual review by the clinical nurse coordinator for each patient. Input from the dietician and other personnel on CFRD follow-up was reported to the clinicians.
University of Utah (Adult)	Clinic staff reminded the physician to perform appropriate CFRD-related physical examinations. Patients were referred by clinic staff for dilated eye examinations. If not performed by the next visit, patients were reminded. The local electronic medical record physical examination form was modified to highlight the need for CFRD-specific examinations such as foot examinations to cue the clinicians to perform these follow-up examinations. Standard clinic laboratory orders were modified to automatically include HbA1c and urine microalbuminuria testing.
University of New Mexico (combined Pediatric and Adult)	Clinic staff kept track of appropriate CFRD-related physical examinations and tests. Staff provided education to each other and to patients to encourage increased numbers of CFRD-specific physical examination elements and to order CFRD-specific laboratory tests and referrals for retinal eye examinations.

BMI, body mass index; CF, cystic fibrosis; CFRD, CF-related diabetes; HbA1c, glycated hemoglobin; OGTT, oral glucose tolerance test; QI, quality improvement.

To enable comparison of screening for CFRD nationally, we classified patients in the CFFPR during 2002 and 2004 as receiving care primarily or not at a MWCFC care center participating in the study. Patients were excluded for prior lung transplantation, and they were censored for loss to follow-up or new lung transplantation during the 2002–2004 period. Cross-matching of patients between MWCFC center data and CFFPR national study-derived data was not feasible due to lack of consent for patients enrolled in the MWCFC study or specific CF Foundation or institutional support for cross-matching by specific patient identifiers.

Statistical analysis

We use the statistical system R for all analyses.13 Comparison of parameters between first and second chart reviews to look for improvements associated with implementation of QI programmes used McNemar's paired t tests for continuous data.14 Comparisons including patients with complete data or with data in only the first or second year of study representing a more complete sampling of each participating center's patient population used Pearson's χ2 or Fisher's exact tests for categorical data and Welch two-sample t tests for continuous data.14 These two sets of parameter comparisons allow us first to explore whether the QI effort was associated with improved CFRD outcomes and second to discern whether there was evidence that analysis of patients with 2 years of data rather than just 1 year might have been influenced by bias due to patient selection. Finding such bias would provide evidence that data were not missing at random.

Comparisons of screening by FBG alone or OGTT between MWCFC and all other accredited care centers using data from the CFFPR used generalized linear models (logistic regression). Univariate relationships were re-examined in multivariate models that corrected for clinical characteristics that might have influenced the likelihood of screening. These included frequency of clinic visits, FEV1%, number of acute pulmonary exacerbations in the year prior to study participation, and 5-year predicted survival as an overall measure of disease status.

Missingness of measurements recommended by CFRD care guidelines were the outcomes used to assess adherence, thus no imputation was planned or performed. However, for data from patients with CFRD where the actual measurement was of interest, we performed multiple imputation with chained equations,15 examined individual imputed data sets, and repeated analyses looking for evidence that data were not missing completely at random (a more stringent level of assessment of missingness than described above), and thus may have introduced bias. For the imputation analyses, we included all patients with 2 years of data collection including both those with complete and incomplete records as well as patients with only 1 year of data, treating them as missing all the data from the other potential year of participation.

Results

Adherence with screening guidelines

There were 1163 patients in 2002 and 1316 patients in 2004 followed at the two adult, two pediatric, and three combined-age participating CF centers in the MWCFC. Nearly all patients (91%) underwent some type of screening in 2002 (by random blood glucose, FBG alone, or OGTT), but there was a significant decrease to 75% by 2004. The rate of screening using the more stringent recommendation in CFRD guidelines, FBG alone or OGTT, was substantially lower and did not change between 2002 and 2004 (table 3).

Table 3

Screening for CFRD

Patients	2002	2004	p Value
MWCFC total	1163	1316	–
Eligible for OGTT (no prior CFRD diagnosis)	1022	1092	–
Tested by OGTT	162	132	0.08*
Tested by FBG alone	109	149	0.12*
Screened at least once for CFRD by any method (% of total)	1054 (91)	982 (75)	<0.001*†
Confirmed with CFRD (% of total)	141 (12)	224 (17)	<0.001†

*Despite specific interventions to improve, screening procedures for CFRD failed to improve during the study. OGTT numbers and FBG measurements were unchanged while random blood glucose measurements were significantly reduced. Considering the more sensitive and specific combination of FBG alone or OGTT shows that 26.5% of all eligible patients in 2002 and 25.7% in 2005 were screened for CFRD in MWCFC study centers. The change in testing for this combination was not significantly improved. These observations cannot be explained by the increased numbers of patients included in the second chart review in the study.

†Although testing for CFRD decreased during the study, the number of patients with a diagnosis of CFRD significantly increased, a change not explained by the increase in overall population of patients with CF. Nationally, all CF centers had a decrease in screening using random blood glucose, FBG alone or OGTT from 80.5% in 2002 to 73.3% in 2004, a change that parallels the decrease in MWCFC centers.9 16

CF, cystic fibrosis; CFRD, CF-related diabetes; FBG, fasting blood glucose; MWCFC, Mountain West CF Consortium; OGTT, oral glucose tolerance test.

Patients with CFRD

There were 141 patients in 2002 (12.1%) and 224 patients in 2004 (17.0%) diagnosed with CFRD (table 3), a statistically significant increase in prevalence (χ2, p<0.001). Eight patients were excluded because their diagnoses of CFRD were reversed; two patients were too young for the study; three patients underwent transplantation prior to the first chart review. Three patients were excluded from the second chart review due to new lung transplants during the study; three additional patients were excluded due to incarceration, death, and loss to follow-up. After exclusions, a total of 92 patients consented to participate in either the first (5 patients) or second (23) or both chart reviews (64).

CFRD chart reviews for adherence with care guidelines

Data collected (table 4) showed that the population of patients studied in each year of study was comparable to the general population of patients with CF in the USA.9 Height was increased due to expected growth in the pediatric patients. Weight and body mass index (BMI) increased (figure 1), and there was an accompanying increase in weight-for-age z-score; the increases in weight measures were statistically significant and included patients for whom no growth in stature was expected or occurred. Finally, FEV1% dropped significantly between chart reviews for patients participating in both years of data collection.

Table 4

Characteristics and outcomes of patients with CFRD after QI efforts

	First chart review n=69	Second chart review n=87	p Value
Age in years (SD)	26.1 (11.7)	25.1 (11.1)	0.56
Male, n (%)	36 (52)	45 (52)	0.92
Caucasian, n (%)	66 (96)	84 (96)	0.89
Height, cm (SD)	163.41 (11.44)	170.73 (57.44)	0.012†
Height-for-age z-score (SD)‡	0.148 (1.75)	1.26 (8.80)	0.26§
Weight, kg (SD)	56.8 (13.5)	58.9 (11.9)	<0.001†
BMI (SD)§	21.1 (3.1)	21.4 (3.9)	0.003†
Weight-for-age z-score (SD)¶	−1.43 (0.76)	−0.84 (0.75)	<0.001†
FEV1% (SD)**	65.6 (25.5)	61.9 (24.0)	0.008†

*Weight change reported is uncorrected for age or growth.

†McNemar's paired t test. There were 63 patients with height measurement, 62 patients with weight, 62 patients with BMI, and 54 patients with FEV1% data from both chart reviews available for paired t tests. Significant changes in weight, weight-for-age z-score, BMI, and FEV1% persist when only adults are included or only patients without growth in height are included.

‡Height-for-age z-score is calculated using the method of Dibley et al17 and Lai et al,18 as we have performed previously for weight-for-age z-score.6

§When tested using t test, p=0.26, indicating that the height characteristics of the average patient followed at the study centers did not change during the study period. However, when testing patients participating in both years of the study, McNemar's paired t test detects that our group of study patients included adolescents who grew in stature during the study.

¶Weight-for-age z-score calculated as we have performed previously.6

**Annual maximum recorded value. The maximum value is chosen because it is the most reliably reproducible measurement.6

BMI, body mass index; CFRD, cystic fibrosis-related diabetes; FEV1%, percent of predicted forced expiratory volume in 1 s; QI, quality improvement.

Figure 1

Changes in weight and body mass index (BMI) associated with quality improvement. (A and B) Show change in weight relative to beginning weight and age. Most patients have an increase in weight during the study period which is not due to growth. (C and D) Show similar improvements in BMI during the study period. The improvements were independent of cystic fibrosis center identities.

There was no change in the numbers of patients with fasting hyperglycemia or the numbers of patients using insulin (table 5). There was a significant decrease in the number of patients visiting clinic six or more times in a year. There were significant increases in the numbers of retinal eye examinations and foot examinations performed. The number of urinalyses obtained from patients with CFRD was unchanged, but the frequency of inclusion of testing for albuminuria was markedly improved. Similarly, there was no change in the number of patients undergoing HbA1c tests during the year nor was there a great increase in the number of patients undergoing testing quarterly, but the number of HbA1c measurements per patient increased markedly.

Table 5

Measures reflective of center adherence with CFRD care guidelines

Recommended test, results are n and per cent of reviewed patients	First chart review n=69	Second chart review n=87	p Value
Insulin usage	50 (72)	64 (73)	0.98*
Patients with more than 6 clinic visits annually†	28 (40)	15 (17)	0.002*
Retinal eye examination	14 (20)	38 (44)	0.004*
Foot examinations	14 (20)	38 (44)	0.004*
Albuminuria testing	6 (9)	52 (60)	<0.001*
Any HbA1c measurements	52 (75)	69 (79)	0.69*
3 or more HbA1c measurements in 1 year, n (%)	1 (1)	14 (16)	0.005*

*Pearson's χ2.

†The CF Foundation recommends four visits annually for routine follow-up and maintenance of health. Additional visits are generally for acute illnesses, and a reduction in these visits is a generally desirable outcome.

CF, cystic fibrosis; CFRD, CF-related diabetes; HbA1c, glycated hemoglobin.

Comparison of the MWCFC to other US CF centers

Screening rates for CFRD using FBG alone or OGTT were low throughout US accredited CF centers in 2002 but significantly increased through 2004 by 41% for non-MWCFC centers and 71% for centers participating in the MWCFC QI project (table 6). The odds of being screened for CFRD were significantly higher at MWCFC centers compared with all other US CF centers by about 80% in 2002 and 2004. In multivariate analyses, corrections for number of clinic visits, best FEV1% in each study year, number of prior acute pulmonary exacerbations, and 5-year predicted survival6 did not significantly change these results.

Table 6

Screening comparison between MWCFC and all other US CF centers

	Eligible patients screened for CFRD
	National (n) screening rate	MWCFC (n) screening rate	OR*	95% CI*
2002	1305 (19 680) 6.6%	125 (1243†) 10%	1.79	1.49 to 2.13
2004	1527 (18 807) 8.1%‡	185 (1226†) 15%‡	1.81	1.54 to 2.14
OR*	1.41	1.71
95% CI*	1.38 to 1.45	1.57 to 1.85

*ORs calculated using generalized linear models (logistic regression) with screening by FBG alone or OGTT as the dependent variable. The 95% CIs all indicate a significance level of p<0.001.

†The n's and screenings reported for MWCFC care centers for 2002 and 2004 differ from those reported in table 1. More patients were screened and fewer were eligible for the study compared with patients included in the CFFPR. The differences are due to the exemption from consent for measuring center adherence to screening guidelines within the QI study compared with required consent for inclusion in the CFFPR, differences in determination of primary care center (and thus study participation eligibility) by the local centers versus the CFFPR and the option afforded to CFFPR patients to withdraw consent with retroactive data erasure at any time. Differences in patients included in the CFFPR compared with the MWCFC study account for the statistically significant improvement in CFRD screening that was not captured in the current study.

‡By 2011, screening rates utilizing either FBG alone or OGTT had risen to 23% nationally and 29% in the original MWCFC centers, maintaining an OR of 1.26 (95% CI 1.12 to 1.41, p<0.001) for screening in the MWCFC compared with the rest of US centers.

CF, cystic fibrosis; CFRD, CF-related diabetes; CFFPR, CF Foundation Patient Registry; FBG, fasting blood glucose; MWCFC, Mountain West CF Consortium; OGTT, oral glucose tolerance test; QI, quality improvement.

Missingness of data

Out of 92 patients enrolled in the overall study, 64 participated in both chart reviews. We examined the potential bias due to missingness of data that was not missing at random or not missing completely at random on the evaluation of effects associated with implementation of QI programmes. We considered both the 64 patients with participation throughout the study who had sporadically missing individual pieces of data as well as the 28 patients that were missing all data from either the first or second year of the study.

Comparison of aggregated data using unpaired tests between 2002 and 2004 showed no qualitative difference from paired t tests for height, weight, BMI, weight-for-age z-score, or HbA1c testing. However, unpaired t test showed no difference in FEV1% between the two study years while paired testing revealed a strong statistically significant difference. This indicated that lung disease progressed for individual patients, although the overall level of disease in each center remained unchanged. Overall, these tests suggest that selection of patients with 2 years of data did not introduce a bias related to missing data that was not missing at random. However, the findings with FEV1% values suggested further evaluation of missingness to consider whether there was evidence that data were not missing completely at random.

Multiple imputation with chained equations15 with 50 iterations using predictive mean matching produced plausible distributions of values for missing data on inspection of density plots comparing imputed to non-missing data but suggested that missing FEV1% values in the second year of chart review would have been somewhat worse than non-missing measurements. FEV1% values had density distributions in 10 imputed data sets that were somewhat lower than the density distribution of actual data. However, there was no significant or clinically relevant shift in median or mean values. Repetition of statistical testing for changes in height, weight, BMI, and FEV1% with imputed data sets between the two study years showed no evidence that data were not missing completely at random or that final results were significantly changed by missingness.

Discussion

CFRD is a common complication of CF itself and requires specific care as outlined in the CF Foundation Care Guidelines.8 Our efforts to improve screening for this condition and to improve the quality of care given to patients bearing the diagnosis had mixed, although generally positive results.

The number of confirmed diagnoses increased significantly during the study. However, the increase unfortunately was not clearly due to increased frequency of screening, a major goal of the QI project (table 3). As part of study development, all clinic practitioners received additional education on the clinical importance and characteristics of CFRD. The increased number of confirmed diagnoses may indicate that practitioners focused their screening efforts on patients for whom they had increased clinical suspicion of CFRD, that were not included in the study, or perhaps that were diagnosed during the 6-month period when QI plans were being formulated at each center: outcomes that we did not measure.

There were three distinct methods for screening: OGTT, a random blood sugar measurement following an abnormal FBG, and two abnormal random blood sugar measurements. Unfortunately, no test used for CFRD screening among study participants was increased in application at the time of the second chart review compared with the first chart review, highlighting the difficulty of obtaining these tests (table 3).

OGTT is mildly uncomfortable due to fasting and repeated blood draws and may be technically difficult to obtain during an already busy multidisciplinary clinic visit. Obtaining fasting blood is complicated by patients that arrive in clinic without fasting and later fail to obtain testing on non-clinic visit days because of the inconvenience of fasting and the need for a timed blood draw. These issues were the most consistently reported barrier to improving the rate of CFRD screening among the MWCFC centers (table 7).

Table 7

Discovered barriers to quality improvement

Programme	Barriers
Children's Hospital Colorado (Pediatric)	Hospital policy required that a limited number of OGTT tests could be performed each day since the patient was required to stay in the laboratory throughout the time of the test. A new protocol was developed by the hospital laboratory to provide 2 regularly scheduled appointment slots for OGTTs on the days of the CF clinics. Many patients lived a long distance from the clinic and wanted to avoid excessively long periods of fasting. A standard laboratory order form (including dose of glucose based on weight) was developed, so that patients could obtain an OGTT at outlying hospitals.
National Jewish Health (Adult)	All clinics were in the afternoon which meant a long day of fasting or giving up a morning to do the OGTT and then spending the afternoon in CF clinic. Patients greatly disliked the length of time it took to undergo OGTT.
Phoenix Children’s Hospital (Pediatric)	There was no laboratory available at clinic at the beginning of the study period. All studies were obtained at outside laboratories, and some results were not reported back to the CF clinic. Outside laboratories did not always know how to dose glucola for children and increased side effects like vomiting and rebound hypoglycemia. Timing of 2 h postglucola challenge glucose measurements were logistically difficult in clinic even after a laboratory facility was started in clinic. The frequency of quarterly HbA1c measurements increased the logistical difficulties. Some providers and patient families were uncomfortable with OGTT for younger patients. All tracking was manual and difficult to perform. There was no single endocrinologist identified to provide CFRD education increasing the potential for confusion about the disease and testing. Patients and families did not like the extra cost of testing or the extra time. Children often disliked the taste of glucola and had nausea and vomiting, and prediabetic patients would have insulin spikes followed by symptomatic hypoglycemia.
University of Arizona (combined Adult and Pediatric)	None reported.
University of Utah (Primary Children’s Medical Center, Pediatric)	Standardization of procedures was difficult. The need for education of personnel that CFRD screening and monitoring are expectations for the entire clinic population. Patients did not like the OGTT because of the time required to complete the testing. Patients often failed to come fasting or to even come to clinic when an OGTT was anticipated. Small children were unable to tolerate glucola, and modified testing was required to obtain results.
University of Utah (Adult)	Patients frequently failed to come to clinic fasting or simply declined testing during clinic. Patients infrequently returned to clinic for OGTT and rarely went to an outside facility to obtain the test.
University of New Mexico (combined Pediatric and Adult)	Patients sometimes refused testing. Patients failed to show for some clinic visits, and some patients limited visits to clinic to once per year.

CF, cystic fibrosis; CFRD, CF-related diabetes; HbA1c, glycated hemoglobin; OGTT, oral glucose tolerance test.

Confirmation of CFRD by random blood glucose measurement after an abnormal FBG is slightly easier to perform because timing of the random blood glucose is not so stringent, but still requires fasting and two blood draws. This screening strategy may also miss the substantial number of patients with CFRD without fasting hyperglycemia.4 10

Screening by obtaining two random, high, blood glucose measurements avoids asking a patient to fast prior to a clinic visit, but it requires careful tracking of random blood glucoses over time to identify two abnormal values consistent with CFRD. The unscheduled nature of such testing introduces the challenge of tracking multiple serial results with varying intervals in order to make a diagnosis. This is further complicated by the possibility of false-positive results for patients with an ongoing acute illness. Those patients may be subject to a disease-specific bias that favors finding false-positive results for frequently hospitalized patients. Frequent sick visits and hospitalizations may increase the number of random blood sugar measurements at times when increased glucose values are much less specific for diagnosing CFRD.

Complementary data regarding screening efforts for CFRD from the CFFPR allow comparison between MWCFC and all other accredited US care centers (table 6). Owing to consenting and enrolment differences, these data overlap but are not directly comparable to data recorded among participants in our QI study. MWCFC screening results using FBG alone or OGTT were better than all others, a relationship that persisted in lesser degree through 2011 (the last year of CFFPR data currently available to our study group) even as all centers in the USA had marked improvements in screening rates. However, the results for all centers continued to fall short of complete adherence to CFRD screening guidelines through 2011.10

In contrast to modest recorded results from trying to increase frequency of screening efforts to establish a diagnosis, we had marked improvements in management of patients with confirmed CFRD. The number of clinic visits was reduced for these patients, indirectly indicating a decrease in encounters for acute illness, even while we increased the numbers of examinations specific for CFRD follow-up. The increased attention to CFRD management was associated with a significant improvement in weight, BMI, and weight-for-age z-score that persisted even when we corrected for the effects of normal growth in height among the children expected to grow or focused exclusively on adults (figure 1). Unfortunately, a significant drop in lung function was also observed during the study period (table 4). This drop, however, was not greater than observed in the national CFFPR for the period of study.9 16

The evaluation of adherence to suggested CFRD care guidelines was hampered by the widely varying settings and styles of practice found within the MWCFC. However, this problem reflects the real-world difficulties that likely exist in adapting a single set of guidelines to over 110 care centers. Since this was a non-randomized and non-blinded trial that was observational for patients but involved a change in practice at the provider level, we expected that there would be an observer effect reflected in improvements in adherence to guidelines for making the diagnosis of CFRD. That we found no evidence of such bias underscores how difficult it may be to implement care guidelines even among caretakers motivated by the knowledge that they are being watched. However, we cannot exclude that the increase in diagnoses during the study may have been due to non-systematically study-associated increased attention for patients with clinical circumstances that raised the suspicion of CFRD and that participation in the study increased CFRD screening during the time allowed to each center to create QI plans.

It is possible that the improvements in measures of weight were spurious and not associated with increased efforts to improve CFRD management. However, observations beyond the end of the study suggest that these particular gains were sustained (not shown), and that efforts at improving management of patients with confirmed CFRD were more successful than for increasing screening of previously undiagnosed patients. Finally, our study was limited somewhat by missingness of data. However, evaluation of data from patients with 2 years of data versus patients with 1 or 2 years of data produced no indication that data were not missing at random, and multiple imputation by chained equations of missing data for height and weight produced no evidence of hidden clinically relevant biases due to missingness that was not completely at random. Imputation of FEV1% suggested that patients with missing data in the second year of the study might have had slightly lower values than for patients that had actual data; however, this potential bias had marginal statistical impact with no impact on interpretation of the change in FEV1% between the two chart reviews in the study.

CFRD is an increasingly common complication of CF. Comprehensive recommendations for screening and management have been disseminated by the CF Foundation, but we found those guidelines to be difficult to implement despite great motivation. The passage of additional time since our study has not resulted in sufficiently improved adherence by CF centers.10 Nevertheless, even with partial improvement and incomplete adherence, there were detectable improvements in clinical outcomes that imply better prognoses for individuals with CF, underscoring the worth of QI efforts.