Literature DB >> 30443343

Using different methods to process forced expiratory volume in one second (FEV 1) data can impact on the interpretation of FEV 1 as an outcome measure to understand the performance of an adult cystic fibrosis centre: A retrospective chart review.

Zhe Hui Hoo1,2, Muhaned S A El-Gheryani1,2, Rachael Curley1,2, Martin J Wildman1,2.   

Abstract

Background: Forced expiratory volume in one second (FEV 1) is an important cystic fibrosis (CF) prognostic marker and an established endpoint for CF clinical trials. FEV 1 is also used in observation studies, e.g. to compare different centre's outcomes. We wished to evaluate whether different methods of processing FEV 1 data can impact on a centre's outcome.
Methods: This is a single-centre retrospective analysis of routinely collected data from 2013-2016 which included 208 adults with CF. Year-to-year %FEV 1 change was calculated by subtracting best %FEV 1 at Year 1 from Year 2 (i.e. negative values indicate %FEV 1 decline), and compared using Friedman test. Three methods were used to process %FEV 1 data. First, %FEV 1 calculated with Knudson equation was extracted directly from spirometer machines. Second, FEV 1 volume were extracted then converted to %FEV 1 using clean height data and Knudson equation. Third, FEV 1 volume were extracted then converted to %FEV 1 using clean height data and GLI equation. In addition, %FEV 1 decline calculated using GLI equation was adjusted for baseline %FEV 1 to understand the impact of case-mix adjustment.
Results: There was a trend of reduction in %FEV 1 decline with all three data processing methods but the magnitude of %FEV 1 decline differed. Median change in %FEV 1 for 2013-2014, 2014-2015 and 2015-2016 was -2.0, -1.0 and 0.0 respectively using %FEV 1 in Knudson equation whereas the median change was -1.1, -0.9 and -0.3 respectively using %FEV 1 in the GLI equation. A statistically significant p-value (0.016) was only obtained when using %FEV 1 in Knudson equation extracted directly from spirometer machines. Conclusions: Although the trend of reduction in %FEV 1 decline was robust, different data processing methods yielded varying results when %FEV 1 decline was compared using a standard related group non-parametric statistical test. Observational studies with %FEV 1 decline as an outcome measure should carefully consider and clearly specify the data processing methods used.

Entities:  

Keywords:  Cystic fibrosis; epidemiology; forced expiratory volume; patient outcome assessment

Mesh:

Year:  2018        PMID: 30443343      PMCID: PMC6213785          DOI: 10.12688/f1000research.14981.1

Source DB:  PubMed          Journal:  F1000Res        ISSN: 2046-1402


Introduction

Cystic fibrosis (CF) is a multi-system genetic condition but the two main affected organs are lungs (resulting in recurrent infections and respiratory failure) and gastrointestinal tract (resulting in fat malabsorption and poor growth) [1]. Median survival has improved to 45 years, in part because of improvement in care quality [2]. An important quality improvement initiative is benchmarking, which involves identifying high-performing centres and the practices associated with outstanding performance [3– 5]. Since forced expiratory volume in one second (FEV 1) is an important CF prognostic marker [6– 9], it is often used as an outcome measure for benchmarking [3– 5, 10]. Different statistical methods of analysing FEV 1 data can yield different results [11], but there is scant attention paid to the methods of processing FEV 1 data. We previously reported a statistically significant reduction in year-to-year %FEV 1 fall for our CF centre from 2013–2016 [12]. We now set out to understand the impact of using different FEV 1 data processing methods on our CF centre’s outcome.

Methods

This is a single-centre retrospective analysis of routinely collected clinical data from 2013–2016. Regulatory approval for the analysis was obtained from NHS Health Research Authority (IRAS number 210313). All adults with CF diagnosed according to the UK CF Trust criteria aged ≥16 years were included, except those with lung transplantation or on ivacaftor. These treatments have transformative effects on %FEV 1 [13– 15], thus may affect the interpretation of year-to-year variation in %FEV 1. Demographic data (age, gender, genotype, pancreatic status, CF related diabetes, Pseudomonas aeruginosa status), body mass index (BMI) and FEV 1 data were collected by two investigators (HZH and RC / HZH and MEG) independently reviewing paper notes and electronic records. Where data from the two investigators differ, the original data from paper notes or electronic records were reviewed to by both investigators to ensure the accuracy of abstracted data. This process ensures the accuracy of abstracted data and helps avoid potential bias from inaccurate or inconsistent data collection [16]. FEV 1 data were processed with three different methods prior to analysis. First, %FEV 1 readings (calculated with Knudson equation [17] and available in whole numbers) were directly extracted from spirometer machines. Second, FEV 1 volumes (in litres, to two decimal places) were extracted and clean height data were used to calculate %FEV 1 (as whole numbers) with Knudson equation [17]. Third, FEV 1 volumes (in litres, to two decimal places) were extracted and clean height data were used to calculate %FEV 1 with GLI equation [18] using an Excel Macro (Microsoft Excel 2013). Best %FEV 1, i.e. the highest %FEV 1 reading in a calendar year for each study subject was used for analysis since it is most reflective of the true baseline %FEV 1 [19]. Year-to-year %FEV 1 change was calculated by subtracting best %FEV 1 at Year 1 from Year 2 (i.e. negative values indicate fall in %FEV 1 and positive values indicate increase in %FEV 1). In addition to calculating year-to-year %FEV 1 change using three different FEV 1 data processing methods, %FEV 1 change calculated with GLI equation was also adjusted for baseline %FEV 1 using reference values from Epidemiologic Study of CF (ESCF) [20]. The ESCF study found median %FEV 1 change of –3%/year, –2%/year and –0.5%/year for baseline %FEV1 ≥100%, 40–99.9% and <40% respectively [20]. Adjusted %FEV 1 change was calculated by subtracting median ESCF %FEV 1 change from actual %FEV 1 change. Thus, an adjusted %FEV 1 change >0 meant the subject’s year-to-year change in %FEV1 was less than expected (indicating better health outcome) whilst an adjusted %FEV 1 change <0 meant the subject’s year-to-year change in %FEV 1 was more than expected (indicating worse health outcome). %FEV 1 change from 2013–2014 to 2015–2016 calculated using different FEV 1 data processing methods were compared using Friedman test. Bland-Altman analyses [21] were also used to compare year-to-year variation in FEV 1 as calculated with Knudson equation against year-to-year variation in FEV 1 as calculated with GLI equation, to understand the impact of using different reference equations. Analyses were performed using SPSS v24 (IBM Corp) and Prism v7 (GraphPad Software). P-value <0.05 was considered statistically significant.

Results

This analysis included 208 adults, with 147 adults providing data for all four years. Overall, the cohort was ageing but baseline %FEV 1 increased from 2014 onwards (see Table 1).
Table 1.

Characteristics of study subjects from 2013 to 2016.

2013201420152016
Excluded      Lung transplantation, n      On ivacaftor, n6 76 79 97 13
Included, n 166 170 185 186
Age in years, median (IQR)25 (19 – 31)26 (20 – 32)27 (20 – 34)27 (21 – 34)
Female, n (%)76 (45.8)80 (47.1)87 (47.0)90 (48.4)
Genotype status: []      ≥1 unknown mutation(s), n (%)      ≥1 class IV-V mutation(s), n (%)      Homozygous class I-III, n (%)11 (6.6) 26 (15.7) 129 (77.7)13 (7.6) 29 (17.1) 128 (75.3)16 (8.6) 36 (19.5) 133 (71.9)15 (8.1) 34 (18.3) 137 (73.7)
Pancreatic insufficient, [] n (%)137 (82.5)135 (79.4)142 (76.8)145 (78.0)
CF related diabetes, [] n (%)39 (23.5)42 (24.7)42 (22.7)54 (29.0)
P. aeruginosa status: [§]      No P. aeruginosa, n (%)      Intermittent P. aeruginosa, n (%)      Chronic P. aeruginosa, n (%)60 (36.1) 37 (22.3) 69 (41.6)57 (33.5) 36 (21.2) 77 (45.3)74 (40.0) 31 (16.8) 80 (43.2)78 (41.9) 29 (15.6) 79 (42.5)
BMI, median (IQR)22.3 (19.7 – 24.6)22.7 (20.0 – 25.0)23.0 (20.3 – 26.0)23.2 (20.4 – 26.0)
Best %FEV 1, median (IQR)78.7 (54.1 – 92.5)76.6 (54.4 – 89.7)77.8 (60.4 – 89.0)78.5 (58.5 – 89.6)

¶ Genotype status as defined by international consensus [22]. Homozygous class I-III mutations indicate ‘severe genotype’.

† Pancreatic insufficiency was diagnosed by the clinical team on the basis of ≥2 faecal pancreatic elastase levels <200µg/g stool and symptoms consistent with maldigestion and malabsorption, in accordance to the UK Cystic Fibrosis (CF) Trust guideline.

‡ CF related diabetes was diagnosed by the clinical team on the basis of oral glucose tolerance test and continuous subcutaneous glucose monitoring results, in accordance to the UK CF Trust guideline.

§ Pseudomonas aeruginosa status was determined according to the Leeds criteria [23].

¶ Genotype status as defined by international consensus [22]. Homozygous class I-III mutations indicate ‘severe genotype’. Pancreatic insufficiency was diagnosed by the clinical team on the basis of ≥2 faecal pancreatic elastase levels <200µg/g stool and symptoms consistent with maldigestion and malabsorption, in accordance to the UK Cystic Fibrosis (CF) Trust guideline. ‡ CF related diabetes was diagnosed by the clinical team on the basis of oral glucose tolerance test and continuous subcutaneous glucose monitoring results, in accordance to the UK CF Trust guideline. § Pseudomonas aeruginosa status was determined according to the Leeds criteria [23]. The %FEV 1 increase was in part due to younger adults with higher %FEV 1 transitioning from paediatric care because %FEV 1 tended to decline from year to year (see Table 2). However, different year-to-year change in %FEV 1 results were obtained with different FEV 1 data processing methods. There was statistically significant reduction in year-to-year fall in %FEV 1 using %FEV 1 readings as recorded in spirometer machines ( p=0.016). Cleaning of height data and standardisation of %FEV 1 calculation with Knudson equation [17] did not alter the magnitude of year-to-year variation in %FEV 1, but the p-value was no longer statistically significant ( p=0.062). The use of GLI equation altered the magnitude of year-to-year variation in %FEV 1 although the trend of reduced year-to-year fall in %FEV 1 persisted ( p=0.135). Adjustment for baseline %FEV 1 further increased the p-value ( p=0.210).
Table 2.

Discrepancies in year-to-year %FEV 1 variation with different methods of processing forced expiratory volume in one second (FEV 1) data.

Methods of processing FEV 1 data:Change in %FEV 1, median (IQR)Friedman test p-values
2013 to 2014 (n = 158)2014 to 2015 (n = 162)2015 to 2016 (n = 176)
(1) %FEV 1 (calculated with Knudson equation) extracted from spirometer machines used for analysis [] –2.0 (–6.0 to 1.0)–1.0 (–3.3 to 2.0)0.0 (–3.0 to 2.0)0.016
(2) FEV 1 volume (in L) extracted and height data were cleaned, then %FEV 1 calculated using Knudson equation [] –2.0 (–5.0 to 1.0)–1.0 (–4.0 to 1.0)0.0 (–3.8 to 2.0)0.062
(3) FEV 1 volume (in L) extracted and height data were cleaned, then %FEV 1 calculated using GLI equation [ϕ] –1.1 (–4.6 to 1.5)–0.9 (–3.2 to 1,5)–0.3 (–2.9 to 1.8)0.135
(4) FEV 1 volume (in L) extracted and height data were cleaned, then %FEV 1 calculated using GLI equation, then change %FEV 1 adjusted for baseline %FEV 1 using ESCF reference values [§] 0.7 (–2.4 to 3.6)1.1 (–1.4 to 3.5)1.6 (–1.3 to 3.7)0.210

ESCF - Epidemiologic Study of cystic fibrosis

† The vast majority of the %FEV 1 data were from spirometer machines at the Sheffield Adult cystic fibrosis (CF) centre, which were calculated with Knudson equation [17] in whole numbers. Some %FEV 1 data were from spirometer machines at the Pulmonary Function Unit which operationalised the Knudson equation differently; by calculating age to one decimal place to determine the predicted FEV 1. These spirometer machines also provided %FEV 1 to two decimal places, but this was rounded to whole numbers for the purpose of analysis. These results were presented at the 2017 North American CF Conference and were published as an abstract in Pediatric Pulmonology [12].

‡ FEV 1 volumes were available in litres to two decimal places from spirometer machines. Height data were also extracted to allow the calculation of predicted FEV 1. This led us to uncover the inconsistency recording of height, which affected 30–40% of the study subjects and would have introduced erroneous variability to the %FEV 1 because all equations for predicted %FEV 1 are dependent on height. Height data were cleaned to weed out error. Where there was uncertainty regarding the height, the higher value was used to obtain a conservative estimate of %FEV 1. To replicate calculation process of the spirometer machines at the Sheffield Adult CF centre, age was rounded down to a whole number and predicted FEV 1 in volume were calculated to two decimal places using Knudson equation [17]. This was used to derive the %FEV 1, which was then rounded to whole numbers for the purpose of analysis.

ϕ FEV 1 and height data were extracted as above. %FEV 1 was calculated using the GLI equation [18] using an Excel Macro available at the European Respiratory Society website.

§ %FEV 1 calculated using the GLI equation [18] as described above, then adjusted for baseline %FEV 1 as described in the ‘Methods’ section. An adjusted %FEV 1 change of >0 meant the subject’s year-to-year fall in %FEV 1 was less than expected for his / her baseline %FEV 1, indicating better health outcomes.

ESCF - Epidemiologic Study of cystic fibrosis † The vast majority of the %FEV 1 data were from spirometer machines at the Sheffield Adult cystic fibrosis (CF) centre, which were calculated with Knudson equation [17] in whole numbers. Some %FEV 1 data were from spirometer machines at the Pulmonary Function Unit which operationalised the Knudson equation differently; by calculating age to one decimal place to determine the predicted FEV 1. These spirometer machines also provided %FEV 1 to two decimal places, but this was rounded to whole numbers for the purpose of analysis. These results were presented at the 2017 North American CF Conference and were published as an abstract in Pediatric Pulmonology [12]. ‡ FEV 1 volumes were available in litres to two decimal places from spirometer machines. Height data were also extracted to allow the calculation of predicted FEV 1. This led us to uncover the inconsistency recording of height, which affected 30–40% of the study subjects and would have introduced erroneous variability to the %FEV 1 because all equations for predicted %FEV 1 are dependent on height. Height data were cleaned to weed out error. Where there was uncertainty regarding the height, the higher value was used to obtain a conservative estimate of %FEV 1. To replicate calculation process of the spirometer machines at the Sheffield Adult CF centre, age was rounded down to a whole number and predicted FEV 1 in volume were calculated to two decimal places using Knudson equation [17]. This was used to derive the %FEV 1, which was then rounded to whole numbers for the purpose of analysis. ϕ FEV 1 and height data were extracted as above. %FEV 1 was calculated using the GLI equation [18] using an Excel Macro available at the European Respiratory Society website. § %FEV 1 calculated using the GLI equation [18] as described above, then adjusted for baseline %FEV 1 as described in the ‘Methods’ section. An adjusted %FEV 1 change of >0 meant the subject’s year-to-year fall in %FEV 1 was less than expected for his / her baseline %FEV 1, indicating better health outcomes. Similar results were obtained when restricting the analyses to those aged ≥18 years (see Table 3). Bland-Altman analyses comparing year-to-year variation in %FEV 1 calculated from clean FEV 1 data using Knudson equation [17] vs year-to-year variation in %FEV 1 calculated from clean FEV 1 data using GLI equation [18] indicate the tendency for Knudson equation [17] to over-estimate the magnitude of year-to-year fall in %FEV 1 by a mean difference of 0.1–0.4% (see Figure 1).
Table 3.

Discrepancies in year-to-year %FEV 1 variation with different methods of processing forced expiratory volume in one second (FEV 1) data among adults aged ≥18 years.

Methods of processing FEV 1 data:Change in %FEV 1, median (IQR)Friedman test p-values
2013 to 2014 (n = 147)2014 to 2015 (n = 157)2015 to 2016 (n = 172)
(1) %FEV 1 (calculated with Knudson equation) extracted from spirometer machines used for analysis–2.0 (–6.0 to 1.0)–1.0 (–3.0 to 2.0)0.0 (–3.0 to 2.0)0.016
(2) FEV 1 volume (in L) extracted and height data were cleaned, then %FEV 1 calculated using Knudson equation–2.0 (–5.0 to 1.0)–1.0 (–4.0 to 1.0)0.0 (–3.8 to 2.0)0.029
(3) FEV 1 volume (in L) extracted and height data were cleaned, then %FEV 1 calculated using GLI equation–1.3 (–4.6 to 1.3)–1.0 (–3.2 to 1.4)–0.3 (–2.9 to 1.8)0.090
(4) FEV 1 volume (in L) extracted and height data were cleaned, then %FEV 1calculated using GLI equation, then change %FEV 1 adjusted for baseline %FEV 1 using ESCF reference values0.5 (–2.4 to 3.3)1.0 (–1.4 to 3.4)1.6 (–1.3 to 3.7)0.149
Figure 1.

Bland-Altman plots comparing year-to-year variation in %FEV 1 as calculated with Knudson equation (i.e. “Method 2” for processing FEV 1 data according to Table 2) against year-to-year variation in %FEV 1 as calculated with GLI equation (i.e. “Method 3” for processing FEV 1 data according to Table 2).

http://dx.doi.org/10.5256/f1000research.14981.d205603 Click here for additional data file.

Discussion

We demonstrated that different centre-level year-to-year variation in %FEV 1 results were obtained using different FEV 1 data processing methods. In particular, year-to-year fall in %FEV 1 was smaller in magnitude when %FEV 1 was calculated using GLI equation [18] instead of Knudson equation [17]. This is in part due to the demographic of our centre which has a relatively young adult population. A previous study found a near-linear %FEV 1 decline from childhood to adulthood with GLI equation, whereas there was accelerated %FEV 1 decline during adolescence and young adulthood when %FEV 1 was calculated with Knudson equation [24]. One advantage of using the GLI equation, which is seamless across all ages, is that it improves the interpretation of %FEV 1 decline [24, 25]. Another advantage is that %FEV 1 decline can be adjusted for baseline %FEV 1 using ESCF reference values (since the ESCF values for %FEV 1 decline were calculated using the GLI equation [20]). The limitation for all single-centre analysis is the potential lack of generalisability. Another limitation of our analysis is that the ESCF reference values used to adjust year-to-year variation in %FEV 1 were derived using a cohort from around 15 years ago [20], and may not represent the current population. Our results nonetheless highlighted that year-to-year variation in %FEV 1 can be extremely sensitive to the FEV 1 data processing methods. This is one of the challenges of using year-to-year variation in %FEV 1 to infer quality of care. Another challenge is that %FEV 1 lacks sensitivity as an outcome measure. A recent sample size estimation using the UK CF registry data suggests that 273 adults per centre are needed to detect a 5% FEV 1 difference at the 95% significance level [26]. The sensitivity of measures used to detect variations in care quality is particularly pertinent to CF because a relatively small population is spread across many centres. Indeed, only 6/28 (21.4%) of all UK adult CF centres have ≥273 adults. That means process measures, e.g. medication adherence, is important to detect variations in quality of CF care. Mant & Hicks previous demonstrated that measuring processes of care proven in randomised controlled trials to reduce death allows detection of meaningful differences in care quality for myocardial infarction with just 75 cases, whereas 8179 cases would be needed if mortality was used as the quality indicator [27]. Given the limitations of FEV 1 as an outcome measure in CF, results of centre comparisons based on FEV 1 data should be carefully interpreted. Observational studies with year-to-year variation in %FEV 1 as an outcome measure should carefully consider and clearly specify the data processing methods used.

Ethical considerations

Regulatory approval for the analysis was obtained from NHS Health Research Authority (IRAS number 210313).

Data availability

The data referenced by this article are under copyright with the following copyright statement: Copyright: © 2018 Hoo ZH et al. Data associated with the article are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication). Dataset 1: Sheffield forced expiratory volume in one second (FEV 1) data 10.5256/f1000research.14981.d205603 [28] Thank you for sending me this interesting note.  A few thoughts on the analysis from a statistician The Knudson equation has a functional form It’s an interesting, though sobering, fact that between 30 and 40 percent of the machine-entered heights are incorrect. Normally the tendency would be for such errors to obscure, rather than generate, associations. This now-known, high error rate makes it less interesting to explore this section of the results. What does a Friedman test measure? It’s a non-parametric version of a repeated measures one-way analysis of variance. Two issues are worth considering.It requires a complete table, so only those subjects with all four years of data may be included. Secondly it produces a three degree of freedom test, which is not very well directed to address the most likely question of interest. We might be most interested in detecting a smooth, linear trend over time. However just as much weight is being given to detect non-linear patterns such as curvature {low, high, high, low} and saw-tooth {low, high, low, high}. I don’t know how centres are compared officially. Comparison of neighbouring years’ data would be unstable. Also, using these non-linear components could be very misleading. I hope that the linear trend is used. Are there any alternative analyses that would address these two issues?Certainly. To begin with, let’s use the original data for FEV1% and not worry about their normality. You could fit a mixed model to these data once you stack them in long format (“varstocases” in SPSS). This would enable you to use all data, not just data for those with a complete set. It would also enable you to extract a one degree of freedom test for trend across the four years.This should be a more powerful approach. I now see that the other referees refer to this as well, though I don’t agree that you need to have at least three observations per subject. If you are worried about the normality (though the published quartiles are not that alarming) then two alternatives would be (1) to find a normalising transformation that would apply to the stacked column of FEV1% values, or (2) to use a rank-based transformation (“Fisher-Yates”) available in SPSS as “rank y /normal into z.” What might be the mathematics underlying any difference in slope obtained by the Knudson and GLI methods? I have tried to abstract the formulae used by Knudson and by GLIin deriving the predicted FEV1 that is used in the calculation of FEV1%. For a specific example I have chosen males (slightly more common in this study) aged 25 to 28 years (somewhere near the median age) with height of 175cm (just below mean UK adult height). FEV1 predicted = 5.1228 – 0.0292.age. FEV1% = FEV1/(FEV1 predicted) can then be differentiated to see how it varies with changes in age and FEV1 However the GLI equivalent is given as point estimates from a Cole-Green LMS fitting procedure. The penalised cubic splines are not given, so no functional form is available. ​The table shows, just for this combination, how the predicted values compare.Those from Knudson are slightly lower and decrease slightly more rapidly with age.Such differences, and those from other combinations, will work together to determine how FEV1% might be expected to change with age and observed FEV. I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. No further comment I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard. The authors performed a retrospective analysis of FEV1% predicted data over 3 years in an adult CF center in the UK. They examined FEV1 decline from year to year by calculating variation in best FEV1 during two consecutive years and examined the impact of using data obtained using Knudson equation (directly extracted from the spirometer or recalculated with the appropriate height) vs. GLI equation. They also performed an adjustment using ESCF data. The authors concluded that trends in FEV1 decline were robust among methods, although the results were somewhat different using different methods/equations. The study has some interest in highlighting problems associated with these type of calculations, especially when used for benchmarking (as in the UK). I have the following comments for improvement: An important drawback of Knusdon equation is related to the change of FEV1 in the transition from pediactric to adults. This is why the GLI is nowadays often used in mixed pediatric/adult population. The authors used the UK definition of adults (over 16 years) and suggested that some of the difference in their results between Knudson and GLI data are due to the younger patients in this cohorts. I would be happier if the authors could perform a sensitivity analysis using only patients 18 years an over? This would miniminze the Knusdon/GLI age bias and would make these results more relevant to the adult centres outside of UK. Looking at Table 1, it seems that only a minority of patients were below 18 years. I think the word FEV1 decline is inappropriate in this manuscript. A year to year variation (even over 3 years) is not a decline. For calculating a decline, you would need multiple data points (at the very least 3 data points) and perform more complicated analyses (e.g., mixed model analysis). I would suggest to remove the word decline from the manuscript as the main goal of the authors did not appear to be FEV1 decline but mostly year to year FEV1 variation which is used for benchmarking in the UK. I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. We thank Prof Burgel for the review and we will iterate the manuscript taking into account the two very useful suggestions, i.e. 1. we will perform a sensitivity analysis for the results in Table 2 using only adults aged 18 years and above 2. we will replace the term "FEV1 decline" with "year-to-year FEV1 variation" FEV1 as a percent of predicted is widely used as an outcome measure in patients with cystic fibrosis and is one of the metrics used to compare centres or countries in benchmarking exercises.  This manuscript presents data showing that differences in data processing and the use of different reference equations used to estimate FEV1 as a percent predicted can result varying estimates of lung disease changes and potentially impact comparisons of centres/countries. The paper supports the standardization of FEV1 collection and reference equations which is currently in development by CF International Registries. It also highlights that different approaches to data collection can impact the interpretation of statistical analyses. Comments: Differences in FEV1 percent predicted using different equations is well known (Rosenfeld et al [1] and more recently in the cited UK/US comparison study). For this reason, the GLI have been recently accepted as the standard for most CF registries. Although year to year subtraction is a method of looking at longitudinal changes, regression methodology is preferable to analyse these changes, especially, as in this case, where you have 3 time points. This also allows to adjust for baseline factors such as lung disease severity. The method of adjustment for baseline Iung function is a bit crude. The medians subtracted are from a US population over 10 years ago and are likely to overestimate lung function decline in this population. In the Morgan et al, J Pediatr 2016 paper cited, the benefits of using this type of adjustment was shown using regression. Did their statistical approach factor in that these were repeated measures in the same patients? Bland & Altman plots comparing different reference equations could be considered. The results suggest that height inaccuracy is impacting the results.  As this is a single centre study, it is difficult to determine is this is a more universal problem. I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard. We thank Prof McKone for the review and we will iterate the manuscript taking into account the suggestion to compare the different reference equations (Knudson vs GLI) using Bland-Altman analysis. We concur the GLI has been recently accepted as the standard for most CF registries. We concur that regression analyses is preferable to determine FEV1 decline. As recommended by Prof Burgel, we will replace the term "FEV1 decline" with "year-to-year FEV1 variation" in the revised manuscript. We concur that the method used to adjust year-to-year FEV1 variation for baseline FEV1 is crude. The displayed data from the ESCF paper is only presented according to the four FEV1 categories, hence our choice of adjustment method. Given the limited number of subjects within the Sheffield dataset, we felt is it is more appropriate to use reference values for suitably large datasets instead of simply calculating the predicted %FEV1 change using the Sheffield dataset. There are more recent reference values for FEV1 from the ECFSPR (Boëlle et al, 2012) and Canadian registry (Kim et al, 2018); however those papers do not provide reference values for year-to-year FEV1 variation. Our statistical method account for repeated FEV1 measures since: 1. by using best FEV1, there is only x1 FEV1 reading per person per year 2. only x1 FEV1 reading per person was used to calculate the year-to-year FEV1 variation As mentioned in the discussion section, we concur that a single-centre study may not be generalisable. However, inaccurate data recording within routine datasets (e.g. CF registries) is unlikely to be an isolated problem. For example, the letter by Hartley et al (2016) in JCF revealed that 6% of the adults with CF at the Manchester Adult CF Centre had incorrect genotype data recorded in the UK CF registry.
  27 in total

1.  Association of High-Dose Ibuprofen Use, Lung Function Decline, and Long-Term Survival in Children with Cystic Fibrosis.

Authors:  Michael W Konstan; Donald R VanDevanter; Gregory S Sawicki; David J Pasta; Aimee J Foreman; Evgueni A Neiman; Wayne J Morgan
Journal:  Ann Am Thorac Soc       Date:  2018-04

2.  Global Lung Function Initiative equations improve interpretation of FEV1 decline among patients with cystic fibrosis.

Authors:  Sanja Stanojevic; Diana Bilton; Alexandra McDonald; Janet Stocks; Paul Aurora; Ammani Prasad; Tim J Cole; Gwyneth Davies
Journal:  Eur Respir J       Date:  2015-04-02       Impact factor: 16.671

Review 3.  Key findings of the US Cystic Fibrosis Foundation's clinical practice benchmarking project.

Authors:  Michael P Boyle; Kathryn A Sabadosa; Hebe B Quinton; Bruce C Marshall; Michael S Schechter
Journal:  BMJ Qual Saf       Date:  2014-04       Impact factor: 7.035

Review 4.  Lung transplantation for cystic fibrosis: a single center experience of 100 consecutive cases.

Authors:  Ilhan Inci; Olivia Stanimirov; Christian Benden; Peter Kestenholz; Markus Hofer; Annette Boehler; Walter Weder
Journal:  Eur J Cardiothorac Surg       Date:  2011-12-12       Impact factor: 4.191

5.  Longitudinal analysis of pulmonary function decline in patients with cystic fibrosis.

Authors:  M Corey; L Edwards; H Levison; M Knowles
Journal:  J Pediatr       Date:  1997-12       Impact factor: 4.406

6.  Pulmonary function outcomes for assessing cystic fibrosis care.

Authors:  Jeffrey S Wagener; Eric P Elkin; David J Pasta; Michael S Schechter; Michael W Konstan; Wayne J Morgan
Journal:  J Cyst Fibros       Date:  2014-12-09       Impact factor: 5.482

Review 7.  Benchmarking to improve the quality of cystic fibrosis care.

Authors:  Michael S Schechter
Journal:  Curr Opin Pulm Med       Date:  2012-11       Impact factor: 3.155

8.  Chart reviews in emergency medicine research: Where are the methods?

Authors:  E H Gilbert; S R Lowenstein; J Koziol-McLain; D C Barta; J Steiner
Journal:  Ann Emerg Med       Date:  1996-03       Impact factor: 5.721

9.  Lung function decline in cystic fibrosis patients and timing for lung transplantation referral.

Authors:  Daniel B Rosenbluth; Kevin Wilson; Thomas Ferkol; Daniel P Schuster
Journal:  Chest       Date:  2004-08       Impact factor: 9.410

10.  Does current reporting of lung function by the UK cystic fibrosis registry allow a fair comparison of adult centres?

Authors:  Julia Anne Nightingale; Clive Osmond
Journal:  J Cyst Fibros       Date:  2017-04-24       Impact factor: 5.482

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.