Spirometry Longitudinal Data Analysis Software (SPIROLA) for Analysis of Spirometry Data in Workplace Prevention or COPD Treatment.

Chronic obstructive pulmonary disease (COPD) is one of the leading causes of morbidity and mortality. Periodic spirometry is often recommended for individuals with potential occupational exposure to respiratory hazards and in medical treatment of respiratory disease, to prevent COPD or improve treatment outcome. To achieve the full potential of spirometry monitoring in preserving lung function, it is important to maintain acceptable precision of the longitudinal measurements, apply interpretive strategies that identify individuals with abnormal test results or excessive loss of lung function in a timely manner, and use the results for intervention on respiratory disease prevention or treatment modification. We describe novel, easy-to-use visual and analytical software, Spirometry Longitudinal Data Analysis software (SPIROLA), designed to assist healthcare providers in the above aspects of spirometry monitoring. Software application in ongoing workplace spirometry-based medical monitoring programs helped to identify increased spirometry data variability due to deteriorating test quality and subsequent improvement following interventions, and helped to enhance identification of individuals with excessive decline in lung function.

INTRODUCTION

Chronic obstructive pulmonary disease (COPD) is one of the leading causes of morbidity and mortality [1]. COPD often profoundly diminishes the affected individual’s quality of life. Furthermore, excessive decline in lung function is associated with premature functional impairment and disability, early retirement from work, and increased morbidity and mortality [2-5]. Fortunately, the severe consequence of COPD can be prevented through early recognition and effective interventions directed at controlling known risk factors, including occupational factors [6-11].

Workplace monitoring of spirometry tests of forced expiratory volume in one second (FEV1) and forced vital capacity (FVC) is widely accepted as a key step in the early (preclinical) recognition of both obstructive and restrictive lung diseases [12-15]. Professional recommendations emphasize several key steps in achieving the full potential of spirometry monitoring in disease prevention. These include: (i) maintaining acceptable longitudinal data variability (i.e., precision); (ii) applying interpretative strategies that have good sensitivity, yet sufficient specificity, to identify individuals who may be at risk of experiencing excessive loss of lung function (i.e., those at risk of developing lung function impairment); and (iii) using health monitoring results, including symptoms, to target and monitor intervention [12-17]. Computer software has the potential to assist healthcare providers in achieving these steps and thus to help in preserving lung health.

In this paper, we describe an easy-to-use visual and analytical tool, Spirometry Longitudinal Data Analysis software (SPIROLA) [18] designed for use by healthcare providers as an aid in spirometry monitoring. We outline SPIROLA’s methodology and functions, and present results from its application in ongoing monitoring programs. The software can be downloaded free of charge from the internet [18].

METHODOLOGICAL BACKGROUND

One of the objectives in spirometry monitoring is to characterize the time-related pattern of lung function decline in adult individuals. This section describes methods SPIROLA uses to identify individuals whose decline in lung function is greater than expected and the method for monitoring longitudinal spirometry data precision and quality.

FEV1 is the most suitable of the spirometry measures for evaluation of lung function changes over time as it is least variable within a person, least prone to measurement error, and is decreased in both obstructive and restrictive impairment. In healthy adult never-smokers with normal body weight, FEV1 declines at about 27 ml/yr, starting at around 27 years of age, and the decline appears to be linear over the working lifetime [19, 20]. The decline with age can be estimated using a simple linear regression model, FEV1=a+b×age, where the slope b represents the rate of FEV1 change (e.g., in milliliters per year, ml/yr) [19].

The variability of longitudinal FEV1 measurements around the predicted line determines the precision of the estimated rate of decline b and is measured by its standard error S.E.(b) estimated as [21]:

where t is the duration of follow-up in years, σw is the within-person standard deviation and P is the number of equally spaced repeated measurements done during the follow-up. Fig. () shows the estimated values for S.E. (b) [using equation (1)] for four individuals with varying inherent within-person variation (from low 50 to high 250 ml), for increasing years of follow-up. The solid line is based on P=2, i.e., baseline comparison with a test taken at a specific year, and the dotted line is based on P=t, i.e., all annual measurements. The one-sided upper 95% confidence limit (95% UCL) for the person’s rate of decline measured by the slope b is calculated as (95% UCL)=b+1.645 S.E.(b). Depending on the magnitude of individual’s within-person variation, it generally takes 5 or more years to estimate an individual’s “true” rate of decline with sufficient precision.

Fig. () demonstrates that in prospectively collected spirometry data where testing is done on an annual or less frequent basis as in spirometry monitoring, the slopes provided by the linear regression model during the first five to eight years, depending on individual’s within-person variation, are generally imprecise and may not provide a reliable estimate of the “true” rate of decline [21-24]. Nevertheless, during this early period there is a need to determine whether a person’s observed decline in lung function exceeds what would be expected based upon an expected rate of decline and expected FEV1 variability. The American Thoracic Society (ATS) recommends a limit of annual decline for FEV1 of 15% as clinically significant decline [25]. The American College of Occupational and Environmental Medicine (ACOEM) has proposed a longitudinal reference limit based on a 15% annual FEV1 decline for working populations [14, 15]. However, the fixed limit of 15% is too wide for maintaining acceptable data precision in a relatively healthy workforce, and too insensitive to detect acute adverse effects in some workplace situations where excessive decline over a short period of time has been observed (see below) [22, 23, 26].

Alternatively, the limit of longitudinal decline (LLD) that approximates the one-sided upper 95% CL for a referent rate of decline and that takes into account the monitoring program’s average FEV1 within-person variation has been proposed for the evaluation of longitudinal changes in individuals [22, 23]. LLDa represents the absolute limit for the maximal decline over time t and is defined as follows:

where b is a referent rate of decline and S.E.(b) is the standard error of b as described in equation (1). Since the within-person variation σw in equation (1) is usually unknown for an individual during the early years of follow-up, one can approximate σw by the monitoring program’s average within-person standard deviation; this can be estimated on a group of n individuals, by the pair-wise within-person standard deviation sp as:

where FEV11 and FEV12i are FEV1 measurements repeated approximately one year apart in an ith individual, as done for annual spirometry monitoring.

Alternatively, a relative limit of longitudinal decline, LLDr, for percent decline from the baseline value FEV1 can be calculated using equation (1) with the parameters standardized by baseline FEV1baseline as b/FEV1baseline and S.E.(b/FEV1baseline), where the relative pair-wise within-person variation sr calculated as:

is substituted for σw in equation (1). The LLDr limit has better applicability for groups that vary with respect to gender, height, race, or ethnicity (i.e., factors that affect FEV1 size) [23]. Alternatively, published estimates of within-person variation can be used [23].

The LLD method has been proposed for the purposes of maintaining longitudinal data precision in workers’ populations and identifying workers who may experience excessive decline during the early (1-8) years of follow-up [22, 23]. If an individual’s FEV1 decline exceed the LLD limit, a first step in the evaluation should include increase in precision of the longitudinal measurements by review of data quality or re-testing in near future, before further steps are taken. Generally, after 5 to 8 years of follow-up, the individual’s own regression slope reaches sufficient precision and can be used for decision-making [21-24].

Fig. () demonstrates that for a monitoring program to be effective at timely identification of excessive decline in lung function and at disease prevention, it is important to maintain acceptable precision of the longitudinal measurements. Monitoring the program’s absolute and relative pair-wise within-person variation statistic sr or sp helps to maintain longitudinal data precision at an acceptable level [16]. In addition, monitoring test quality grades assigned by a spirometer at a testing session can help to monitor percentage of tests that do not adhere to ATS/ European Respiratory Society (ERS) recommendations. Monitoring of precision or test quality grades, overall and by a spirometry technician, allows prompt investigation into the source of increased variation (e.g., instrument malfunction, procedural errors, effects of exposure, technician related errors) [16, 27].

SOFTWARE METHODS AND FUNCTIONS

Development and Testing

From the onset of its development in 2005, SPIROLA software has been piloted by several large ongoing monitoring programs. In these programs SPIROLA is used by physicians and their needs were considered in its development. In one program, an Occupational Medicine Inc.® (OMI) spirometry system automatically loads spirometry results into SPIROLA to be displayed at the time of individuals’ medical examinations.

Software Environment and Data Requirement

SPIROLA runs on PC with Microsoft Windows system and requires Microsoft Windows 2000/XP/Vista, Microsoft.NET Framework 2.0 and Database engine, which are Microsoft default options. The User Manual, provided by the Help menu, describes installation procedure, data input, functions, and theoretical background on which the data analysis is based. The SPIROLA databases should be kept in a secured folder and use a shared folder if multiple users are using the data.

At a minimum, SPIROLA requires the following data: a unique personal identifier, age, height, race/ethnicity, best FEV1 and FVC test values, and date of test. Where the spirometry system provides quality indices for a testing session (i.e., quality grades for acceptability and repeatability, second best FEV1 and FVC, technician or provider code), these data can be also uploaded into SPIROLA database and analyzed by SPIROLA. Data for intervention decision-making (e.g., weight, occupational exposure factors, smoking data, and questionnaire responses) can be included in the database for display in individual records.

SPIROLA main menu options are easy to operate and allow for a spirometry file selection, a group selection and evaluation, evaluation of individual’s data, monitoring of longitudinal spirometry data precision and tests quality scores, and automatic selection of individuals whose tests need review because of abnormal findings.

Functions for Group Evaluation

The following functions are provided to assist in evaluating data at a group level:

Monitoring longitudinal data precision

To achieve and maintain acceptable longitudinal FEV1 data precision over time, the program’s data precision is monitored on an annual basis using the absolute and relative pair-wise within-person variation statistics, sp (ml) and sr (%), respectively (see Background).

Monitoring the group mean FEV1 and FVC values

Time-trends in mean FEV1 and FVC are displayed to help to identify effects taking place at a group level (e.g., due to occupational hazard, smoking cessation program). To adjust for time-related changes in a group’s demographics, SPIROLA monitors also the mean predicted values estimated from standard or user supplied reference equations and z-score. Z-score reflects the mean difference between the observed and predicted values expressed in the standard deviation units, standardized for demographic data distribution.

Monitoring spirometry quality control

To optimize the spirometry quality control for the monitoring program and individual technicians, SPIROLA analyzes tests’ quality grades assigned by a spirometer at a testing session [28, 29]. SPIROLA monitors on a quarterly basis: (i) the percentage of tests that do not meet the ATS/ERS criteria for acceptability and repeatability, and (ii) the percentage of tests that do not meet repeatability criteria (i.e., >150 ml between the two best FEV1 and FVC measurements). The user can specify quality grades and cutoff points appropriate for a spirometer type.

Screening for individuals with abnormal results

Individuals identified to have abnormal lung function results are listed in Risk List. Risk List provides summary statistics on a number screened and found with specific type of abnormal results (see below).

SPIROLA’s Functions for Individual Evaluation

The following functions are provided to assist in evaluating data at an individual level:

Evaluating the most recent spirometry test results

As recommended by the ATS/ERS and ACOEM, the most recent best FEV1, FVC, and FEV1/FVC values are compared to U.S. population-based reference values (default) [30] or to user-defined reference values [25,28]. Individuals whose values are below the lower limit of normal (LLN, i.e., values that have 5% probability of being normal in a healthy non-smoker population) are identified for further evaluation and listed in the Risk List.

Evaluating longitudinal changes in FEV1

Time-trends for FEV1, FVC, and their percent predicted values and the FEV1/FVC ratio are displayed graphically. During the first seven years of follow-up, SPIROLA applies the limit of longitudinal decline (LLD) criterion to identify FEV1 measurements that decline excessively from the baseline measurement(s). The LLD can be specified in absolute values (LLDa) or in relative values as percentage (LLDr), or as the ACOEM limit; [14,15] a default limit is based on within-person variation of 4% [23]. Beginning with the fourth year of follow-up, the changes in the rate of FEV1 decline due to each longitudinal data point are monitored graphically. The later function is useful in monitoring the effect of intervention or identification of events leading to deterioration in the rate of decline. Beginning with eight years of follow-up, SPIROLA evaluates whether an individual is at risk of developing FEV1 values that has low probability of being normal (i.e., <0.1 percentile which is comparable to 60% predicted, defined by ATS as moderate impairment), based on the level of FEV1 and the rate of FEV1 decline [31].

Evaluating longitudinal FEV1 data variability

Within-person variation in FEV1 and FVC is calculated when there are three or more longitudinal measurements and evaluated for the probability of being normal.

An Individual’s report displays

An individual’s report display results of data analyses together with demographic data. If there are abnormal findings, the individual report suggests steps to be considered in further evaluation. These include: (a) assessment of the individual’s longitudinal data; obvious outliers can be excluded temporarily from the analysis; (b) review of the baseline and most recent spirometry tracings and test quality; (c) re-testing in near future to confirm the results; and (d) only if abnormal test results are confirmed, further steps such as further medical evaluation and intervention on potential risk factors are recommended.

Tagging individuals for further evaluation

The software enables the user to create a list of individuals for quality control or re-testing, and intervention.

The project proposal and methods were approved by the NIOSH Human Subject Review Board.

RESULTS

Results presented are examples from application of SPIROLA to data from several ongoing monitoring programs. The examples have been selected to demonstrate SPIROLA functions and to show how the results can help healthcare providers.

Group Evaluation of Spirometry Data Precision and Mean Lung Function Values

Application of SPIROLA in 2005 for the evaluation of data precision in one of the monitoring programs prompted concerns about spirometry quality. Fig. (, bottom part) shows that the annual values of absolute and relative pair-wise within-person variation, sp (ml) (left axis) and sr (%) (right axis), had declined gradually from the program’s inception in 1988 until 1999, indicating improving data quality, but then the statistics showed a marked increase in data variability from 2000. In June 2001, a volumetric spirometer, used since 1988, had been replaced by a new flow-based spirometer. Data generated by the new spirometer resulted in a marked increase in data variability since 2000; the year 2000 includes repeated measurements done in 2001. Prompted by the SPIROLA results, interventions to improve spirometry quality was initiated in 2005 and involved the following measures: technician training through a NIOSH-approved spirometry training course [32] in April 2005; replacement of a flow-based spirometer by a volumetric spirometer in December 2005; a computerized central-quality control by a senior technician from September 2006; and SPIROLA’s quality grades analysis from January 2008. Taken together, the interventions resulted in a substantial decrease in the within-person variation from 2006. The observation in 2008 is based on first observations made from after January 2008 and includes repeated tests made mainly because of quality issues. The sr (right axis) value of 4% achieved from 2006-7 signifies acceptable data precision and corresponds to annual LLDr value of ≈10% [22, 23].

Fig. (, top charts) also shows trends for the observed (green line) and predicted (yellow line) group mean FEV1 and FVC values by year. As there were no changes in the employment pattern since the intervention onset in 2005, the increase in the observed means in relation to the predicted means and the increase in the z-scores (red line) was mainly due to the improvement in spirometry quality. Charts shown in Fig. () can be displayed individually also.

Evaluation of Spirometry Quality Grades

Fig. () shows SPIROLA’s chart generated from the analysis of quality indices (the grades assigned by a spirometer, within-test repeatability, and relative pair-wise within-person variation), in this case summarized across all technicians, by quartiles. Individual technicians’ charts can be also shown.

The quality of the FEV1 test was mostly acceptable, based on the small percentage of tests that did not meet the ATS/ERS criteria of acceptability and repeatability (<10%) (green lines ●), within-test repeatability (<10%) (blue line ●), and pair-wise within-person variation of ≈4%22 (red line); a yellow circle indicates small sample size. On the other hand, a large percentage of the FVC measurements did not meet the ATS/ERS criteria. Additional training in 2008 help to improve acceptability of FVC measurements; most of the unacceptable tests failed to fulfill the end of test criteria [28]. Analysis by technicians permitted specific guidance to individual technicians.

Screening for Individuals with Abnormal Tests Results: Risk List

The summary results from one monitoring program (Fig. ) show that there were 3,449 workers who had at least one spirometry test during the screening period. Of these, 312 (9%) were selected into the risk list because the FEV1/FVC ratio was below LLN at the most recent test. Of the 3,084 individuals who had at least two longitudinal observations, 174 (5.6%) were selected into the risk list because of potential excessive decline: in 102 (3.3%) the excessive decline was assessed using LLDr as the duration of follow-up was less than 8 years; and in 77 the identification was based on the linear regression slope and the risk of developing FEV1 value that has <0.1% probability of being normal (i.e., moderate impairment).

Evaluations of Individuals’ Data

The first step in the evaluation of individual’s data is to view the longitudinal trends. Fig. () shows SPIROLA’ multiple charts of longitudinal data for FEV1, FVC, and the FEV1/FVC ratio for an individual with less than eight years of follow-up. Although the most recent lung function values were above the LLN (i.e., the lung function level is within the normal limits), the FEV1 values are below LLDr from ≈35 years of age, indicating excessive decline. There is also decreasing trend in FVC.

Fig. () shows longitudinal data for an individual with eight or more years of follow-up who was identified having an excessive decline based on the regression slope and an increased risk of development of FEV1 value that has less than 0.1% probability of being normal based on the U.S. population of healthy nonsmokers (this level corresponds to 60% predicted, i.e., moderate impairment).

The first step in the evaluation is to confirm the results by reviewing the longitudinal data, the quality of the baseline and last tests, and re-testing if needed to increase longitudinal data precision. If an obvious outlier is observed, a data point can be temporarily deleted from the analysis. If the abnormal findings are confirmed, the individual should be referred for further medical evaluation to investigate whether there is respiratory abnormality due to a specific condition or disease and if needed intervention on potential risk factors should be initiated. The results should be discussed with an individual to motivate participation in interventions directed at controlling occupational and non-occupational risk factors. Because of confidentiality issues individuals’ results should not be made available to the employer, only group summary findings should be provided to the employer to motivate preventive measures at workplace.

DISCUSSION

Periodic spirometry is often recommended for individuals with actual and potential exposures to respiratory hazards [12-16]. To achieve the full potential of spirometry-based medical monitoring in detecting the signal due to adverse health effects, it is necessary to maintain acceptable test quality, and apply interpretive strategies that have high sensitivity and specificity in identifying individuals at risk of developing lung function impairment. Longitudinal data precision determines how soon and how reliably a “true” excessive decline can be identified (Fig. ) [22-23].

SPIROLA software was developed as a visual and analytical tool to assist healthcare professionals in addressing challenges arising from monitoring respiratory health of individuals potentially at risk [18]. The software is intended to assist the user in assembling the information required to make medical decisions, however, it cannot be substituted for competent and informed professional judgment.

To assist in the evaluation of the practical utility of SPIROLA, managers of several ongoing spirometry-based health surveillance programs adopted the software. The results from monitoring programs conducted on U.S. workers reported here demonstrate that the information displayed by SPIROLA on longitudinal data precision can assist the healthcare professionals to determine potential sources of excess variability (e.g., a change in spirometry systems and procedural errors) and recognize when an intervention on data quality is needed and subsequently, whether the intervention improved longitudinal data precision (Fig. ) and quality (Fig. ). SPIROLA can also aid in optimizing the performance of individual technicians through the spirometry quality grades analysis (Fig. ). Although appropriate equipment, trained technicians, knowledgeable professional oversight, and comprehensive procedure manuals are basic components of a quality testing program [28], data precision can vary over time for various reasons and such changes may not be noticeable on individual tests.

The estimate of data precision provided by the software affords additional benefits during the interpretation of longitudinal change for individuals. It facilitates determination of an appropriate limit of longitudinal decline, LLD, a criterion applied by SPIROLA software to maintain longitudinal data precision and detect early (within 8 years) excessive lung function decline. The LLD method increases flexibility to develop stringent quality control and to increase sensitive for detecting long-term excessive decline or acute respiratory effects, under different monitoring conditions [22, 23]. The knowledge of group longitudinal data precision and data quality increases the likelihood of discerning whether an observed change in lung function is due to procedural error or incipient lung disease. However, workplace or environmental factors may be responsible for increased FEV1 variability by causing respiratory illness.

The user may choose to modify the default parameters on which the longitudinal detection limit LLD is based. The LLD limit can reflect existing data variability. However, if data variability can not be calculated, SPIROLA provides LLDr default based on an annual limit of decline of 10 % and expected normal physiological lung function decline with increasing years. The value of 10% is based on evaluation of data precision in several existing monitoring programs, and assumes relatively good longitudinal data precision (within-person variation of 4%) [16, 17, 22, 23]. Alternatively the user can use the ACOEM fixed limit [14, 15]. When setting the LLDr limit, the user should also consider the severity and implications of potential occupational health effects. For example, when disabling irreversible work-related excessive declines in lung function can occur within short exposure duration, as was observed in popcorn workers, higher sensitivity is preferable to higher specificity [26].

Because COPD is a preventable disease that usually takes many years to develop, early recognition of abnormal pulmonary function decline followed by an effective intervention is important in disease prevention [6]. The longitudinal assessment over all follow-up years based on evaluation that takes into account data variability, as done by SPIROLA, helps to improve the accuracy of recognition of development of respiratory disease. By helping to improve longitudinal data precision, SPIROLA improves the precision of the estimated rate of decline and identification of those with true excessive rate of decline. Furthermore, the Risk List function helps the healthcare provider to identify individuals whose spirometry results may be abnormal and who may need further evaluation; this function is especially useful in occupational settings where a large number of workers undergo spirometry monitoring.

A limitation of our study is that the long-term implications of the application of SPIROLA for disease prevention have not yet been fully evaluated in ongoing monitoring programs. Data input can be a limitation that we plan to overcome by adding to SPIROLA interfaces to allow automatic transfer of spirometry data generated by different spirometers.

CONCLUSION

Application of SPIROLA in an ongoing spirometry monitoring program has helped to identify previously unrecognized increases in longitudinal data variability due to equipment and procedural problems, and to demonstrate that subsequent data quality interventions resulted in improvement in data precision and in spirometry quality. By organizing and analyzing longitudinal spirometry data, SPIROLA software has helped to improve identification of individuals who have or are at risk of developing lung function abnormalities.