Forecasting COPD hospitalization in the clinic: optimizing the chronic respiratory questionnaire.

PURPOSE: Forecasting hospitalization in patients with COPD has gained significant interest in the field of COPD care. There is a need to find simple tools that can help clinicians to stratify the risk of hospitalization in these patients at the time of care. The perception of quality of life has been reported to be independently associated with hospitalizations, but questionnaires are impractical for daily clinical use. Individual questions from valid questionnaires can have robust predictive abilities, as has been suggested in previous reports, as a way to use patient-reported outcomes to forecast important events like hospitalizations in COPD. Our primary aim was to assess the predictive value of individual questions from the Chronic Respiratory Questionnaire Self-Assessment Survey (CRQ-SAS) on the risk of hospitalization and to develop a clinically relevant and simple algorithm that clinicians can use in routine practice to identify patients with an increased risk of hospitalization. PATIENTS AND METHODS: A total of 493 patients with COPD prospectively recruited from an outpatient pulmonary clinic completed the CRQ-SAS, demographic information, pulmonary function testing, and clinical outcomes. The cohort had a mean age of 70 years, was 54% male, with forced expiratory volume in 1 second percentage predicted 42.8±16.7, and modified Medical Research Council dyspnea scale score of 2±1.13.
RESULTS: Our analysis validated the original CRQ-SAS domains. Importantly, recursive partitioning analysis identified three CRQ-SAS items regarding fear or panic of breathlessness, dyspnea with basic activities of daily living, and depressive symptoms that were highly predictive of hospitalization. We propose a robust (area under the curve =0.70) but short and easy algorithm for daily clinical care to forecast hospitalizations in patients with COPD.
CONCLUSION: We identified three themes - fear of breathlessness, dyspnea with basic activities of daily living, and depressive symptoms - as important patient-reported outcomes to predict hospitalizations, and propose a short and easy algorithm to forecast hospitalizations in patients with COPD.

Introduction

COPD is one of the main causes of morbidity and mortality worldwide, and is expected to become the third-leading cause of death and the fifth-leading cause of disability-adjusted life years lost in 2020.1 Patients with COPD suffer recurrent exacerbations that require hospitalization. Reducing admissions to the hospital is one of the primary aims in the management of the disease,2 due to the high burden to the patient and also the economic and social cost.3 Furthermore, GOLD (Global initiative for chronic Obstructive Lung Disease) recently proposed a way to categorize risk in patients with COPD using history of exacerbations for identifying patients that have a higher risk of being hospitalized. There is a need for simple ways to identify patients who are at the highest risk of being hospitalized within the clinic, in order to design preventive interventions and proper care, including palliative care.

Quality of life (QoL), measured with disease-specific questionnaires, has been shown to offer additional information to predict COPD patients’ risk of hospitalization.4 However, disease-specific questionnaires are currently done in the context of clinical trials, and are rarely used in daily practice. Not using the predictive information from such questionnaires as the Chronic Respiratory Questionnaire Self-Administered Survey (CRQ-SAS)5–7 or St George’s Respiratory Questionnaire (SGRQ)8 may be a “missing opportunity” for better forecasting the risk of hospitalization. While the entire questionnaire might not be feasible for routine use, some questions might be significantly associated with the likelihood of hospitalization and merit further investigation. For example, while inflammatory and physiologic changes associated with COPD have been implicated in the onset of depression and anxiety,9 the perception of QoL is a better predictor of difficult emotions in COPD than biological or physiological markers.10 The objective of the present study was to investigate the predictive value of individual questions from a disease-specific QoL questionnaire, the CRQ-SAS, on the risk of hospitalization in a well-characterized cohort of COPD patients. The ultimate goal of this work is to develop a clinically relevant and easy algorithm that clinicians can use in routine practice to identify patients with an increased risk of hospitalization.

Patients and methods

Patients with COPD (n=493) were prospectively recruited from an outpatient pulmonary clinic at Mayo Clinic in Rochester, MN, USA. The following inclusion criteria were used in an attempt to obtain a uniform patient population: diagnosis of COPD based on the GOLD 2011 guidelines,11 age >40 years, history of smoking more than 10 pack-years, and the ability to complete questionnaires. This study received Mayo Clinic Institutional Review Board approval, and all patients signed research consent.

At the time of recruitment, investigators recorded demographics, clinical information, and health care utilization (hospitalization and ER visits) during the previous year and self-reported by participants. Pulmonary function tests were performed according to the current guidelines and established reference values.12 Dyspnea status was assessed using the modified Medical Research Council (mMRC) dyspnea scale (range: 0–4), as has been previously described.13 Perceived QoL was assessed using the CRQ-SAS, a 20-item validated questionnaire that measures the health status of patients with COPD. The inventory is divided into four dimensions: dyspnea, fatigue, emotional function, and mastery. Lower scores in each dimension indicate a greater degree of dysfunction on a 7-point scale.6,7 Finally, patients were classified subsequently according to the GOLD severity and risk criteria (GOLD 2013) into GOLD A, GOLD B, GOLD C, and GOLD D groups.14 The composite index of COPD severity (age, dyspnea, obstruction)15 was calculated for all patients.

Statistical analysis

The goal of this study was to define subsets of items (individual questions from the CRQ-SAS) that could predict the risk of hospitalization after adjusting for age, lung function, history of hospitalizations, and mMRC dyspnea that can be used in daily clinical practice to make decisions on individuals at highest risk of hospitalization. Methods used to define the subsets included variable cluster analysis, factor analysis using scree plots and varimax rotation, recursive partitioning (classification and regression tree [CART] models), univariate and stepwise logistic regression models, and model validation using bootstrapping. Recursive partitioning was done using RPART version 4.1–8.16 All other analyses were done using SAS 9.2 (SAS Institute Inc, Cary, NC, USA).

Development of the algorithm to identify patients at risk of hospitalization began with a confirmatory analysis of the internal psychometric structure of the existing measures. Factor- and cluster-analysis routines were followed to demonstrate that indeed the internal structure of the original measures was demonstrated in our application setting.

Univariate logistic models were fitted to see how well each of the individual questions and subscales could predict hospitalizations. Collinearity diagnostics were then run to determine whether any combinations of variables were too highly correlated to be included together in multivariate modeling. These diagnostic measures showed that the four CRQ subscales (mastery, dyspnea, fatigue, and emotional) were highly related to the individual CRQ questions, so subsequent multivariate models only used individual CRQ items. No other multicollinearity concerns were found. The logistic regression models then identified a subset of the individual items that were related to the incidence of hospitalization, indicating that a small number of items might be useful in identifying patient subgroups at higher risk of hospitalization. The Akaike information criterion was used as the primary guide for item selection, along with the c-statistic.

CART models were used to find combinations of items that could predict hospitalization using the variables identified in the previous factor analysis, cluster analysis, and logistic regression work. CART models were created once using only the individual CRQ questions and once using the CRQ variables plus sex, age, forced expiratory volume in 1 second (FEV1) percentage predicted, and mMRC scale. Stepwise logistic regression models were then used to confirm and refine the predictive power of the CART models. Finally, the stepwise logistic models were confirmed by applying stepwise logistic modeling to 1,000 bootstrapped samples.

Results

Demographics and baseline characteristics are shown in Table 1. Cluster and factor analysis arrived at the same conclusions and verified the original CRQ-SAS domains. These two multivariate methods resulted in the following four groups of the CRQ-SAS variables: group 1, questions 1–5; group 2, questions 8, 11, 15, and 17; group 3, questions 6, 12, 14, 16, 18, and 20; and group 4, questions 7, 9, 10, 13, and 19. These four factors are the same as the four factors defined in the development of the CRQ: dyspnea, fatigue, emotional, and mastery.5 The only exception was that question 9 clustered with the mastery variables in this analysis, even though it was originally part of the emotional subscale. This is not a surprising result, since question 9 contains both emotional issues and concerns about how well the subjects can overcome COPD barriers.

Table 1

Baseline characteristics

Variable	Mean ± SD/n (%)
n	493
Age (years)	70±9.5
Sex
Male	267 (54.4)
Active smokers (%)	13
BMI	28.6±6.5
PFT data
FEV1% predicted	42.8±16.7
mMRC dyspnea scale	2±1.13
Exacerbations ≥2 previous year	169 (42)
Hospital admission previous year	163 (33)
ADO index (range: 0–14)	8.8±2.1
GOLD risk groups
A	89 (18.0)
B	86 (17.4)
C	66 (13.3)
D	252 (51.1)

Abbreviations: SD, standard deviation; BMI, body mass index; PFT, pulmonary function test; FEV1, forced expiratory volume in 1 second; mMRC, modified Medical Research Council; ADO, age, dyspnea, obstruction; GOLD, Global initiative for chronic Obstructive Lung Disease.

Logistic regression models were used to determine variables associated with hospitalization. Before running these models, collinearity diagnostics were checked. The subscales based on factor analysis were strongly related to the individual CRQ-SAS variables, so those variables were not used together in the logistic models. All of the other variables had condition numbers less than 100, indicating there were no other collinearity concerns.

Recursive partitioning was done using just the CRQ-SAS variables and again using the CRQ-SAS variables along with the mMRC dyspnea scale, age, sex, and FEV1% predicted. The resulting CART model using the CRQ-SAS variables demonstrated an algorithm to predict hospitalization (Figure 1). Univariate logistic modeling (Table 2) showed that FEV1% predicted, mMRC dyspnea scale, each of the individual CRQ-SAS questions, the subscales created from factor analysis, and the CART groups were all significantly related to hospitalization. Age, sex, and active smoking were not associated with hospitalization rates. The two different CART models (CRQ-SAS variables alone versus CRQ-SAS variables plus other variables: mMRC dyspnea scale, FEV1% predicted, age, and sex) performed almost the same in predicting the risk of hospitalizations. In fact, the CART model using just the CRQ-SAS variables had a better c-statistic (0.70) than the other CART model using the mMRC dyspnea scale, FEV1% predicted, age, and sex (c=0.684). Stepwise logistic modeling found that the CART model using the CRQ-SAS variables was the best predictor of the risk of hospitalization (Table 3).

Figure 1

Algorithm proposed to predict hospitalization in patients with COPD.

Table 2

Univariate logistic models predicting hospitalizations

Variable	P-value	Odds ratio (95% CI)	c-statistic	AIC
Male	0.278	1.23 (0.845–1.795)	0.53	626
Age	0.638	0.99 (0.976–1.015)	0.51	630
FEV1% predicted	0.003	0.98 (0.971–0.994)	0.58	608
mMRC	<0.0001	1.71 (1.421–2.076)	0.65	595
Q1: SOB while angry or upset	0.0002	0.79 (0.697–0.894)	0.62	525
Q2: SOB caring for basic needs	<0.0001	0.75 (0.667–0.849)	0.63	595
Q3: SOB walking	<0.0001	0.74 (0.656–0.839)	0.64	586
Q4: SOB performing chores	<0.0001	0.72 (0.641–0.820)	0.65	568
Q5: SOB in social activities	<0.0001	0.73 (0.643–0.833)	0.64	536
Q6: felt frustrated or impatient	0.002	0.80 (0.694–0.923)	0.59	607
Q7: feeling fear or panic with SOB	<0.0001	0.63 (0.553–0.728)	0.67	573
Q8: fatigue	<0.0001	0.76 (0.670–0.871)	0.61	609
Q9: embarrassed by cough or heavy breathing	0.001	0.82 (0.737–0.933)	0.59	616
Q10: confident could deal with illness	<0.0001	0.76 (0.678–0.868)	0.62	608
Q11: energy	<0.0001	0.70 (0.591–0.835)	0.62	607
Q12: feel upset, worried, or depressed	0.0002	0.76 (0.666–0.883)	0.60	600
Q13: felt in control of breathing problems	<0.0001	0.80 (0.723–0.892)	0.61	604
Q14: felt relaxed	0.013	0.85 (0.751–0.968)	0.57	615
Q15: felt low in energy	0.0001	0.75 (0.657–0.871)	0.61	606
Q16: felt discouraged	<0.0001	0.75 (0.655–0.866)	0.61	608
Q17: felt worn out or sluggish	0.0004	0.78 (0.682–0.897)	0.60	605
Q18: happy with personal life	0.0003	0.77 (0.669–0.887)	0.60	608
Q19: felt upset or scared when difficult to get breath	<0.0001	0.65 (0.569–0.745)	0.67	574
Q20: felt restless, tense, or uptight	0.0001	0.76 (0.665–0.877)	0.60	613
CART groups using all variables	<0.0001	1.77 (1.504–2.094)	0.68	548
CART groups using only CRQ-SAS	<0.0001	1.64 (1.434–1.885)	0.70	556
Factor analysis: factor 1	<0.0001	0.72 (0.619–0.852)	0.61	615
Factor analysis: factor 2	<0.0001	0.67 (0.586–0.781)	0.65	590
Factor analysis: factor 3	<0.0001	0.70 (0.605–0.832)	0.62	612
Factor analysis: factor 4	<0.0001	0.64 (0.550–0.745)	0.66	595
Cluster analysis: cluster 1	<0.0001	0.72 (0.619–0.852)	0.61	615
Cluster analysis: cluster 2	<0.0001	0.64 (0.550–0.745)	0.66	590
Cluster analysis: cluster 3	<0.0001	0.70 (0.605–0.832)	0.62	612
Cluster analysis: cluster 4	<0.0001	0.67 (0.586–0.781)	0.65	595

Abbreviations: CI, confidence interval; AIC, Akaike information criterion; FEV1, forced expiratory volume in 1 second; mMRC, modified Medical Research Council; SOB, shortness of breath; CART, classification and regression tree; CRQ-SAS, Chronic Respiratory Questionnaire Self-Assessment Survey.

Table 3

Stepwise logistic model results

Model	c-statistic	AIC
CART model with only CRQ-SAS variables	0.70	561.522
CART model with all variables*	0.68	551.709

Note:

CRQ-SAS variables, mMRC dyspnea scale, age, sex, and FEV1% predicted.

Abbreviations: AIC, Akaike information criterion; CART, classification and regression tree; CRQ-SAS, Chronic Respiratory Questionnaire Self-Assessment Survey; mMRC, modified Medical Research Council; FEV1, forced expiratory volume in 1 second.

The algorithm obtained through the CART modeling (Figure 1) identified two subsets of patients that accounted for 40% of the sample with a combined hospitalization risk of 50% (double the risk of hospitalization compared to the rest of the patients). The first subset, approximately 20% of the sample (103 of 493), indicated that they felt “fear or panic” when they were short of breath most of the time or all the time. These participants carried a 57% risk of hospitalization compared to only 27% for the rest of the sample (all other groups combined). The second subset, approximately a further 20% of the sample (101 of 493), included individuals who indicated they felt at least mildly short of breath while caring for their basic needs and also “felt discouraged or down in the dumps”, at least a little of the time, and had a 43% risk of hospitalization.

Discussion

We built an algorithm using three questions from the CRQ-SAS following a rigorous statistical method that can help clinicians to forecast risk of hospitalization and increase our portfolio of methods to determine hospitalization risk, an event associated with poor prognosis and mortality.17

We identified important outcomes in COPD – fear of breathlessness, dyspnea with activities of daily living, and depressive symptoms (Figure 1) – that have been previously reported with an increased risk of hospitalization.14,18–20 Importantly, we defined specific cut points (a defined score for each question) that made them simple for interpretation and definition of risk.

We identified a simple way to test the construct of fear of breathlessness in COPD that is associated with hospitalizations. The construct of fear has been shown to have an impact on disease disability in COPD.21 Specific measures of the construct of fear to use in daily care are lacking, but currently existing measures have been reported to be predictive of COPD-treatment outcomes after controlling for general anxiety.22 Disease-specific fear is defined as anxiety in the face of severe physical symptoms and their consequences.23 Keil et al showed in 2011 the importance of specific fears in the context of COPD and their association with disability.21 Our study supports the hypothesis of Keil et al feeling fear or panic due to shortness of breath was the most predictive question in our algorithm: a 57% risk of hospitalization.

Our results, which further emphasize the importance of symptoms of depression and anxiety (fear), have profound consequences for the health of patients with COPD. Anxiety (fear) is associated with increased risk of exacerbations, poorer health-related QoL, worse physical activity19 relapse within 1 month of receiving emergency treatment,24 and hospital readmission.25 Depression is associated with increased mortality, impaired health-related QoL, and excessive health-care-utilization rates and costs, including longer hospital stay after acute exacerbation,20 increased risk of exacerbation and hospital admission,26 hospital readmission,27 and lower physical activity.28

We support and extend previous reports about the impact emotions (anxiety and depression) have on health care utilization (in addition to physical functioning and QoL).19,29,30 GOLD has recently highlighted the importance of effective screening and management of anxiety and depression.14 Furthermore, gathering patient-reported outcome data regarding sensitive issues, such as fear and depression, from a questionnaire rather than through a personal and potentially difficult conversation has been seen to elicit information that a patient may not be willing to verbalize to a health care provider.31,32

Our findings also extend previous reports suggesting that individual items within questionnaires can be as sensitive, if not more sensitive, than the overall scores and content of larger questionnaires to forecast specific outcomes.33,34 Furthermore, items drawn from general questionnaires have been demonstrated to be useful indicators for more refined clinical interventions.35 The overall measures and longer questionnaires remain useful tools, but by looking at the psychometrics of individual items we can capitalize on the most clinically relevant information.

We followed a strict psychometric approach with multiple sensitivity analyses via alternative analytical approaches and bootstrapping resampling sets of 1,000 patients. Further application of our algorithm is needed to validate its clinical utility and generalizability. The algorithm is intended to be a supplementary source of information that the clinician can incorporate into their personal assessment of the patient that can impact the monitoring and care plan for the patient. Importantly, the algorithm incorporates patient-reported information that has not been used routinely or systematically in clinical practice. Current algorithms in the area of COPD care have prognostic characteristics that are similar to what we have produced. The body mass, obstruction, dyspnea, and exercise capacity index that has universal application in clinical practice have an area under the curve of 0.74, which is comparable to the area under the curve of 0.70 obtained for our algorithm.36

Our group previously showed that a single item measuring QoL was actually more informative and sensitive to change than longer scales purported to measure the same thing.37 Specifically, in COPD we initially reported that a single general question on health status is independently associated with the risk of hospitalization.18

Limitations

The retrospective health-care-utilization measure (history of a hospitalization in the last year) can be viewed as a limitation. However, a recent report from the ECLIPSE group38 has clearly shown a very strong association between a hospitalization in the previous year and hospitalization in the subsequent year, supporting the validity of the measure used in this study.

There are (undoubtedly) more variables involved to accurately predict individualized risk for hospitalization (a previous hospitalization and GOLD risk assessment); our results provide a simple screening tool to identify a subset of the population that might benefit from closer monitoring, specific therapies, or even palliative care. In particular, the data indicate that if a patient perceives fear related to breathlessness, their risk of hospitalization doubles from a mean value of 30% in the COPD-severe population to approximately 50%.39 This allows the limited resources available to the clinical team to be directed to patients who are more likely to be hospitalized.

This algorithm to identify patients at higher risk of hospitalization will have false positives and negatives; however, it is not intended as a diagnostic laboratory test, but a supplementary source of information for the clinician.

Conclusion

We created a simple algorithm following a very robust statistical method that may become informative to the practicing clinician to forecast the risk of hospitalization in COPD patients. We identified clinically relevant constructs (fear of breathlessness, significant dyspnea with activities of daily living, and depressive symptoms) embedded in the CRQ questionnaire that are independently associated with hospitalization risk. Our work is not implying that we have a better way to predict hospitalization, but an alternative way to augment our accuracy in forecasting the risk of hospitalization and the opportunity to provide our patients the most individualized and precise care possible.