The Relationship between Patient Satisfaction with Service Quality and Survival in Non-Small Cell Lung Cancer - Is Self-Rated Health a Potential Confounder?

BACKGROUND/AIMS: Previously we reported that higher patient satisfaction (PS) with service quality is associated with favorable survival outcomes in a variety of cancers. However, we cautioned the readers that patients with greater satisfaction might be the ones with better self-rated health (SRH), a well-established prognosticator of cancer survival. In other words, SRH could potentially confound the PS and survival relationship. We investigated this hypothesis in non-small cell lung cancer (NSCLC).
METHODS: 778 NSCLC patients (327 males and 451 females; mean age 58.8 years) treated at 4 Cancer Treatment Centers of America hospitals between July 2011 and March 2013. PS was measured on a 7-point scale ranging from "completely dissatisfied" to "completely satisfied". SRH was measured on a 7-point scale ranging from "very poor" to "excellent". Both were dichotomized into 2 categories: top box response (7) versus all others (1-6). Patient survival was the primary end point. Cox regression was used to evaluate the association between PS and survival controlling for covariates.
RESULTS: 74, 70, 232 and 391 patients had stage I, II, III and IV disease respectively. 631 (81.1%) patients were "completely satisfied". 184 (23.7%) patients had "excellent" SRH. There was a weak but significant correlation between overall PS and SRH (Kendall's tau b = 0.19; p<0.001). On univariate analysis, "completely satisfied" patients had a significantly lower risk of mortality (HR = 0.75; 95% CI: 0.57 to 0.99; p = 0.04). Similarly, patients with "excellent" SRH had a significantly lower risk of mortality (HR = 0.61; 95% CI: 0.46 to 0.81; p = 0.001). On multivariate analysis controlling for stage at diagnosis, treatment history and gender, SRH was found to be a significant predictor of survival (HR = 0.67; 95% CI: 0.50 to 0.89; p = 0.007) while PS was not (HR = 0.86; 95% CI: 0.64 to 1.2; p = 0.32). Among the individual PS items, the only significant independent predictor of survival was "teams communicating with each other concerning your medical condition and treatment" (HR = 0.59; 95% CI: 0.36 to 0.94; p = 0.03).
CONCLUSION: SRH appears to confound the PS-survival relationship in NSCLC. SRH should be used as a control/stratification variable in analyses involving PS as a predictor of clinical cancer outcomes.

Introduction

Over the past two decades, patient-reported metrics such as self-rated health (SRH) and patient satisfaction (PS) with service quality have been increasingly used as important endpoints in cancer along with traditional endpoints of tumor response and survival. PS aims to assess the extent to which an individual's health care experiences match his or her expectations and provides important data concerning the quality of care and treatment delivered by physicians, paramedical staff and the hospital as a whole [1]. The assessment of PS in an oncology setting is particularly salient where patients are subjected to increasingly complex treatments, exhaustive follow-ups, and numerous visits to hospital [2]. On the other hand, SRH is a multidimensional construct that includes physical, social, psychological and functional domains and provides information about the impact of the disease and its treatment on multiple patient parameters that can aid physicians in selecting and managing antineoplastic and supportive therapy [3;4].

There are extensive data in the literature demonstrating that pretreatment SRH can predict survival in several different types of cancers independent of the extent of the disease and other clinical prognostic factors [5-18]. More recently, we have reported that higher PS with service quality is associated with favorable survival outcomes in a variety of cancers including breast, colorectal and non-small cell lung [19-21]. However, while discussing our results, we cautioned the readers that patients with greater satisfaction with service quality might be the ones with better self-rated SRH, a well-established prognosticator of cancer survival. Concurrently, several recently published studies have indicated a possible link between SRH and PS in cancer [22-29].

Collectively, the above observations indicate that self-rated SRH might potentially confound the PS and survival relationship in cancer. However, to the best of our knowledge, no studies in the literature have explored this hypothesis in an oncologic setting. Understanding the interrelationships between SRH, PS and survival can have important implications in interpreting the results of studies that report on these measures within the context of cancer survival. The goal of this study, which is a sequel to our previously published research cited above, was to investigate if SRH is a potential confounder of the relationship between PS with service quality and survival in patients with non-small cell lung cancer (NSCLC) undergoing treatment at a national network of oncology hospitals.

Methods

Study Population

All NSCLC patients who were seen in consultation at one of four Cancer Treatment Centers of America (CTCA) hospitals between July 2011 and March 2013, who elected to have treatment at CTCA and who had not responded to a PS questionnaire within the preceding 60 days of treatment were eligible for this study. The four CTCA hospitals were CTCA Eastern, CTCA Midwestern, CTCA Southwestern and CTCA Western. The final surveyed cohort included a total of 778 patients. This study was approved by the Institutional Review Board (IRB) at CTCA. The need for informed consent was waived by the IRB because there was no direct patient contact in this study. No written informed consent was given by participants for their clinical records to be used in this study. This study involved collection of existing data from patient records in such a manner that subjects cannot be identified, directly or through identifiers linked to the subjects. Patient records/information was anonymized and de-identified prior to analysis.

Questionnaire

The PS questionnaire used in this study was first implemented at our institution in August 2006. The instrument was developed based on input obtained from patient focus groups, and survey dimensions were collated from several existing studies or questionnaires of oncology patients [30-33]. This PS questionnaire covers the following dimensions: hospital operations and services, physicians and staff, and patient endorsements for others (friends and associates). The questionnaire was administered by trained survey associates at each CTCA hospital during a treating patient's visit. Eligible patients were typically contacted while they were waiting for various appointments. The survey was paper-based and was completed by the patient and returned during that same visit at designated locations at each CTCA hospital. The survey was not anonymous because the survey data were linked with the electronic health records to create a comprehensive dataset which was anonymized and de-identified prior to analysis.

The questionnaire included PS items on: team giving you the information you need to understand your medical condition, team explaining your treatment options, team involving you in decision making as much as you preferred, teams communicating with each other concerning your medical condition and treatment, care manager’s effectiveness in helping with your care when you are at home, team treating you with respect and in a professional manner, the response/call back from scheduling after you have left a message, waiting time for appointments and satisfaction with the treating medical oncologist (patient’s primary physician). The questionnaire contained one overall PS item measured using the following question: “considering everything, how satisfied are you with your overall experience with the institution?” The questionnaire also contained one overall self-rated health (SRH) item measured using the following question: “how would you rate your overall health during the last week?” This questionnaire has not been validated previously.

Statistical Analysis

Patient survival was the primary end point, and was defined as the time interval between the date a patient first returned the patient survey and the date of patient’s death from any cause or the date of last contact/last known to be alive. The overall PS item was used as the primary independent variable in this study along with 9 individual PS items. All PS items were measured on a 7-point scale ranging from “completely dissatisfied” to “completely satisfied.” The overall SRH item was used as the main study covariate/confounder. It was measured on a 7-point scale ranging from “very poor” to “excellent.” Because of skewed data distributions, both PS and SRH items were dichotomized into two categories for the purpose of this analysis: top box response (7) versus all others (1–6). Other control variables investigated for their relationship with survival were gender, prior treatment history, stage at diagnosis, age and CTCA hospital. The prior treatment history variable categorized patients into those who had received definitive cancer treatment elsewhere before coming to CTCA and those who were newly diagnosed at CTCA. The stage at diagnosis variable was dichotomized into metastatic (stage IV) and non-metastatic disease (stages I-III). For CTCA hospital, dummy variables were created with CTCA Western as the reference category.

The overall survival was calculated using the Kaplan-Meier method. Univariate Cox proportional hazards models were used to determine which variables showed individual prognostic value for survival. Multivariate Cox proportional hazards models were then performed to evaluate the joint prognostic significance of all variables significant on univariate analysis. We used both block entry method (all variables entered together at the same time in one block) as well as the forward stepwise method. Forward stepwise method was used because, as is common in PS data, many of the individual items are highly correlated. Stepwise regression avoids the problem of multicollinearity because two highly correlated attributes will normally not both be entered in the model. Since ‘overall PS’ is highly correlated with other individual PS items, it was not included in multivariate Cox analyses when other PS items were used, in order to achieve model stability. Instead, “overall PS” was analyzed separately after adjusting for clinical and demographic factors. The effect of individual variables on patient survival was expressed as hazard ratios (HRs) with 95% confidence intervals (CIs).

Cox regression with time-invariant covariates assumes that the ratio of hazards for any two groups remains constant in proportion over time. We checked this assumption by examining log-minus-log plots for categorical predictors. For continuous predictors, this assumption was checked using an extended Cox model with time-dependent covariates. Potential multicollinearity was assessed in two steps. Large values (> 0.70) of Kendall’s tau b correlation coefficient were used as an initial screen for pairs of PS measures. Kendall’s tau b is an appropriate measure of association for categorical variables and is commonly used when both variables have the same number of categories. As a second check, the variance inflation factor (VIF) was used with the final model to verify that multicollinearity was not significantly influencing model coefficients [34;35].

All data were analyzed using IBM SPSS version 20.0 (IBM, Armonk, NY, USA). A difference was considered to be statistically significant if the p value was less than or equal to 0.05.

Results

Response Rate

A total of 1,111 returning NSCLC patients were contacted at all four hospitals combined to participate in the survey between July 2011 and March 2013. However, only 778 patients responded. As a result, the response rate for this study was 70%.

Baseline Patient Characteristics

displays baseline patient characteristics of the entire study population (N = 778). At the time of this analysis (June 2014), 317 (40.7%) patients had expired. A majority of the patients were newly diagnosed at our institution and had advanced stage (III or IV) disease at diagnosis. The median time duration between the date first seen at CTCA and the date of PS survey was 5 months. describes the distribution of PS items. 631 (81.1%) patients were “completely satisfied” with the overall service quality they received. The highest levels of dissatisfaction were observed for the following 3 individual PS items in terms of percent “not completely satisfied”: waiting time for appointments (32.7%), the response/call back from scheduling after you have left a message (23.5%) and care manager’s effectiveness in helping with your care when you are at home (20.7%). 184 (23.7%) patients had “excellent” SRH.

Correlation Analysis

displays Kendall’s tau b correlation coefficients among the PS items and SRH. The correlations among the PS items were weak to strong (ranging from 0.23 to 0.74) and all were statistically significant at the 0.01 level. The correlations between SRH and PS items were weak (ranging from 0.13 to 0.19) but statistically significant at the 0.01 level.

Univariate Analysis—Predictors of Patient Survival

On Kaplan-Meier analysis, median overall survival for the entire patient cohort was 14.4 months (95% CI: 12.7–16.1 months). The median survival for “completely satisfied” patients and “not completely satisfied” patients was 14.9 and 11.9 months respectively, log-rank p = 0.04. The median survival for patients with “excellent SRH” and those with “not excellent SRH” was 19.7 and 12.5 months respectively, log-rank p = 0.001. As shown in , the individual PS items that were significantly predictive of survival on univariate Cox regression analysis were: “team giving you the information you need to understand your medical condition”, “team explaining your treatment options”, “team involving you in decision making as much as you preferred”, “teams communicating with each other concerning your medical condition and treatment”, “care manager’s effectiveness in helping with your care when you are at home”, “team treating you with respect and in a professional manner” and “the treating medical oncologist”. In addition, the overall PS item was also significantly predictive of survival. Among the patient characteristics, SRH, prior treatment history, stage at diagnosis and gender were significant predictors of survival.

Multivariate Analysis—Predictors of Patient Survival

Before proceeding with multivariate analysis, we checked the bivariate Kendall’s tau b correlation among the PS items in order to screen for observable multicollinearity. “Team explaining your treatment options” was highly correlated with 3 other PS items: “team giving you the information you need to understand your medical condition” (tau b = 0.74; p<0.001), “team involving you in decision making as much as you preferred” (tau b = 0.69; p<0.001) and “teams communicating with each other concerning your medical condition and treatment” (tau b = 0.70; p<0.001). As a result, “team explaining your treatment options” was not considered further in multivariate analysis. We also found a weak but significant correlation between overall PS and SRH (tau b = 0.19; p<0.001).

displays the results of the multivariate Cox regression for the following two models: “Model I” investigated 6 individual PS items controlling for SRH, stage at diagnosis, prior treatment history and gender. “Model II” investigated the overall PS item controlling for SRH, stage at diagnosis, prior treatment history and gender. In “Model I,” only 1 PS item “teams communicating with each other concerning your medical condition and treatment” reached statistical significance. displays the adjusted survival curves for the two categories of this item. Stage at diagnosis, prior treatment history, gender and SRH were all found to be statistically significant. In “Model II,” the item pertaining to overall PS lost its statistical significance whereas SRH, stage at diagnosis, prior treatment history and gender retained their statistical significance from univariate analysis. displays the adjusted survival curves for the two categories of SRH after controlling for overall PS, stage at diagnosis, prior treatment history and gender. The SRH curves were significantly different from each other (p = 0.007). displays the adjusted survival curves for the two categories of overall PS after controlling for SRH, stage at diagnosis, prior treatment history and gender. The PS curves were not significantly different from each other (p = 0.32).

The results of both models were confirmed using the forward stepwise approach. VIF values for the PS measures ranged from 1.3 to 2.4, none of which indicates a significant problem with multicollinearity [34;35]. There was no evidence of non-proportional hazards in the multivariate models presented.

Discussion

We investigated the association between PS with service quality and survival after adjusting for the effects of SRH in NSCLC patients treated in an acute care national oncology hospital network. There are a few key findings of this study that require careful consideration.

The univariate findings of this study suggest that patients completely satisfied with their service quality experience better survival outcomes compared to those who are not. However, after controlling for the effects of SRH in multivariate models, the relationship between PS and survival was rendered non-significant. On the other hand, SRH was found to be an independent predictor of survival in multivariate analysis after controlling for PS. This finding coupled with the observation that PS and SRH were significantly correlated (albeit weakly) suggests that SRH is a potential confounder of the relationship between PS with service quality and survival in NSCLC. As a result, we propose that future studies involved in the collection and analysis of PS data should additionally collect information on SRH for more meaningful interpretation of their results. SRH should be an important stratification variable to consider when analyzing the data on PS in oncology.

Patients know better than anyone how they are feeling, and when patients report feeling less than in excellent health, this can be a sign that their disease is not responding well to treatment, or its associated side effects. Without clinical measures of treatment efficacy, these results also suggest that SRH is a reasonable proxy, since it has an independent effect on survival of the same order of magnitude as disease stage. This finding of a positive relationship between SRH and survival in oncology has been extensively reported in the literature over the last 2 decades [5-18]. Similarly, the finding of a positive relationship between PS and SRH has been recently reported in a few studies [22-29]. However, what is unique about this study is the fact that we have systematically and concurrently analyzed these inter-relationships in an oncology setting using survival as the primary endpoint.

Interestingly, we found the PS item “teams communicating with each other concerning your medical condition and treatment” was an independent predictor of survival in multivariate analysis such that patients who were completely satisfied with this measure had 41% lesser risk of mortality compared to those who were not completely satisfied after controlling for the effects of other PS items, SRH and clinical and demographic factors. Coordinated care is known to be important when treating complex conditions such as NSCLS [21], and better care should lead to longer survival. This finding suggests that patients can accurately assess whether they are receiving such care, as their perceived satisfaction with team communication was correlated with greater survival, after controlling for other factors. Asking patients about their care is a reasonable proxy for direct measurements of teamwork and care coordination, and can be used as a trigger for the patient care team to review its efforts.

In contrast, the PS items “team giving you the information you need to understand your medical condition” and “team involving you in decision making as much as you preferred” were significant in the univariate model, but not the multivariate. This difference can be understood with reference to critical and non-critical elements in care. Patients should be fully informed about their medical condition and involved in decision making, but even when this doesn’t occur, treatment can be effective if patients follow a recommended treatment program. However, care that is not coordinated can be less effective and so the item on team communication can have a significant relationship with survival as observed in this study.

Patient satisfaction, which is often assessed by heath care organizations, may be viewed as a useful, if imprecise, indicator of prognosis in NSCLC patients, whether that association be due to improved general health, more positive emotions, or a combination of these. Although clinical indicators of prognosis are primary, these findings suggest that health care providers pay close attention to those patients who are less than completely satisfied during treatment. Doing so and alleviating any readily remedied causes of dissatisfaction may improve patient commitment to treatment protocols and secondary factors such as adequate nutrition.

We acknowledge several limitations of this study. The patient cohort was limited to only those patients who spoke English, so this study sample is, therefore, not broadly representative of NSCLC patients in general. Further, our study, which is exploratory by nature, used a non-validated questionnaire measuring PS and SRH. We were not able to control for patient co-morbidities due to lack of relevant data. Given that co-morbidities are significantly associated with patient survival, lack of adjustment for them leaves room for residual confounding in our analysis. Finally, we could not perform a comparison of baseline characteristics between responders and non-responders since we did not have any information available on non-responders. Since responders can differ from non-responders with regard to certain baseline demographic and clinical characteristics, the possibility of selection bias affecting our results cannot be ruled out. The strengths of our study include: a large sample size, a good response rate of 70%, the fact that we measured PS and SRH as close to the time service was delivered as possible, and the fact that we used patient survival (the most objective and most commonly used health outcome measure in oncology) as our dependent variable. To the best of our knowledge, this study is the first in the health care literature to report on the association between PS with service quality and survival controlling for the confounding effects of SRH in a large sample of NSCLC patients.

Conclusion

In conclusion, SRH appears to confound the PS-survival relationship in NSCLC. SRH should be used as a control variable in analyses involving PS as a predictor of clinical cancer outcomes.

Table 1

Baseline Patient Characteristics.

Variable	Categories	Number (Percent)
Age at the time of first survey	Mean	58.8
	Median	58.9
	Range	31–94
Gender	Males	327 (42)
	Females	451 (58)
CTCA Hospital	Midwestern	311 (40)
	Southwestern	191 (24.5)
	Eastern	210 (27)
	Western	66 (8.5)
Stage at diagnosis	Stage I	74 (9.5)
	Stage II	70 (9)
	Stage III	232 (29.8)
	Stage IV	391 (50.3)
	Indeterminate	11 (1.4)
Treatment History	Newly Diagnosed	521 (67)
	Previously Treated	257 (33)

(CTCA = Cancer Treatment Centers of America)

Table 2

Distribution of Patient Satisfaction Items.

How satisfied are you in the following areas:	Completely Satisfied
Team giving you the information you need to understand your medical condition (n = 764)	635 (83.1)
Team explaining your treatment options (n = 759)	629 (82.9)
Team involving you in decision making as much as you preferred (n = 755)	648 (85.8)
Teams communicating with each other concerning your medical condition and treatment (n = 759)	615 (81)
Care manager’s effectiveness in helping with your care when you are at home (n = 704)	558 (79.3)
Team treating you with respect and in a professional manner (n = 760)	716 (94.2)
The response/call back from scheduling after you have left a message (n = 732)	560 (76.5)
Waiting time for appointments (n = 753)	507 (67.3)
Treating medical oncologist (n = 755)	680 (90.1)

• Items were dichotomized into two groups of “completely satisfied (7)” and “not completely satisfied (1–6)”

• Some sample sizes are less than 778 because of missing responses

Table 3

Correlation Analysis of Patient Satisfaction Items with Self-Rated Health.

Kendall’s tau b	Overall Satisfaction	Medical Oncologist	Information	Explaining Treatment	Involvement in Decisions	Team Communication	Help with Home Care	Respectful Treatment	Scheduling	Waiting Time	Overall Health
Overall Satisfaction	1.0
Medical Oncologist	.55	1.0
Information	.55	.48	1.0
Explaining Treatment	.52	.45	.74	1.0
Involvement in Decisions	.47	.45	.57	.69	1.0
Team Communication	.50	.46	.69	.70	.67	1.0
Help with Home Care	.48	.46	.54	.53	.56	.58	1.0
Respectful Treatment	.43	.44	.47	.42	.43	.49	.41	1.0
Scheduling	.39	.28	.36	.33	.34	.38	.40	.28	1.0
Waiting Time	.36	.29	.36	.37	.34	.42	.38	.23	.54	1.0
Overall Health	.19	.17	.18	.16	.15	.17	.15	.13	.14	.16	1.0

• ll c All correlations were significant at the 0.01 level

Table 4

Univariate Cox Regression Analysis.

Variable	HR	95% CI	P-value
Individual PS Items
Team giving you the information you need to understand your medical condition	0.69	0.52 to 0.91	0.009*
Team explaining your treatment options	0.56	0.42 to 0.73	<0.001*
Team involving you in decision making as much as you preferred	0.59	0.44 to 0.79	<0.001*
Teams communicating with each other concerning your medical condition and treatment	0.60	0.46 to 0.78	<0.001*
Care manager’s effectiveness in helping with your care when you are at home	0.59	0.46 to 0.77	<0.001*
Team treating you with respect and in a professional manner	0.60	0.39 to 0.93	0.02*
The response/call back from scheduling after you have left a message	0.79	0.61 to 1.02	0.07
Waiting time for appointments	0.82	0.65 to 1.04	0.10
Treating medical oncologist	0.58	0.41 to 0.82	0.002*
Overall PS Item
Overall patient satisfaction with the institution	0.75	0.57 to 0.99	0.04*
Patient Characteristics
Overall self-rated health (“not excellent” as referent)	0.61	0.46 to 0.81	0.001*
Treatment History (newly diagnosed as referent)	1.6	1.3 to 2.0	<0.001*
Stage at diagnosis (stages I-III as referent)	1.7	1.3 to 2.1	<0.001*
Age at first survey (used as a continuous variable)	0.99	0.98 to 1.01	0.78
Gender (males as referent)	0.74	0.59 to 0.92	0.007*
CTCA Hospital (overall effect)			0.08
Midwestern versus Western	2.0	1.1 to 3.4	0.02*
Southwestern versus Western	1.7	0.95 to 3.0	0.08
Eastern versus Western	2.0	1.1 to 3.5	0.02*

(CTCA = Cancer Treatment Centers of America, PS = Patient Satisfaction, HR = Hazard Ratio, CI = Confidence Interval)

• *P <0.05

• Individual and overall PS iems were dichotomized into two categories: “completely satisfied” (7) and “not completely satisfied” (1–6). “Not completely satisfied” was the referent group.

• Self-rated health was dichotomized into two categories: “excellent” (7) and “not excellent” (1–6). “Not excellent” was the referent group.

Table 5

Multivariate Cox Regression Analysis.

Variable	HR	95% CI	P-value
Model I: Individual PS Items
Team giving you the information you need to understand your medical condition	1.4	0.86 to 2.2	0.18
Team involving you in decision making as much as you preferred	1.1	0.67 to 1.7	0.76
Teams communicating with each other concerning your medical condition and treatment	0.59	0.36 to 0.94	0.03*
Care manager’s effectiveness in helping with your care when you are at home	0.77	0.53 to 1.1	0.16
Team treating you with respect and in a professional manner	1.1	0.60 to 1.9	0.87
Treating medical oncologist	0.91	0.58 to 1.4	0.69
Overall self-rated health (“not excellent” as referent)	0.61	0.44 to 0.85	0.003*
Treatment History (newly diagnosed as referent)	1.6	1.2 to 2.0	<0.001*
Stage at diagnosis (stages I-III as referent)	1.7	1.3 to 2.1	<0.001*
Gender (males as referent)	0.68	0.54 to 0.86	0.001*
Model II: Overall PS Item
Overall patient satisfaction with the institution	0.86	0.64 to 1.2	0.32
Overall self-rated health (“not excellent” as referent)	0.67	0.50 to 0.89	0.007*
Treatment History (newly diagnosed as referent)	1.6	1.3 to 2.0	<0.001*
Stage at diagnosis (stages I-III as referent)	1.8	1.4 to 2.3	<0.001*
Gender (males as referent)	0.69	0.55 to 0.86	0.001*

• (PS = Patient Satisfaction, HR = Hazard Ratio, CI = Confidence Interval)

• *P <0.05

• Individual and overall PS items were dichotomized into two categories: “completely satisfied” (7) and “not completely satisfied” (1–6). “Not completely satisfied” was the referent group.

• Self-rated health was dichotomized into two categories: “excellent” (7) and “not excellent” (1–6). “Not excellent” was the referent group.

• Model I investigates the individual PS items controlling for self-rated health, stage at diagnosis, prior treatment history and gender.

• Model II investigates the overall PS item controlling for self-rated health, stage at diagnosis, prior treatment history and gender.