Impact of patient characteristics on the Canadian Patient Experiences Survey-Inpatient Care: survey analysis from an academic tertiary care centre.

OBJECTIVE: To determine the role of patient demographics, care domains and self-perceived health status in the analysis and interpretation of results from the Canadian Patient Experience Survey-Inpatient Care.
DESIGN: Cross-sectional survey.
SETTING: Single large Canadian two campus tertiary care academic centre. PARTICIPANTS: Random sampling of hospital patients postdischarge. INTERVENTION AND MAIN OUTCOME MEASURES: Logistic regression models were developed to analyse topbox scoring on four questions of global care (rate experience, recommend hospital, rate hospital, overall helped). Means of each composite domain were correlated to the four overall scores at the patient level to determine Spearman's rank correlation coefficients which were plotted against the overall (hospital) domain score for the key driver analysis.
RESULTS: Topbox scoring was decreased with worse degrees of perceived physical and mental health in all four global questions (p<0.05). Female gender and higher levels of education were associated with worse scoring on rate experience, recommend hospital and rate hospital (p<0.001). Whereas there was a significant difference between hospital departments in unadjusted measures, these differences were no longer evident after adjustment with patient covariates. Key driver analysis identified person-centred care, care transition and the domain related to emergency admission as areas of highest potential for improvement.
CONCLUSIONS: Global measures of overall care are influenced by patient-perceived physical and mental health. Caution should be exercised in using patient-satisfaction surveys to compare performance between different healthcare provision entities, as apparent differences could be explained by variation in patient mix rather than variation in performance. © Author(s) (or their employer(s)) 2018. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

This study involves the novel linkage of a clinical database to individual survey results to allow the accurate analysis of the role of patient characteristics and demographics on survey response.

The study provides a validated process by which covariates could be used to adjust patient experience survey outcomes to facilitate interunit and interinstitution comparisons.

The analysis has been completed on data from a single institution and thus the generalisability is not known.

This study is limited by survey non-responders and the random nature of survey participants among the total discharge population from the hospital.

Introduction

Patient experience is now recognised as a critical component of modern healthcare delivery.1 Aside from the clear rationale to routinely provide compassionate care, there exists a strong ethical basis for physicians to support excellence in this area as it is of vital interest to patients and governments as a foundation of patient-centred medicine.2 There is also supportive evidence that improved patient experience may positively impact outcomes,1 3 particularly through better compliance to evidence-based guidelines, such as in areas of chronic disease management.4

There are many different processes by which inpatient patient experience has been measured internationally.5–8 In the USA, it is measured using the Hospital Consumer Assessment of Health Care Provider Systems (HCAHPS) survey.9 Hospital funding from Medicare is partially dependent on the results from this survey, and thus, healthcare organisations are deeply committed to improving results. A modification of the HCAHPS survey (Canadian Patient Experience Survey–Inpatient Care, CPES-IC) was developed through collaboration between the Canadian Institute for Health Information (CIHI), Accreditation Canada, the Canadian Patient Safety Institute, the Change Foundation and the Inter-Jurisdictional Patient Experience Group, and this survey is now routinely administered in four provinces in Canada.10

Though the HCAHPS and the CPES-IC are very similar, there are subtle differences that reflect the unique nature of the single-payer system in Canada. The CPES-IC survey consists of 22 questions derived from the HCAHPS as well as other questions that ‘address key areas relevant to the Canadian context’. The questions can be classified in three specific groups. In the first group, individual questions can be clustered as they reflect care in particular domains such as doctor communication skills (three questions) and nursing communication skills (three questions) among others. The Canadian survey includes the same domains as the HCAHPS, but also comprises several questions that constitute new domains not addressed in the HCAHPS survey such as admission experience, person-centred care, discharge and transition. Further details regarding differences between the Canadian and American surveys are available on the CIHI website (https://www.cihi.ca/en/patient-experience).

The composite questions for each domain can be averaged to provide a mean value which is currently reported at the hospital level for the HCAHPS survey.11 In the second group, there are four questions that reflect overall care that are of particular importance at the institutional level to assess the quality of patient experience. One of these questions is also used as a corporate measure of key interest (‘Rate your experience?’), and it is most commonly used to rank hospitals nationally after adjustment for regional differences.3 Results from the three other questions related to overall care include: ‘Would you recommend this hospital to your friends and family?’ (recommend hospital) and ‘Using any number from 0 to 10, where 0 is the worst hospital possible and 10 is the best hospital possible, what number would you use to rate this hospital during your stay?’ (rate hospital) and ‘Overall, do you feel you were helped by your hospital stay?) (overall helped). Success in these and other questions are measured by the per cent of ‘topbox’ designation by the patients in which they have ranked a 4 on the recommend hospital question (on a scale of 1–4) or 9 or 10 out of an ordinal scale of 10 for the remaining three questions. The ‘topbox’ metric has been validated and accepted as a marker of excellence in patient experience measurement.12

The final group of questions found in both surveys consists of inquiries regarding patient-perceived health status and demographic topics such as race and education. These questions are referred to a Patient Mix Adjusters (PMA), and they are used in the HCAHPS survey in order to provide risk adjustment, particularly when comparing between geographic regions. The PMA questions for the HCAHPS are reassessed quarterly by the Centers for Medicare and Medicaid Services (CMS) after reviewing national results.

There is limited familiarity in the assessment of patient experience in Canada and the use of such surveys. Although it has been demonstrated that patient sociodemographic factors such as age, ethnicity, sex and socioeconomic class have been shown to influence patient experience responses,13 there is also no understanding of the validity of the PMA questions in adjusting the results of the CPES-IC survey and how they may contribute to credibly compare units or departments within a hospital. In summary, it is not clear how patient factors such as self-described characteristics including perception of mental and physical health, patient demographics and comorbidities impact the results of the Canadian survey on in-hospital patient experience.

The overall objective of this research was to compare the value of the self-described patient characteristics obtained from the survey with covariates obtained from a hospital database, in the development of a statistical model to predict topbox scoring in the four survey questions related to overall care: (a) rate your experience, (b) recommend hospital, (c) rate hospital, (d) overall helped. We also sought to assess how the PMA questions and other data from the hospital database influence patient experience at the hospital and departmental level and to determine how the composite domain measurements influence the four adjusted global measurements.

Methods

This analysis was conducted as a quality assurance project. Data were collected from 1 April 2016 to 30 November 2016 from the CPES-IC Survey (see online supplementary appendix 1) administered by National Research Corporation (NRC; Markham, Ontario). Surveys were distributed in both official languages.

Patient and public involvement

There was no patient or public involvement in this research in terms of development, design or analysis.

The data were merged with administrative data collected from The Ottawa Hospital Data Warehouse which is a relational database that contains administrative and clinical data for all patients seen at The Ottawa Hospital. Deciles of income class were derived using the Postal Code Conversion File V.6.6 based on data from August 2015 (Statistics Canada). The Elixhauser class was derived using a modification of the Elixhauser comorbidity measure after applying the latter to the hospital data.14 The occurrence of a patient safety indicator event (ie, an in-hospital adverse event) was determined using International Classification of Diseases 10th Revision coding from administrative data.15

The Ottawa Hospital is a large academic tertiary care teaching centre with two inpatient campuses. There are six admitting departments (surgery/ear, nose, and throat (ENT), medicine, obstetrics/gynaecology, family medicine, ophthalmology and psychiatry). A different survey was used in psychiatry and obstetrics, thus these patients were excluded. Ophthalmology was excluded as it is primarily an outpatient service and accounts for less than 1% of admissions. Data from one surgical division (cardiac surgery) and one medical division (cardiology) were not available as administrative data were not linkable to the patient experience data from NRC due to a differing collection and analysis process. Patients who died prior to discharge were excluded from analysis.

Composite domains were identified as follows: communication with doctors (questions 5–7), communication with nurses (questions 1–3), responsiveness of staff (questions 4, 11), communication of medications (questions 16, 17), transition of care (37–39), person-centred care (30–36), direct admission (questions 24, 25) and emergency admission (26–29). The mean was calculated for each patient for each domain as long as more than 50% of the questions in the domain were reported.16 Spearman’s rank correlation coefficients were determined for the continuous value of each domain and the ordinal global question score, and this was plotted against the overall (hospital) domain score for the key driver analysis.17 The median value of the domain scores was used for the vertical separation of the quadrants due to skewness. Points identified in quadrant 1 represent domains with increased potential for improvement due to high correlation with a global score and lower mean value.

Statistical analyses

Patient characteristics across department groups were compared using a χ2 test.

Distribution normality of covariates was tested using the Shapiro-Wilk test.

For categorical variables with equal variances, one-way analysis of variance was used to compare departments, whereas Kruskal-Wallis equality of populations rank test was used for categorical groups with unequal variances.

Multivariable logistic models were developed to test the primary outcomes from the overall care questions ((a) rate experience, (b) recommend hospital, (c) rate hospital, (d) overall helped) reported as dichotomous outcomes representing ‘topbox’ response (9 or 10) or no topbox (<9). The association of each covariate was assessed using likelihood ratio tests by testing the model with and without the variable. Marginal means were determined for each department using the derived model with all of the covariates, as well as with no covariates (unadjusted). In order to compare departments, a Bonferroni correction was used for multiple pairwise comparisons. A p value of <0.05 was considered significant. Analyses were completed using STATA V.14.2.

Results

Patient characteristics

There were 2989 patients who responded to the survey representing hospital admissions under the care of 295 physicians (146 medicine, 110 surgery/ENT, 22 family, 17 obstetrics/gynaecology.). The institution consists of 918 in-hospital beds, geographically situated at two campuses. Characteristics of the patients from the total group and from each department are presented in table 1. There were significant differences between the department groups in terms of physical and mental health, Elixhauser class, admission status, length of stay, age, discharge disposition, marital status and sex.

Table 1

Characteristics of patients answering patient experience survey

	Total (n=2989)	Surgery (n=1699)	Medicine (n=1023)	Family medicine (n=79)	Obs/gyn (n=95)	P values
Physical health, n (%)						<0.001
Excellent	272 (9.3)	210 (12.4)	45 (4.4)	4 (5.1)	11 (11.5)
Very good	812 (27.7)	583 (34.3)	166 (16.2)	8 (10.1)	46 (48.4)
Good	1008 (34.3)	612 (36.0)	328 (32.1)	37 (46.8)	22 (23.2)
Fair	616 (21.0)	243 (14.3)	329 (32.2)	19 (24.1)	14 (14.7)
Poor	227 (7.7)	51 (3)	155 (15.2)	11 (13.9)	2 (2.1)
Mental health, n (%)						<0.001
Excellent	705 (24.0)	484 (28.5)	180 (17.5)	10 (12.8)	23 (29.2)
Very good	1036 (35.3)	636 (37.5)	323 (31.5)	25 (32.1)	42 (44.2)
Good	786 (26.8)	411 (24.2)	321 (31.3)	24 (30.8)	20 (21.1)
Fair	335 (11.4)	141 (83)	160 (15.6)	15 (19.2)	9 (9.5)
Poor	76 (2.6)	26 (1.5)	43 (4.2)	4 (5.1)	1 (1.1)
Education, n (%)						0.289
Eighth grade	182 (6.4)	92 (5.6)	78 (7.8)	8 (10.4)	2 (2.2)
College/CEGEP	676 (23.6)	417 (25.2)	214 (21.4)	12 (15.6)	21 (22.8)
Some high school	315 (11.0)	178 (10.8)	109 (10.9)	12 (15.6)	10 (10.9)
High school	682 (23.9)	370 (22.4)	270 (27.0)	18 (23.4)	16 (17.4)
Undergraduate	456 (16.0)	265 (11.0)	156 (15.6)	15 (19.5)	16 (17.4)
Postgraduate	548 (19.2)	331 (20.0)	172 (17.2)	12 (15.6)	27 (29.4)
Race, n (%)						0.223
White	2555 (89.7)	1518 (90.7)	896 (89.2)	62 (79.5)	79 (84.0)
Black	53 (1.9)	26 (1.6)	26 (2.6)	1 (1.3)	0
Arab	43 (1.5)	25 (1.5)	13 (1.3)	2 (2.6)	3 (3.2)
First nation	20 (0.7)	13 (0.8)	5 (0.5)	1 (1.3)	1 (1.1)
Oriental	69 (2.4)	36 (2.2)	30 (3.0)	3 (3.9)	0
Indian	54 (1.9)	24 (1.4)	22 (22.2)	4 (5.1)	4 (4.3)
Other	55 (1.9)	31 (1.9)	12 (1.2)	5 (6.4)	7 (7.5)
Elixclass, n (%)						<0.001
<0	90 (3.1)	60 (3.5)	28 (2.7)	2 (2.5)	0
0	1606 (54.5)	1123 (65.3)	403 (38.3)	42 (51.9)	38 (40)
1–5	693 (23.5)	382 (22.2)	245 (23.3)	26 (32.1)	40 (42.1)
6–13	370 (12.6)	86 (5.0)	269 (25.6)	10 (12.4)	5 (5.3)
>13	189 (6.4)	69 (4.0)	107 (10.2)	1 (1.2)	12 (12.6)
Admission, n (%)						<0.001
Elective	1037 (35.2)	896 (50.1)	79 (7.5)	0	62 (65.3)
Emergent	1709 (58.0)	720 (41.9)	880 (83.7)	80 (98.8)	29 (30.5)
Urgent	202 (6.9)	104 (6.1)	93 (8.8)	1 (1.2)	4 (4.2)
Age group, n (%)						<0.001
18–34	134 (4.6)	90 (5.2)	39 (3.7)	2 (2.5)	3 (3.2)
35–44	152 (5.2)	89 (5.2)	46 (4.4)	3 (3.7)	14 (14.7)
45–54	313 (10.6)	219 (12.7)	80 (7.6)	0	14 (14.7)
55–64	622 (21.1)	383 (22.3)	202 (19.2)	10 (12.4)	27 (28.4)
65–79	1136 (38.6)	687 (39.9)	394 (37.5)	25 (30.9)	30 (31.6)
>79	590 (20.0)	252 (14.7)	290 (27.6)	41 (50.6)	7 (7.4)
Any psi, n (%)	321 (10.9)	205 (11.9)	96 (9.1)	10 (12.4)	10 (10.5)	0.145
LOS (days), median (IQR)	4 (2–7)	3 (2–6)	5 (3–8)	5 (3–9)	3 (2–4)	<0.001
Income decile, median (IQR)	8 (5–9)	8 (5–9)	8 (5–9)	8 (5–9)	8 (6–9)	0.449
ICU, n (%)	102 (3.5)	60 (3.5)	41 (3.9)	1 (1.2)	0	0.914
Married/partner, n (%)	1904 (64.6)	1153 (67.0)	650 (61.8)	42 (51.9)	59 (62.1)	0.003
Sex female, n (%)	1435 (48.7)	794 (41.2)	502 (47.7)	45 (55.6)	100	<0.001
Campus A, n (%)	1308 (43.8)	834 (48.5)	423 (40.2)	51 (63.0)	0	<0.001
ED visit within 7 days, n (%)	226 (7.6)	144 (8.4)	68 (6.5)	8 (9.9)	5 (5.3)	0.195
Discharge disposition, n (%)						<0.001
Home	1885 (63.2)	1220 (71.1)	548 (52.2)	35 (43.2)	72 (75.8)
Home setting	872 (29.2)	367 (21.4)	425 (40.5)	37 (45.7)	21 (22.1)
Another health facility	226 (7.6)	130 (7.6)	76 (7.2)	9 (11.1)	2 (2.1)
Topbox rate experience, n (%)	1963 (69.1)	1191 (71.2)	662 (66.3)	45 (57.7)	65 (69.2)	0.008
Topbox recommend hospital, n (%)	2168 (74.8)	1294 (76.1)	752 (73.2)	52 (66.7)	70 (73.7)	0.126
Topbox rate hospital, n (%)	1737 (60.4)	1049 (62.2)	591 (58.0)	37 (47.4)	60 (63.8)	0.014
Topbox overall helped, n (%)	2145 (74.6)	1325 (78.7)	701 (68.8)	46 (57.5)	73 (78.5)	<0.001

CEGEP, Collège d’enseignement général et professionnel; ED, emergency department; Elixclass, Elixhauser class; ICU, intensive care unit stay; LOS, length of stay; Obs/gyn, obstetrics and gynaecology; psi, patient safety indicator event.

Topbox analysis: overall measures

The results of the multivariable analyses in the derivation of the model for the overall measures (rate experience, recommend hospital, rate hospital and overall helped) are presented in tables 2-5. Decrease in topbox scoring was associated with worse degrees of perceived physical and mental health in all four of the questions. There was a significant relationship with age group in all questions with lowest ORs in patients between the ages of 18 and 34 years. On pairwise comparison, the predicted scores in this group were significantly lower than those in the age groups of 55–64 years and 65–79 years (p<0.05). Increased level of education and female sex were associated with worse scoring in rate experience, recommend hospital and rate hospital questions. Covariates from the institutional database that were significant contributors to the models included discharge disposition to a facility (recommend and rate hospital), marital status (recommend hospital) and ICU stay (rate hospital). Campus site was found to be a factor in rate hospital (p<0.05).

Adjusted and unadjusted department-based predicted measures for rate experience, and recommend hospital are presented in figures 1 and 2. Unadjusted pairwise comparison of rate experience demonstrated a greater likelihood of topbox scoring with surgery as compared with medicine; however, this was not significant (p=0.054). This difference was not seen after adjustment (p=0.911). Unadjusted pairwise comparison of the question rate hospital demonstrated a significant increase in surgery as compared with family medicine; however, this difference was not present in the adjusted model (data not shown). Unadjusted analysis of the overall helped question demonstrated greater likelihood of topbox scoring in surgery as compared with medicine and family medicine, as well as obstetrics and gynaecology as compared with family medicine (p<0.05); however, these comparisons were no longer significant after adjustment for the covariates in the model (data not shown).

Unadjusted and adjusted predicted per cent topbox of corporate indicator ‘Rate your experience’ by hospital department. Error bars represent 95% CI. Difference between surgery/ENT and medicine significant (p=0.05) in unadjusted, however no differences between departments in adjusted. Adjustment was completed using all of the variables in the multivariable model. ENT, ear, nose and throat; Obs/gyn, obstetrics and gynaecology.

Unadjusted and adjusted predicted per cent topbox of corporate indicator ‘Recommend this hospital’ by hospital department. Error bars represent 95% CI. No statistically significant difference between groups. Adjustment was completed using all of the variables in the multivariable model. ENT, ear, nose and throat; Obs/gyn, obstetrics and gynaecology.

Key driver analysis

Key driver analysis of the global question of rate experience is presented in figure 3. Common domains present in quadrant 1 in all four questions include person-centred care, care transition and the domain related to emergency admission processes. Similar patterns were seen with the other three global questions (results not shown).

Figure 3

Key driver analysis: relationship domain composite measures to the global measure of overall experience, direct admission (left) and emergency admission (right). Horizontal black dotted line: mean for all correlation values. Vertical red dotted line: median for all composites. A: communication doctors, B: communication nurses, C: responsiveness staff, D: care transition, E: person-centred care, F: pain management, G: communication medications, H: admission processes emergency, I: admission processes elective. CPES-IC, Canadian Patient Experience Survey–Inpatient Care; emerg, emergency.

Discussion

Results from the CPES-IC survey administered to patients discharged from a large Canadian multicampus health institution were analysed after merging with a comprehensive administrative database. Two patient-answered demographic questions collected from the survey (patient-perceived overall physical and mental health) were significant covariates predicting topbox recognition in all four of the overall care questions. Increasing level of education and female sex were associated with decreased topbox scoring in rate experience, recommend hospital and rate hospital. Discharge to a non-home environment was associated with lower topbox scoring on recommend and rate hospital. The only significant contributors to the models from the hospital database included marital status (recommend hospital) and ICU stay (rate hospital). Economic status, in-hospital adverse events and Elixhauser comorbidity class did not significantly contribute to the models for the four questions related to overall care. After adjustment, there was no significant difference in the predicted measures between the four major departments in any of the four questions that related to the overall patient experience. Finally, key driver analysis using these models confirmed that the greatest yield for interventions at the hospital level include efforts to improve person-centred care, care transition and the experience for those being admitted through the emergency department.

Patient experience has become a focus of the healthcare evolution, and it has been recognised as a key interest to consumers and patient advocacy groups. The Institute of Healthcare Improvement, a leader in the transformation of the healthcare system, has advocated the goal of improving the experience of care within its triple aim of quality.18 The Affordable Care Act in collaboration with the CMS12 has emphasised the need to deliver care that provides a quality patient experience. The act has integrated patient experience scores and reporting mandates into hospital reimbursement strategies which further incentivise excellence. Patient experience scores are reported nationally in the USA,19 and they may be a source of pride and engagement for healthcare teams and used to compete for patients.

The environment is different in Canada as there is currently no financial benefit, and competition between institutions is not a driver for patient services. On the other hand, federal and provincial government health organisations have embraced patient experience as a priority for healthcare, and they have initiated legislation to support its significance in quality delivery. Future public reporting of CPES-IC results and national benchmarking will motivate quality improvement in this area, and patient experience surveying is currently mandatory for hospital accreditation. In Ontario, the Excellent Care for All Act (2010) established that hospitals must develop sustained processes to address and improve the patient experience.20 Our own institution has raised the profile of patient experience to the level of a corporate target by integrating it as a foundation of the vision of the hospital with a priority equal to other quality outcomes and efficiency.

In order to strategise to bring about improvements in patient experience, it is essential to understand how the current American-based survey applies to Canadian culture and our single-payer system. Specifically, it is crucial to appreciate how to adjust for patient demographics within different settings, not just to externally compare with other urban institutions, but also to begin to internally identify factors that may influence overall scoring and interpretation.

The current study is not the first to examine the role of patient and other covariates in the modelling of measures of overall patient experience in Canada.21 However in the latter work, the analysis involved the HCAHPS survey focusing on the single question of rate experience. The authors did demonstrate a similar relationship with higher level of education, urgent admission status and longer length of stay as predictive of poorer measures of experience rating; however, they did not include patient-perceived physical and mental health status, both of which were the most consistent and significant predictors of overall care.

It may not be feasible to generalise from the analysis at a single hospital due to the differing contributions of the patient covariates and interactions with the specific domains of patient care at each hospital across the country.22 For example, race was not found to be a significant factor for most questions unlike in the USA.22 This finding may only be relevant in the context of our centre (a medium-sized Canadian city), whereas it may not apply to larger metropolitan centres such as Toronto and Montreal, where there may be greater ethnic diversity. On the other hand, the finding that women are less likely to provide a topbox scoring on questions of overall experience is in keeping with previous findings with the HCAHPS survey.23

Patient experience key driver analysis has been used to focus attention and initiatives in patient-care areas with high potential to impact on the overall global measures of care. The new CPES-IC survey has been designed to not only include domains currently in the HCAHPS survey, but also domains reflecting patient-centred care, transition of care and the processes of direct or emergency admission. Although these new domains have not been formally validated in the Canadian context, they were all identified as areas of potential high yield in our study in terms of overall contribution to the patient experience. Many of these questions refer to key issues of team communication and the perception of coordination of care; items that could be addressed through team restructuring, checklists and scheduling. On the other hand, nursing and doctor communication skills, though important, did not support targets of high yield in terms of hospital resources.

There are multiple important implications of this work. The analysis highlights the differences in adjusted and unadjusted rankings between departments which emphasise the importance of the use of the demographic covariates obtained from the survey such as perception of physical and mental health and education level. The adjusted improved measures in medicine and family medicine underscore that chronic disease and comorbidity must be taken into account in patient experience initiatives. Recognition of adjusted results also enhances engagement of staff who face the challenges of chronic disease care and provides the opportunity to follow for improvements.

The analysis may be limited by unknown and unmeasured covariates. Only a few of the covariates from the administrative database were significant in models describing perceptions of excellence in individual questions of overall care. Further work will be necessary to determine if these administrative database variables are important at model development at the unit or provider level. Although there was no difference between departments in any of the questions, more subtle comparisons such as between divisions and services may be important in understanding how to advance patient experience initiatives. Finally, patient care domains were not included as covariates in the derivation of the multivariable models for the global overall questions. We elected not to do this as we felt the domains as covariates would demonstrate significant bias due to their correlation not only to the outcomes but also to many of the other predictors. Therefore, we elected rather to look at their interactions and correlations using key driver analysis.

In summary, this analysis provides a perspective on drivers that must be considered when assessing patients’ perceptions on the overall care at a healthcare institution in Canada. Healthcare institutions must incorporate patient demographics and self-reported aspects of perceived health into the analysis of patient experience data to properly interpret this information, particularly when comparing departments and units within the institution. We believe that this understanding will form the basis for a strategy of thoughtful data-driven targeted interventions to improve the patient experience.

Table 2

Analysis of covariates associated with topbox designation of the corporate measure of ‘Rate experience’

	Multivariable analysis	P values	LR test (p)
Department			0.671
Surgery/ENT	reference
Medicine	1.08 (0.87, 1.34)	0.502
Family	0.82 (0.49, 1.39)	0.468
Obs/gyn	0.88 (0.54, 1.44)	0.620
Physical health			<0.001
Excellent	Reference
Very good	0.71 (0.48, 1.05)	0.083
Good	0.49 (0.33, 0.73)	<0.001
Fair	0.48 (0.31, 0.74)	0.001
Poor	0.40 (0.24, 0.67)	<0.001
Mental health			<0.001
Excellent	Reference
Very good	0.77 (0.60, 1.00)	0.051
Good	0.57 (0.43, 0.76)	<0.001
Fair	0.43 (0.30, 0.62)	<0.001
Poor	0.40 (0.22, 0.73)	0.003
Education			0.007
Eighth Grade	Reference
Some high  school	1.02 (0.64, 1.64)	0.924
High school	0.69 (0.45, 1.04)	0.077
College/CEGEP	0.56 (0.37, 0.86)	0.007
Undergraduate	0.44 (0.29, 0.69)	<0.001
Postgraduate	0.42 (0.28, 0.65)	<0.001
Admit-urgent	0.86 (0.72, 1.02)	0.075	0.075
Sex male	1.22 (1.02, 1.47)	0.030	0.031
Race			0.243
White	Reference
Black	1.45 (0.73, 2.91)	0.289
Arab	0.98 (0.49, 1.97)	0.958
First nation	0.59 (0.20, 1.79)	0.355
Oriental	1.43 (0.80, 2.54)	0.226
Indian	1.18 (0.63, 2.21)	0.611
Other	0.53 (0.29, 0.98)	0.043
Elixclass			0.064
<0	Reference
0	0.56 (0.31, 0.99)	0.045
1–5	0.72 (0.40, 1.31)	0.282
6–13	0.57 (0.30, 1.05)	0.073
>13	0.61 (0.32, 1.20)	0.151
Age group			0.007
18–34	Reference
35–44	1.64 (0.97, 2.77)	0.066
45–54	1.73 (1.09, 2.72)	0.019
55–64	2.28 (1.49, 3.51)	<0.001
65–79	2.07 (1.37, 3.13)	0.001
>79	1.83 (1.18, 2.84)	0.007
Any psi	0.98 (0.73, 1.32)	0.879	0.879
LOS (>3 days)	0.85 (0.69, 1.04)	0.122	0.122
Income decile*	0.95 (0.83, 1.10)	0.521	0.521
ICU	1.24 (0.75, 2.04)	0.407	0.402
Married/partner	0.93 (0.76, 1.12)	0.426	0.425
Emergency visit within 7 days post d/c	0.77 (0.56, 1.06)	0.107	0.110
Discharge			0.116
Home	Reference
Home setting	0.91 (0.74, 1.14)	0.423
Another facility	0.69 (0.48, 0.98)	0.037
Campus		0.332

*Log transformed.

d/c, discharge; Elixclass, Elixhauser class; ENT, ear, nose and throat; ICU, intensive care unit stay; LOS, length of stay; LR, likelihood ratio; Obs/gyn, obstetrics and gynaecology; psi, patient safety indicator event.

Table 3

Analysis of covariates associated with topbox measure of ‘Recommend this hospital’

	Multivariable analysis	P values	LR test (p)
Department			0.908
Surgery/ENT	Reference
Medicine	1.06 (0.84, 1.34)	0.620
Family	0.89 (0.51, 1.53)	0.669
Obs/gyn	1.03 (0.62, 1.72)	0.913
Physical health			0.018
Excellent	Reference
Very good	0.74 (0.49, 1.12)	0.152
Good	0.54 (0.36, 0.81)	0.003
Fair	0.56 (0.35, 0.88)	0.012
Poor	0.557 (0.323, 0.959)	0.035
Mental health			<0.001
Excellent	Reference
Very good	0.90 (0.69, 1.18)	0.435
Good	0.63 (0.47, 0.85)	0.002
Fair	0.56 (0.39, 0.81)	0.002
Poor	0.39 (0.21, 0.71)	0.001
Education			<0.001
Eighth grade	Reference
Some high school	1.07 (0.67, 1.73)	0.768
High school	0.94 (0.62, 1.45)	0.793
College/CEGEP	0.67 (0.44, 1.03)	0.069
Undergraduate	0.57 (0.36, 0.89)	0.014
Postgraduate	0.63 (0.41, 0.99)	0.045
Race			<0.001
White	Reference
Black	5.63 (1.72, 18.45)	0.004
Arab	1.56 (0.70, 3.49)	0.273
First nation	0.38 (0.13, 1.11)	0.078
Oriental	2.09 (1.07, 4.11)	0.032
Indian	1.64 (0.81, 3.33)	0.168
Other	0.51 (0.28, 0.93)	0.028
Elixclass			0.197
<0	Reference
0	0.48 (0.26, 0.93)	0.030
1–5	0.54 (0.27, 1.05)	0.068
6–13	0.56 (0.28, 1.13)	0.103
>13	0.51 (0.25, 1.07)	0.074
Admit urgent	0.98 (0.82, 1.17)	0.843	0.843
Age group			0.048
18–34	Reference
35–44	1.17 (0.67, 2.06)	0.566
45–54	1.82 (1.11, 3.00)	0.019
55–64	1.85 (1.16, 2.93)	0.009
65–79	1.58 (1.02, 2.46)	0.042
>79	1.37 (0.86, 2.19)	0.185
Any psi	1.09 (0.79, 1.49)	0.600	0.092
LOS >3 days	0.88 (0.71, 1.09)	0.247	0.248
Income decile*	1.01 (0.87, 1.17)	0.908	0.908
ICU	1.62 (0.92, 2.87)	0.098	0.086
Married/partner	0.80 (0.65, 0.98)	0.031	0.030
Sex male	1.41 (1.16, 1.70)	<0.001	<0.001
Emergency visit within 7 days post d/c	0.75 (0.54, 1.04)	0.088	0.081
Discharge			0.037
Home	Reference
Home setting	0.76 (0.61, 0.96)	0.020
Another facility	0.71 (0.49, 1.03)	0.069
Campus		1.000

*Log transformed.

Elixclass, Elixhauser class; ENT, ear, nose and throat; ICU, intensive care unit stay; LOS, length of stay; LR, likelihood ratio; Obs/gyn, obstetrics and gynaecology; psi, patient safety indicator event.

Table 4

Analysis of covariates associated with topbox measure of ‘Rate this hospital’

	Multivariable analysis	P values	LR test (p)
Department			0.496
Surgery/ENT	Reference
Medicine	0.96 (0.78, 1.18)	0.676
Family	0.71 (0.43, 1.19)	0.197
Obs/gyn	1.20 (0.75, 1.93)	0.451
Physical health			<0.001
Excellent	Reference
Very good	0.70 (0.50, 0.99)	0.041
Good	0.49 (0.34, 0.69)	<0.001
Fair	0.61 (0.42, 0.91)	0.014
Poor	0.67 (0.41, 1.09)	0.109
Mental health			<0.001
Excellent	Reference
Very good	0.74 (0.59, 0.94)	0.013
Good	0.58 (0.45, 0.76)	<0.001
Fair	0.52 (0.37, 0.73)	<0.001
Poor	0.51 (0.28, 0.91)	0.024
Education			<0.001
Eighth grade	Reference
Some high school	1.16 (0.75, 1.77)	0.507
High school	0.90 (0.62, 1.32)	0.599
College/CEGEP	0.61 (0.42, 0.90)	0.013
Undergraduate	0.47 (0.32, 0.72)	<0.001
Post graduate	0.49 (0.32, 0.71)	<0.001
Race			0.399
White	Reference
Black	1.70 (0.88, 3.29)	0.114
Arab	0.95 (0.50, 1.82)	0.879
First nation	0.70 (0.24, 2.01)	0.503
Oriental	1.26 (0.74, 2.14)	0.403
Indian	1.23 (0.67, 2.26)	0.501
Other	0.66 (0.36, 1.19)	0.166
Admit urgent	0.87 (0.74, 1.02)		0.093
Sex male	1.31 (1.10, 1.55)	0.002	0.002
Elixclass			0.073
<0	Reference
0	0.56 (0.34, 0.93)	0.025
1–5	0.69 (0.40, 1.17)	0.169
6–13	0.66 (0.38, 1.16)	0.148
>13	0.59 (0.32, 1.07)	0.083
Age group			0.001
18–34	Reference
35–44	1.47 (0.89, 2.44)	0.136
45–54	2.03 (1.30, 3.17)	0.002
55–64	2.35 (1.54, 3.58)	<0.001
65–79	2.03 (1.35, 3.04)	0.001
>79	1.82 (1.19, 2.80)	0.006
Any psi	0.92 (0.69, 1.22)	0.544	0.544
LOS >3 days	0.96 (0.79, 1.16)	0.668	0.668
Income decile*	1.06 (0.93, 1.21)	0.395	0.395
ICU	1.93 (1.17, 3.19)	0.010	0.008
Married/partner	0.89 (0.74, 1.06)	0.200	0.200
Emergency visit within 7 days post d/c	0.76 (0.56, 1.04)	0.083	0.084
Discharge			0.016
Home	Reference
Home setting	0.81 (0.66, 1.00)	0.052
Another facility	0.70 (0.50, 0.99)	0.046
Campus		0.008

*Log transformed.

Elixclass, Elixhauser class; ENT, ear, nose and throat; ICU, intensive care unit stay; LOS, length of stay; LR, likelihood ratio; Obs/gyn, obstetrics and gynaecology; psi, patient safety indicator event.

Table 5

Analysis of covariates associated with topbox measure of ‘Overall helped’

	Multivariable analysis	P values	LR test (p)
Department			0.167
Surgery/ENT	Reference
Medicine	0.83 (0.66, 1.04)	0.113
Family	0.60 (0.36, 1.01)	0.047
Obs/gyn	0.85 (0.49, 1.47)	0.558
Physical health			<0.001
Excellent	Reference
Very good	0.89 (0.58, 1.37)	0.601
Good	0.59 (0.38, 0.90)	0.014
Fair	0.57 (0.36, 0.91)	0.019
Poor	0.39 (0.23, 0.68)	0.001
Mental health			<0.001
Excellent	Reference
Very good	0.70 (0.53, 0.94)	0.019
Good	0.52 (0.39, 0.71)	<0.001
Fair	0.44 (0.30, 0.64)	<0.001
Poor	0.44 (0.24, 0.81)	0.008
Education			0.126
Eighth grade	Reference
Some high school	1.03 (0.64, 1.63)	0.914
High school	0.87 (0.57, 1.31)	0.500
College/CEGEP	0.81 (0.53, 1.23)	0.319
Undergraduate	0.63 (0.41, 0.98)	0.039
Postgraduate	0.79 (0.51, 1.22)	0.285
Race			0.505
White	Reference
Black	1.81 (0.81, 4.01)	0.146
Arab	0.83 (0.41, 1.69)	0.612
First nation	0.94 (0.28, 3.12)	0.920
Oriental	1.17 (0.65, 2.12)	0.606
Indian	1.04 (0.55, 2.00)	0.895
Other	0.61 (0.33, 1.14)	0.122
Admit urgent	0.86 (0.72, 1.03)	0.108	0.109
Sex male	1.01 (0.83, 1.23)	0.906	0.906
Elixclass			0.079
<0	Reference
0	0.70 (0.39, 1.28)	0.252
1–5	0.98 (0.52, 1.82)	0.938
6–13	0.71 (0.37, 1.37)	0.309
>13	0.81 (0.40, 1.62)	0.547
Age group			0.042
18–34	Reference
35–44	1.10 (0.63, 1.91)	0.739
45–54	1.82 (1.10, 3.00)	0.019
55–64	1.73 (1.10, 2.75)	0.018
65–79	1.56 (1.01, 2.42)	0.047
>79	1.42 (0.89, 2.26)	0.254
Any psi	1.12 (0.81, 1.54)	0.492	0.490
LOS >3 days	0.91 (0.73, 1.13)	0.378	0.379
Income decile*	1.01 (0.87, 1.17)	0.912	0.912
ICU	1.32 (0.76, 2.27)	0.325	0.316
Married/partner	0.92 (0.75, 1.13)	0.418	0.417
Emergency visit within 7 days post d/c	0.76 (0.54, 1.06)	0.102	0.107
Discharge			0.088
Home	Reference
Home setting	0.84 (0.67, 1.05)	0.128
Another facility	0.68 (0.47, 0.99)	0.043
Campus		0.999

*Log transformed.

Elixclass, Elixhauser class; ENT, ear, nose and throat; ICU, intensive care unit stay; LOS, length of stay; LR, likelihood ratio; Obs/gyn, obstetrics and gynaecology; psi, patient safety indicator event.