| Literature DB >> 28725858 |
Steven C Martino1, Dale Shaller2, Mark Schlesinger3, Andrew M Parker1, Lise Rybowski4, Rachel Grob5,6, Jennifer L Cerully1, Melissa L Finucane1.
Abstract
OBJECTIVES: To investigate whether content from patient narratives explains variation in patients' primary care provider (PCP) ratings beyond information from the closed-ended questions of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Clinician and Group Survey and whether the relative placement of closed- and open-ended survey questions affects either the content of narratives or the CAHPS composite scores.Entities:
Keywords: CAHPS; patient comments; patient experience; patient narratives
Year: 2017 PMID: 28725858 PMCID: PMC5513663 DOI: 10.1177/2374373516685940
Source DB: PubMed Journal: J Patient Exp ISSN: 2374-3735
Characteristics of Healthier (n = 113) and Sicker (n = 219) Patients.
| Characteristics | Healthier (%) | Sickera (%) | χ2 | |
|---|---|---|---|---|
| Gender | 2.69 | .10 | ||
| Male | 37.2 | 46.6 | ||
| Female | 62.8 | 53.4 | ||
| Age, years | 19.30 | .001 | ||
| Younger than 35 | 26.6 | 10.5 | ||
| 35-44 | 11.5 | 11.4 | ||
| 45-54 | 20.4 | 13.7 | ||
| 55-64 | 20.4 | 29.7 | ||
| 65 or older | 21.2 | 34.7 | ||
| Race/ethnicity | 3.07 | .38 | ||
| White, non-Hispanic | 81.4 | 76.3 | ||
| Black, non-Hispanic | 11.5 | 11.4 | ||
| Other, non-Hispanic | 1.8 | 5.7 | ||
| Hispanic | 5.3 | 6.6 | ||
| Education | 5.46 | .14 | ||
| High school degree or less | 31.9 | 40.3 | ||
| Some college | 29.2 | 33.2 | ||
| 4-year college degree or more | 38.9 | 26.5 | ||
| Length of relationship with provider | 5.50 | .14 | ||
| Less than 1 year | 23.2 | 19.5 | ||
| 1-3 years | 26.8 | 17.7 | ||
| 3-5 years | 14.3 | 18.6 | ||
| More than 5 years | 35.7 | 44.2 | ||
| Doctor visits in past 12 months | 63.03 | <.0001 | ||
| 1 | 39.3 | 7.9 | ||
| 2-3 | 46.4 | 43.3 | ||
| 4-9 | 11.6 | 35.8 | ||
| 10 or more | 2.7 | 13.0 |
aHad a recent serious or chronic illness.
Descriptive Data on the Content of Narratives of Healthier (n = 113) and Sicker (n = 218) Patients.
| Aspect of Care | Healthier Patients | Sickerb Patients | ||||
|---|---|---|---|---|---|---|
| Any Mention, % | Any Negative Commentary, % | Proportion of Commentary That Is Negative, Mean (SD) | Any Mention, % | Any Negative Commentary, % | Proportion of Commentary That Is Negative, Mean (SD) | |
| Provider communication | 69.0 | 3.5 | 0.03 (0.17) | 62.1 | 9.1 | 0.07 (0.23) |
| Time spent during office visits | 53.1 | 15.9 | 0.14 (0.33) | 42.9 | 16.9 | 0.14 (0.32) |
| Access to care | 42.5 | 15.0 | 0.12 (0.30) | 42.9 | 10.0 | 0.08 (0.26) |
| Office staff | 47.8 | 14.2 | 0.12 (0.31) | 51.6 | 16.0 | 0.13 (0.31) |
| Emotional rapport | 66.4 | 4.4 | 0.03 (0.16) | 62.6 | 4.1 | 0.03 (0.17) |
| Perceived thoroughness | 15.9 | 1.8 | 0.02 (0.13) | 21.5 | 3.7 | 0.03 (0.17) |
| Perceived technical competence | 47.8 | 3.5 | 0.03 (0.18) | 58.0 | 7.3 | 0.05 (0.21) |
| Shared decision-making | 6.2 | 0.0 | 0.00 (0.00) | 12.8 | 2.3 | 0.02 (0.15) |
| Practice style | 13.3 | 0.0 | 0.00 (0.00) | 18.3 | 0.9 | 0.01 (0.10) |
| Care coordination | 0.9 | 0.0 | 0.00 (0.00) | 6.4a | 0.0 | 0.00 (0.00) |
Abbreviation: SD, standard deviation.
aP value from χ2 test of healthier versus sicker patients <.05.
bHad a recent serious or chronic illness.
Regression Models Predicting Global Provider Rating From CAHPS Composites and Evaluative Information From Patient Narratives: Healthier Patients (n = 107).
| Predictor | Model 1 | Model 2 | Model 3 | |||
|---|---|---|---|---|---|---|
| β Coefficient (Standard Error) | β Coefficient (Standard Error) | β Coefficient (Standard Error) | ||||
| CAHPS composites | ||||||
| Provider communication | 1.67 (0.18) | <.0001 | - | - | 1.61 (0.20) | <.0001 |
| Access to care | −0.26 (0.16) | .87 | - | - | −0.14 (0.17) | .42 |
| Office staff | 0.61 (0.18) | .001 | - | - | 0.72 (0.19) | <.0001 |
| Evaluative information from narrativea | ||||||
| Provider communication | - | - | −2.56 (0.96) | .009 | −0.97 (0.73) | .19 |
| Time spent during office visits | - | - | −0.42 (0.44) | .34 | −0.33 (0.30) | .27 |
| Access to care | - | - | 0.48 (0.45) | .29 | 0.06 (0.32) | .86 |
| Office staff | - | - | −0.37 (0.49) | .45 | 0.15 (0.38) | .69 |
| Emotional rapport | - | - | −0.50 (1.17) | .67 | 0.17 (0.79) | .83 |
| Perceived thoroughness | - | - | −0.52 (1.38) | .71 | 0.06 (0.94) | .95 |
| Perceived technical competence | - | - | −0.06 (0.79) | .94 | −0.64 (0.54) | .24 |
| 0.63 | 0.17 | 0.65 | ||||
Abbreviation: CAHPS, Consumer Assessment of Healthcare Providers and Systems.
aNumber of lines devoted to negative commentary as a proportion of the total lines devoted to all commentary about a particular aspect of care.
Regression Models Predicting Global Provider Rating From CAHPS Composites and Evaluative Information From Patient Narratives: Sickera Participants (n = 205).
| Predictor | Model 1 | Model 2 | Model 3 | |||
|---|---|---|---|---|---|---|
| β Coefficient (Standard Error) | β Coefficient (Standard Error) | β Coefficient (Standard Error) | ||||
| CAHPS composites | ||||||
| Provider communication | 1.51 (0.18) | <.0001 | - | - | 0.99 (0.19) | <.0001 |
| Access to care | 0.21 (0.13) | .10 | - | - | 0.24 (0.12) | .05 |
| Office staff | 0.53 (0.15) | <.0001 | - | - | 0.60 (0.15) | <.0001 |
| Evaluative information from narrativeb | ||||||
| Provider communication | - | - | −1.34 (0.51) | <.0001 | −0.27 (0.43) | .54 |
| Time spent during office visits | - | - | −1.04 (0.29) | <.0001 | −0.42 (0.24) | .09 |
| Access to care | - | - | 0.30 (0.35) | .40 | 0.58 (0.29) | .04 |
| Office staff | - | - | −0.90 (0.30) | .003 | −0.39 (0.26) | .14 |
| Emotional rapport | - | - | −2.03 (0.56) | <.0001 | −1.42 (0.46) | .002 |
| Perceived thoroughness | - | - | −1.94 (0.61) | .002 | −1.92 (0.51) | <.0001 |
| Perceived technical competence | - | - | −0.24 (0.47) | .61 | 0.27 (0.39) | .49 |
| 0.50 | 0.37 | 0.60 | ||||
Abbreviation: CAHPS, Consumer Assessment of Healthcare Providers and Systems.
aHad a recent or chronic illness.
bNumber of lines devoted to negative commentary as a proportion of the total lines devoted to all commentary about a particular aspect of care.
Effect of the Placement of the Narrative Protocol Relative to CAHPS Questions on Narrative Responses.
| Content/Quality of Narrative | Healthier Patients (n = 113) | Sickera patients (n = 219) | ||||
|---|---|---|---|---|---|---|
| Narrative Elicitation Placed Before CAHPS | Narrative Elicitation Placed After CAHPS | Narrative Elicitation Placed Before CAHPS | Narrative Elicitation Placed After CAHPS | |||
| Aspect of care discussed, % | ||||||
| Provider communication | 71.9 | 66.1 | .51 | 67.6 | 56.5 | .09 |
| Time spent during office visits | 49.1 | 57.1 | .40 | 47.7 | 40.0 | .15 |
| Access to care | 36.8 | 48.2 | .23 | 47.7 | 40.0 | .15 |
| Office staff | 49.1 | 46.4 | .78 | 58.6 | 44.4 | .04 |
| Emotional rapport | 70.2 | 62.5 | .39 | 62.2 | 63.0 | .90 |
| Perceived thoroughness | 15.8 | 16.1 | .97 | 23.4 | 19.4 | .48 |
| Perceived technical competence | 49.1 | 46.4 | .78 | 60.4 | 55.6 | .47 |
| Shared decisions | 7.0 | 5.4 | .72 | 13.5 | 12.0 | .75 |
| Practice style | 12.3 | 14.3 | .76 | 14.4 | 22.2 | .14 |
| Care coordination | 0.0 | 1.8 | .32 | 5.4 | 7.4 | .55 |
| Other qualities of narrative, mean (SD) | ||||||
| Overall coherence | 1.02 (0.53) | 1.11 (0.54) | .39 | 1.13 (0.55) | 1.03 (0.58) | .18 |
| Scopeb | 0.36 (0.18) | 0.36 (0.21) | .94 | 0.40 (0.19) | 0.36 (0.20) | .09 |
| Length (number of lines) | 7.05 (7.50) | 8.63 (11.09) | .38 | 10.42 (10.24) | 7.74 (8.41) | .04 |
| Evaluative balance | 0.84 (0.25) | 0.77 (0.29) | .23 | 0.80 (0.28) | 0.82 (0.25) | .53 |
Abbreviations: CAHPS, Consumer Assessment of Healthcare Providers and Systems; SD, standard deviation.
aHad a recent or chronic illness.
bProportion of 10 aspects of care that were discussed in the narrative.
Effect of the Relative Placement of the Narrative Protocol on CAHPS Composite Means and the Correlation of the CAHPS Composites With the Global Provider Rating.
| CAHPS Composite | Healthier Patients (n = 113) | Sickera patients (n = 219) | ||||
|---|---|---|---|---|---|---|
| Narrative Elicitation Placed Before CAHPS | Narrative Elicitation Placed After CAHPS | Narrative Elicitation Placed Before CAHPS | Narrative Elicitation Placed After CAHPS | |||
| Provider communication | ||||||
| Mean (SD) | 3.61 (0.62) | 3.57 (0.59) | .69 | 3.61 (0.52) | 3.58 (0.60) | .62 |
| Correlation with global rating | 0.83 | 0.67 | .05 | 0.74 | 0.56 | .02 |
| Access to care | ||||||
| Mean (SD) | 3.16 (0.80) | 3.20 (0.69) | .74 | 3.23 (0.72) | 3.05 (0.67) | .06 |
| Correlation with global rating | 0.42 | 0.52 | .51 | 0.38 | 0.37 | .94 |
| Office staff | ||||||
| Mean (SD) | 3.46 (0.62) | 3.54 (0.61) | .53 | 3.65 (0.57) | 3.55 (0.70) | .24 |
| Correlation with global rating | 0.48 | 0.51 | .84 | 0.49 | 0.54 | .62 |
Abbreviations: CAHPS, Consumer Assessment of Healthcare Providers and Systems; SD, standard deviation.
aHad a recent or chronic illness.