| Literature DB >> 34179413 |
Rachel Thompson1, Gabrielle Stevens2, Glyn Elwyn2.
Abstract
The objective of this study was to assess the psychometric properties of IntegRATE-a 4-item patient-reported measure of integration in health care delivery-under controlled conditions. Adults who reported having received health care in the previous year were exposed to a fictional health care scenario featuring good, mixed, or poor integration on 1 or 2 occasions. They were then asked to imagine themselves as a patient in the scenario and complete IntegRATE and other measures. The data collected were analyzed to assess the discriminative, concurrent, and divergent validity of IntegRATE and its test-retest reliability and responsiveness using both "sum score" and "top score" scoring approaches. Six-hundred people participated in the study with 190 taking part on 2 occasions. The IntegRATE sum score demonstrated discriminative validity, concurrent validity, divergent validity, and responsiveness and partially demonstrated test-retest reliability. The IntegRATE top score demonstrated concurrent validity, divergent validity, and responsiveness and partially demonstrated discriminative validity and test-retest reliability. We conclude that the IntegRATE sum score exhibits encouraging psychometric properties and performs more optimally than the IntegRATE top score.Entities:
Keywords: health literacy; interprofessional communication; measurement; patient feedback; patient satisfaction; team communication; transitions of care
Year: 2021 PMID: 34179413 PMCID: PMC8205402 DOI: 10.1177/23743735211007346
Source DB: PubMed Journal: J Patient Exp ISSN: 2374-3735
Letter Excerpts Demonstrating the Manipulation of Integration Across Conditions.
| Good integration condition | Mixed integration condition | Poor integration condition |
|---|---|---|
| Domain: Consistent Advice | ||
| When I began to get a headache, we were nervous so we called the hospital. The person on the phone agreed with our doctor. Then, when we told her about my headache, she said this was a good reason to come in to the hospital right away. We were clear it was the right thing to do and chose to come in. | (As for poor integration condition) | When I began to get a headache, we were nervous so we called the hospital. The person on the phone disagreed with our doctor. Then, when we told her about my headache, she said that this was common and to wait to see if it would settle. We were unclear about what to do but chose to come in, just in case. |
| Domain: Information Sharing | ||
| When we arrived at the maternity unit, the person at the front desk knew we were coming, so we were able to go straight through to the maternity unit. Then, when we were getting settled in our room, our nurse came in. He had been told about my headache, so my blood pressure was taken right away. | (As for poor integration condition) | When we arrived at the maternity unit, the person at the front desk didn’t know we were coming, and we were asked the same questions again. Then, when we were getting settled in our room, our nurse came in. He had not been told about my headache, so my blood pressure wasn’t taken until 30 minutes later. |
| Domain: Mutual Respect | ||
| Within the first couple of hours, a doctor, a breastfeeding specialist, and our nurse had all come by to help. They really seemed to enjoy working together, which made a stressful situation so much easier for us to deal with. | (As for good integration condition) | Within the first couple of hours, a doctor, a breastfeeding specialist, and our nurse had all come by to help. They didn’t seem to enjoy working together, which made a stressful situation so much harder for us to deal with. |
| Domain: Role Clarity | ||
| While Sam massaged my lower back, where it was hurting most, our doctor came into the room with 2 new people. Our doctor explained that they were the doctor and nurse who had come to do the epidural. Knowing why everyone was there made us feel more in control. | (As for good integration condition) | While Sam massaged my lower back, where it was hurting most, our doctor came into the room with 2 new people. Our doctor did not explain who these people were or what they were going to do. Not knowing why everyone was there made us feel less in control. |
IntegRATE Domains and Items.
| Domain | Item |
|---|---|
| Information sharing | How often did you have to do or explain something because people did not share information with each other? |
| Consistent advice | How often were you confused because people gave you conflicting information or advice? |
| Mutual respect | How often did you feel uncomfortable because people did not get along with each other? |
| Role clarity | How often were you unclear whose job it was to deal with a specific question or concern? |
Figure 1.Participant flow diagram. aDoes not include those who consented and were screened for the study but discontinued participation. The number of these participants is unknown but is not greater than n = 454 given the known number of people who clicked on the survey link. bSome participants were excluded because the relevant sociodemographic quota was met, while they were completing the survey. cIncludes participants who attempted to take part but were unable to because the participant quota had been met and may also include participants who started the time 2 survey but discontinued for their own reasons. The number of these latter participants is unknown but is not greater than n = 42 given the known number of people who clicked on the survey link.
Participant Sociodemographic Characteristics by Time 1 Condition.a
| Good (n = 200) Freq. (%) | Mixed (n = 202) Freq. (%) | Poor (n = 198) Freq. (%) | Total (n = 600) (%) | Population (%) | |
|---|---|---|---|---|---|
| Gender | |||||
| Female | 104 (52.0) | 98 (48.5) | 106 (53.5) | 51.3 | 51.4 |
| Male | 95 (47.5) | 102 (50.5) | 91 (46.0) | 48.0 | 48.6 |
| Other | 1 (0.5) | 2 (1.0) | 1 (0.5) | 0.7 | - |
| Age | |||||
| 18-44 years | 98 (49.0) | 97 (48.0) | 86 (43.4) | 46.8 | 46.8 |
| 45-64 years | 64 (32.0) | 66 (32.7) | 76 (38.4) | 34.3 | 33.9 |
| 65+ years | 38 (19.0) | 39 (19.3) | 36 (18.2) | 18.8 | 19.3 |
| Educational attainment | |||||
| High school graduate or less | 77 (38.5) | 80 (39.6) | 76 (38.4) | 38.8 | 40.9 |
| Some college, no degree, or associate’s degree | 60 (30.0) | 70 (34.7) | 71 (35.9) | 33.5 | 31.1 |
| Bachelor’s degree or more | 62 (31.0) | 51 (25.2) | 50 (25.3) | 27.2 | 28.0 |
| Prefer not to say | 1 (0.5) | 1 (0.5) | 1 (0.5) | 0.5 | - |
| Ethnicity | |||||
| Hispanic, Latino, or Spanish origin | 17 (8.6) | 18 (9.0) | 9 (4.6) | 7.4 | 15.5 |
| Not of Hispanic, Latino, or Spanish origin | 181 (91.4) | 183 (91.0) | 186 (95.4) | 92.6 | 84.5 |
| Race | |||||
| One race | 193 (97.5) | 196 (97.5) | 188 (95.9) | 97.0 | 97.8 |
| – White | 163 (82.3) | 165 (82.1) | 160 (81.6) | 82.0 | 74.8 |
| – Black or African American | 22 (11.1) | 19 (9.5) | 23 (11.7) | 10.8 | 12.2 |
| – American Indian or Alaska Native | 2 (1.0) | 1 (0.5) | 2 (1.0) | 0.8 | 0.8 |
| – Asian | 4 (2.0) | 6 (3.0) | 0 (0.0) | 1.7 | 5.6 |
| – Native Hawaiian or Other Pacific Islanderb | 0 (0.0) | 0 (0.0) | 0 (0.0) | 0.0 | 0.2 |
| – Other | 2 (1.0) | 5 (2.5) | 3 (1.5) | 1.7 | 4.4 |
| Two or more races | 5 (2.5) | 5 (2.5) | 8 (4.1) | 3.0 | 2.2 |
| Language spoken at home | |||||
| English only | 178 (91.3) | 180 (91.4) | 181 (93.8) | 92.1 | 78.7 |
| Language(s) other than English | 17 (8.7) | 17 (8.6) | 12 (6.2) | 7.9 | 21.3 |
| Health literacy | |||||
| Limited | 27 (13.5) | 46 (22.8) | 35 (17.7) | 18.0 | c |
| Adequate | 173 (86.5) | 156 (77.2) | 163 (82.3) | 82.0 | c |
a Frequencies may not add to the total due to occasional cases of missing data.
b Not included in population comparison due to cell count of 0.
c No population data are available.
Validity and Reliability of the IntegRATE Sum Score and Top Score: All Participants.
| Property | Analysis | N | Result | Interpretation | Demonstrated |
|---|---|---|---|---|---|
| Sum score | |||||
| Discriminative validity | Difference between good (M = 9.68, SD = 2.87) and mixed (M = 7.06, SD = 2.52) integration conditions at time 1 | 402 | MD = 2.61, | Significant difference | Yes |
| Difference between mixed (M = 7.06, SD = 2.52) and poor (M = 5.14, SD = 2.72) integration conditions at time 1 | 400 | MD = 1.93, | Significant difference | Yes | |
| Concurrent validity | Association between IntegRATE score and Role Clarity and Coordination within Clinic subscale score at time 1 | 597 |
| Strong-negative association | Yes |
| Divergent validity | Association between IntegRATE score and hospital receptivity to feedback score at time 1 | 600 |
| Weak-positive association | Yes |
| Test–retest reliability | Agreement between time 1 and time 2 scores among all randomized to the same integration condition | 99 | ICC (3,1) = 0.78, | Good reliability | Yes |
| Agreement between time 1 and time 2 scores among those randomized to the good integration condition | 57 | ICC ( | Moderate reliability | Yes | |
| Agreement between Time 1 and Time 2 scores among those randomized to the poor integration condition | 42 | ICC ( | Poor reliability | No | |
| Responsiveness | Difference between good integration condition at time 1 (M = 10.07, SD = 2.60) and poor integration condition at time 2 (M = 4.91, SD = 3.29) | 45 | MD = 5.16, | Significant difference | Yes |
| Difference between poor integration condition at time 1 (M = 4.78, SD = 2.29) and good integration condition at time 2 (M = 9.93, SD = 2.64) | 46 | MD = −5.15, | Significant difference | Yes | |
| Top score | |||||
| Discriminative validity | Difference between good (39.5% high integration) and mixed (2.5% high integration) integration conditions at time 1 | 402 | χ2 (1) = 83.35, | Significant difference | Yes |
| Difference between mixed (2.5% high integration) and poor (3.5% high integration) integration conditions at time 1 | 400 | χ2 (1) = 0.39, | No difference | No | |
| Concurrent validity | Association between IntegRATE score and Role Clarity and Coordination within Clinic subscale score at time 1 | 597 | rpb = −0.49, | Moderate negative association | Yes |
| Divergent validity | Association between IntegRATE score and hospital receptivity to feedback score at Time 1 | 600 | rpb = 0.23, | Weak-positive association | Yes |
| Test–retest reliability | Agreement between time 1 and time 2 scores among all randomized to the same integration condition | 99 | Agreement = 76.8; κ = 0.43, | Moderate agreement | Yes |
| Agreement between time 1 and time 2 scores among those randomized to the good integration condition | 57 | Agreement = 63.2; κ = 0.30, | Fair agreement | No | |
| Agreement between time 1 and time 2 scores among those randomized to the poor integration condition | 42 | a | Unknown | ||
| Responsiveness | Difference between good integration condition at time 1 (40.0% high integration) and poor integration condition at Time 2 (4.4% high integration) | 45 |
| Significant difference | Yes |
| Difference between poor integration condition at time 1 (0% high integration) and good integration condition at time 2 (50.0% high integration) | 46 |
| Significant difference | Yes |
Abbreviations: M, mean; SD, standard deviation; MD, mean difference; ICC, intraclass correlation coefficient.
a Results not reported due to extremely low cell numbers.