Literature DB >> 34492734

Living with Chronic Illness Scale: International validation through the classic test theory and Rasch analysis among Spanish-speaking populations with long-term conditions.

Carmen Rodriguez-Blazquez1,2, Maria João Forjaz1,3, Alba Ayala3,4, Mari Carmen Portillo5, Leire Ambrosio5.   

Abstract

BACKGROUND: The Living with Chronic Illness (LW-CI) Scale is a comprehensive patient-reported outcome measure that evaluates the complex process of living with long-term conditions.
OBJECTIVE: This study aimed to analyse the psychometric properties of the LW-CI scale according to the classic test theory and the Rasch model among individuals living with different long-term conditions.
DESIGN: This was an observational, international and cross-sectional study.
METHODS: A total of 2753 people from six Spanish-speaking countries living with type 2 diabetes mellitus, chronic obstructive pulmonary disease, chronic heart failure, Parkinson's disease, hypertension and osteoarthritis were included. The acceptability, internal consistency and validity of the LW-CI scale were analysed using the classical test theory, and fit to the model, unidimensionality, person separation index, item local independency and differential item functioning were analysed using the Rasch model.
RESULTS: Cronbach's α for the LW-CI scale was .91, and correlation values for all domains of the LW-CI scale ranged from .62 to .68, except for Domain 1, which showed correlation coefficients less than .30. The LW-CI domains showed a good fit to the Rasch model, with unidimensionality, item local independency and moderate reliability providing scores in a true interval scale. Except for two items, the LW-CI scale was free from bias by long-term condition type. DISCUSSION: After some adjustments, the LW-CI scale is a reliable and valid measure showing a good fit to the Rasch model and is ready for use in research and clinical practice. Future implementation studies are suggested. PATIENT AND PUBLIC CONTRIBUTION: Patient and public involvement was conducted before this validation study - in the pilot study phase.
© 2021 The Authors. Health Expectations published by John Wiley & Sons Ltd.

Entities:  

Keywords:  Rasch analysis; Spanish; classic test theory; living with; long-term condition; person-centred tool; psychometric properties

Mesh:

Year:  2021        PMID: 34492734      PMCID: PMC8628594          DOI: 10.1111/hex.13351

Source DB:  PubMed          Journal:  Health Expect        ISSN: 1369-6513            Impact factor:   3.377


INTRODUCTION

Nowadays, long‐term conditions (LTCs) are the leading causes of disability and costs worldwide. It is estimated that, by 2030, LTCs will account for three quarters of deaths globally, with considerable social and economic impact due to the exorbitant costs to the system. , In particular, cardiovascular and respiratory diseases, as well as diabetes, are the LTCs that account for the most deaths woldwide. Based on previous studies, living with an LTC is defined as a complex, dynamic, cyclical and multidimensional process that involves five different attributes, namely, acceptance, coping, self‐management, integration and adjustment. Living with an LTC is influenced by social and personal factors; therefore, living with an LTC is a unique, individual and unrepeatable process. , Health and social professionals need to have an in‐deep understanding of what it means to live with an LTC from the person's perspective. They should focus on the psychosocial and spiritual areas of the person and not just on the condition as has been done thus far. , , In this sense, use of patient‐reported outcome measures (PROMs) is paramount to evaluate how the person is living with his/her condition. , Consequently, an interdisciplinary team could design individualized and comprehensive care pathways and recommendations to achieve positive living with an LTC as a final desired target. , Currently, most relevant available PROMs in clinical practice and research evaluate specific aspects of the LTC (e.g., stage, symptoms or severity) or outcomes of the process of living with LTCs (e.g., quality of life, satisfaction with life or well‐being). The Long‐Term Conditions Questionnaire is the only PROM that potentially evaluates how a person is living with/managing an LTC. However, this scale seems to evaluate quality‐of‐life outcomes and does not tackle items related to acceptance, which is an essential attribute when living with an LTC. Inevitably, this left a gap regarding person‐centred measures that can evaluate the process of living with an LTC. To fill this gap and based on previous empirical studies , and conceptual works, , the Living with Chronic Illness (LW‐CI) Scale was designed. The LW‐CI scale is a comprehensive PROM that evaluates the complex process of living with an LTC. , It is a 26‐item self‐reported scale with direct applicability in people living with LTCs. It was originally designed for Spanish‐speaking populations living with an LTC. The LW‐CI scale has been previously published for Spanish‐speaking populations in a pilot study carried out among patients living with different LTCs. To date, the LW‐CI scale has been tested separately in several LTCs, namely, Parkinson's disease (PD), , osteoarthritis, chronic heart failure, type 2 diabetes mellitus (T2DM) and chronic obstructive pulmonary disease (COPD). The results from each validation study showed that the LW‐CI scale is a feasible, reliable and valid measure to evaluate separately the process of living with an LTC in a Spanish‐speaking population. According to those validation studies, , , , , , potential modifications were proposed to achieve a better version of the LW‐CI scale for each LTC in particular, such as simplifying the response scale, deleting some items or redesigning the domains. However, could those previous specific‐disease validation results be extended across LTC populations? There is an opportunity to test the psychometric properties of the LW‐CI scale in a sample representing diverse chronic health conditions to validate the measurement properties across persons living with different LTCs. All LW‐CI scale validation studies were conducted using a classical test theory (CTT) approach to evaluate reliability, validity and sensitivity to change along with acceptability and other parameters, mostly based on correlations and mean difference analyses. Only the LW‐CI for people with PD was additionally tested using Rash measurement analysis. The application of the Rasch model, one of the most used applications of the item response theory, combined with the classic test theory approach is recommended for evaluating PROM. , , The Rasch model completes the information provided by the CTT because it provides additional and relevant information about the measurement properties of a scale such as unidimensionality and differential item functioning (DIF) by individual groups including LTC type. In addition, it also allows for the calculation of scores on a linear scale. Therefore, the aim of this study is to analyse the psychometric properties of the LW‐CI scale according to the classic test theory and the Rasch model among people living with different LTCs. Suggestions for modification of the LW‐CI scale are presented accordingly.

METHODS

Design

This was an international and cross‐sectional study. This study is part of a multicentric and multidisciplinary research programme led by nurses (ReNACE Programme; https://www.unav.edu/web/programa-renace/proyectos) aimed at achieving an in‐depth understanding of the complex process of living with an LTC from the persons' and family/carers' perspectives through the development of individualized interventions and comprehensive PROM. , In particular, this study has the general aim of achieving a unique and standardized international Spanish‐speaking self‐reported scale to evaluate how the person is living with his/her LTC in several Spanish‐speaking countries.

Setting

Participants were recruited from different healthcare systems from six Spanish‐speaking countries, namely, Spain, Cuba, Argentina, Ecuador, Mexico and Colombia. More concretely, private and public primary and specialized healthcare service‐attending outpatients with LTCs were included. Additionally, individuals living with LTCs from the community were also approached, mainly from LTC organisations in Spain, such as the Parkinson's Disease Association.

Participants

Sampling of consecutive cases , was applied to select participants. The sample was composed of individuals living with different LTCs, namely, T2DM, COPD, chronic heart failure (HF), PD, hypertension and osteoarthritis. The following criteria were applied: (1) diagnosed with an LTC by a general practitioner or consultant (T2DM, COPD, HF, PD, hypertension and osteoarthritis); (2) adult patient (≥18 years); (3) able to read, understand and answer written questionnaires; (4) native Spanish‐speaking person; and (5) able to provide written informed consent. The applied exclusion criteria were as follows: (1) presence of cognitive deterioration or psychiatric disorders, or any other disorder that could interfere with or impede the appropriate development of the study (e.g., blindness); (2) hospitalized patients; and (3) patients not fulfilling the established inclusion criteria. According to international criteria, the sample size was estimated to fulfil the rule of 10 participants per item, which exceeds the minimum of 100 subjects required for CTT. Therefore, considering that the LW‐CI scale is a 26‐item scale, the minimum sample size estimated was 260 participants per condition, aiming for a total of 1560 participants.

Assessments

Sociodemographic data, such as age, gender, marital status, employment situation and educational level, were collected. In addition, LTC‐related information was collected, namely, age at disease and disease duration. In addition to sociodemographic and LTC‐related data, the Spanish version of the following self‐reported validated PROMs was used: LW‐CI scale : The LW‐CI scale is a self‐reported scale that evaluates the complex process of living with an LTC. The LW‐CI scale is a 26‐item scale grouped into five domains: Domain 1: Acceptance (4 items); Domain 2: Coping (7 items); Domain 3: Self‐management (4 items); Domain 4: Integration (5 items); and Domain 5: Adjustment (6 items). All items are answered using a 5‐point Likert scale from never or nothing (0) to always or a lot (4), except for Domain 1: Acceptance, which is reversely scored from never or nothing (4) to always or a lot (0). The LW‐CI scale has a total score value ranging from 0 points, indicating negative living with the condition, to 104 points, reflecting positive living with the condition. Duke‐UNC Functional Social Support Questionnaire (DUFSS) : The DUFSS is a self‐reported measure that comprises 11 items evaluating diverse dimensions of social support such as confidant, affective and instrumental support. The score for each item varies from 1 (much less than I would like) to 5 (as much as I would like). The total score ranges from 11 (lowest level of support ‘much less than I would like’) to 55 (highest level of support ‘as much as I like’). According to the Spanish validation study, the DUFSS presented adequate psychometric properties, showing a Cronbach's α value of .9 and satisfactory construct validity. , Modified version of the Satisfaction with Life Scale (SLS‐6): Originally, this is a 7‐item self‐reported questionnaire. For this study, the modified version of the SLS‐6 was used because the original version and, in particular, one of the items were specific for a student population. In this way, a modified version with a 6‐item scale was used to evaluate the degree of overall satisfaction with life and regarding six areas: whole life, physical, psychological well‐being, social relations, leisure and financial situation. Each item was rated on a 0 (totally unsatisfied with life) to 10 (totally satisfied with life)‐point Likert scale. According to the Spanish validation study, the SLS‐6 presented satisfactory psychometric properties, with a Cronbach's α of .8 and internal validity values ranging from .4 to .7. , Patient‐Based Global Impression of Severity Scale (PGIS): This is an adaptation of the clinical global impression of severity adapted for patients as a self‐reported scale. It is a global index that may be used to assess self‐perception of disease severity of the person living with a disease. The PGIS is a 6‐point Likert scale, ranging from 0 (not ill at all) to 5 (extremely ill). It has excellent construct validity and has been widely used in studies of chronic diseases.

Data collection

For people living with PD, data were collected between January and June 2015, and for people living with T2DM, COPD, HF, hypertension and osteoarthritis, data were collected between November 2018 and May 2019 among the different healthcare centres and community settings of six Spanish‐speaking countries. Although data collection was performed at different times, a detailed and standardized protocol was used to ensure data collection homogeneity and reduce possible errors during the process. According to the established protocol, potential participants were approached through a health professional (nurse or physician) or member of the research group. An invitation letter and a participant information sheet as well as verbal information were provided about the study. Participants who agreed to participate signed the consent form and were asked to complete the sociodemographic and LTC‐related data as well as PROM when they agreed with his/her health professional or researcher. Hence, participants completed the scales during consultations with the GP, specialized clinician, nurse specialist or primary care nurse. Participants who required help to complete the scales (e.g., due to vision problems) were assisted by a researcher. Once the participants finished answering the scales, a researcher reviewed the answers to identify possible missing data. Hence, no missing data were expected.

Ethical aspects

The study was approved by the research ethics committee of the principal investigator centre (reference numbers: 071/2014 and 2017.099) and all the included centres. This validation study was adjusted to the principles outlined in the Declaration of Helsinki (1964) of Law 14/2007 on Biomedical Research and Law 15/1999 on the Protection of Personal Data. All participants provided their signed consent to participate voluntarily after receiving verbal and written information related to the study. Signed consent was provided in front of the health professional or a member of the research group before completing the surveys.

Data analysis

Descriptive statistics, namely, central tendency measures and proportions, were used to determine the sociodemographic and LTC characteristics of the participants. The main data were ordinal or did not fit a normal distribution. Therefore, nonparametric statistics were used. According to the CTT, the following psychometric attributes were analysed: Feasibility and acceptability: The quality of the data was considered satisfactory if 95% of the data were computable. The limit for missing data was less than 5%, and the mean, median and standard deviation (SD) were estimated to be roughly equivalent (≤10% maximum punctuation). Floor and ceiling effects were deemed acceptable if they were less than 15%, and the skewness was expected to be between −1 and +1. Reliability: Internal consistency was tested by Cronbach's α coefficient (criterion value ≥ 0.70), item‐total correlation (corrected for overlap; criterion value, r s ≥ .30), inter‐item correlation (criterion value, r ≥ .20 and r ≤ .75) , and item homogeneity (criterion value > 0.30). Construct validity: For convergent validity, a moderate (r s ≥ .35–.50) or strong relationship (r s > .50) , , was hypothesized between the LW‐CI scale and DUFSS and SLS‐6, according to previous studies. A weak (r s = .20–.34) or insignificant (r s = .00–.19) relationship with age at diagnosis and disease duration was also hypothesized. These hypotheses were established to corroborate previous LW‐CI scale validation study results in specific LTCs. , , , , Spearman's rank correlation coefficients were obtained for this purpose. Internal validity, defined as the intercorrelations between the LW‐CI scale dimensions (standard, r s = .30–.70), , was determined. For known groups' validity, differences in LW‐CI scale scores in the participants grouped by gender and PGIS scores were analysed. , Mann–Whitney and Kruskal–Wallis tests with Bonferroni corrections were used for group comparisons. For the Rasch model, the following measurement properties were analysed: fit to the Rasch model, reliability (person separation index [PSI]), adequacy of the response scale, item local independence and unidimensionality. In addition, DIF was analysed by the following factors: sex, age groups (70 years or younger vs. older than 70 years), disease duration (categorized by the median; up to 6 vs. 7+ years) and LTC type; DIF by country was not possible due to an unequal distribution of data from different countries, precluding comparisons. According to the Rasch model, the response to a certain item is a function of the person's ability (or experienced level of the construct) and the item's difficulty (or the measured level of construct by that item), expressed in logits. Fit to the Rasch model is observed when there is a nonsignificant χ 2 difference between the data and the Rasch model, with Bonferroni correction by number of items. In addition, residuals should follow a normal distribution (mean of 0; SD of 1) and fall within the ±2.5 range. Large sample sizes might result in a high statistical power to detect small model deviations and unnecessary modifications. Therefore, for Rasch analysis, we included a random sample of 300 individuals. Reliability is expressed by the PSI, interpreted similarly to Cronbach's α. A threshold is the point of equal response probability between two adjacent categories. Its order is analysed and in the case of disordered thresholds, adjacent categories are collapsed. For items to be locally independent, we expect low correlations (<.30 of the average correlation) between item residuals. Unidimensionality is measured through a principal component of the residuals, and person estimates are compared using t‐tests. A lower bound of the associated binomial 95% confidence interval (CI) less than 5% indicates unidimensionality. , For DIF, analyses of variance (ANOVA) with Bonferroni correlation are conducted for all factors. When several items present significant DIF by a certain factor, a top–down purification procedure is followed by creating two groups of items, with or without DIF, and comparing the estimates in an ANOVA to see if DIF remains. Model modifications were evaluated iteratively. SPSS 22.0 (IBM Corp.) was used for all CTT analyses, and RUMM2030 was used for Rasch analysis.

RESULTS

A total of 2753 people living with different LTCs were included in the sample. Osteoarthritis presented the lowest sample size (n = 291), and T2DM presented the highest sample size (n = 582). Demographic information is shown in Table 1. The age range was 20–98 years, with a mean age of 68.21 years (SD: 12.21 years). More than half of the sample was female (n = 1441, 52.3%), was married (n = 1555, 56.5%) and had basic/primary education levels (n = 1596, 58.1%). The employment status of the sample was mainly distributed between been retired (n = 934, 34%) and working as housekeeper (n = 827, 30.1%). All of the participants had at least one LTC, with a duration of 9.80 years (SD: 8.65; range: 0–67 years) and a mean age at diagnosis of 58.37 years (SD: ±13; range: 3–91 years).
Table 1

Participant characteristics (n = 2753)

Demographic variableResponse option N (%)
CountryArgentina60 (2.2)
Colombia1329 (48.3)
Cuba50 (1.8)
Ecuador60 (2.2)
Mexico53 (1.9)
Spain1201 (43.6)
Long‐term conditionType 2 diabetes mellitus582 (21.1)
Chronic obstructive pulmonary disease612 (22.2)
Chronic heart failure603 (21.9)
Parkinson's disease324 (11.8)
Hypertension341 (12.4)
Osteoarthritis291 (10.6)
GenderMale1312 (47.7)
Female1441 (52.3)
Marital statusSingle316 (11.5)
Married1555 (56.5)
Widower612 (22.3)
Separated/divorced261 (9.5)
Others6 (0.2)
Employment situationActive working501 (18.2)
Housekeeper827 (30.1)
Retired937 (34)
Other487 (17.7)
Educational levelBasic/primary studies1596 (58.1)
Secondary studies709 (25.8)
University studies359 (13.1)
Others83 (3)
RangeMean (standard deviation)
Age20–9868.21 (12.21)
Age at diagnosis3–9158.37 (13.00)
Long‐term condition duration0–679.80 (8.65)
Participant characteristics (n = 2753)

CTT analysis

The results related to feasibility and acceptability showed that the LW‐CI scale was fully completed by 2738 participants, with 99.46% of the data computable. Levels of missing data were low and broadly uniform across domains, ranging from 0 missing data (Domain 1: Acceptance) to 6 (Domain 5: Adjustment). The floor effect was absent in all domains and in the total score, whereas Domains 1: Acceptance and 4: Integration showed ceiling effects (19.1% and 15.6%, respectively). For the five domains and the LW‐CI total scale, the difference between the mean and the median was less than 10%, the theoretical and observed ranges were coincident and the skewness values were between −1 and +1. Table 2 presents further feasibility and acceptability results.
Table 2

Feasibility, acceptability and reliability of the LW‐CI scale

LW‐CI scale
Domain 1: AcceptanceDomain 2: CopingDomain 3: Self‐managementDomain: 4 IntegrationDomain 5: AdjustmentTotal
Missing data/fully computable data0/27532/27515/27482/27516/274715/2738
Mean10.6618.5410.6214.6914.9969.52
Median111911151570
Standard deviation4.406.073.724.045.9418.37
Observed range0‐160‐280‐160‐200‐240‐104
Floor effect (%)2.40.50.40.20.50.1
Ceiling effect (%)19.16.212.915.612.61.6
Skewness−0.59−0.43−0.36−0.66−0.17−0.21
Cronbach's α 0.870.810.760.790.850.91
Item‐total correlation0.618–0.800.418–0.650.488–0.600.388–0.670.498–0.68
Inter‐item correlation0.48–0.730.238–0.530.308–0.550.208–0.620.298–0.61
Item homogeneity0.620.380.440.420.48

Abbreviation: LW‐CI scale, Living with Chronic Illness Scale.

Feasibility, acceptability and reliability of the LW‐CI scale Abbreviation: LW‐CI scale, Living with Chronic Illness Scale. The results related to internal consistency showed that Cronbach's α for the LW‐CI scale was .91 and that for domains ranged between .76 (Domain 3: Self‐management) and .87 (Domain 1: Acceptance). All domains reached the present .30 threshold value for item‐total correlation, and item homogeneity index values were higher than 0.30 for all domains. Inter‐item correlation coefficient values ranged from .20 to .73 (Table 2). Regarding convergent validity (Table 3), the LW‐CI scale showed strong positive correlation coefficients with DUFSS (r s = .62) and SLS‐6 (r s = .54).
Table 3

Convergent validity and internal validity of the LW‐CI scale

LW‐CI scale
Domain 1: AcceptanceDomain 2: CopingDomain 3: Self‐managementDomain 4: IntegrationDomain 5: AdjustmentTotal score
Convergent validity
Age0.00−0.10** −0.10** −0.05* −0.12** −0.10**
Age at diagnosis0.02−0.06** −0.10** −0.03−0.09** −0.08**
Disease duration−0.02−0.06** −0.01−0.02−0.06** −0.04*
DUFSS0.30** 0.54** 0.470.540.50** 0.62**
SLS‐60.40** 0.40** 0.40** 0.48** 0.50** 0.54**
Internal validity
Domain 2: Coping0.15
Domain 3: Self‐management0.140.66
Domain 4: Integration0.270.680.67
Domain 5: Adjustment0.230.640.620.63

Abbreviations: DUFFS, Duke‐UNC Functional Social Support Questionnaire; LW‐CI scale, Living with Chronic Illness Scale; SLS‐6, Satisfaction with Life Scale.

p < .05

p < .01.

Convergent validity and internal validity of the LW‐CI scale Abbreviations: DUFFS, Duke‐UNC Functional Social Support Questionnaire; LW‐CI scale, Living with Chronic Illness Scale; SLS‐6, Satisfaction with Life Scale. p < .05 p < .01. Regarding internal validity, correlation values for all domains of the LW‐CI scale ranged from .62 to .68, except for Domain 1: Acceptance, which showed correlation coefficients less than .30 (Table 3). LW‐CI scale scores were significantly different for each category of PGIS (normal, mild, moderate, severe), gender and LTC (Table 4), with significantly higher scores for people with normal severity, women and individuals with hypertension (p < .05). Comparisons between subgroups of PGIS and type of LTC are presented in Table 4.
Table 4

Known groups' validity

CategoriesLW‐CI scale total mean (SD) p
PGIS‐based severity levelsa <.001b
Normal75.06 (17.20)
Mild69.84 (17.11)
Moderate71.12 (18.23)
Severe59.73 (18.51)
Gender<.001
Male68.09 (18.13)
Female70.83 (18.50)
Long‐term condition<.001c
Type 2 diabetes mellitus71.53 (16.45)
Chronic obstructive pulmonary disease67.84 (18.86)
Chronic heart failure72.92 (20.14)
Parkinson's disease62.45 (18.57)
Hypertension75.20 (15.37)
Osteoarthritis63.19 (15.30)

Note: Kruskal–Wallis test with Bonferroni correction for PGIS and long‐term condition, Mann–Whitney test for gender.

Abbreviations: LW‐CI scale, Living with Chronic Illness Scale; PGIS, Patient‐Based Global Impression of Severity Scale; SD, standard deviation.

PGIS‐based severity levels: normal, 0 points; mild, 1–2 points; moderate, 3 points; severe 4–5 points.

Except for mild–moderate comparison, not significant.

Except for Parkinson's disease with osteoarthritis, and chronic heart failure with type 2 diabetes mellitus and with hypertension comparisons, all not significant.

Known groups' validity Note: Kruskal–Wallis test with Bonferroni correction for PGIS and long‐term condition, Mann–Whitney test for gender. Abbreviations: LW‐CI scale, Living with Chronic Illness Scale; PGIS, Patient‐Based Global Impression of Severity Scale; SD, standard deviation. PGIS‐based severity levels: normal, 0 points; mild, 1–2 points; moderate, 3 points; severe 4–5 points. Except for mild–moderate comparison, not significant. Except for Parkinson's disease with osteoarthritis, and chronic heart failure with type 2 diabetes mellitus and with hypertension comparisons, all not significant.

Rasch analysis

The first Rasch analysis, with all items, showed a significant model deviation: χ 2(234) = 560, p < .00001. Because the total scale was multidimensional (19% significant t tests, 95% CI: 0.165–0.215), each domain was analysed separately. Table 5 presents the goodness of fit of the LW‐CI domains, and Table 6 presents the individual item fit.
Table 5

Goodness of fit to the Rasch model of LW‐CI scale domains

AttributeCriteriaDomain 1: AcceptanceDomain 2: CopingDomain 3: Self‐managementDomain 4: IntegrationDomain 5: Adjustment
Item fit residual
Mean00.0670.5450.4410.6340.371
SD10.7530.7340.9990.5941.496
Person fit residual
Mean01.1890.6501.3221.2560.444
SD11.7301.2241.5441.4901.362
Item–trait interaction
χ 2(df)Low18.771 (16)23.790 (20)13.783 (16)15.493 (12)33.994 (20)
p ValueNS0.2810.2510.6150.2160.0262
PSI>0.700.7630.6480.7030.5760.743
Unidimensionality
Independent t tests<5%1.33%1.33%0%1.33%3.00%
95% CI binomial a (−0.011, 0038)(−0.011, 0038)(−0.011, 0038)(0.005, 0.055)

Abbreviations: CI, confidence interval; LW‐CI scale, Living with Chronic Illness Scale; NS, nonsignificant; PSI, personal separation index; SD, standard deviation.

Lower bound should be ≤0.05.

Table 6

Individual item fit

Item (response categories)LocationStandard errorFit residual df χ 2(df = 4) p Value
Domain 1: Acceptance
Item 1: (0–4)0.2120.078−0.283175.756.051.195
Item 2: (0–3)−1.2990.1110.605175.756.326.176
Item 3: (0–4)0.3120.079−0.825175.755.827.212
Item 4: (0–4)0.7750.0790.77175.750.566.967
Domain 2: Coping
Item 5: (0–3)−0.0750.0740.096206.22.828.587
Item 6: (0–3)−0.0720.0750.048206.27.006.136
Item 7: (0–2)0.4720.1091.654206.29.113.058
Item 9: (0–3)0.0380.073−0.018206.22.542.637
Item 10: (0–3)−0.3620.0760.948206.22.301.681
Domain 3: Self‐management
Item 13: (0–4)0.4360.0751.731168.750.937.919
Item 14: (0–4)−0.4180.083−0.471168.755.131.274
Item 15: (0–4)0.2020.0730.711168.752.934.569
Item 16: (0–4)−0.2200.08−0.209168.754.781.311
Domain 4: Integration
Item 17: (0–3)−0.3220.0941.2611432.981.561
Item 19: (0–4)0.3650.0780.0781434.211.378
Item 20: (0–3)−0.0430.0960.5641438.301.081
Domain 5: Adjustment
Item 22: (0–3)0.4670.080.38204.21.281.865
Item 23: (0–3)−0.2350.0820.775204.26.801.147
Item 24: (0–4)−0.8060.066−0.553204.26.175.186
Item 25: (0–3)0.2330.078−1.347204.213.897.008
Item 26: (0–3)0.3410.0822.602204.25.839.212
Goodness of fit to the Rasch model of LW‐CI scale domains Abbreviations: CI, confidence interval; LW‐CI scale, Living with Chronic Illness Scale; NS, nonsignificant; PSI, personal separation index; SD, standard deviation. Lower bound should be ≤0.05. Individual item fit For the Acceptance domain, item 2 showed disordered thresholds, and categories 2–3 were collapsed. This dimension showed a good model fit, χ 2(16) = 18.772, p = .281, with unidimensionality, PSI = 0.763, locally independent items and absence of DIF by age, sex, disease duration or LTC. The person‐item threshold distribution shows a ceiling effect close to 20% (Figure 1).
Figure 1

Person‐item threshold distributions for the Living with Chronic Illness domains

Person‐item threshold distributions for the Living with Chronic Illness domains When performing a Rasch analysis of the Coping domain, three items (2, 11 and 12) showed a significant misfit: Item 8 presented a low‐fit residual (−2.501) and items 11 and 12 presented high‐fit residuals (3.506 and 2.957, respectively). All Coping items were rescored due to disordered thresholds. The resulting scale presented an adequate fit to the Rasch model, χ 2(20) = 23.790, p = .252, PSI = 0.648, unidimensionality and item local independency. Item 7 presented DIF by LTC type, and item 5 showed uniform DIF by disease duration (people with a more recent diagnosis underestimated scores). The Self‐management domain presented a good fit to the Rasch model, with ordered thresholds, unidimensionality, PSI = 0.703, locally independent items and absence of DIF: χ 2(16) = 13.783, p = .615. To obtain fit in the Integration domain, the following modifications were performed: Rescoring of all items due to disordered thresholds, and deletion of items 18 (fit residual: 3.454) and 21 (fit residual: 2.848). The modified scale presented a good fit to the Rasch model, PSI = 0.576, unidimensionality and item local independency, χ 2(12) = 15.493, p = .216. Item 20 presented uniform DIF by LTC type. The person‐item threshold distribution showed a high (26.7%) ceiling effect (Figure 1). In the Adjustment domain, all items except one (item 24) were rescored due to disordered thresholds. After this, the domain presented a good fit to the Rasch model, χ 2(20) = 33.994, p = .0262, PSI = 0.743, unidimensionality and item local independency. Although item 26 showed a marginally high‐fit residual (2.603), it was nonsignificant. The initial DIF by LTC type in items 24 and 26 cancelled out in the top–down purification procedure.

DISCUSSION

This is the first study to analyse the psychometric properties of the LW‐CI scale in a large sample of individuals with different LTCs in several Spanish‐speaking countries. Currently, the LW‐CI scale is the only PROM available in clinical practice and research that evaluates in a comprehensive manner how a person is living with an LTC.

Feasibility and acceptability

In general, all acceptability parameters fulfilled the standard criteria. Floor and ceiling effects could be explored using both CTT and Rasch analyses. The two domains with the highest ceiling effect at the item level, Acceptance and Self‐management, also showed a ceiling effect at the threshold level in the Rasch analysis. This could be attributed to the fact that individuals involved in this study participated voluntarily, potentially implying some degree of acceptance as well as good management of the LTC and hence, in some cases, also a positive living with the disease. A large percentage of individuals tend to score in the highest levels of these domains, which might prevent observation of changes after an intervention in people with initial high scores. To verify this result, group comparisons in the Acceptance and Self‐management domains should be performed with caution. The quality of the data was satisfactory, exceeding 95% of computable data, due to the close supervision performed by researchers during data collection and the standardized protocol established for the data collection.

Reliability

Reliability was also explored using both CTT and Rasch approaches. The internal consistency of the LW‐CI scale is satisfactory, with all domains exceeding the criteria of ≥0.70 for Cronbach's α. However, Integration and Coping domains showed lower reliability (PSI) in Rasch analysis, which may be due to a small number of items and the ceiling effect. A lower reliability might hinder the ability of these domain scores to discriminate between two individual groups. In this sense, further studies are recommended to verify the reliability of both domains.

Convergent validity

Regarding convergent validity, the results corroborate the strong relationship between living with an LTC and perceived social support of the person as well as satisfaction with life. Living with an LTC presents low correlations with disease‐related factors, namely, duration. Congruently, all items except one were unbiased by disease duration in Rasch analysis. Further studies are needed to confirm whether DIF by duration in item 5 (I try to cope and fight the disease) remains, as it was not identified in a study with a PD population. In addition, two items showed bias by LTC type: Coping item 7 (I try to see the positive side of the disease) and Integration item 20 (Although I have the disease, I feel satisfied with my life). In item 20, people with hypertension tended to overestimate scores, whereas for item 7, there was no a clear pattern. Further studies are needed to confirm these DIF results, and the results at the item level should be interpreted with caution when comparing individuals. However, these two items represent less than 10% of the scale. Even though a previous study had found that one item was biased by age, we did not replicate this finding in the present study, showing the absence of DIF by age for all items. Therefore, the LW‐CI scale could be useful across a general adult (≥18 years) population living with at least one LTC in clinical practice. Convergent validity findings were also identified in previous validation studies , , , , and additionally were confirmed through linear regression models performed with an LTC population such as PD. According to these results, there is clearly a need to place the emphasis on the person and in his/her daily living with the condition, and not just on the disease. Each person with an LTC must be seen as a unique person, independent of the stage or the severity of the disease. Therefore, it is necessary to incorporate multidisciplinary and individualized interventions in current health and social services, focusing on the factors that directly influence living with an LTC, namely, social support and satisfaction with life. Consequently, possible negative aspects of the daily living with an LTC, such as lack of support, loneliness or dissatisfaction with life, could be prevented, and a more positive living can be achieved. In this sense, person‐centred interventions or individualized health and social pathways could be implemented in clinical practice, incorporating nonpharmacological or disease‐specific measures that address the factors that are paramount in the daily living with an LTC. Therefore, LTC programmes that mobilize and optimize the use of community resources and increase social networks and support seem to be the direction for the management of LTCs.

Internal validity

The internal validity for LW‐CI scale domains was excellent, except for Domain 1: Acceptance, with correlation coefficients under .30 with the rest of the domains. This result is consistent with previous validation studies and conceptual work showing that Acceptance is always the first domain to achieve a positive living. Only when the person has accepted and assumed his/her illness can he or she move on to the other domains, such as Coping or Self‐management. Therefore, according to the poor correlation that Acceptance showed with other dimensions of the LW‐CI scale and based on the aforementioned conceptual framework, these findings were expected because Acceptance is considered an internal, illness‐independent, process through which the person recognizes and accepts the reality. Interval validity was also supported by Rasch analysis, showing that each domain is unidimensional, and providing support for the calculation of domain scores.

Known groups' validity

The LW‐CI scale demonstrated satisfactory known groups' validity, yielding significantly different scores between men and women, patient‐based global impression of disease severity and LTC type. The result related to differences among types of LTC is understandable, as each condition has its particular symptoms and evolution. For example, PD is defined as a complex and disabling disorder characterized by being a neurodegenerative and progressive disorder, while hypertension is a cardiovascular condition that could be managed with healthy lifestyle patterns. In this sense, the individual may have a better or worst process based on the LTC characteristics. However, further studies are suggested to verify this result. Regarding gender differences, existing evidence also justifies the identified results. For example, Crispino et al. stated that in general, women with PD showed more positive disease outcomes than men. Besides, other studies performed in individuals with T2DM showed that women with T2DM are at greater risk than men of psychosocial maladjustment, a poorer cardiovascular profile and/or noncompliance with treatment goals. The observed significant differences by gender are not due to a bias, as no item presented DIF by gender. However, the significantly lower scores in hypertension individuals should be interpreted with caution, since two items were biased by LTC type. Therefore, LW‐CI scores may be interpreted similarly across LTC types, thus allowing group comparisons, except for two items. To achieve model fit in Rasch analysis, some modifications were performed. First, the response scale was simplified for some items, similar to a previous study with only a PD population. This result suggests that individuals have difficulty in setting apart from some response options and that the response scale should be codified differently than what was initially proposed. This does not modify the scale administration. Another modification suggested by Rasch analysis was the deletion of certain items. Again, they might be maintained in the scale administration, as they can provide useful clinical information. However, when calculating linear scores, these items should not be considered, as they are either redundant or they measure a different construct. In both the present study and the previous study, item 8 was found to be redundant, and item 18 measured a different construct. Recently, other measures have been designed and validated as the Long‐Term Conditions Questionnaire with Rasch analysis in a wide and representative sample of people living with LTCs in three regions of England with the general aim of evaluating how people live/manage their LTC. However, despite the potential relevance of the Long‐Term Conditions Questionnaire, this scale seems to evaluate quality‐of‐life outcomes instead of living with an LTC and excludes aspects related to acceptance, which is an essential attribute when living with an LTC. Moreover, currently, there are multiple measuring scales that seem to evaluate the phenomena of living with an LTC. However, existing scales evaluate the process in a fragmented way by measuring some elements of the process or related processes, such as quality of life. Consequently, to our knowledge, the LW‐CI scale could be considered the only available person‐centred measure that evaluates the complex process of living with an LTC in a comprehensive manner. Using this scale, healthcare professionals could identify aspect/s of the process that the patient finds more challenging and consequently, referrals, interventions or signposting to services or resources could take place based on the assessment and identified needs. For example, the scale itself could be part of interventions through which patients could complete the scale at home, increasing their awareness of how they live with the LTCs and in their annual or periodic review with the GP, nurse or specialist, the results from the assessment could also be discussed for further support. This could be equally applied to research projects. At present, a cross‐culturally adapted version of the scale has been produced in the United Kingdom (called the living with long‐term condition scale) and full validation study is ongoing, which would allow health and social care professionals to implement person‐centred care pathways and referral processes. This validation study is novel because the LW‐CI scale is the first validated rating scale for assessing the phenomenon of living with an LTC. Moreover, this scale has been used for the first time to assess several highly prevalent LTCs in different Spanish‐speaking countries using two complementary analytical approaches to ascertain its psychometric properties. Therefore, considering the results, the LW‐CI scale could be used in clinical practice to evaluate the degree of living with several highly prevalent LTCs in different Spanish‐speaking countries.

Limitations

We acknowledge that the limitations of the study are mainly related to the convenience sample, with a heterogeneous representation of LTCs and countries. Additionally, although country‐based samples were not large enough to produce any country‐based (cultural) analysis, further international studies are needed to test item bias by country as well as cultural differences within countries. Besides, considering the sample diversity, including people from six different countries, sociodemographic data related to ethnicity were not collected. Additionally, for this validation study patient and public involvement (PPI) was not conducted because the aim of this study was to statistically analyze the psychometric properties of the LW‐CI scale. However, PPI was a key aspect during the development of the scale and piloting phase before the main validation studies. Finally, data collection was performed at different times for PD and the rest of the LTCs. However, to ensure homogeneity of the process and avoid errors, a clear and standardized protocol was followed, and data quality was equally valid for the purpose of this study. On the other hand, the strengths of this study are related to the sample diversity, including the highly prevalent and prototypical LTC population as well as the large age range population, which led to the real value of the LW‐CI scale psychometric properties for a general LTC population. Finally, the combined application of the classic test theory approach and Rasch analysis is highly recommended for evaluating patient outcome report measures such as the LW‐CI scale.

CONCLUSION

This study fulfils an important gap in the literature regarding person‐centred measures to evaluate the process of living with an LTC. After some adjustments, the LW‐CI domains showed a good fit to the Rasch model, with unidimensionality, item local independency and moderate reliability, providing scores on a true interval scale. This last feature is key for using the scale in clinical trials. Except for two items, the LW‐CI scale was free from bias by LTC type. In this sense, although cautious use is suggested, the LW‐CI scale is ready for use in clinical practice and research in Spanish‐speaking populations living with different LTCs, which could lead to more person‐centred care and individualized psychosocial interventions. Therefore, future implementation studies are suggested to assess the usefulness of the LW‐CI scale in clinical practice.

CONFLICT OF INTERESTS

The authors declare that there are no conflict of interests.

AUTHOR CONTRIBUTIONS

Carmen Rodriguez‐Blazquez, Maria João Forjaz, and Alba Ayala: design of the work, data analysis, interpretation of the findings, drafting the article, critical revision and substantial contribution of the article, approval of the final version for publication. Mari Carmen Portillo: conception and design of the work, expert consulting, critical revision and substantial contribution of the article, approval of the final version for publication. Leire Ambrosio: principal author of the scale, principal investigator of the project and responsible for funding of the project, conception and design of the work, oversight of the project, data collection, interpretation of the findings, drafting the article, critical revision and substantial contribution of the article, approval of the final version for publication. The corresponding author, in representation of the rest of the undersigning individuals, guarantees the precision, transparency and honesty of the data and information contained in the study and additionally that none of the relevant information has been omitted, and that all discrepancies among the authors have been adequately resolved and described. Supporting information. Click here for additional data file.
  37 in total

Review 1.  Assessing health status and quality-of-life instruments: attributes and review criteria.

Authors:  Neil Aaronson; Jordi Alonso; Audrey Burnam; Kathleen N Lohr; Donald L Patrick; Edward Perrin; Ruth E Stein
Journal:  Qual Life Res       Date:  2002-05       Impact factor: 4.147

2.  Self-reported health status of the general adult U.S. population as assessed by the EQ-5D and Health Utilities Index.

Authors:  Nan Luo; Jeffrey A Johnson; James W Shaw; David Feeny; Stephen Joel Coons
Journal:  Med Care       Date:  2005-11       Impact factor: 2.983

Review 3.  The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper?

Authors:  Alan Tennant; Philip G Conaghan
Journal:  Arthritis Rheum       Date:  2007-12-15

Review 4.  Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations.

Authors:  Jeremy C Hobart; Stefan J Cano; John P Zajicek; Alan J Thompson
Journal:  Lancet Neurol       Date:  2007-12       Impact factor: 44.182

5.  A simulation study of the number of events per variable in logistic regression analysis.

Authors:  P Peduzzi; J Concato; E Kemper; T R Holford; A R Feinstein
Journal:  J Clin Epidemiol       Date:  1996-12       Impact factor: 6.437

6.  The problem with health measurement.

Authors:  Stefan J Cano; Jeremy C Hobart
Journal:  Patient Prefer Adherence       Date:  2011-06-14       Impact factor: 2.711

Review 7.  Sex and Gender Differences in Risk, Pathophysiology and Complications of Type 2 Diabetes Mellitus.

Authors:  Alexandra Kautzky-Willer; Jürgen Harreiter; Giovanni Pacini
Journal:  Endocr Rev       Date:  2016-05-09       Impact factor: 19.871

8.  Validation of living with chronic illness scale in a type 2 diabetes mellitus population.

Authors:  Jorge Caro-Bautista; Carmen Rodríguez-Blázquez; David Perez-Manchon; Eva Timonet-Andreu; Gloria Carvajal-Carrascal; Alejandra Fuentes-Ramírez; Silvia Corchon; Marta Aranda-Gallardo; Leire Ambrosio
Journal:  Health Qual Life Outcomes       Date:  2021-03-17       Impact factor: 3.186

9.  Person-Centered Health Promotion: Learning from 10 Years of Practice within Long Term Conditions.

Authors:  John Downey; Saul Bloxham; Ben Jane; Joseph D Layden; Sam Vaughan
Journal:  Healthcare (Basel)       Date:  2021-04-08

10.  Rasch analysis of the long-term conditions questionnaire (LTCQ) and development of a short-form (LTCQ-8).

Authors:  Laurie Batchelder; Diane Fox; Caroline M Potter; Michele Peters; Karen Jones; Julien E Forder; Ray Fitzpatrick
Journal:  Health Qual Life Outcomes       Date:  2020-11-30       Impact factor: 3.186

View more
  1 in total

1.  Living with Chronic Illness Scale: International validation through the classic test theory and Rasch analysis among Spanish-speaking populations with long-term conditions.

Authors:  Carmen Rodriguez-Blazquez; Maria João Forjaz; Alba Ayala; Mari Carmen Portillo; Leire Ambrosio
Journal:  Health Expect       Date:  2021-09-07       Impact factor: 3.377

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.