Agreement of a Short Form of the Self-Administered Multidimensional Prognostic Index (SELFY-MPI-SF): A Useful Tool for the Self-Assessment of Frailty in Community-Dwelling Older People.

BACKGROUND: The Multidimensional Prognostic Index (MPI) is a comprehensive geriatric assessment (CGA)-based tool that has shown excellent accuracy in predicting negative health outcomes in older people. Recently, the self-administered version of MPI (SELFY-MPI) has been validated in a community-dwelling sample, revealing excellent agreement with the original MPI. In the SELFY-MPI, Gijon's social-familial evaluation scale (SFES) was used to assess socio-relational and economic aspects. Completion of the SELFY-MPI, however, requires a significant amount of time in people aged over 60 years, particularly to fill in the SFES scale. The aim of this study was to validate, in a sample of community-dwelling older people, a short-form version of the SELFY-MPI (SELFY-MPI-SF), in which the SFES scale was replaced by the "co-habitation status" domain, as in the original version of the MPI.
METHODS: All participants included in the study completed both versions of the self-administered MPI, which share the following seven domains: 1) basic and 2) instrumental activities of daily living, 3) mobility, 4) cognition, 5) nutrition, 6) comorbidity, and 7) number of medications. Moreover, in the SELFY-MPI-SF, the 8th domain "co-habitation status" (ie living alone, with family or in a residential facility) replaced the SFES scale. The Bland-Altman methodology was applied in order to measure the agreement between the two instruments. Finally, the time to complete the SFES scale and the question on co-habitation was measured.
RESULTS: The final study sample was composed of 129 participants (mean age=76.8 years, range=65-93 years, 64.3% women) were enrolled. The mean SELFY-MPI and SELFY-MPI-SF values were 0.221±0.196 and 0.246± 0.188, respectively. The mean difference was clinically irrelevant (-0.025±0.058). None of the 129 observations showed values outside the established 5% limits of agreement. The agreement between SELFY-MPI and SELFY-MPI-SF was excellent (k=0.762; rho=0.924, p<0.0001 for both). Stratified analyses of agreement among subgroups of participants of different ages did not show any significant differences between the two versions. Completion of the SFES required about 7 mins, on average, while the question on habitation status required about 10 s.
CONCLUSION: The SELFY-MPI-SF showed strong agreement and precision when compared with the standard SELFY-MPI in people aged 65 and older and can therefore be successfully used as a quicker self-administered frailty instrument in community-dwelling older people.

Introduction

Prognostic tools have increasingly been used in current geriatric medicine in order to improve clinical decision-making in diagnostics and therapeutics, and also to identify frail older people in order to tailor appropriate interventions. Multimorbidity and domains such as physical and cognitive function and biological and social determinants are key factors in formulating the prognosis of older people.1 Comprehensive Geriatric Assessment (CGA) has been recognized as a multidimensional, interdisciplinary diagnostic process able to effectively explore all these multiple domains of health, and is widely used to determine the clinical profile, pathological risk, residual skills, and short- and long-term prognosis in frail older people.2

Among the few mortality prognostic indices used in geriatric medicine, the Multidimensional Prognostic Index (MPI)3 has proved to be a well-calibrated tool with good discrimination and accuracy in predicting short- and long-term mortality in both hospital4 and community settings.5 The MPI is a CGA-based prognostic tool that collects information on functional and cognitive aspects, mobility, nutrition, polypharmacy, comorbidity and cohabitation status through standardized and validated rating scales.3

The ability of MPI to identify short- and long-term mortality and other negative health outcomes has been demonstrated by several multicenter studies, making this instrument a valuable aid to the clinical decision-making process in multimorbid older patients6 and one of the reference tools for assessing frailty.7,8 According to the growing interest in self-perception of health status in current medicine, a self-administered version of a clinical assessment tool has been developed. Hence, the self-perception of frailty could allow an early diagnosis of this syndrome. Nevertheless, a recent review underlined that data on self-reported tools regarding frailty assessment in older people were limited9 and that only physical frailty was the dimension that could be assessed on the basis of the criteria proposed by Fried et al.10

Very recently, a self-administered version of MPI (SELFY-MPI) was developed and validated in a community-dwelling population within the framework of the European Union co-funded project EFFICHRONIC.11 The SELFY-MPI showed similar values to the standard MPI, and their agreement proved to be age-independent.11 Moreover, preliminary data on this easy-to-use tool indicate that it has been implemented in five European countries, attesting to its feasibility in different national contexts and in heterogeneous populations.12

However, even though the SELFY-MPI is a quick and easy tool, it has shown a significant difference in filling time between people aged under 60 years and those over 60 years: in the younger age-group, the mean value was 13.5 mins (standard deviation ±4.7), while in older participants the mean value was 21.7 mins (standard deviation ±9.2).12 A significant portion of the completion time is required by Gijon’s social-familiar evaluation scale (SFES), which was used in the EFFICHRONIC project for the in-depth assessment of social marginalization in a sample of adults of all ages.12 Although an in-depth assessment of the social dimension could be particularly relevant for older people, information on cohabitation status, and particularly the condition of living alone, is also relevant in assessing social determinants of frailty. Living alone is, in itself, associated with a higher risk of unplanned hospitalization,13 a higher risk of falling, higher levels of disease and disability,14 and even a higher risk of mortality.15

We therefore constructed a short-form version of the SELFY-MPI (SELFY-MPI-SF) in order, on the one hand, to place greater emphasis on the loneliness of older people as a potential risk factor, and mainly to facilitate self-administration of the test by older people by shortening its completion time.

The aim of the present study was to compare the precision and agreement of this new short-form version of the SELFY-MPI with the previously validated SELFY-MPI.11 The only difference between the two instruments is that the SFES (included in the standard version of the SELFY-MPI) has been replaced by the question on cohabitation status in the SELFY-MPI-SF.

Methods

Study Design and Population

This observational study was conducted between January and July 2019 in accordance with the World Medical Association’s 2008 Declaration of Helsinki, the guidelines for Good Clinical Practice, and the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines.16

The inclusion criteria were: (1) age 65 years or over; (2) community-dwelling people who attended the outpatient clinics of Galliera Hospital; (3) absence of acute clinical conditions; (4) ability to provide informed consent. All participants read and signed the informed consent form and all participants’ records and personal information were rendered anonymous before statistical analysis.

The Ethics Committee of the Liguria Region (Italy) approved this study.

Self-Administered MPI (Standard SELFY-MPI)

The standard SELFY-MPI11 considers the following eight domains, assessed through eight self-administered scales ():

Functional status, measured by the Barthel ADL scale,17 which assesses feeding, bathing, personal hygiene, dressing, fecal and urinary continence and toilet use. This scale can be self-assessed.18

Mobility, assessed through the Barthel mobility17 scale, which measures the ability to get in and out of bed/chair, walk and go up and down the stairs. This scale can also be self-administered.18,19

Independence in the instrumental activities of daily living, ie, telephone use, grocery shopping, meal preparation, housekeeping, laundry, travel, medication, handling finances; these items are assessed through the self-administered version of Lawton’s Instrumental Activities of Daily Living (IADL) scale.20

Cognitive status, investigated by means of the self-administered cognitive screening test, Test Your Memory (TYM).21 This 10-task cognitive test explores several domains, such as orientation, ability to copy a sentence, semantic knowledge, calculation, verbal fluency, similarities, naming, visuo-spatial abilities and recall of a previously copied sentence. The score ranges from 0 to 50, higher scores indicating better cognitive function.21

Nutritional status, measured by means of the Mini Nutritional Assessment Short Form (MNA-SF)22 through its validated self-administered version.23 This scale is composed of 6 items and includes information on (1) decline in food intake, (2) weight loss, (3) mobility, (4) recent psychological stress, (5) neuropsychological problems and (6) anthropometric measures (body mass index and weight loss).

The number of medications regularly taken by the subject.

Comorbidity, evaluated by means of the Cumulative Illness Rating Scale (CIRS),24 which explores the number of chronic health diseases requiring drug therapies in 13 health areas: (1) cardiac, (2) hypertension, (3) vascular, (4) respiratory, (5) eye, ear, nose, throat, larynx, (6) upper gastrointestinal (esophagus, stomach, pancreas), (7) lower gastrointestinal (intestines, hernias), (8) hepatic and pancreatic, (9) renal, (10) genitourinary (ureters, bladder, urethra, prostate, genitals) or gynecological, (11) muscles, bone and skin, (12) neurological (stroke, multiple sclerosis), (13) endocrine-metabolic (diabetes, thyroid, high cholesterol). Self-assessment of this scale is possible since participants are asked to report health problems for which they receive pharmacological treatment.

Socioeconomic domain, explored through the adapted version of the self-administered Gijon’s social-familial evaluation scale (SFES).25 This scale assesses the subject’s household composition, net monthly household income, living accommodation, social relationships and social support received. The SFES is a self-administered scale composed of 5 items, the maximum score being 25 points. Higher scores indicate a major social risk: scores between 10 and 14 indicate a social risk, and scores over 15 social problems.26

For each domain, a tripartite hierarchy is used, whereby a score of 0 indicates no problems, 0.5 minor problems and 1.0 major problems. This scoring is based on the conventional literature on each scale. The sum of these eight domains has to be divided by 8 in order to obtain a final SELFY-MPI risk score, ranging from 0 (= no risk) to 1 (= high risk), using the tripartite hierarchy in 0–0.33 (low risk of mortality), 0.34–0.66 (moderate risk) and 0.67-1.0 (severe risk), according to the traditional division of this score.11

SELFY-MPI Short-Form

The SELFY-MPI-SF includes the first seven items of the standard SELFY-MPI (), ie, Barthel ADL, Barthel MOB, IADL, TYM test, MNA-SF, number of medications, and CIRS. In the eighth domain, however, the SFES scale is replaced by a tripartite item that includes three different living conditions: living alone, living in a residential facility, living with family members (see ). Different levels of risk are attributed to each condition; living alone is considered a high-risk condition, living in a residential facility a moderate-risk condition and living with family members (such as spouse, offspring, relatives) a low-risk condition.

The same tripartite hierarchy as the standard SELFY-MPI is used and the same scoring is applied in order to obtain a final SELFY-MPI-SF risk score ranging from 0, low risk, to 1, higher risk of negative outcomes.

Statistical Analysis

The main descriptive statistics were: absolute and relative (%) frequencies; mean; standard deviation (SD); median; and minimum, maximum, and interquartile range (IQR). Mean differences were tested by means of the paired sample t-test.

The relationship between SELFY-MPI and SELFY-MPI-SF was assessed through several methods. First, the agreement between these two measures, divided into categories, was estimated using the kappa coefficient; values less than 0.4 can be considered as poor, from 0.4 to 0.75 fair to good, and over 0.75 excellent.27 The agreement between the two tools was assessed as continuous measures using the Spearman’s rank correlation coefficient (rho), due to the non-normal distribution of the two variables of interest: values close to zero indicate a low association between variables and those close to –1 or +1 indicate a strong linear association between two variables. Finally, precision was assessed using the Bland–Altman plots. Although scatter plots are an excellent way of checking the correlation between two outcomes, this method has low sensitivity in assessing the agreement between two measures. The Bland–Altman plot (BAP)28 methodology was used, since it provides an objective measure (95% limits of agreement) and a visual representation (plot of the difference vs the mean of the two measures) of the level of agreement between two different continuous measures. In order to detect possible age-dependent differences in the level of agreement, a BAP analysis stratified by deciles of age was performed.

We report two-tailed probabilities; a p-value of 0.05 was adopted to define nominal statistical significance. All analyses were conducted by means of the STATA software (version 14.2; StataCorp., Station, TX).

Results

A total of 129 participants completed both versions of the SELFY-MPI questionnaire; their mean age was 76.8 years (standard deviation, SD ± 6.16 years; range 65–93 years) and most were women (64.3%) (Table 1). In this cohort, mean standard SELFY-MPI and SELFY-MPI-SF values were 0.221 (SD ± 0.196) and 0.246 (SD ± 0.188), respectively. The mean difference between the standard SELFY-MPI and its short-form version (SELFY-MPI-SF) was −0.025 (SD ± 0.058) (p = 0.316). The agreement between SELFY-MPI and SELFY-MPI-SF was excellent using both the kappa coefficient (k=0.762, p<0.0001) and the rho coefficient (rho=0.924, p<0.0001).

Table 1

Participants’ Characteristics

Age, Years
Mean (SD)	76.8 (6.2)
Median (IQR)	78 (72–81)
Min/max	65/93
Gender, n (%)
Men	46 (35.6)
Women	83 (64.3)
Diseases, n (%)
Hypertension	77 (59.7)
Cardiac	32 (24.8)
Vascular	25 (19.4)
Musculo-Skeletal	25 (19.4)
Endocrine-Metabolic	25 (19.4)
Upper GI	23 (17.9)
Lower GI	10 (7.8)
Genitourinary	20 (15.5)
ENT	15 (11.6)
Neurological	8 (6.2)
Respiratory	7 (5.4)
Liver	2 (1.6)
Kidney	1 (0.8)
Standard SELFY-MPI
Mean (SD)	0.221 (0.196)
Median (IQR)	0.188 (0.063–0.250)
Min/max	0.0/0.813
SELFY-MPI-SF
Mean (SD)	0.246 (0.188)
Median (IQR)	0.188 (0.063–0.313)
Min/max	0.0/0.813
Difference (SELFY-MPI-SF; Standard SELFY-MPI)
Mean (SD)	−0.025 (0.058)
Median (IQR)	0.0 (−0.063 −0.0)
Min/max	−0.125/0.063

Abbreviations: IQR, interquartile range; SD, standard deviation; GI, gastrointestinal; ENT, eye, nose, throat, larynx.

Hypertension was the most common disease, being reported by 77/129 participants (59.7%), followed by cardiac diseases in 32 (24.8%), vascular, musculo-skeletal and endocrine-metabolic diseases in 25 participants each (19.4%), gastroenteric conditions (upper and lower) in 33 (25.6%) and genitourinary diseases in 20 (15.5%).

Figure 1 shows the BAPs of the association between the two SELFY-MPI versions: none of the 129 participants included in the study showed values outside the limits of agreement.

Figure 1

Bap of agreement between standard SELFY-MPI and SELFY-MPI-SF.

A stratified analysis of agreement among subgroups of participants subdivided by deciles of age was performed. As shown in Figure 2, across the deciles of age the difference between the standard SELFY-MPI and its short-form version (SELFY-MPI-SF) was not statistically significant. Moreover, within each age-category, no significant differences between the two versions of SELFY-MPI emerged.

Figure 2

Agreement between standard SELFY-MPI and SELFY-MPI-SF in participants subdivided according to deciles of age.

With regard to completion time, we observed a highly significant (p <0.001) statistical difference between the time needed to complete the SFES scale (about 7 mins) and the time needed to complete the question on cohabitation status (about 10 s) ().

Discussion

A self-administered tool able to evaluate frailty is currently a target for welfare and health-care systems, since the self-perception of frailty could yield a wider assessment and enable frailty to be diagnosed earlier.29 So far, the self-assessment of frailty has been used only for screening purposes. Moreover, a systematic review found a total of 10 self-administered tools for assessing frailty in primary care and concluded that the Tilburg Frailty Indicator and the SHARE Frailty Index were the only suitable ones.9 However, as neither of the two was reported to have been compared with a validated scale, their utility in daily clinical practice remains to be confirmed by further research.9 The self-administered FRAIL scale recently developed by Morley30 is based mainly on the criteria proposed by Fried at al.10 and investigates frailty only in terms of physical frailty.

Very recently, a self-administered version of MPI (SELFY-MPI) was developed and validated within the framework of the EFFICHRONIC project,11 with the aim of enabling self-assessment of the degree of personal frailty. Like the original MPI, the SELFY-MPI includes not only physical domains but also other important aspects of frailty, ie, comorbidity, polypharmacy, cognition, functional, nutrition and social status. A previous study demonstrated the strong diagnostic agreement between the SELFY-MPI and the MPI, indicating that the SELFY-MPI could be used as a predictive tool in community-dwelling subjects.11 Like the original MPI, which is able to extract information from CGA to categorize frailty in three subgroups and has excellent prognostic value,31 the SELFY-MPI stems from the need for prognostic indices that can be used in the clinical decision-making process in multimorbid and frail older adults, starting from the primary care setting.32

Our investigation was aimed at validating a short-form version of the SELFY-MPI (SELFY-MPI-SF), in which the SFES scale has been replaced by the item “co-habitation status”; this item was included in the original version of the MPI in order to underline the relevance of the co-habitation status of the elderly.3,14 Our comparison of the two versions of the self-administered MPI showed good agreement between the standard SELFY-MPI and its short-form version (SELFY-MPI-SF), since we observed a very small, and not clinically significant, overestimation in the case of the short-form version (a mean difference of only −0.025 points). Moreover, the BAPs showed that none of the 129 participants fell outside the limits of agreement.

Finally, as expected, we found a highly significant difference in completion time between the two instruments, the average time needed to complete the SFES scale (about 7 mins) being much longer than the 10 s required, on average, for the simple co-habitation status question. This significant reduction in completion time makes the SELFY-MPI-SF an even easier self-administered tool for frailty assessment in older people.

The present study has some limitations. First, the cohort enrolled was relatively small, consisting of 129 people enrolled. Second, the study design was cross-sectional: longitudinal studies will be required in order to ascertain whether both versions of the SELFY-MPI can predict outcome (mortality or negative outcomes) with the same accuracy as the MPI. Third, as in the case of all self-administered tools, self-reported data may be influenced by the subject’s cognitive status. Moreover, not having more information on the cognitive state of the participants is a further limitation.

Conclusion

In conclusion, these findings suggest that the new short-form version of the SELFY-MPI (SELFY-MPI-SF) is similar to that of the standard SELFY-MPI, with the advantage that the completion time is shorter. The SELFY-MPI-SF may therefore be an excellent tool for the self-assessment of frailty in community-dwelling older people.