Chinese version of Montreal Cognitive Assessment Basic for discrimination among different severities of Alzheimer's disease.

OBJECTIVES: To find out whether the Chinese version of Montreal Cognitive Assessment Basic (MoCA-BC) and its subtests could be applied in discrimination among cognitively normal controls (NC), mild cognitive impairment (MCI), mild and moderate Alzheimer's Disease (AD), and furthermore, to determine the optimal cutoffs most sensitive to distinguish between them.
DESIGN: A cross-sectional validation study.
SETTING: Huashan Hospital, Shanghai, China. PARTICIPANTS: There was a total of 1,969 participants: individuals with MCI (n=663), mild (n=345), moderate (n=441) AD, and cognitively NC (n=520) were recruited from the Memory Clinic, Huashan Hospital, Shanghai, China. MEASUREMENTS: Baseline MoCA-BC scores were collected from firsthand data. Two subtests were calculated from MoCA-BC: the Memory Index Score of MoCA-BC (MoCA-BC-MIS) and the Non-memory Index Score of MoCA-BC (MoCA-BC-NM).
RESULTS: MoCA-BC was an effective cognitive tool to discriminate among NC, MCI, mild and moderate AD in the Chinese elderly across all education groups, implying that it was efficient not only for detecting MCI, but for different severities of AD as well. For MCI screening, the total score of MoCA-BC (MoCA-BC-T) and MoCA-BC-MIS had similar high sensitivity and specificity. For discrimination among MCI, mild and moderate AD, the MoCA-BC-T and MoCA-BC-NM had similar performance.
CONCLUSION: MoCA-BC is an effective cognitive test to distinguish between NC, MCI, mild and moderate AD among the Chinese elderly with various levels of education.

Background

Montreal Cognitive Assessment (MoCA) has been widely used as a screening test for detection of mild cognitive impairment (MCI) in the highly educated elderly with an average education level of 13 years.1–4 A revised MoCA test called the MoCA basic (MoCA-B) was devised to screen for MCI in a group of individuals with little education.5

However, the application of MoCA to discriminate patients with MCI and Alzheimer’s Disease (AD) showed wide differences in thresholds due to cultural differences across regions. Comparisons between healthy controls and subjects with MCI or AD conducted in several international validation studies reported diverse cutoff points, sensitivity and specificity values. For instance, Bosco et al6 reported a minimum cutoff of 17 to detect MCI in Italy, while Ng et al7 as well as Tu et al8 suggested a maximum cutoff of 27 appropriate for Singaporean and Chinese. As for AD detection, cutoff points were also demonstrated differently ranging from a minimum of 146 to a maximum of 269 all over the world. The Chinese version of the MoCA-B (MOCA-BC), translated with cultural modifications from the original English version, has shown excellent validity and accuracy in screening for MCI in the Chinese elderly.9–11 Since education level had been found to affect MoCA scores,2,12 the optimal cutoff points of the MOCA-BC for screening for MCI were developed based on it as well.13 Our previous study determined the optimal cutoff scores for MCI screening among different education groups, and recognized the MoCA-BC as a more sensitive and accurate scale in screening for MCI compared to the mini-mental state examination (MMSE).10

In addition, epidemiological studies have found that MoCA was superior to MMSE as a brief and feasible assessment tool, particularly in discerning earlier stages of cognitive decline.14 To save time and avoid duplicate tests, the MOCA-BC had been observed to be frequently used in clinics in China as a replacement of MMSE due to convenience and higher screening efficiency.15 The MoCA-BC, given its sensitivity to non-memory cognitive domains such as executive function,5,10 should be better suited for detecting more severe disease states. However, no relevant research has been conducted concerning MoCA-BC in staging dementia severity. The present study aimed to find out whether MoCA-BC or its subtests could be applied as a preliminary screening method to distinguish among outpatients with MCI, mild and moderate AD as a substitute for MMSE.

Many studies have shown that patients with MCI, who subsequently declined to AD, were first impaired in delayed recall memory.16–18 In the early phase of MCI, executive functions were preserved as a compensation for hippocampal dysfunction.19,20 However, with the progression of the disease, the frontal executive networks were also involved1,20 and caused encoding memory deficit that did not improve with cueing.20 The Memory Index Score of MoCA-BC (MoCA-BC-MIS) was calculated by adding the number of words remembered in free delayed recall, category-cued recall, and multiple choice-cued recall multiplied by 3, 2, and 1, respectively, with a score ranging from 0 to 15. This scoring method was designed to better detect the encoding memory deficit.21 The Non-memory Index Score of MoCA-BC (MoCA-BC-NM) was calculated by adding the score of orientation, calculation, animal naming, and verbal fluency (the number of fruits listed), with a score ranging from 0 to 15 likewise. The latter subtest was a novel creation for the present study and was devised to describe cognitive domains other than episodic memory.

Given the importance and popularity of MoCA-BC for clinical application, this study was aimed at exploring the capacity and examining the accuracy of MoCA-BC and its two subtests (MoCA-BC-MIS and MoCA-BC-NM) in discrimination of NC, MCI, mild and moderate AD.

Participants and methods

Participants

A total of 1,969 individuals were recruited: 520 cognitively normal controls (NC), 663 individuals with MCI, 345 individuals with mild AD, and 441 individuals with moderate AD. The participants with MCI or AD were recruited from the Memory Clinic, Huashan Hospital, Shanghai, China, from May 2015 to August 2017. NC were recruited from their spouses and friends. The descriptive statistics are reported in Table S1. Inclusion criteria for all were aged 50–90, nearly normal eyesight and hearing, no history of alcoholism, drug abuse, head trauma or other serious neuropsychiatric diseases that would affect their performance. Written consent was obtained from participants or their legally authorized caregivers. This study has been approved by the ethics committee of Huashan Hospital.

Materials and procedure

All subjects received complete neurological and neuropsychological assessments, brain imaging, and other necessary laboratory tests. The diagnosis decision was made independent of MoCA-BC scores.

MoCA-BC had been translated from the original version with subtle linguistic and cultural modifications, reviewed, and approved by the original author (Dr Ziad Nasreddine). MoCA-BC is free of charge, online for clinical use (www.mocatest.org, Basic section), assessing nine cognitive domains including language, attention, calculation, orientation, memory, concentration, executive function, conceptual thinking, and visual perception.

The total score of MoCA-BC (MoCA-BC-T), the MoCA-BC-MIS, and the MoCA-BC-NM scores were all calculated from MoCA-BC as aforesaid.

Diagnosis of MCI was made as follows:17 complaints of cognitive impairments; normal activities of daily living or slight impairment in instrumental activities of daily living; objective cognitive impairment (MMSE) score ≥ cutoff,22 Clinical Dementia Rating (CDR) score of 0.5,23 and performance on a set of neuropsychological tests 1.5 SDs or more below the normative mean; no dementia.

Diagnosis of AD was based on the National Institute of Aging and Alzheimer’s Association criteria:24 insidious onset of symptoms, history of cognitive decline by observation, and the initial and most prominent cognitive deficits being typically amnestic or non-amnestic. Diagnosis of mild and moderate AD was based on CDR scores: a CDR score of 1 for mild AD, two for moderate AD.23

Moreover, NC should have no memory complaints, no significant impairment in activities of daily living, MMSE score at or above the cutoff,22 a CDR score of 0,23 a Modified Hachinski Ischemic Scale (MHIS) score of 4 or less,25 and a Hamilton Depression Rating Scale (HDRS) score of 12 or less in the past 2 weeks.26

Five examiners conducted all the assessments in the neuropsychological laboratory of Huashan Hospital, including MMSE,22 MoCA-BC, CDR,23 MHIS,25 and HDRS26 as mentioned previously. Individuals were tested one at a time by blinded raters.

Statistical analysis

We used chi-square and one-way ANOVA to assess possible group differences between the four groups (NC, MCI, mild and moderate AD) in demographic characteristics and cognitive test performance. Pearson correlation coefficients (r) between MoCA-BC and MMSE were computed to measure criterion-related validity. Receiver operating characteristic (ROC)27 curves were carried out to determine the ability of MoCA-BC, MoCA-BC-MIS, and MoCA-BC-NM to distinguish among NC, MCI, mild and moderate AD. The method of comparing the AUCs derived from the same sample of patients was from Hanley and Mcneil27 (by Medcalc).27 Analyses were all conducted using SPSS version 20.0 (IBM Corporation, Armonk, NY, USA) and Medcalc version 11.4.2.0 (Medcalc Software, bvba).

Results

Demographic information and performance of MoCA-BC and MMSE

The demographic characteristics of the four groups (NC, MCI, mild and moderate AD) are summarized in Table S1. The level of significance was set at α=0.05. Differences in significance were found in education, not in age. Correlation analysis revealed that MoCA-BC-T scores were strongly associated with education (r=0.484, P<0.001), not age (r=−0.069, P=0.116). In order to reduce education bias, subjects were divided into three education subgroups according to years of formal education: low-level education (≤6 years), mid-level education (7–12 years), and high-level education (>12 years). The demographic characteristics and scores of MMSE, MoCA-BC-T, MoCA-BC-MIS, and MoCA-BC-NM of the subgroups are shown in Table S2, with no significant difference in age or education.

Psychometric properties of MoCA-BC

Correlation coefficient between MoCA-BC and MMSE was 0.817 (P<0.001), implying high criterion-related validity. Among all the NC, only three subjects (0.58%) obtained the maximum MoCA-BC-T score, indicating no obvious ceiling effect. Among individuals with MCI or AD, only one subject obtained a MoCA-BC-T score of 0 (0.07%), indicating no obvious floor effect.

Comparison of MoCA-BC and its subtests for discrimination among NC, MCI, mild and moderate AD

For detecting MCI, shown by ROC analysis, MoCA-BC-T and MoCA-BC-MIS had similar high sensitivity and specificity with AUCs of more than 0.80 in the three education subgroups, suggesting that the predictive information captured by MoCA-BC-T and MoCA-BC-MIS was reasonably good regardless of education level, superior to MoCA-BC-NM. The optimal MoCA-BC-T cutoffs were 19 in the low-level education group, 22 in the mid-level education group, and 24 in the high-level education group respectively, consistent with our previous study.10 However, a MoCA-BC-MIS cutoff score of 8 was proposed for individuals across all levels of education (Table S3).

For discrimination among MCI, mild and moderate AD, MoCA-BC-T and MoCA-BC-NM had high sensitivity and specificity, with AUCs of around 0.80 in the three education subgroups, superior to MoCA-BC-MIS.

For mild AD, a MoCA-BC-T cutoff of 13 was suggested for individuals with low-level education, 15 for those with mid-level education, and 16 for high-level education. Comparatively, a MoCA-BC-NM cutoff of 9 was proposed for individuals in the low-level education group, and 10 for those in the mid- and high-level education groups.

As for moderate AD, a MoCA-BC-T cutoff score of 10 was proposed for individuals with 6 or fewer years of education, 11 for those with 7–12 years, and 13 for those with more than 12 years. Likewise, a MoCA-BC-NM cutoff score of 7 was proposed for individuals in the low-level education group, and 8 for those in the mid- and high-level education groups.

In general, the AUCs of MoCA-BC-MIS for detecting MCI were notably higher than that of MoCA-BC-NM (P<0.001), indicating that the ability of the memory-related subtest of MoCA-BC to screen for MCI was significantly better than the non-memory part of it. The results confirmed that delayed recall memory was the first domain to be impaired in individuals with MCI as mentioned previously. As to discrimination among MCI, mild and moderate AD, MoCA-BC-MIS performed worse than MoCA-BC-NM with lower AUCs (P<0.001), probably owing to floor effects.

Discussion

Our study was aimed at establishing the value of MoCA-BC for discrimination among different severities of AD and defining education cutoff scores of MoCA-BC and its subtests, among groups of NC, MCI, mild and moderate AD. The study revealed that MoCA-BC had the ability to determine AD severity with cutoffs based on different education levels.

Since education had been found to affect MoCA scores in previous literature4,13,28 and has been considered the strongest non-cognitive factor influencing performance on MoCA,3,22,28 the optimal cutoffs for MoCA-BC were calculated based on it. Thus, the best cutoffs of NC, MCI, mild and moderate AD were clarified in three different education level groups in this study to reduce the education bias. No significant difference of age or education was found per subgroup.

The corresponding education cutoffs of MoCA-BC and its subtests to best distinguish AD of different severities are summarized in Table 1. The optimal cutoff scores of MoCA-BC for screening for MCI and AD based on education level in the present study were similar to that found in Italy,6 lower than most other versions according to previous international studies.7–9 The cutoffs of the aforementioned validation studies ranged from 17–27 for MCI detection and 14–26 for AD detection,6–9 indicating huge regional differences in cognitive performance.

Table 1

Best MoCA-BC subtests and the corresponding cutoff scores recommended for discrimination between normal controls, mild cognitive impairment, mild and moderate Alzheimer’s disease

Diagnosis groups	Recommended tests	Best cutoff scores
		Low-level education	Mid-level education	High-level education
NC vs MCI	MoCA-BC-T	19	22	24
	MoCA-BC-MIS	8
MCI vs AD	MoCA-BC-T	13	15	16
	MoCA-BC-NM	9	10
Mild vs moderate AD	MoCA-BC-T	10	11	13
	MoCA-BC-NM	7	8

Abbreviations: MoCA-BC, Chinese version of Montreal Cognitive Assessment Basic; NC, cognitively normal controls; MCI, mild cognitive impairment; AD, Alzheimer’s disease; MoCA-BC-T, total score of MoCA-BC; MoCA-BC-MIS, the Memory Index Score of MoCA-BC; MoCA-BC-NM, the Non-memory Index Score of MoCA-BC.

Our results presented large AUCs of MoCA-BC-T for detecting MCI and determining severity of AD in all education groups, indicating validity not only in MCI, but also in mild and moderate AD. In addition, MoCA-BC-T education cutoffs for MCI were in accordance with our previous study,10 which further confirmed our finding in a larger sample.

The best cutoff scores of MoCA-BC-MIS and MoCA-BC-NM in different education groups were almost the same in this study. This may be due to several reasons. Firstly, MoCA-BC-MIS was calculated by adding the number of words remembered, which might be, rarely, affected by education level. Secondly, MoCA-BC-NM was calculated by adding the scores of orientation, calculation, animal naming, and verbal fluency. The average years of education of the mid- and high-level education groups were all above 10 years, which might have led to small effects on the ability of calculation, orientation, and animal naming.

Since MoCA-BC is a quick, simple, and feasible assessment tool for outpatients, superior to the MMSE with less time needed and higher efficiency for screening for MCI,1,5,19,29 it is of great importance for clinical practice to verify MoCA-BC as a capable test to help discriminate the severity of AD instead of MMSE. Our research concluded that MoCA-BC was a highly reliable and sensitive tool to not only screen for MCI, but also distinguish between mild and moderate AD, which had never been reported before. It also determined the optimal cutoffs most sensitive for discrimination. The results revealed that MoCA-BC could be applied in clinical work as a quick and sensitive screening tool to distinguish different severities of AD.

Some limitations of the present study should be noted when utilizing its results. This study was a cross-sectional observational study. Selection bias in our sample may have affected the results. The data of our research were mainly based on urban residents of Shanghai due to lack of participants from rural areas and other cities. As China is such a huge geographically and culturally pluralistic nation, specific regional characteristics are likely to have impacted the performance of these neuropsychological tests. Encouragingly, the sample size was very large, with 1,969 participants, with a minimum of 345 individuals in each group, and all individuals received the same tests over a timespan of 2 years. Future studies should be conducted recruiting more subjects from diverse regions of the country and ethnic minorities as well.

Conclusion

The study verified that MoCA-BC was a valid cognitive test to determine AD severity in the Chinese elderly and defined cutoff scores of NC, MCI, mild and moderate AD based on education levels. Regarding screening for MCI, MoCA-BC-T and MoCA-BC-MIS were found to have similar high sensitivity and specificity, while for discrimination among MCI, mild and moderate AD, MoCA-BC-T and MoCA-BC-NM would perform better. The results suggested that MoCA-BC could be applied in clinical work not only to screen for MCI, but also to distinguish different severities of AD.

Data sharing statement

The datasets analyzed during the current study are available from the corresponding author upon reasonable request.

Table S1

Demographic information and mean scores of MoCA-BC and MMSE

Index	NC (n=520)	MCI (n=663)	Mild AD (n=345)	Moderate AD (n=441)	F (P)	P-value*
Age	68.77 (8.24)	68.21 (8.49)	69.27 (8.76)	69.18 (9.05)	0.172
Education	10.68 (4.11)	10.80 (3.95)	10.21 (4.07)	9.16 (4.33)	<0.001	<0.05
Sex (M/F)	178/342	305/358	162/183	194/247		sig <0.001
MMSE	27.88 (1.79)	26.38 (1.87)	21.92 (1.88)	16.30 (2.81)	<0.001	<0.05
MoCA-BC-T	24.10 (3.40)	19.37 (3.74)	14.38 (3.62)	9.51 (3.72)	<0.001	<0.05
MoCA-BC-MIS	10.24 (6.63)	4.75 (3.91)	1.99 (2.86)	0.96 (2.04)	<0.001	<0.05
MoCA-BC-NM	13.57 (1.39)	12.17 (1.80)	9.78 (2.10)	7.01 (2.28)	<0.001	<0.05

Note:

NC vs MCI, NC vs mild AD, NC vs moderate AD, MCI vs mild AD, MCI vs moderate AD, mild AD vs moderate AD.

Abbreviations: MoCA-BC, Chinese version of Montreal Cognitive Assessment Basic; MMSE, mini-mental state examination; NC, cognitively normal controls; MCI, mild cognitive impairment; AD, Alzheimer’s disease; MoCA-BC-T, total score of MoCA-BC; MoCA-BC-MIS, the Memory Index Score of MoCA-BC; MoCA-BC-NM, the Non-memory Index Score of MoCA-BC; sig, significant.

Table S2

Demographic characteristics and mean scores according to level of education

Low-level education group
Index (mean ± SD)	NC (n=82)	MCI (n=96)	Mild AD (n=80)	Moderate AD (n=132)	F (P)	P-value
Age	68.2±8.8	67.5±8.2	68.2±7.6	68.4±8.5	0.869	–
Education, years	3.9±2.3	4.0±2.1	4.5±2.1	3.7±2.2	0.135	–
Sex (M/F)	27/55	37/59	28/52	43/89	–	sig 0.800
MMSE total score	27.1±2.6	25.3±2.5	20.9±2.8	15.8±2.8	<0.001	<0.001
MoCA-BC-T score	20.6±4.7	16.4±3.8	12.9±3.0	8.7±3.7	<0.001	<0.001
MoCA-BC-MIS score	9.7±4.5	4.5±3.9	2.5±3.4	1.2±2.4	<0.001	<0.001
MoCA-BC-NM score	12.4±2.1	11.0±2.1	9.2±2.1	6.7±2.4	<0.001	<0.001
Mid-level education group
Index (mean ± SD)	NC (n=285)	MCI (n=379)	Mild AD (n=180)	Moderate AD (n=225)	F (P)	P-value
Age	67.8±8.3	66.9±8.3	68.6±9.2	68.5±9.5	0.080	–
Education, years	10.1±1.9	10.2±1.7	10.4±1.5	10.1±1.5	0.314	–
Sex (M/F)	87/198	165/214	79/101	106/119	–	sig <0.001
MMSE total	28.0±1.5	26.5±1.7	22.0±1.3	16.4±2.8	<0.001	<0.001
MoCA-BC-T	24.4±2.6	19.6±3.5	14.7±3.5	9.6±3.5	<0.001	<0.001
MoCA-BC-MIS	10.4±3.3	5.1±3.9	1.8±2.8	0.9±1.9	<0.001	<0.001
MoCA-BC-NM	13.7±1.2	12.3±1.7	9.9±2.0	7.0±2.2	<0.001	<0.001
High-level education group
Index (mean ± SD)	NC (n=153)	MCI (n=188)	Mild AD (n=85)	Moderate AD (n=84)	F (P)	P-value
Age	71.0±7.5	71.2±8.3	71.7±8.4	72.3±7.9	0.607	–
Education, years	15.3±1.2	15.4±1.2	15.2±1.5	15.1±1.1	0.108	–
Sex (M/F)	64/89	103/85	55/30	45/39	–	sig 0.006
MMSE total	28.1±1.6	26.6±1.7	22.7±1.5	16.9±2.7	<0.001	<0.001
MoCA-BC-T	25.3±2.6	20.4±3.3	15.2±4.0	10.6±3.9	<0.001	<0.001
MoCA-BC-MIS	10.2±3.7	4.3±3.9	1.9±2.4	0.8±1.8	<0.001	<0.001
MoCA-BC-NM	13.9±1.0	12.5±1.6	10.0±2.3	7.4±2.3	<0.001	<0.001

Note: NC vs MCI, NC vs mild AD, NC vs moderate AD, MCI vs mild AD, MCI vs moderate AD, mild AD vs moderate AD.

Abbreviations: MMSE, mini-mental state examination; MoCA-BC, Chinese version of Montreal Cognitive Assessment Basic; NC, cognitively normal controls; MCI, mild cognitive impairment; AD, Alzheimer’s disease; MoCA-BC-T, total score of MoCA-BC; MoCA-BC-MIS, the Memory Index Score of MoCA-BC; MoCA-BC-NM, the Non-memory Index Score of MoCA-BC.

Table S3

MoCA-BC and its subtests to discriminate among NC, MCI, mild and moderate AD

Diagnosis groups	Tests	Cutoff score	Sensitivity %	Specificity %	AUC
Low-level education group (≤6 years)
NC vs MCI	MoCA-BC-T	19	0.794	0.706	0.810
	MoCA-BC-MIS	8	0.738	0.745	0.816
	MoCA-BC-NM	12	0.738	0.578	0.708
MCI vs AD	MoCA-BC-T	13	0.774	0.794	0.865
	MoCA-BC-MIS	2	0.731	0.673	0.735
	MoCA-BC-NM	9	0.774	0.757	0.836
Mild vs moderate AD	MoCA-BC-T	10	0.705	0.812	0.807
	MoCA-BC-MIS	0	0.727	0.487	0.616
	MoCA-BC-NM	7	0.659	0.850	0.793
Mid-level education group (7–12 years)
NC vs MCI	MoCA-BC-T	22	0.777	0.830	0.873
	MoCA-BC-MIS	8	0.793	0.740	0.846
	MoCA-BC-NM	13	0.731	0.691	0.769
MCI vs AD	MoCA-BC-T	15	0.790	0.889	0.914
	MoCA-BC-MIS	2	0.783	0.698	0.776
	MoCA-BC-NM	10	0.802	0.853	0.902
Mild vs moderate AD	MoCA-BC-T	11	0.729	0.828	0.847
	MoCA-BC-MIS	0	0.756	0.417	0.595
	MoCA-BC-NM	8	0.729	0.772	0.833
High-level education group (>12 years)
NC vs MCI	MoCA-BC-T	24	0.899	0.686	0.885
	MoCA-BC-MIS	8	0.803	0.725	0.855
	MoCA-BC-NM	13	0.681	0.752	0.769
MCI vs AD	MoCA-BC-T	16	0.787	0.867	0.906
	MoCA-BC-MIS	2	0.746	0.622	0.719
	MoCA-BC-NM	10	0.734	0.894	0.892
Mild vs moderate AD	MoCA-BC-T	13	0.762	0.694	0.792
	MoCA-BC-MIS	1	0.798	0.447	0.623
	MoCA-BC-NM	8	0.714	0.729	0.792

Abbreviations: MoCA-BC, Chinese version of Montreal Cognitive Assessment Basic; NC, cognitively normal controls; MCI, mild cognitive impairment; AD, Alzheimer’s disease; MoCA-BC-T, total score of MoCA-BC; MoCA-BC-MIS, the Memory Index Score of MoCA-BC; MoCA-BC-NM, the Non-memory Index Score of MoCA-BC; AUC, area under the curve.