Validation Study of the Mini-Mental State Examination in Urdu Language for Pakistani Population.

UNLABELLED: Validation study of the Mini-Mental State Examination in Urdu language for Pakistani population.
OBJECTIVE: This study was conducted primarily to validate and determine the optimal cutoff score in the diagnosis of dementia among Pakistani's and study the effects of gender and education on the MMSE performance in our population.
METHODS: Four hundred participants took part in the study. Patient with dementia recruited from five major hospitals from Pakistan. The MMSE was translated into Urdu.
RESULTS: There were 61 men and 39 women in dementia group and 225 men and 75 women in the control group. The mean score of Urdu MMSE were lower in patients with dementia 18.5 ± 5.6 (range 0-30) as compared to the controls 26.8 ± 2.6 (range 7-30). This difference between groups was statistically significant (p<0.001). Educational based MMSE score below 15 yielded perfect sensitivity and specificity for the diagnosis of dementia.
CONCLUSIONS: These finding confirm the influence of level of education on MMSE score and education stratified cutoff scores should be used while screening for cognitive impairment in this population.

INTRODUCTION

Overall burden of Neurological diseases in the world is around 6.5%. It ranges from 4-5% in lower income countries as compared to 10-11% in high income countries [1]. Overall death and disability related to neurological diseases is higher than HIV/AIDS, neoplasms, Ischemic heart diseases and Tuberculosis. More than half of the disability due to neurological diseases is related to stroke followed by Dementia, Migraine, Epilepsy and tetanus [1].

Dementia in general and Alzheimer’s disease (AD) in particular, affect elderly people all around the world. In epidemiological studies of dementia and Alzheimer’s disease (AD) in developed countries, the prevalence rates of dementia for persons aged 65 years and older have been estimated between 1.3% and 6.2% [2]. According to the Global Burden of Disease estimates for the 2003 World Health Report [3], dementia contributed 11·2% of years lived with disability in people aged 60 years and older; more than stroke, musculoskeletal disorders, cardiovascular disease, and all forms of cancer.

Dementia is largely a clinical diagnosis and a clinical test (MMSE- mini mental status examination) is available with high specificity and sensitivity to diagnose this condition. The Mini-Mental State Examination (MMSE) [4] is a reliable screening test for cognitive impairment with older and hospitalized adults. This scale has been used as a brief cognitive tool which allows serial assessment and monitoring of the cognitive function of patients including orientation, memory, language, attention, calculation and ability to follow simple verbal and written commands with dementia over time. Despite criticism that it relies on verbal response and reading and writing, it still remains one of the widely utilized clinical screening tools in the diagnosis of dementia.

This test is devised in English, the maximum score is 30, and a cutoff score 24 has been reported as a normal range for cognition and has a sensitivity of 84% and a specificity of 80% in detecting dementia across different age groups [4]. However, validation studies in other non English speaking countries have reported different sensitivities and specificities [2, 5-9]. These differences are not due to variation in the native language but result of cultural and ethnic [10] differences has been shown to modify performance in the test [10]. Furthermore, the education levels [11] may also affect the results of MMSE within a specific community, hence the need for each country to have its own validation study to determine the optimal cutoff scores in the diagnosis of dementia.

With 180.1 million residents reported in 2012, Pakistan is the sixth most populated country in the world More than sixty languages are spoken in Pakistan, including a number of provincial languages. Urdu is the national language of Pakistanis and Urdu is also one of the officially recognized languages in India. This test has not been validated in Urdu language. This is a major limitation in conducting population based studies for dementia. This test is being used in Pakistan by neurologist, psychiatrists, psychologist and other physician but due to lack of validation studies physicians are using cutoff values for US, UK and other developed countries which may be misleading for our patient population. Therefore, this study was conducted primarily to validate and determine the optimal cutoff score in the diagnosis of dementia among Pakistani’s and secondarily to study the effects of gender and education on the MMSE performance in our population.

MATERIALS AND METHODOLOGY

This is a matched case control study involved patients with dementia from the urban hospitals. Patient with dementia recruited from five major hospitals from Pakistan. The controls were age matched normal individuals from urban communities and those attending the hospital for reason other than dementia between january 2013 to july 2013. Patients attending neurology and dementia outpatient clinics were interviewed by neurologist or psychiatrists and those who fulfilled the Diagnostic and Statistical manual of Mental Disorders IV criteria for dementia [12] were invited to participate. Prior informed consent was obtained from all participants. The patients were excluded if they were neurological disorders, blindness, deafness and other mental disabilities.

INSTRUMENT

This is an 11-item instrument, obtained by forward and back translation of Folstein’s MMSE, by researchers who were fluent in both the English and Urdu languages. The researchers administering the MMSE were blinded to the original clinical diagnosis given. In case of illiterate subjects, the following two items were modified: instead of reading a command it was communicated verbally and subjects were asked to perform the command (‘close your eyes’); instead of asking participants to write a spontaneous sentence, subjects were asked to articulate a spontaneous sentence.

Convenience sampling was used by getting the questionnaires filled during the study period.

The study was approved by the Ethical Review Committee (ERC) of the Aga Khan University, Hospital. A trained MBBS qualified doctor administered the study questionnaire and the MMSE.

STATISTICAL ANALYSIS

Descriptive analysis was done for demographic and clinical features and results were presented as mean ± standard deviation for quantitative variables and number (Percentage) for qualitative variables. Comparison between groups and educational backgrounds was performed with the ANOVA. The mean of Urdu MMSE score were compared between genders in all subjects by using independent samples t-test. The internal consistency of MMSE was assessed by Cronbach’s α for the total scale and each individual item. In order to determine the optima cutoff scores, the sensitivity and specificity were calculated. All analyses were performed with the SPSS software package, version 19.0 (SPSS, Chicago, Ill.,USA). All p-values were two sided and considered as statistically significant if < 0.05.

RESULTS

A total of four hundred participate in this study. On hundred participant (25%) had a clinical diagnosis of dementia based on criteria of the Diagnostic and Statistical Manual of Mental Disorders IV [12] and 300 (75%) were controls. There were 61 men and 39 women in dementia group and 225 men and 75 women in the control group. Forty two (10.5%) subjects were illiterate; 28% of the samples were received school level education (up to 10 grades). The mean score of Urdu MMSE was 24.8 ± 5.7 (range; 0-30); the mean scores for MMSE were lower in patients with dementia 18.5 ± 5.6 (range 0-30) as compared to the controls 26.8 ± 2.6 (range 7-30) Table . This difference between groups was statistically significant (p<0.001). The mean MMSE score was 25.3 ± 4.8 for male and 23.5 ± 7.3 for female (p value=0.004).

The subjects with primary education and no education had significantly lower mean score in both group. Subjects with illiterate and up to 10 grades had significantly lower mean scores in patients with dementia group compare to those with higher education (p<0.001). In control group, illiterate group had lower mean MMSE as compared to secondary education group. The mean MMSE score were high in male as compared to female in both groups but this difference was not statistically significant (Table ).

These results were further stratified by gender. The mean MMSE scores were significantly better in males with higher education compared to those with primary or no education in dementia group and control group. Significant gender difference present in male subjects with lower education in both groups. Having secondary or higher education did not significantly affect the MMSE score in females (Table ).

The sensitivity and specificity for optimal cutoff score of Urdu MMSE are shown in Table . The cutoff score of 24 appeared to be the best with sensitivity of 69% and specificity of 93%. Educational based MMSE score showed different cutoff values. Any score below 15 yielded perfect sensitivity and specificity for the diagnosis of dementia in this study. The internal consistency coefficient was obtained. Overall, the Cronbach’s ∞ was 0.74 for Urdu MMSE.

DISCUSSION

The MMSE has been one of the most widely used instruments for screening dementia. It is also used to estimate the severity of cognitive impairment and to follow the course of cognitive changes in an individual over time. This study showed that Urdu version of MMSE is a valid and reliable measure in the diagnosis of dementia in our population. The Urdu MMSE score was found it to be a user friendly, easy to administer scale.

Screening tests should be able to detect cognitive impairment and discriminate between subjects with and without disease. Results showed that the mean difference of total scores between groups was significant. This signifies the ability of the instrument to discriminate between subjects with normal and abnormal cognitive function.

The mean MMSE score for control group in this study is high and this finding is consistent with the previous studies [13, 14]. The reason may be that most of control subjects in this study were educated as compare to dementia group. Xu et al. calculated different cutoff score for educated and uneducated individuals [15].

This study showed that the educational level, similar to previous results, significantly affect the MMSE score [11, 13, 15, 16]. The mean MMSE scores improved progressively with improvement in the education level from primary to higher levels in dementia group. In males, mean score increased significantly as education level increased in both groups. Though, in females’ education level did not affect the MMSE performance in dementia and control groups. However, study from Malaysia indicate that educational background affects the mean MMSE score in control group [13]. Therefore, a variety of cutoff scores could be found in the literature. The cutoff scores are generally higher for education individuals than those who are uneducated [13, 15]. The greater performance of the educated subjects as compared to the uneducated subjects confirmed the educational bias of the MMSE, as other studies have reported [17-20]. The mean score of above primary education level subjects falls within the conventional cut-off score of <2 4 in Western countries [4], and there would have been no need for any adjustment if all the individuals were literate.

Male performance is significantly better in MMSE score compared to female. Male have a high MMSE score as compared to female in dementia group. Gender has been known to influence MMSE score [21, 22]. A study using Arabic MMSE version showed lower MMSE score for women [19]. However, a study from Persia reported that gender had no effect on MMSE score [14]. Significant socio-demographic factors and gender differences in MMSE score among cases with low educational background have been reported previously [11, 13, 18, 23].

The optimal cutoff scores 23/24 has a low sensitivity of 69% with specificity of 93%. Studies in other population groups have also yielding different cutoff scores. A study from South Korea showed the similar cutoff but high sensitivity 92% with 91.5% specificity [24]. The sensitivity of the Persian MMSE was 98% with a score of 23 [14]. While in Saudi Arabia population, a cutoff score of 11 was 100% sensitive and 97% specific for the diagnosis of dementia [19]. These observations further highlight the need for each population to use their own validated versions of the MMSE. Based on Cronbach’s ∞ all items of MMSE had a discriminatory values in differentiating those with and without dementia, the ∞ coefficient was 0.74, implies that this instrument is valid and reliable as a screening tool for dementia in our population

CONCLUSION

In conclusion, this is the first validation study of the MMSE-Urdu among Pakistani population. The cutoff score presented here should be considered with caution. Pakistan is a developing country with limited health care resources and a literacy rate of only 45%. Prior to screening, the patient’s education level should be ascertained. Hence, the results might not generalize to all healthy subjects and to patients with mild cognitive impairment. A future population based study with large sample of subject has been design to investigate the reliability of instrument in Urdu speaking communities.

Table 1.

Demographic characteristics of study population (n=400).

	Total	Dementia(n=100)	No dementia (n=300)	p value
Age, in years	64.4 ± 18.0	66.7 ± 11.2	61.02 ± 10.3
Gender
Male	286(71.5)	61(61)	225(75)	0.01
Female	114(28.5)	39(39)	75(25)
Education
Illiterate	42(10.5)	24(24)	18(6.0)	<0.001
Primary (1-5 grade)	38(9.5)	14(14)	24(8.0)
Matric (6-10 grades)	75(18.8)	23(23)	52(17.3)
Up to graduation	172(43)	24(24)	148(49.3)
Master	73(18.3)	15(15)	58(19.3)
MMSE-Urdu score	24.8 ± 5.7	18.5 ± 7.6	26.8 ± 2.6	<0.001

Table 2.

Mean MMSE-Urdu score based on educational level and gender.

	Mean Score ± SD	p Value	Pairwise Comparison
Patients with dementia
Education	14.3 ± 7.6	<0.001
Illiterate (1)	17.2± 6.3		(1) vs. (5) <0.001
Primary (1-5 grade) 2	17.3 ± 8.3		(2) vs (5) 0.01
Matric (6-10 grades) 3	20.3± 1.1		(3) vs (5) 0.006
Up to graduation (4)	25.4± 4.7		(4) vs (1) 0.03
Master (5)
Gender
Male	19.7 ± 6.5	0.05
Female	16.7 ± 8.8
Patient without dementia
Education
Illiterate	25.0 ± 5.4	0.01	(1) vs (3) 0.02
Primary (1-5 grade)	26.3 ± 2.8
Matric (6-10 grades)	27.2 ± 2.7
Up to graduation	27.1 ± 2.0		(4) vs (1) 0.01
Masterspan>	26.7 ± 2.2
Gender
Male	26.8 ± 2.7	0.53
Female	27.0 ± 2.0

Table 3.

Mean MMSE-Urdu score inpatients with and without dementia between genders, based on educational level.

	Male	P Value	Female	p value
Dementia group
Education
Illiterate	16.8 ± 5.4	0.001	11.9 ± 8.8	0.12
Primary (1-5 grade)	16.3 ± 6.4		18.3 ± 6.5
Matric (6-10 grades)	17.8 ± 6.7		16.8 ± 9.8
Up to graduation	20.4 ± 5.8		20.2 ± 6.0
Master	26.5 ± 3.9		23.2 ± 5.9
Patient without dementia
Education
Illiterate	24.8 ± 5.5	0.01	29	0.8
Primary (1-5 grade)	26.2 ± 2.9		27.5 ± 0.7
Matric (6-10 grades)	27.2 ± 2.8		28 ± 2.6
Up to graduation	27.1 ± 2.0		26.9 ± 2.0
Master	26.5 ± 2.2		27 ± 2.2

Table 4.

Screening ability of MMSE-Urdu score based on education level.

Cutoff Score	Combine	Illiterate	Primary (1-5 grade)	Matric (6-10 Grades)	Up to Graduation	Master
Optimal cutoff	24	10	10	12	12	15
Sensitivity (%)	69	79	85	78	91	93
Specificity (%)	93	94	100	100	100	100