Performance of the Achutha Menon Centre Diabetes Risk Score in Identifying Prevalent Diabetes in Tamil Nadu, India.

BACKGROUND: The Achutha Menon Centre Diabetes Risk Score (AMCDRS), which was developed in rural Kerala State, South India, had not previously been externally validated. We examined the performance of the AMCDRS in urban and rural areas in the district of Vellore in the South Indian state of Tamil Nadu, and compared it with other diabetes risk scores developed from India.
METHODS: We used the data from 4,896 participants (30 to 64 years) of a cross-sectional study conducted in Vellore (2010 to 2012), to calculate the AMCDRS scores using age, family history, and waist circumference. Sensitivity, specificity, positive predictive value (PPV), and negative predictive values (NPV), and the area under the receiver operating characteristic curve (AROC) were calculated for undiagnosed and total diabetes.
RESULTS: Of the 4,896 individuals surveyed, 274 (5.6%) had undiagnosed diabetes and 759 (15.5%) had total diabetes. The AMCDRS, with an optimum cut-point of ≥4, identified 45.0% for further testing with 59.5% sensitivity, 60.5% specificity, 9.1% PPV, 95.8% NPV, and an AROC of 0.639 (95% confidence interval [CI], 0.608 to 0.670) for undiagnosed diabetes. The corresponding figures for total diabetes were 75.1%, 60.5%, 25.9%, 93.0%, and 0.731 (95% CI, 0.713 to 0.750), respectively. The AROC for the AMCDRS was not significantly different from that of the Indian Diabetes Risk Score, the Ramachandran or the Chaturvedi risk scores for total diabetes, but was significantly lower than the AROC of the Chaturvedi score for undiagnosed diabetes.
CONCLUSION: The AMCDRS is a simple diabetes risk score that can be used to screen for undiagnosed and total diabetes in low-resource primary care settings in India. However, it probably requires recalibration to improve its performance for undiagnosed diabetes.

INTRODUCTION

Type 2 diabetes mellitus (T2DM) is now a major cause of morbidity and mortality worldwide, particularly in low and middle-income countries such as India [1]. Currently India is home to an estimated 69.2 million people with T2DM and an estimated 52% of these cases are undiagnosed [1]. Undiagnosed diabetes is frequently associated with complications affecting the heart, blood vessels, kidneys, and nerves [1]. Furthermore, several randomised controlled trials have unequivocally shown that the onset of T2DM can be delayed or prevented through lifestyle and pharmacological interventions [234]. For these reasons, early identification and treatment of individuals with T2DM is essential.

Universal blood testing for screening for T2DM is not feasible, especially in resource constrained settings such as in India. Simple, low-cost screening tools such as diabetes risk scores have therefore been developed for use in various populations throughout the world, including four in India [567891011]. The first of these, the Indian Diabetes Risk Score (IDRS) [9], collects information on age, family history of diabetes, waist circumference, and physical activity. The second, the Ramachandran risk score [10], includes body mass index (BMI) in addition to the four variables used for the IDRS. The third, the Chaturvedi risk score [11], includes information on age, family history of diabetes, waist circumference, and hypertension. All three have proved useful in identifying undiagnosed T2DM. Variables such as BMI, blood pressure (BP), and physical activity may, however, be cumbersome to measure in low-resource primary care settings such as in some parts of India. This is because measurements such as BMI and BP require expensive instruments and standardization [12], while measuring physical activity using self-reported questionnaires takes time and has low validity and reliability [13].

The fourth diabetes risk score, the Achutha Menon Centre Diabetes Risk Score (AMCDRS), is a simple diabetes risk score developed using data from a cross-sectional study conducted in rural Kerala, India, to identify people with total diabetes (diagnosed and undiagnosed) [1415]. The AMCDRS includes three simple variables—age, family history of diabetes, and waist circumference—which are relatively easy to measure in primary care settings in India.

In the original study using the AMCDRS, the number of individuals with undiagnosed diabetes was low and therefore the AMCDRS's performance in identifying undiagnosed cases of diabetes could not be assessed [14]. Furthermore, the AMCDRS has not been externally validated. The study that is the subject of this article therefore aims to validate the AMCDRS by examining its performance in identifying undiagnosed diabetes, as well as total diabetes, in urban and rural Vellore district in the South Indian state of Tamil Nadu. For this study, we compared the performance of other Indian risk scores—IDRS, Ramachandran risk score, and the Chaturvedi risk score [91011]—with that of the AMCDRS. We also estimated the number needed to screen (NNS), in order to identify one case of undiagnosed diabetes, and the cost per case detected using a two-step screening procedure (risk score followed by fasting plasma glucose [FPG]). The results of these estimates were compared with universal screening using FPG.

METHODS

All procedures performed in the study were approved by the Institutional Review Board of the Christian Medical College, Vellore (IRB. Min. No. 7020 dated 16-12-2009) and were in accordance with the ethical standards specified by the 1964 Helsinki Declaration and its later amendments. Written informed consent was obtained from all participants.

A cross sectional survey of 6,196 individuals aged 30 to 64 years was conducted in 2010 to 2012 in urban and rural Vellore using the World Health Organisation's (WHO) STEPwise approach to surveillance (STEPS) [16]. The aim of this survey was to study the prevalence of coronary heart disease and its risk factors [1718].

For the rural sample, all adults aged 30 to 64 years in nine randomly selected villages in Kaniyambadi, a rural block, were invited to participate in the study. For the urban sample, all adults aged 30 to 64 years in one randomly selected street in 48 different wards in Vellore city were surveyed for the study [17]. Eligible adults were interviewed at home and then invited to local study clinics where physical and biochemical measurements (FPG and lipids) were taken. Physical activity was assessed using the Global Physical Activity Questionnaire, which is a part of the STEPS methodology [16].

The data from this study was used to compute the AMCDRS for both the rural and urban subjects [17]. The maximum score possible for the AMCDRS is 6, with maximum weightage for age (age 55 to 64 years acquires a score of 4, 45 to 54 years a score of 3, 35 to 44 years a score of 2, and <35 years a score of 0). A score of 1 each was given for positive family history of diabetes (parents or siblings) and abdominal obesity (waist circumference ≥80 cm in women and ≥90 cm in men) [14]. T2DM was defined as either FPG ≥126 mg/dL or being on anti-diabetic medications [16]. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) for undiagnosed diabetes and total diabetes were calculated for various possible cut-off values of the AMCDRS. Area under the receiver operating characteristic curve (AROC) was used to determine the optimum cut-off value for undiagnosed diabetes and total diabetes. Other risk scores—IDRS, Ramachandran, and Chaturvedi—were also computed, and sensitivity, specificity, PPV, NPV, and the AROC were calculated for the published cut-off values [91011]. The AROC for the AMCDRS was compared with the three other risk scores for undiagnosed diabetes and total diabetes.

We estimated the NNS for identifying one case of undiagnosed diabetes and the cost per case detected using a two-step screening process (risk score followed by FPG among those who were screen positive on the risk score) and for universal screening with FPG using a previously reported methodology [19]. The number of people eligible for screening in this costing analysis were those who were not on anti-diabetic medication, for whom data was available to calculate the AMCDRS (n=4,411 participants). The costs of FPG testing (material and personnel costs) and questionnaires (printing and supplies), were taken from figures used for a recent economic analysis on a simulated national population, which used inputs from the WHO CHOICE (CHOosing Interventions that are Cost-Effective) guide [1920]. Additional costs, such as payments for personnel (from national level managers to district health workers) and operational costs (transport, office rent, and utilities) were not measured.

RESULTS

Of the 6,196 study participants, data on diabetes status as well as risk scores were available for 4,896 (3,051 rural and 1,845 urban), comprising 79% of the study population. The mean age of the sample was 45 years, with 43% males and literacy rates of 65% in the rural area and 77% in the urban areas. While 46% of the rural population was engaged in agriculture or non-agricultural manual labour, only 13% of the urban sample was involved in manual labour.

The study identified 759 participants (15.5%) with total diabetes. Of these 759 diabetics, 274 were previously undiagnosed and the remaining 485 were known diabetics. The optimum cut-off value of the AMCDRS was 4 and above for both undiagnosed diabetes and total diabetes. The proportion of individuals who were screen positive was 45.0% (47.8% in the urban sample and 36.9% in the rural sample).

A higher AMCDRS was associated with a higher total diabetes prevalence (chi-square for trend 478.63, P<0.001). The prevalence of T2DM was 47.3% among those with a score of 6, as compared to 1.5% among those with a score of 0. A similar relationship was observed for undiagnosed diabetes (chi-square for trend 65.47, P<0.001), where the prevalence was 9.3% among those with a score of 6, as compared to 1.2% among those with a score of 0.

Sensitivity, specificity, and predictive values for the AMCDRS in identifying undiagnosed diabetes and total diabetes are given in Table 1. Table 2 shows the sensitivity, specificity, and predictive values of the IDRS, Ramachandran, and Chaturvedi scores for predicting undiagnosed diabetes. A comparison of the two tables shows that the AMCDRS's sensitivity and specificity were closest to those of the IDRS.

Table 1

Validity of the Achutha Menon Centre Diabetes Risk Score for predicting prevalent diabetes

Cut-off score	Sensitivity, %	Specificity, %	PPV, %	NPV, %
Validity of score for predicting prevalent undiagnosed diabetes
6 and above	1.8	98.8	9.3	93.8
5 and above	24.5	87.1	11.1	94.6
4 and abovea	59.5	60.5	9.1	95.8
3 and above	86.5	31.8	7.7	97.3
2 and above	97.4	14.5	7.0	98.8
Validity of score for predicting prevalent total diabetes (diagnosed and undiagnosed)
6 and above	5.8	98.8	47.3	85.1
5 and above	40.4	87.1	36.5	88.9
4 and abovea	75.1	60.5	25.9	93
3 and above	92.6	31.8	19.9	95.9
2 and above	98.6	14.5	17.5	98.2

PPV, positive predictive value; NPV, negative predictive value.

aOptimal score both in this study as well as the study by Sathish et al. [14].

Table 2

Validity of other risk scores from India, in predicting prevalent diabetes

Risk score	Sensitivity, %	Specificity, %	PPV, %	NPV, %
Validity of score for predicting prevalent undiagnosed diabetes
IDRS	59.1	59.4	8.9	95.6
Ramachandran score	77.4	45.2	8.6	96.8
Chaturvedi score	66.8	63.0	10.7	96.6
Validity of score for predicting prevalent total diabetes (diagnosed and undiagnosed)
IDRS	69.1	59.3	23.9	91.2
Ramachandran score	83.4	45.2	21.9	93.7
Chaturvedi score	75.9	63.0	27.3	93.4

PPV, positive predictive value; NPV, negative predictive value; IDRS, Indian Diabetes Risk Score.

Figs. 1 and 2 show the AROC curves for the AMCDRS and other Indian risk scores for undiagnosed diabetes and total diabetes. The AROC of the AMCDRS for undiagnosed diabetes was 0.638 (95% confidence interval [CI], 0.624 to 0.652), which was significantly lower than that of the Chaturvedi risk score (P<0.001) and similar to the AROC of the other risk scores. The AROC of the AMCDRS for total diabetes was 0.731 (95% CI, 0.713 to 0.750) which was significantly lower than the Chaturvedi score (P=0.001), but higher than the other scores (P<0.01).

Fig. 1

Receiver operating characteristic curves of various risk scores for diagnosis of undiagnosed diabetes. AMCDRS, Achutha Menon Centre Diabetes Risk Score; IDRS, Indian Diabetes Risk Score.

Fig. 2

Receiver operating characteristic curves of various risk scores for diagnosis of total diabetes. AMCDRS, Achutha Menon Centre Diabetes Risk Score; IDRS, Indian Diabetes Risk Score.

The NNS to detect one case of undiagnosed diabetes was lower for universal screening with FPG (NNS, 16), as compared to 21 to 27 for the two-step screening procedure (risk score followed by confirmation with FPG) (Table 3). The IDRS and the AMCDRS had similar NNS values (NNS, 27) and these were lower than the values for the Chaturvedi score (NNS, 24) and Ramachandran score (NNS, 21). The cost per case detected, however, was highest (US$ 39.2) for universal screening with FPG and lowest (US$ 24.1) for the two-step screening procedure with the Chaturvedi score. The IDRS and the AMCDRS had similar values for cost per case detected, US$ 28.3 and 28.8, respectively (Table 3).

Table 3

Cost per case detected for universal screening versus risk score followed by confirmation

	Screening with FPG		AMCDRSa		IDRSa		Chaturvedi scorea		Ramachandran scorea
	No. of units	Total costs, US$ (95%CI)	No. of units	Total costs, US$ (95%CI)	No. of units	Total costs, US$ (95%CI)	No. of units	Total costs, US$ (95%CI)	No. of units	Total costs, US$ (95%CI)
Materialsb, unit cost (range)
Questionnaire, $0.05 (0.04–0.07)	0	0	4,411	220.6 (176.4–308.8)	4,362	218.1 (174.5–305.3)	4,411	220.6 (176.4–308.8)	4,396	219.8 (175.8–307.7)
FPG, $2.44 (1.71–3.17)	4,411	10762.8 (7,542.8–13,982.9)	1,798	4387.1 (3,074.6–5,699.7)	1,824	4450.6 (3,119.0–5,782.1)	1,715	4184.6 (2,932.7–5,436.6)	2,469	6024.4 (4,221.9–7,826.7)
Cost of strategyc		10762.8 (7,542.8–13,982.9)		4607.7 (3,251.0–6,008.5)		4668.7 (3,293.5–6,087.4)		4405.2 (3,109.1–5,745.4)		6,244.2 (4,397.7–8,134.4)
Score positives sent for FPG	-		1,798		1,824		1,715		2,469
FPG ≥126 mg/dL (diabetes)	274		163		162		183		212
No. needed to screen	16		27		27		24		21
Cost/person screened	2.44 (1.71–3.17)		1.04 (0.74–1.36)		1.07 (0.76–1.39)		0.99 (0.70–1.30)		1.40 (1.00–1.85)
Cost/confirmed case	39.2 (27.5–51.0)		28.3 (19.9–36.9)		28.8 (20.3–37.6)		24.1 (16.9–31.4)		29.5 (20.7–38.4)

FPG, fasting plasma glucose; AMCDRS, Achutha Menon Centre Diabetes Risk Score; IDRS, Indian Diabetes Risk Score; CI, confidence interval.

aAll risk score based screening followed by a confirmatory FPG, bCosts in 2014 US$ obtained from a modelling study by Basu et al. [19], cOperation costs and personnel costs (training for glucometer use or questionnaire based survey) assumed to be the same for both strategies.

DISCUSSION

Our study confirmed that the AMCDRS's best cut-off for identifying undiagnosed diabetes and total diabetes was 4, as shown in the original study by Sathish et al. [14]. The original AMCDRS study conducted in Kerala showed a sensitivity and specificity of 81% and 68% with an AROC of 0.812 (95% CI, 0.765 to 0.860), for an optimal cut-off value of 4 [14]. The sensitivity of 75.1% and specificity of 60.5% obtained from this study in the state of Tamil Nadu confirms the score's usefulness for screening for diabetes.

The original study in Kerala was probably not powered to assess the validity of the AMCDRS for identifying undiagnosed diabetes, as the number of participants with undiagnosed diabetes was low (n=42) [14]. This study from Tamil Nadu which included 274 cases of undiagnosed diabetes, showed a lower performance of AMCDRS for undiagnosed diabetes (AROC, 0.638) as compared to total diabetes (AROC, 0.731). The study for which the Chaturvedi risk score was developed showed a similar finding, where the risk score had a lower AROC (0.69) for undiagnosed diabetes as compared to total diabetes (AROC, 0.74) [11]. This discrepancy in the performance of the risk scores in identifying undiagnosed and total diabetes might be because older participants or those with a family history of diabetes are more likely to develop diabetes at an earlier stage, and thus already be diabetic at the time of screening [112122].

The AMCDRS's performance in identifying total diabetes was similar to that of other Indian risk scores, which include variables such as BMI, BP, and physical activity that are relatively difficult to measure in low-resource primary care settings in India, due to the need for expensive instruments [23]. It should be acknowledged however, that measuring waist circumference requires adequate training to ensure measurement accuracy [16]. For detecting undiagnosed diabetes, the AMCDRS did not perform as well as the Chaturvedi risk score which also includes hypertension along with the three other variables included in the AMDRS—age, family history, and waist circumference. This could be explained by the fact that hypertension has a strong association with diabetes [24]. Measuring BP accurately in primary care settings is not easy however, as it requires at least three readings to confirm a diagnosis of hypertension with a calibrated BP apparatus [16].

In this study, the NNS was higher when the risk score based approach was used as compared to universal FPG testing. The previous microsimulation study by Basu et al. [19] had also found that the NNS was higher with risk score based screening or random glucometer based screening (NNS ranging from 15.2 to 21.7) as compared to FPG (NNS, 11), due to the low sensitivity of the risk score based approaches.

The cost per case detected, however, was lower for the risk score based approach than for universal FPG testing in this study, for all risk scores including the AMCDRS. The microsimulation study had shown that the lowest cost per case detected would be for random glucometer based screening (US$ 5.28) as compared to risk score based two-step screening (US$ 13.01 to 17.06) [19]. As we did not obtain random glucometer values, we were unable to compare costs per case detected between risk scores and random point of care glucometer testing. Thus, when random glucometer based screening is impractical (due to lack of resources), a two-step screening using an initial risk score could be considered as an alternative screening method.

Our study had certain limitations. Firstly, as mentioned earlier, we could only calculate the AMCDRS and other risk scores for 79% of the study population. However, the sample size was large enough to validate a diabetes risk score. Secondly, the diagnosis of T2DM was made using FPG as recommended for the WHO STEPS survey [16], and not by a 75-g oral glucose tolerance test, the current gold standard for diagnosing T2DM [25]. Thirdly, our study findings may not be able to be generalised to other states in India owing to differences in diabetes prevalence and the distribution of risk factors. The states of Tamil Nadu and Kerala, for example, have a much higher burden of diabetes as compared to that of other states in India [151726]. Finally, the cost analysis was a simplified analysis as only actual screening tool costs were considered and not those additional costs associated with personnel and operations.

To conclude, the AMCDRS is a simple diabetes risk score that field workers and volunteers can use in low-resource primary care settings to screen for undiagnosed diabetes and total diabetes. If the AMCDRS was recalibrated, its performance in identifying undiagnosed diabetes would probably improve. If there are sufficient resources, additional parameters such as BP and BMI for calculating risk would improve prediction. Cohort studies are required to assess the performance of the AMCDRS in predicting incident T2DM.