A headset method for measuring the visual temporal discrimination threshold in cervical dystonia.

BACKGROUND: The visual temporal discrimination threshold (TDT) is the shortest time interval at which one can determine two stimuli to be asynchronous and meets criteria for a valid endophenotype in adult-onset idiopathic focal dystonia, a poorly penetrant disorder. Temporal discrimination is assessed in the hospital laboratory; in unaffected relatives of multiplex adult-onset dystonia patients distance from the hospital is a barrier to data acquisition. We devised a portable headset method for visual temporal discrimination determination and our aim was to validate this portable tool against the traditional laboratory-based method in a group of patients and in a large cohort of healthy controls.
METHODS: Visual TDTs were examined in two groups 1) in 96 healthy control participants divided by age and gender, and 2) in 33 cervical dystonia patients, using two methods of data acquisition, the traditional table-top laboratory-based system, and the novel portable headset method. The order of assessment was randomized in the control group. The results obtained by each technique were compared.
RESULTS: Visual temporal discrimination in healthy control participants demonstrated similar age and gender effects by the headset method as found by the table-top examination. There were no significant differences between visual TDTs obtained using the two methods, both for the control participants and for the cervical dystonia patients. Bland-Altman testing showed good concordance between the two methods in both patients and in controls. DISCUSSION: The portable headset device is a reliable and accurate method for visual temporal discrimination testing for use outside the laboratory, and will facilitate increased TDT data collection outside of the hospital setting. This is of particular importance in multiplex families where data collection in all available members of the pedigree is important for exome sequencing studies.

Introduction

Dystonia is a movement disorder, characterized by “sustained muscle contractions, frequently causing twisting and repetitive movements, or abnormal postures.”1 Adult-onset idiopathic isolated focal dystonia (AOIFD) is inherited in an autosomal dominant manner with a reduced penetrance of 12–15%;2,3 this lack of penetrance poses difficulties for genetic studies as identification of gene carriers is challenging. Recent advances in next-generation genetic sequencing have facilitated the discovery of a number of adult-onset idiopathic focal dystonia (AOIFD) genes,4–7 but these affect relatively few families and overall gene discovery in AOIFD has been slow.

Tools to identify non-manifesting gene carriage have been extensively studied in the form of endophenotypes,8–10 traits that are subclinical markers of gene carriage.11,12 We have suggested that an abnormal temporal discrimination threshold (TDT) fulfills the criteria for an endophenotype in AOIFD,13,14 and could significantly increase the yield from genetic studies. The neural circuitry involved in the TDT is thought to involve a sub-cortical–basal ganglia circuit,12 and it is postulated that the main input to this circuit is the superior colliculus.15 TDT abnormalities are not specific to AOIFD, however, and are present in other disorders that are characterized by basal ganglia pathology.16,17

Distance from the hospital laboratory has meant that families living in remote areas have been unable to participate in TDT testing, despite wishing to do so. In order to facilitate data acquisition in those who were unable to attend the hospital, we constructed a portable headset device for measurement of the visual TDT. The aim of this study was to assess the reliability and validity of measurement of the visual TDT using the novel headset device compared to the standard table-top method in healthy control participants and patients with cervical dystonia.

Methods

The study received ethical approval from the St Vincent's University Hospital Research Ethics committee and was carried out between February 2009 and November 2013.

Participants tested

Healthy control participants

Ninety-six healthy control participants (48 females) were recruited from hospital staff and visitors; informed written consent was obtained from each individual. The controls were divided into four subgroups in accordance with our most recently published control values that are age and gender dependent.18 The subgroups were (1) males aged 18–35 years, (2) males aged 36–65 years, (3) females aged 18–35 years, (4) females aged 36–65 years. Exclusion criteria were: history of any condition resulting in loss of visual acuity that might affect ability to perceive the visual stimulus (excluding visual refractory disorders such as myopia or hyperopia that are correctable with lenses); any history of a neurological disorder known to affect the basal ganglia including dystonia or a family history of dystonia, or parkinsonism of any cause; any history of cognitive impairment that may affect ability to understand and participate in the analysis.

Cervical dystonia patients

Thirty-three cervical dystonia patients (18 females) attending the botulinum toxin clinic were examined by both techniques at separate times, prior to their therapeutic injection. All of these patients had their TDT determined by the standard table-top method at variable intervals up to three years previously.

Testing conditions

Although the headset followed the table-top data acquisition in all patients, the order of testing in the healthy control participants by table-top and headset methods was counterbalanced within the subgroups in order to minimize any bias. The traditional table-top method required testing in a sound-proofed, air-conditioned, darkened room in the hospital. The novel headset method was tested, either in the same single session or at a different time point, in a bright, quiet office simulating the home environment as the device is enclosed; therefore, the ambient lighting conditions do not affect its use. Testing was carried out by research registrars (A.M., O.K., L.W.) according to a standard protocol. One demonstration run was done prior to each test in order to ensure that the participant knew what to expect, and understood the test. Inter-rater reliability determined by repeat examination of the TDT in 30 control patients and relatives showed no evidence of any significant inter-rater variability among the three raters (intraclass correlation coefficient = 0.8).18

Device design

Table-top method

The standard table-top method was created by the Trinity Centre for Bioengineering, Trinity College Dublin, employing commercial software presentation (Neurobehavioural Systems, www.neurobs.com) installed on a desktop computer and programmed to control the illumination of two light-emitting diodes (LED) via the parallel port of the computer. The two LED lights were positioned 7 degrees into the visual field of the participant and horizontally orientated on the table in front of the subject. The participants were asked to focus on a focal point in the midline and to try not to look directly at the flashing lights. Pairs of lights were illuminated synchronously for 5 ms initially, and thereafter were progressively separated in time by 5-ms steps every 5 s. When the subject reported that pairs of lights were flashing asynchronously on three consecutive occasions, the first of these was taken as the visual TDT. The median of four trials on each side was used for each subject in order to allow for practice effect, and these two results (one from each side) were averaged to obtain a summary visual TDT score (ms).

Headset device

The headset device (see Figure 1), also created by the Trinity Centre for Bioengineering, Trinity College Dublin, was made from laser-sintered nylon plastic and weighed 0.70 kg; the device is strong, flexible and has a low transparency index. Mirrors reflect the LEDs, yellow lights with a 5 mm diameter, with a red focal point of 3 mm diameter, from the back of the unit to 7 degrees into the subject's visual field. A rubber sealing system surrounded the unit-to-head interface to ensure that little light entered the device while the test was running. A focal distance of 350 mm was found to be sufficient to ensure focus, regardless of age of the participant. A strapping system ensured that the device was fixed securely to the participant's head in a comfortable manner. A compact control unit centered on a microcontroller (Arduino ATmega328) connected to the device was developed so that no external computer connection was needed to execute the experiment. Pairs of lights were presented in the same way as with the table-top method.

Figure 1

The Headset Device from the Rear (from the Patient's Perspective).

The device is made of nylon plastic and is lightweight and flexible. Two mirrors reflect the LEDs from the back of the unit on each side to 7 degrees into the subject's visual field. A comfortable rubber sealing system that surrounds the unit-to-head interface ensures that little light enters the device and that consistent background luminance is maintained. A flexible, elasticated strapping system ensures that the device is fixed securely to the participant's head comfortably during the test.

The luminance of the LEDs with both devices was 90 cd/m2, with an additional small amount of background luminance with the table-top method, to enable the operator to see just enough in the dark environment to run the experiment.

Statistical analysis

Demographic information was expressed as means and standard deviations (SD). Mean visual TDT scores including range and standard deviation were obtained for 1) the healthy control participant population as a whole and for each of the four subgroups, and 2) the cervical dystonia patients. Differences in means between subgroups were analyzed using one-way analysis of variance (ANOVA). Paired t-testing was used to assess differences in table-top versus headset results within each subgroup and for the population as a whole. Bland–Altman testing was done in each of the four control subgroups in order to assess for a systematic bias between methods. The effect of age and gender on the visual TDT result was determined using linear regression modeling.

Results

Control participants

The 96 (48 females) healthy control participants had a mean age of 38.6 years (SD: 11.9, range 21.6–64.9 years). Each of the four subgroups (divided by gender and age, 18–35 and 36–65 years) included 24 individuals: 12 who carried out the table-top method first, and 12 who carried out the headset method first. The mean time difference between the two tests was 1.6 months (SD: 3.0, range 0–15.8 months) and on linear regression testing there was no significant effect of time difference on TDT result (p = 0.2). Mean visual TDT results, by gender, age, and method, including SD and upper limit of normal (mean+2.5 SD) are given in Table 1. Overall, using the average TDT of both testing methods, there was a significant difference in mean visual TDT between the four subgroups (one-way ANOVA [F(3,92) = 5.11, p = 0.002]): males 18–35 years: 37.3 ms (SD: 14.4), females 18–35 years: 31.1 ms (SD: 14.9); males 36–65 years: 42.7 ms (SD: 15.75), females 36–65 years: 33.75 (SD: 16.2). Paired t-testing (see Figure 2) showed no significant differences in the visual TDT between table-top versus headset methods within the subgroups: males 18–35 years (p = 0.96), females 18–35 years (p =  0.89); males 36–65 years (p = 0.12), females 36–65 years (p =  0.09). Using Bland–Altman testing, there was good concordance between the two methods with a homogeneous scatter around the mean in each group: in younger males the bias was 0.16 ms, in younger females 0.41 ms; in older males it was 6.44 ms and in older females it was 5.73 ms. In each group, the bias was in favor of the headset (the headset result was marginally longer). A significant practice effect was found regardless of method used first (first test mean visual TDT: 39.1 ms; second test mean visual TDT: 33.4 ms) (paired t-test, p =  0.012). Linear regression modeling showed a significant association of gender (p = 0.001), but not age (p = 0.43) with the visual TDT result.

Table 1

The Visual TDT in Healthy Control Participants, by Gender and Age subgroup, using Headset and Table-top Methods.

	Males18–35 years (n = 24)	Females 18–35 years (n = 24)	Males 36–65 years (n = 24)	Females 36–65 years (n = 24)
Headset method
Mean TDT (ms)	37.3	31.4	45.9	36.6
SD TDT (ms)	14.2	15.9	13.1	13.4
ULN (mean+2.5 SD)	72.8	71.2	78.7	70.1
Table-top method
Mean TDT (ms)	37.2	30.9	39.5	30.9
SD table-top TDT	14.9	14.2	17.8	18.5
ULN (mean+2.5 SD)	74.5	66.4	84.0	77.2

SD, Standard Deviation; TDT, Temporal Discrimination Threshold; ULN, Upper Limit of Normal.

Mean visual TDT with standard deviations by table-top and headset methods in each of four control groups (24 participants in each group) (males 18–35; females 18–35; males 36–65; females 36–65 years). The ULN for each group is the mean TDT plus 2.5 SD.

Figure 2

Illustrating the Visual TDT (in ms) Determined by the Traditional Table-top and Novel Headset Methods in Each of the Four Control Groups.

Paired t-tests of differences in means with headset and table-top values within each group are shown, all p-values are non-significant, consistent with no significant difference in means between each device in each group. Males 18–35, blue circles; females 18–35, red circles; males 36–65, blue circles; females 36–65, red circles. ms: Milliseconds; TDT, Temporal Discrimination Threshold.

The 33 patients (18 females) with cervical dystonia had a mean age of 55.3 years (SD: 9.7, range 36.9–71.3 years). All had performed the table-top method previously (mean time between table-top and headset method 21.6 months, range 0–60 months). There was no significant difference in mean visual TDT between table-top (mean 70.2 ms, SD: 26.2) and headset methods (mean 69.0 ms, SD: 28.0) (p = 0.72). Bland–Altman analysis showed a bias of 1.2 ms in favor of the headset device in this group with a homogeneous scatter around the mean. The device was deemed to be light-weight, and was tolerated by all participants, and each individual completed the procedure.

Discussion

The aim of this study was to examine the utility of a portable device to measure visual temporal discrimination in unaffected relatives of AOIFD patients who lived some distance from the hospital laboratory. Such a device would particularly help in collecting data from unaffected relatives of multiplex AOIFD families in their homes. We have shown that this novel, portable device produces visual TDT results comparable to the traditional laboratory-based method.

Visual temporal discrimination in control participants

Control participants were divided into groups according to age and gender; we had previously found in 192 healthy control participants, using the table-top method, that TDTs showed significant independent age- and gender-related effects (temporal discrimination increased with age and was longer in men than in women).18 Thus, in the current headset study, we similarly subdivided our control participants; the visual TDT by the headset method behaved similarly in relation to age and gender and, within the four control sub-groups, showed good concordance and consistency.

Practice effect

We found a significant practice effect between the first and second test in this study, as we noted previously.18 This is relatively small (approximately 6 ms; <0.5 SD). However, this finding implies that in any individual, if a mildly abnormal visual TDT (TDT Z-score: 2.5–3.0) is found, it would be prudent and important to repeat the test. It is possible that the ascending nature of the inter-stimulus interval between light flashes might lend itself to pattern recognition among subjects. We plan to explore various alternative algorithms for presentation of stimuli in future studies.

TDT methods in this study compared to published studies

In this study we have tried to replicate the stimulus set-up we used in the table-top system. The luminance of both our table–top and headset LEDs is 90 cd/m2, which is lower than that reported in other studies (140 cd/m2).19,20 This may be important in measurement of the visual TDT, as the perception of an interval between sequential flashes of a bright stimuli could possibly differ with changes in luminance. Some variability exists between studies in relation to calculation of the TDT19,20 and, although not relevant in our analysis here, in studies that have employed the tactile TDT the location of electrodes for tactile stimuli has varied.21 Many studies used tactile stimuli alone, but in those that have employed visual stimuli for a combined TDT, the location of the LEDs has remained relatively consistent.13,19,20

Limitations of the current study

Both men and women in the 36–65 years age subgroup had slightly longer mean visual TDTs using the headset (males: 45.9 ms, females: 36.6 ms) compared to the table-top (males: 39.5 ms, females: 30.9 ms); smaller LEDs in the headset than in the table-top apparatus might be a possible reason. As noted above, any individual with a borderline abnormal visual TDT result using the headset should be re-tested with the table-top method. The headset was generally well tolerated by the control participants; however, a few cervical dystonia patients reported increased head tremor due to anxiety and the requirement for concentration; this occurs with the table-top examination also. An advantage of the headset system is that it moves with head tremor, presenting a static image to the subject compared to the table-top system.

Summary and conclusions

To date, only candidate gene-association studies in dystonia have been reported22 and the highest yield in gene discovery so far has been in multiplex dystonia pedigrees. In our experience, recruitment of all members of large, geographically dispersed, kindreds for research studies is challenging; using the headset, any consenting adult family member will be able to participate in testing the visual TDT in the community. The researcher can now travel to the family member, making participation more convenient and less time-consuming for these individuals. We have shown that a portable headset device is a valid alternative tool for visual TDT measurement. We recommend that dystonia research groups using the visual TDT might consider such a device in their daily practice as it has the potential to increase data collection and study participation.