| Literature DB >> 25883562 |
Jasmin Pfeifer1, Silke Hamann2.
Abstract
This article presents a critical survey of the prevalent usage of the Montreal Battery of Evaluation of Amusia (MBEA; Peretz et al., 2003) to assess congenital amusia, a neuro-developmental disorder that has been claimed to be present in 4% of the population (Kalmus and Fry, 1980). It reviews and discusses the current usage of the MBEA in relation to cut-off scores, number of used subtests, manner of testing, and employed statistics, as these vary in the literature. Furthermore, data are presented from a large-scale experiment with 228 German undergraduate students who were assessed with the MBEA and a comprehensive questionnaire. This experiment tested the difference between scores that were obtained in a web-based study (at participants' homes) and those obtained under laboratory conditions with a computerized version of the MBEA. In addition to traditional statistical procedures, the data were evaluated using Signal Detection Theory (SDT; Green and Swets, 1966), taking into consideration the individual's ability to discriminate and their response bias. Results show that using SDT for scoring instead of proportion correct offers a bias-free and normally distributed measure of discrimination ability. It is also demonstrated that a diagnosis based on an average score leads to cases of misdiagnosis. The prevalence of congenital amusia is shown to depend highly on the statistical criterion that is applied as cut-off score and on the number of subtests that is considered for the diagnosis. In addition, three different subtypes of amusics were found in our sample. Lastly, significant differences between the web-based and the laboratory group were found, giving rise to questions about the validity of web-based experimentation.Entities:
Keywords: Congenital amusia; MBEA; SDT; prevelance; web-based testing
Year: 2015 PMID: 25883562 PMCID: PMC4381621 DOI: 10.3389/fnhum.2015.00161
Source DB: PubMed Journal: Front Hum Neurosci ISSN: 1662-5161 Impact factor: 3.169
Montreal Battery of Evaluation of Amusia (MBEA) test scores for the six subtests and average score in the study by Peretz et al. (2003, p. 66).
| Scale | Contour | Interval | Rhythm | Meter | Memory | Average | |
|---|---|---|---|---|---|---|---|
| Mean correct responses | 27 | 27 | 26 | 27 | 26 | 27 | 27 |
| SD | 2.3 | 2.2 | 2.4 | 2.1 | 2.9 | 2.3 | 1.6 |
| Cut-off score (mean – 2 SD) | 22 | 22 | 21 | 23 | 20 | 22 | 21.6∗ |
| Cut-off in % | 73.3 | 73.3 | 70 | 76.7 | 66.7 | 73.3 | 72.2∗ |
| Participants with perfect score (%) | 17 | 9 | 7 | 15 | 14 | 10 | 3 |
| Participants below cut off (%) | 3 | 1 | 1 | 1 | 1 | 1 | 2 |
MBEA cut-off scores for the six subtests and the average score by control subjects in the large-scale studies by Cuddy et al. (2005), Wise (2009), Nan et al. (2010) and Peretz et al. (2003) (for comparison).
| Source | Scale | Contour | Interval | Rhythm | Meter | Memory | Average | |
|---|---|---|---|---|---|---|---|---|
| Cut-off scores | 20.1 | 19.4 | 18.6 | 20.2 | 15.1 | 22.7 | 21.5 | |
| Cut-off (%) | 67.0 | 64.7 | 62.0 | 67.3 | 50.3 | 75.7 | 71.7 | |
| Cut-off scores | 21.5 | 19.7 | 19.8 | 23.2 | 19.4 | 20.8 | 22.4 | |
| Cut-off (%) | 71.5 | 65.7 | 66.1 | 77.4 | 64.6 | 69.3 | 74.6 | |
| Cut-off scores | 19.3 | 20.9 | 17.7 | 22.0 | 16.2 | 21.5 | 21.5 | |
| Cut-off (%) | 64.2 | 69.6 | 59.0 | 73.3 | 53.9 | 71.8 | 71.7 | |
| Cut-off scores | 22 | 22 | 21 | 23 | 20 | 22 | 21.6 | |
| Cut-off (%) | 73.3 | 73.3 | 70 | 76.7 | 66.7 | 73.3 | 72.2 | |
Descriptive statistics and results of t-tests comparing laboratory and web-based participant characteristics.
| Group | Age | Years of education | Years of music education | Handedness | Gender | |
|---|---|---|---|---|---|---|
| Laboratory | Mean | 22.7 | 14.4 | 5.9 | 101 right | 90 female |
| Range | 20–35 | 12–23 | 0–12 | |||
| Web-based | Mean | 22.0 | 14.7 | 6.3 | 107 right | 99 female |
| Range | 19–36 | 12–22 | 0–17 | |||
| Total | Mean | 22.3 | 14.6 | 6.1 | 207 right | 188 female |
| 1.82 | –1.06 | –0.82 | – | – | ||
| 0.71 | 0.29 | 0.41 | – | – | ||
Overview of stimulus types and possible responses.
| Stimulus pair | Response | |
|---|---|---|
| Different | Same | |
| Different | Hit (H) | Miss (M) |
| Same | False alarm (FA) | Correct rejection (CR) |
Sum of correct responses for the web-based and laboratory groups (absolute numbers, with maximum of 30 per subtest).
| Group | Scale | Contour | Interval | Rhythm | Meter | Memory | Average | |
|---|---|---|---|---|---|---|---|---|
| Web-based | Mean | 24.97 | 23.86 | 23.21 | 24.87 | 24.09 | 26.34 | 24.56 |
| SD | 3.03 | 3.38 | 3.89 | 3.80 | 5.29 | 3.09 | 3.94 | |
| Laboratory | Mean | 24.95 | 24.68 | 24.32 | 25.84 | 26.07 | 27.51 | 25.56 |
| SD | 2.73 | 3.01 | 3.29 | 2.64 | 3.65 | 1.77 | 3.09 | |
The results of variance and normality analyses, comparison between laboratory and web-based group per MBEA subtest.
| Subtest | Group | Skew | SE Skew | Kurtosis | SE Kurtosis | Kolmogorov–Smirnov Test | Levene’s Test | Mann-Whitney-Test (1-tailed) | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Scale | Lab | –1.06 | 0.23 | 1.99 | 0.46 | 0.14 | 1.46 | 6239 | –0.52 | 0.30 | ||||
| Web | –0.93 | 0.22 | 0.61 | 0.44 | 1.36 | 0.16 | ||||||||
| Contour | Lab | –0.70 | 0.23 | 0.05 | 0.46 | 0.12 | 0.12 | 2.56 | 5588 | –1.83 | ||||
| Web | –0.45 | 0.22 | – | –0.43 | 0.44 | –0.96 | 0.12 | |||||||
| Interval | Lab | –0.81 | 0.23 | 0.55 | 0.46 | 1.20 | 0.14 | 4.10 | 5398 | –2.21 | ||||
| Web | –0.47 | 0.22 | – | –0.40 | 0.44 | –0.90 | 0.09 | |||||||
| Rhythm | Lab | –0.63 | 0.23 | – | –0.06 | 0.46 | –0.14 | 0.14 | 8.86 | 5786 | –1.43 | 0.08 | ||
| Web | –0.96 | 0.22 | 0.28 | 0.44 | 0.64 | 0.15 | ||||||||
| Meter | Lab | –1.20 | 0.23 | 1.22 | 0.46 | 0.17 | 19.76 | 5251 | –2.51 | |||||
| Web | –0.85 | 0.22 | 0.13 | 0.44 | 0.29 | 0.15 | ||||||||
| Memory | Lab | –0.66 | 0.23 | – | 0.05 | 0.46 | 0.11 | 0.15 | 19.85 | 5309 | –2.41 | |||
| Web | –1.39 | 0.22 | 1.78 | 0.44 | 0.20 | |||||||||
| Average | Lab | –0.69 | 0.23 | 0.55 | 0.46 | 1.20 | 0.33 | 8.60 | 5353 | –2.29 | ||||
| Web | –0.94 | 0.22 | 0.62 | 0.44 | 1.39 | 0.28 | ||||||||
Sum of correct responses for the group tested in the laboratory.
| Sum of correct responses | Scale | Contour | Interval | Rhythm | Meter | Memory | Average | Pitch Average |
|---|---|---|---|---|---|---|---|---|
| Mean | 24.95 | 24.68 | 24.32 | 25.84 | 26.07 | 27.51 | 25.48 | 24.64 |
| SD | 2.73 | 3.01 | 3.29 | 2.64 | 3.65 | 1.77 | 2.06 | 2.47 |
| Cut-off (2 SD) | 19.49 | 18.66 | 17.74 | 20.56 | 18.77 | 23.97 | 21.36 | 19.7 |
| Cut-off (%) | 65.0 | 62.2 | 59.1 | 68.5 | 62.6 | 79.9 | 71.2 | 65.7 |
| % below cut off | 4.5 | 7.2 | 7.2 | 4.5 | 6.3 | 7.2 | 5.4 | 6.3 |
| Cut-off % Peretz | 73.3 | 73.3 | 70 | 76.7 | 66.7 | 73.3 | 76.6 | 72.2 |
| % below cut-off Peretz | 14.4 | 22.5 | 15.3 | 20.7 | 7.2 | 0 | 9.01 | 13.5 |
Means and SD of d′ and c for the group tested in the laboratory, including cut-off scores and percentage of amusics and controls categorization based on PC and z-scores used for normality analysis.
| Scale | Contour | Interval | Rhythm | Meter | Memory | Average | Pitch Average | ||
|---|---|---|---|---|---|---|---|---|---|
| Mean | 0.01 | 0.15 | 0.29 | –0.05 | –0.22 | –0.21 | –0.00 | 0.15 | |
| SD | 0.55 | 0.54 | 0.48 | 0.55 | 0.34 | 0.43 | 0.29 | 0.46 | |
| Mean | 2.33 | 2.25 | 2.16 | 2.65 | 2.81 | 3.23 | 2.25 | 2.25 | |
| SD | 0.84 | 0.90 | 0.95 | 0.90 | 1.28 | 0.81 | 0.66 | 0.73 | |
| –0.51 | 0.69 | 0.28 | –0.19 | –0.99 | 0.32 | 1.56 | –0.01 | ||
| 1.28 | –1.30 | 0.10 | –1.64 | –1.70 | –1.15 | 0.61 | 0.15 | ||
| % below cut-off score: Mean–1 SD | 15.32 | 18.02 | 13.51 | 25.23 | 18.92 | 17.12 | 14.41 | 14.41 | |
| % overdignosis: amean–1 SD | 1.80 | 4.50 | 1.80 | 2.70 | 0.00 | 1.80 | 2.70 | 1.80 | |
| % underdiagnosis: Mean–1 SD | 2.70 | 0.00 | 0.00 | 7.21 | 11.71 | 11.71 | 1.80 | 2.70 | |
Percentage of participants scoring below a cut-off score of (mean–1 SD) on at least two subtests.
| Two or more subtests | Three or more subtests | |||
|---|---|---|---|---|
| Total (%) | Below cut-off score (%) | Total (%) | Below cut-off score (%) | |
| Total | 28.8 | 13.5 | ||
| Only pitch | 5.4 (3.6) | 18.6 (15.6) | 2.7 (2.7) | 20.0 (20.0) |
| Only rhythm | 9.0 (4.5) | 31.3 (12.5) | 0.9 (0.9) | 6.6 (6.6) |
| Pitch and rhythm | 14.4 (5.4) | 50.0 (18.6) | 9.9 (5.4) | 73.3 (40) |
Summary of principal component analysis (PCA): Rotated pattern matrix with factor loadings, ordered according to the factor loadings per component.
| Questionnaire item | Component | |||||
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | |
| Perception 1 – melodies without lyrics | –016 | –0.19 | –0.04 | –0.07 | 0.10 | |
| Perception 3 – piano tones | –0.00 | –0.08 | –0.01 | 0.02 | –0.02 | |
| Perception 2 – off/wrong singing | 0.01 | –0.02 | 0.15 | 0.07 | –0.06 | |
| Clapping | 0.13 | 0.20 | –0.22 | –0.09 | 0.17 | |
| Singing 3 – notice wrong singing and correct it | –0.07 | 0.10 | 0.37 | 0.06 | –0.08 | |
| Perception 4 – surrounded by music as child | 0.19 | 0.12 | 0.19 | –0.03 | –0.12 | |
| Music education 2 – age of onset | 0.01 | –0.08 | –0.05 | –0.09 | –0.02 | |
| Music education 4 – frustration | 0.00 | 0.00 | –0.04 | 0.00 | 0.03 | |
| Music education 3 – years of lessons | –0.14 | 0.09 | –0.03 | –0.09 | 0.06 | |
| Music education 1 – type of education | 0.15 | 0.00 | 0.06 | 0.02 | –0.12 | |
| Music education 5 – still playing/singing | –0.08 | –0.16 | 0.19 | 0.32 | 0.05 | |
| Dancing 2 – quality – own assessment | 0.03 | –0.01 | –0.06 | 0.00 | –0.05 | |
| Dancing 1 – quantity/frequency | –0.14 | –0.03 | 0.13 | 0.04 | 0.04 | |
| Singing 1 – when alone | –0.08 | –0.01 | 0.09 | –0.04 | 0.13 | |
| Singing 2 – in public | 0.13 | 0.01 | –0.05 | –0.02 | –0.01 | |
| Unmusicality 1 – family members | –0.15 | –0.11 | –0.01 | 0.04 | –0.01 | |
| Unmusicality 2 – qwn assessment | 0.17 | 0.04 | 0.08 | –0.13 | 0.05 | |
| Listening habits 1 – quantity listening to music | –0.02 | –0.02 | –0.03 | 0.27 | –0.13 | |
| Listening habits 2 – attitude toward music | 0.09 | 0.02 | 0.02 | –0.12 | 0.17 | |
Summary of multiple regression analysis predicting MBEA scores per subtest from components.
| Coefficients | Collinearity statistics | Model fit | ||||||
|---|---|---|---|---|---|---|---|---|
| Subtest | Components included | β | VIF | Tolerance | Durbin–Watson | ANOVA | ||
| Scale | 1.87 | |||||||
| Contour | 2.41 | |||||||
| Interval | 1.93 | |||||||
| Rhythm | 2.07 | |||||||
| Meter | 2.13 | |||||||
| Memory | 2.10 | |||||||
| Average | 2.36 | |||||||