Joshua M Garcia1, Matthew W Gallagher1, Sid E O'Bryant2, Luis D Medina3. 1. University of Houston, Department of Psychology, Houston, TX, USA. 2. University of North Texas Health Science Center, Graduate School of Biomedical Sciences, Fort Worth, TX, USA. 3. University of Houston, Department of Psychology, Houston, TX, USA. Electronic address: LDMedina2@uh.edu.
Abstract
BACKGROUND: Evaluating measurement bias is vital to ensure equivalent assessment across diverse groups. One approach for evaluating test bias, differential item functioning (DIF), assesses item-level bias across specified groups by comparing item-level responses between groups that have the same overall score. Previous DIF studies of the Beck Anxiety Inventory (BAI) have only assessed bias across age, sex, and disease duration in monolingual samples. We expand this literature through DIF analysis of the BAI across age, sex, education, ethnicity, cognitive status, and test language. METHODS: BAI data from a sample (n = 527, mean age=61.4 ± 12.7, mean education=10.9 ± 4.3, 69.3% female, 41.9% Hispanic/Latin American) from rural communities in West Texas, USA were analyzed. Item response theory (IRT) / logistic ordinal regression DIF was conducted across dichotomized demographic grouping factors. The Mann-Whitney U test and Hedge's g standardized mean differences were calculated before and after adjusting for the impact of DIF. RESULTS: Significant DIF was demonstrated in 10/21 items. An adverse impact of DIF was not identified when demographics were assessed individually. Adverse DIF was identified for only one participant (1/527, 0.2%) when all demographics were aggregated. LIMITATIONS: These results might not be generalizable to a sample with broader racial representation, more severe cognitive impairment, and higher levels of anxiety. CONCLUSIONS: Minimal item-level bias was identified across demographic factors considered. These results support prior evidence that the BAI is valid for assessing anxiety across age and sex while contributing new evidence of its clinical relevance across education, ethnicity, cognitive status, and English/Spanish test language.
BACKGROUND: Evaluating measurement bias is vital to ensure equivalent assessment across diverse groups. One approach for evaluating test bias, differential item functioning (DIF), assesses item-level bias across specified groups by comparing item-level responses between groups that have the same overall score. Previous DIF studies of the Beck Anxiety Inventory (BAI) have only assessed bias across age, sex, and disease duration in monolingual samples. We expand this literature through DIF analysis of the BAI across age, sex, education, ethnicity, cognitive status, and test language. METHODS: BAI data from a sample (n = 527, mean age=61.4 ± 12.7, mean education=10.9 ± 4.3, 69.3% female, 41.9% Hispanic/Latin American) from rural communities in West Texas, USA were analyzed. Item response theory (IRT) / logistic ordinal regression DIF was conducted across dichotomized demographic grouping factors. The Mann-Whitney U test and Hedge's g standardized mean differences were calculated before and after adjusting for the impact of DIF. RESULTS: Significant DIF was demonstrated in 10/21 items. An adverse impact of DIF was not identified when demographics were assessed individually. Adverse DIF was identified for only one participant (1/527, 0.2%) when all demographics were aggregated. LIMITATIONS: These results might not be generalizable to a sample with broader racial representation, more severe cognitive impairment, and higher levels of anxiety. CONCLUSIONS: Minimal item-level bias was identified across demographic factors considered. These results support prior evidence that the BAI is valid for assessing anxiety across age and sex while contributing new evidence of its clinical relevance across education, ethnicity, cognitive status, and English/Spanish test language.
Authors: Natalia O Dmitrieva; Denise Fyffe; Shubhabrata Mukherjee; Robert Fieo; Laura B Zahodne; Jamie Hamilton; Guy G Potter; Jennifer J Manly; Heather R Romero; Dan Mungas; Laura E Gibbons Journal: Int J Geriatr Psychiatry Date: 2014-04-15 Impact factor: 3.485
Authors: Kate B Wolitzky-Taylor; Natalie Castriotta; Eric J Lenze; Melinda A Stanley; Michelle G Craske Journal: Depress Anxiety Date: 2010-02 Impact factor: 6.505
Authors: Laura E Gibbons; Susan McCurry; Kristoffer Rhoads; Kamal Masaki; Lon White; Amy R Borenstein; Eric B Larson; Paul K Crane Journal: Int Psychogeriatr Date: 2008-10-24 Impact factor: 3.878