BACKGROUND: Several techniques have been developed to detect differential item functioning (DIF), including ordinal logistic regression (OLR). This study compared different criteria for determining whether items have DIF using OLR. OBJECTIVES: To compare and contrast findings from three different sets of criteria for detecting DIF using OLR. General distress and physical functioning items were evaluated for DIF related to five covariates: age, marital status, gender, race, and Hispanic origin. RESEARCH DESIGN: Cross-sectional study. SUBJECTS: 1,714 patients with cancer or HIV/AIDS. MEASURES: A total of 23 items addressing physical functioning and 15 items addressing general distress were selected from a pool of 154 items from four different health-related quality of life questionnaires. RESULTS: The three sets of criteria produced qualitatively and quantitatively different results. Criteria based on statistical significance alone detected DIF in almost all the items, while alternative criteria based on magnitude detected DIF in far fewer items. Accounting for DIF by using demographic-group specific item parameters had negligible effects on individual scores, except for race. CONCLUSIONS: Specific criteria chosen to determine whether items have DIF have an impact on the findings. Criteria based entirely on statistical significance may detect small differences that are clinically negligible.
BACKGROUND: Several techniques have been developed to detect differential item functioning (DIF), including ordinal logistic regression (OLR). This study compared different criteria for determining whether items have DIF using OLR. OBJECTIVES: To compare and contrast findings from three different sets of criteria for detecting DIF using OLR. General distress and physical functioning items were evaluated for DIF related to five covariates: age, marital status, gender, race, and Hispanic origin. RESEARCH DESIGN: Cross-sectional study. SUBJECTS: 1,714 patients with cancer or HIV/AIDS. MEASURES: A total of 23 items addressing physical functioning and 15 items addressing general distress were selected from a pool of 154 items from four different health-related quality of life questionnaires. RESULTS: The three sets of criteria produced qualitatively and quantitatively different results. Criteria based on statistical significance alone detected DIF in almost all the items, while alternative criteria based on magnitude detected DIF in far fewer items. Accounting for DIF by using demographic-group specific item parameters had negligible effects on individual scores, except for race. CONCLUSIONS: Specific criteria chosen to determine whether items have DIF have an impact on the findings. Criteria based entirely on statistical significance may detect small differences that are clinically negligible.
Authors: N K Aaronson; S Ahmedzai; B Bergman; M Bullinger; A Cull; N J Duez; A Filiberti; H Flechtner; S B Fleishman; J C de Haes Journal: J Natl Cancer Inst Date: 1993-03-03 Impact factor: 13.506
Authors: Christine M McDonough; Feng Tian; Pengsheng Ni; Ilona M Kopits; Richard Moed; Poonam K Pardasaney; Alan M Jette Journal: J Gerontol A Biol Sci Med Sci Date: 2012-04-30 Impact factor: 6.053
Authors: Jeanne A Teresi; Katja Ocepek-Welikson; Marjorie Kleinman; Joseph P Eimicke; Paul K Crane; Richard N Jones; Jin-Shei Lai; Seung W Choi; Ron D Hays; Bryce B Reeve; Steven P Reise; Paul A Pilkonis; David Cella Journal: Psychol Sci Q Date: 2009
Authors: Paul K Crane; Karynsa Cetin; Karon F Cook; Kurt Johnson; Richard Deyo; Dagmar Amtmann Journal: Qual Life Res Date: 2007-04-19 Impact factor: 4.147
Authors: Yan Wang; Ron Hays; Marvin Marcus; Carl Maida; Jie Shen; Di Xiong; Steve Lee; Vladimir Spolsky; Ian Coulter; James Crall; Honghu Liu Journal: Int J Paediatr Dent Date: 2019-01-24 Impact factor: 3.455