Molly Marino1,2, Pengsheng Ni3, Lewis Kazis3, Diane Brandt4, Alan Jette3,5. 1. Department of Health Law, Policy, & Management, Boston University School of Public Health, Boston, MA, USA. memarino@bu.edu. 2. RTI International, Quality Measurement and Health Policy Program, 307 Waverly Oaks Road, Suite 101, Waltham, MA, 02452-8413, USA. memarino@bu.edu. 3. Department of Health Law, Policy, & Management, Boston University School of Public Health, Boston, MA, USA. 4. Rehabilitation Medicine Department, Mark O. Hatfield Clinical Research Center, National Institutes of Health, Bethesda, MD, USA. 5. Massachusetts General Hospital, Institute of Health Professions, Boston, MA, USA.
Abstract
PURPOSE: Sociodemographic characteristics may influence responses on self-reported measures. Differential item functioning (DIF) is when individuals expected to have the same ability level on a construct of interest have a different probability of endorsing an item on an item response theory (IRT) scale due to population characteristics. The goal of this study was to identify DIF for items in an outcome instrument by sociodemographic factors and, one controlling for DIF, assess true differences in function by those same factors. METHODS: The Work Disability Functional Assessment Battery 2.0 (WD-FAB 2.0) is an IRT-based self-reported measure of activity limitations relevant to work. Two samples from WD-FAB developed were used: 3793 SSA disability claimants randomly drawn from a pool of 16,500 claimants and a general sample if 2100 working age adults. We used a two-step IRT-based DIF method for three pairs of respondent characteristics: age, gender, and race/ethnicity, and calculated the weighted absolute difference between item characteristic curves. Independent two-group T-tests assessed differences in scores across groups. RESULTS: Seventeen items displayed DIF. Men had higher scores than women on two physical and two mental function scales. Older respondents had lower physical and higher mental function scores. The lower education group had lower mental function scores. CONCLUSION: DIF impacts function measurement and is important when assessing psychometric characteristics of instruments. Self-report measures should include diverse samples to conduct similar analyses. WD-FAB 2.0 scores are now reflections of function with reduced bias related to gender, race/ethnicity, or age.
PURPOSE: Sociodemographic characteristics may influence responses on self-reported measures. Differential item functioning (DIF) is when individuals expected to have the same ability level on a construct of interest have a different probability of endorsing an item on an item response theory (IRT) scale due to population characteristics. The goal of this study was to identify DIF for items in an outcome instrument by sociodemographic factors and, one controlling for DIF, assess true differences in function by those same factors. METHODS: The Work Disability Functional Assessment Battery 2.0 (WD-FAB 2.0) is an IRT-based self-reported measure of activity limitations relevant to work. Two samples from WD-FAB developed were used: 3793 SSA disability claimants randomly drawn from a pool of 16,500 claimants and a general sample if 2100 working age adults. We used a two-step IRT-based DIF method for three pairs of respondent characteristics: age, gender, and race/ethnicity, and calculated the weighted absolute difference between item characteristic curves. Independent two-group T-tests assessed differences in scores across groups. RESULTS: Seventeen items displayed DIF. Men had higher scores than women on two physical and two mental function scales. Older respondents had lower physical and higher mental function scores. The lower education group had lower mental function scores. CONCLUSION: DIF impacts function measurement and is important when assessing psychometric characteristics of instruments. Self-report measures should include diverse samples to conduct similar analyses. WD-FAB 2.0 scores are now reflections of function with reduced bias related to gender, race/ethnicity, or age.
Entities:
Keywords:
Differential item functioning; Functional assessment; Psychometrics; Work disability
Authors: Bryce B Reeve; Ron D Hays; Jakob B Bjorner; Karon F Cook; Paul K Crane; Jeanne A Teresi; David Thissen; Dennis A Revicki; David J Weiss; Ronald K Hambleton; Honghu Liu; Richard Gershon; Steven P Reise; Jin-shei Lai; David Cella Journal: Med Care Date: 2007-05 Impact factor: 2.983
Authors: Elizabeth E Marfeo; Pengsheng Ni; Stephen M Haley; Alan M Jette; Kara Bogusz; Mark Meterko; Christine M McDonough; Leighton Chan; Diane E Brandt; Elizabeth K Rasch Journal: Arch Phys Med Rehabil Date: 2013-03-30 Impact factor: 3.966
Authors: Shih-Fan Lin; Audrey N Beck; Brian K Finch; Robert A Hummer; Ryan K Masters; Ryan K Master Journal: Am J Public Health Date: 2012-09-20 Impact factor: 9.308
Authors: Mark Meterko; Elizabeth E Marfeo; Christine M McDonough; Alan M Jette; Pengsheng Ni; Kara Bogusz; Elizabeth K Rasch; Diane E Brandt; Leighton Chan Journal: Arch Phys Med Rehabil Date: 2014-12-18 Impact factor: 3.966
Authors: Pengsheng Ni; Christine M McDonough; Alan M Jette; Kara Bogusz; Elizabeth E Marfeo; Elizabeth K Rasch; Diane E Brandt; Mark Meterko; Stephen M Haley; Leighton Chan Journal: Arch Phys Med Rehabil Date: 2013-04-08 Impact factor: 3.966