Trevor A Lentz1,2, Michael A Kallen3, Daniel Deutscher4,5, Steven Z George1,2. 1. Department of Orthopaedic Surgery, Duke University, Durham, NC, USA. 2. Duke Clinical Research Institute, Duke University, Durham, NC, USA. 3. Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. 4. Net Health Systems Inc, Pittsburgh, PA, USA. 5. Maccabitech Institute for Research & Innovation, Maccabi Healthcare Services, Tel-Aviv, Israel.
Abstract
BACKGROUND: Negative mood is an important risk factor for poor clinical outcomes among individuals with musculoskeletal pain. Screening for negative mood can aid in identifying those who may need additional psychological interventions. Limitations of current negative mood screening tools include (1) high response burden, (2) a focus on single dimensions of negative mood, (3) poor precision for identifying individuals with low or high negative mood levels, and/or (4) design not specific for use in populations with orthopaedic conditions and musculoskeletal pain. QUESTIONS/PURPOSES: (1) Can item response theory methods be used to construct screening tools for negative mood (such as depression, anxiety, and anger) in patients undergoing physical therapy for orthopaedic conditions? (2) Do these tools demonstrate reliability and construct validity when used in a clinical setting? METHODS: This was a cross-sectional study involving outpatients having physical therapy in tertiary-care settings. A total of 431 outpatients with neck (n = 93), shoulder (n = 108), low back (n = 119), or knee (n = 111) conditions were enrolled between December 2014 and December 2015, with 24% (103 of 431) seeking care after orthopaedic surgery. Participants completed three validated psychological questionnaires measuring negative mood, resulting in 39 candidate items for item response theory analysis. Factor analysis was used to identify the dimensions (factors) assessed by the candidate items and select items that loaded on the main factor of interest (negative mood), establishing a unidimensional item set. Unidimensionality of an item set suggests they are assessing one main factor or trait, allowing unbiased score estimates. The identified items were assessed for their fit to the graded item response theory model. This model allows for items to vary by the level of difficulty they represent and by their ability to discriminate between patients at different levels of the trait being assessed, in this case, negative mood. Finally, a hierarchical bifactor model where multiple subfactors are allowed to load on an overall factor was used to confirm that the items identified as representing a unidimensional item set explained the large majority of variance of the overall factor, providing additional support for essential unidimensionality. Using the final item bank, we constructed a computer adaptive test administration mode, and reduced item sets were selected to create short forms including items with the highest information (reliability) at targeted score levels of the trait being measured, while also considering clinical content. RESULTS: We identified a 12-item bank for assessment of negative mood; eight-item and four-item short-form versions were developed to reduce administrative burden. Computer adaptive test administration used a mean ± SD of 8 ± 1 items. The item bank's reliability (0 = no reliability; 1 = perfect reliability) was 0.89 for the computer adaptive test administration, 0.86 for the eight-item short form, and 0.71 for the four-item short form. Reliability values equal to or greater than 0.7 are considered acceptable for group level measures. Construct validity sufficient for clinical practice was supported by more severe negative mood scores among individuals with a previous episode of pain in the involved anatomical region, pain and activity limitations during the past 3 months, a work-related injury, education less than a college degree, and income less than or equal to USD 50,000. CONCLUSION: These newly derived tools include short-form and computer adaptive test options for reliable and valid negative mood assessment in outpatient orthopaedic populations. Future research should determine the responsiveness of these measures to change and establish score thresholds for clinical decision-making. CLINICAL RELEVANCE: Orthopaedic providers can use these tools to inform prognosis, establish clinical benchmarks, and identify patients who may benefit from psychological and/or behavioral treatments.
BACKGROUND: Negative mood is an important risk factor for poor clinical outcomes among individuals with musculoskeletal pain. Screening for negative mood can aid in identifying those who may need additional psychological interventions. Limitations of current negative mood screening tools include (1) high response burden, (2) a focus on single dimensions of negative mood, (3) poor precision for identifying individuals with low or high negative mood levels, and/or (4) design not specific for use in populations with orthopaedic conditions and musculoskeletal pain. QUESTIONS/PURPOSES: (1) Can item response theory methods be used to construct screening tools for negative mood (such as depression, anxiety, and anger) in patients undergoing physical therapy for orthopaedic conditions? (2) Do these tools demonstrate reliability and construct validity when used in a clinical setting? METHODS: This was a cross-sectional study involving outpatients having physical therapy in tertiary-care settings. A total of 431 outpatients with neck (n = 93), shoulder (n = 108), low back (n = 119), or knee (n = 111) conditions were enrolled between December 2014 and December 2015, with 24% (103 of 431) seeking care after orthopaedic surgery. Participants completed three validated psychological questionnaires measuring negative mood, resulting in 39 candidate items for item response theory analysis. Factor analysis was used to identify the dimensions (factors) assessed by the candidate items and select items that loaded on the main factor of interest (negative mood), establishing a unidimensional item set. Unidimensionality of an item set suggests they are assessing one main factor or trait, allowing unbiased score estimates. The identified items were assessed for their fit to the graded item response theory model. This model allows for items to vary by the level of difficulty they represent and by their ability to discriminate between patients at different levels of the trait being assessed, in this case, negative mood. Finally, a hierarchical bifactor model where multiple subfactors are allowed to load on an overall factor was used to confirm that the items identified as representing a unidimensional item set explained the large majority of variance of the overall factor, providing additional support for essential unidimensionality. Using the final item bank, we constructed a computer adaptive test administration mode, and reduced item sets were selected to create short forms including items with the highest information (reliability) at targeted score levels of the trait being measured, while also considering clinical content. RESULTS: We identified a 12-item bank for assessment of negative mood; eight-item and four-item short-form versions were developed to reduce administrative burden. Computer adaptive test administration used a mean ± SD of 8 ± 1 items. The item bank's reliability (0 = no reliability; 1 = perfect reliability) was 0.89 for the computer adaptive test administration, 0.86 for the eight-item short form, and 0.71 for the four-item short form. Reliability values equal to or greater than 0.7 are considered acceptable for group level measures. Construct validity sufficient for clinical practice was supported by more severe negative mood scores among individuals with a previous episode of pain in the involved anatomical region, pain and activity limitations during the past 3 months, a work-related injury, education less than a college degree, and income less than or equal to USD 50,000. CONCLUSION: These newly derived tools include short-form and computer adaptive test options for reliable and valid negative mood assessment in outpatient orthopaedic populations. Future research should determine the responsiveness of these measures to change and establish score thresholds for clinical decision-making. CLINICAL RELEVANCE: Orthopaedic providers can use these tools to inform prognosis, establish clinical benchmarks, and identify patients who may benefit from psychological and/or behavioral treatments.
Authors: D Scott Kreiner; Paul Matz; Christopher M Bono; Charles H Cho; John E Easa; Gary Ghiselli; Zoher Ghogawala; Charles A Reitman; Daniel K Resnick; William C Watters; Thiru M Annaswamy; Jamie Baisden; Walter S Bartynski; Shay Bess; Randall P Brewer; R Carter Cassidy; David S Cheng; Sean D Christie; Norman B Chutkan; Bernard Allan Cohen; Simon Dagenais; Dennis E Enix; Paul Dougherty; S Raymond Golish; Padma Gulur; Steven W Hwang; Cumhur Kilincer; Jeffrey A King; Adam C Lipson; Anthony J Lisi; Richard J Meagher; John E O'Toole; Paul Park; Murat Pekmezci; Daniel R Perry; Ravi Prasad; David A Provenzano; Kris E Radcliff; Gazanfar Rahmathulla; Tom E Reinsel; Robert L Rich; Daniel S Robbins; Karie A Rosolowski; Jonathan N Sembrano; Anil K Sharma; Alison A Stout; Christopher K Taleghani; Ryan A Tauzell; Terry Trammell; Yakov Vorobeychik; Amy M Yahiro Journal: Spine J Date: 2020-04-22 Impact factor: 4.166
Authors: Paul A Pilkonis; Lan Yu; Nathan E Dodds; Kelly L Johnston; Catherine C Maihoefer; Suzanne M Lawrence Journal: J Psychiatr Res Date: 2014-05-29 Impact factor: 4.791
Authors: Trevor A Lentz; Jason M Beneciuk; Joel E Bialosky; Giorgio Zeppieri; Yunfeng Dai; Samuel S Wu; Steven Z George Journal: J Orthop Sports Phys Ther Date: 2016-03-21 Impact factor: 4.751
Authors: Jessica J Wong; Andrea C Tricco; Pierre Côté; Catherine Y Liang; Jeremy A Lewis; Zachary Bouck; Laura C Rosella Journal: J Gen Intern Med Date: 2021-08-12 Impact factor: 6.473