Dane J Brodke1, Chong Zhang2, Jeremy D Shaw3, Amy M Cizik2, Charles L Saltzman2, Darrel S Brodke2. 1. University of California, Los Angeles, Los Angeles, CA, USA. 2. Department of Orthopaedic Surgery, University of Utah, Salt Lake City, UT, USA. 3. Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, PA, USA.
Abstract
BACKGROUND: The Patient-Report Outcomes Measurement Information System (PROMIS) is increasingly used as a general-purpose tool for measuring orthopaedic surgery outcomes. This set of questionnaires is efficient, precise, and correlates well with specialty-specific measures, but impactful implementation of patient-specific data, especially at the point of care, remains a challenge. Although clinicians may have substantial experience with established patient-reported outcome measures in their fields, PROMIS is relatively new, and the real-life meaning of PROMIS numerical summary scores may be unknown to many orthopaedic surgeons. QUESTIONS/PURPOSES: We aimed to (1) identify a small subset of important items in the PROMIS Physical Function (PF) item bank that are answered by many patients with orthopaedic conditions and (2) graphically display characteristic responses to these items across the physical function spectrum in order to translate PROMIS numerical scores into physical ability levels using clinically relevant, familiar terms. METHODS: In a cross-sectional study, 97,852 PROMIS PF assessments completed by 37,517 patients with orthopaedic conditions presenting to a tertiary-care academic institution were pooled and descriptively analyzed. Between 2017 and 2020, we evaluated 75,354 patients for outpatient orthopaedic care. Of these, 67% (50,578) were eligible for inclusion because they completed a PROMIS version 2.0 physical function assessment; 17% (12,720) were excluded because they lacked information in the database on individual item responses, and another < 1% (341) were excluded because the assessment standard error was greater than 0.32, leaving 50% of the patients (37,517) for analysis. The PROMIS PF is scored on a 0-point to 100-point scale, with a population mean of 50 and SD of 10. Anchor-based minimum clinically important differences have been found to be 8 to 10 points in a foot and ankle population, 7 to 8 points in a spine population, and approximately 4 points in a hand surgery population. The most efficient and precise means of administering the PROMIS PF is as a computerized adaptive test (CAT), whereby an algorithm intelligently tailors each follow-up question based on responses to previous questions, requiring only a few targeted questions to generate an accurate result. In this study, the mean PROMIS PF score was 41 ± 9. The questions most frequently used by the PROMIS CAT software were identified (defined in this study as any question administered to > 0.1% of the cohort). To understand the ability levels of patients based on their individual scores, patients were grouped into score categories: < 18, 20 ± 2, 25 ± 2, 30 ± 2, 35 ± 2, 40 ± 2, 45 ± 2, 50 ± 2, 55 ± 2, 60 ± 2, and > 62. For each score category, the relative frequency of each possible response (ranging from "cannot do" to "without any difficulty") was determined for each question. The distribution of responses given by each score group for each question was graphically displayed to generate an intuitive map linking PROMIS scores to patient ability levels (with ability levels represented by how patients responded to the PROMIS items). RESULTS: Twenty-eight items from the 165-question item bank were used frequently (that is, administered to more than 0.1% of the cohort) by the PROMIS CAT software. The top four items constituted 63% of all items. These top four items asked about the patient's ability to perform 2 hours of physical labor, yard work, household chores, and walking more than 1 mile. Graphical displays of responses to the top 28 and top four items revealed how PROMIS scores correspond to patient ability levels. Patients with a score of 40 most frequently responded that they experienced "some difficulty" with physical labor, yard work, household chores, and walking more than 1 mile, compared with "little" or "no" difficulty for patients with a score of 50 and "cannot do" for patients with a score of 30. CONCLUSION: We provided a visual key linking PROMIS numerical scores to physical ability levels using clinically relevant, familiar terms. Future studies might investigate whether using similar graphical displays as a patient education tool enhances patient-provider communication and improves the patient experience. CLINICAL RELEVANCE: The visual explanation of PROMIS scores provided by this study may help new users of the PROMIS understand the instrument, feel empowered to incorporate it into their practices, and use it as a tool for counseling patients about their scores.
BACKGROUND: The Patient-Report Outcomes Measurement Information System (PROMIS) is increasingly used as a general-purpose tool for measuring orthopaedic surgery outcomes. This set of questionnaires is efficient, precise, and correlates well with specialty-specific measures, but impactful implementation of patient-specific data, especially at the point of care, remains a challenge. Although clinicians may have substantial experience with established patient-reported outcome measures in their fields, PROMIS is relatively new, and the real-life meaning of PROMIS numerical summary scores may be unknown to many orthopaedic surgeons. QUESTIONS/PURPOSES: We aimed to (1) identify a small subset of important items in the PROMIS Physical Function (PF) item bank that are answered by many patients with orthopaedic conditions and (2) graphically display characteristic responses to these items across the physical function spectrum in order to translate PROMIS numerical scores into physical ability levels using clinically relevant, familiar terms. METHODS: In a cross-sectional study, 97,852 PROMIS PF assessments completed by 37,517 patients with orthopaedic conditions presenting to a tertiary-care academic institution were pooled and descriptively analyzed. Between 2017 and 2020, we evaluated 75,354 patients for outpatient orthopaedic care. Of these, 67% (50,578) were eligible for inclusion because they completed a PROMIS version 2.0 physical function assessment; 17% (12,720) were excluded because they lacked information in the database on individual item responses, and another < 1% (341) were excluded because the assessment standard error was greater than 0.32, leaving 50% of the patients (37,517) for analysis. The PROMIS PF is scored on a 0-point to 100-point scale, with a population mean of 50 and SD of 10. Anchor-based minimum clinically important differences have been found to be 8 to 10 points in a foot and ankle population, 7 to 8 points in a spine population, and approximately 4 points in a hand surgery population. The most efficient and precise means of administering the PROMIS PF is as a computerized adaptive test (CAT), whereby an algorithm intelligently tailors each follow-up question based on responses to previous questions, requiring only a few targeted questions to generate an accurate result. In this study, the mean PROMIS PF score was 41 ± 9. The questions most frequently used by the PROMIS CAT software were identified (defined in this study as any question administered to > 0.1% of the cohort). To understand the ability levels of patients based on their individual scores, patients were grouped into score categories: < 18, 20 ± 2, 25 ± 2, 30 ± 2, 35 ± 2, 40 ± 2, 45 ± 2, 50 ± 2, 55 ± 2, 60 ± 2, and > 62. For each score category, the relative frequency of each possible response (ranging from "cannot do" to "without any difficulty") was determined for each question. The distribution of responses given by each score group for each question was graphically displayed to generate an intuitive map linking PROMIS scores to patient ability levels (with ability levels represented by how patients responded to the PROMIS items). RESULTS: Twenty-eight items from the 165-question item bank were used frequently (that is, administered to more than 0.1% of the cohort) by the PROMIS CAT software. The top four items constituted 63% of all items. These top four items asked about the patient's ability to perform 2 hours of physical labor, yard work, household chores, and walking more than 1 mile. Graphical displays of responses to the top 28 and top four items revealed how PROMIS scores correspond to patient ability levels. Patients with a score of 40 most frequently responded that they experienced "some difficulty" with physical labor, yard work, household chores, and walking more than 1 mile, compared with "little" or "no" difficulty for patients with a score of 50 and "cannot do" for patients with a score of 30. CONCLUSION: We provided a visual key linking PROMIS numerical scores to physical ability levels using clinically relevant, familiar terms. Future studies might investigate whether using similar graphical displays as a patient education tool enhances patient-provider communication and improves the patient experience. CLINICAL RELEVANCE: The visual explanation of PROMIS scores provided by this study may help new users of the PROMIS understand the instrument, feel empowered to incorporate it into their practices, and use it as a tool for counseling patients about their scores.
Authors: Mohsin S Fidai; Bryan M Saltzman; Fabien Meta; Vincent A Lizzio; Jeffrey P Stephens; Kevin J Bozic; Eric C Makhni Journal: Arthroscopy Date: 2017-10-31 Impact factor: 4.772
Authors: David N Bernstein; Kathleen Fear; Addisu Mesfin; Warren C Hammert; David J Mitten; Paul T Rubery; Judith F Baumhauer Journal: Musculoskeletal Care Date: 2019-01-07
Authors: Man Hung; Charles L Saltzman; Richard Kendall; Jerry Bounsanga; Maren W Voss; Brandon Lawrence; Ryan Spiker; Darrel Brodke Journal: Clin Orthop Relat Res Date: 2018-10 Impact factor: 4.176
Authors: Vanessa K Noonan; Anne Lyddiatt; Patrick Ware; Susan B Jaglal; Richard J Riopelle; Clifton O Bingham; Sabrina Figueiredo; Richard Sawatzky; Maria Santana; Susan J Bartlett; Sara Ahmed Journal: J Clin Epidemiol Date: 2017-04-20 Impact factor: 6.437
Authors: Jonathan L Berliner; Dane J Brodke; Vanessa Chan; Nelson F SooHoo; Kevin J Bozic Journal: Clin Orthop Relat Res Date: 2017-01 Impact factor: 4.176
Authors: Man Hung; Judith F Baumhauer; Frank W Licari; Maren W Voss; Jerry Bounsanga; Charles L Saltzman Journal: Foot Ankle Int Date: 2018-10-04 Impact factor: 2.827
Authors: Matthias Rose; Jakob B Bjorner; Barbara Gandek; Bonnie Bruce; James F Fries; John E Ware Journal: J Clin Epidemiol Date: 2014-05 Impact factor: 6.437
Authors: Michiel A J Luijten; Raphaële R L van Litsenburg; Caroline B Terwee; Martha A Grootenhuis; Lotte Haverman Journal: Qual Life Res Date: 2021-02-19 Impact factor: 4.147
Authors: Jeremy D Shaw; Ross McEntarfer; Jason Ferrel; Natasha Greene; Angela P Presson; Chong Zhang; Brandon D Lawrence; William R Spiker; Nicholas Spina; Darrel S Brodke Journal: Global Spine J Date: 2020-10-14
Authors: Bonnie Bruce; James F Fries; Debbie Ambrosini; Bharathi Lingala; Barbara Gandek; Matthias Rose; John E Ware Journal: Arthritis Res Ther Date: 2009-12-16 Impact factor: 5.156