Otho R Plummer1, Joseph A Abboud2, John-Erik Bell3, Anand M Murthi4, Anthony A Romeo5, Priyanka Singh6, Benjamin M Zmistowski2. 1. Universal Research Solutions, LLC, Columbia, MO, USA. Electronic address: otho.plummer@oberd.com. 2. Department of Shoulder and Elbow Surgery, Rothman Institute and Jefferson University, Philadelphia, PA, USA. 3. Department of Shoulder and Elbow Surgery, Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA. 4. Department of Shoulder and Elbow Surgery, MedStar Union Memorial, Baltimore, MD, USA. 5. Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, IL, USA. 6. Universal Research Solutions, LLC, Columbia, MO, USA.
Abstract
BACKGROUND: Patient-reported outcome measures enable quantitative and patient-centric assessment of orthopedic interventions; however, increased use of these forms has an associated burden for patients and practices. We examined the utility of a computerized adaptive testing (CAT) method to reduce the number of questions on the American Shoulder and Elbow Surgeons (ASES) instrument. METHODS: A previously developed ASES CAT system was applied to the responses of 2763 patients who underwent shoulder evaluation and treatment and had answered all questions on the full ASES instrument. Analyses to assess the accuracy of the CAT score in replicating the full-form score included the mean and standard deviation of both groups of scores, frequency distributions of the 2 sets of scores and score differences, Pearson and intraclass correlation coefficients, and Bland-Altman assessment of patterns in score differences. RESULTS: By tailoring questions according to prior responses, CAT reduced the question burden by 40%. The mean difference between CAT and full ASES scores was -0.14, and the scores were within 5 points in 95% of cases (a 12-point difference is considered the threshold for clinical significance) and were clustered around zero. The correlation coefficients were 0.99, and the frequency distributions of the CAT and full ASES scores were nearly identical. The differences between scores were independent of the overall score, and no significant bias for CAT scores was found in either a positive or negative direction. CONCLUSION: The ASES CAT system lessens respondent burden with a negligible effect on score integrity.
BACKGROUND:Patient-reported outcome measures enable quantitative and patient-centric assessment of orthopedic interventions; however, increased use of these forms has an associated burden for patients and practices. We examined the utility of a computerized adaptive testing (CAT) method to reduce the number of questions on the American Shoulder and Elbow Surgeons (ASES) instrument. METHODS: A previously developed ASES CAT system was applied to the responses of 2763 patients who underwent shoulder evaluation and treatment and had answered all questions on the full ASES instrument. Analyses to assess the accuracy of the CAT score in replicating the full-form score included the mean and standard deviation of both groups of scores, frequency distributions of the 2 sets of scores and score differences, Pearson and intraclass correlation coefficients, and Bland-Altman assessment of patterns in score differences. RESULTS: By tailoring questions according to prior responses, CAT reduced the question burden by 40%. The mean difference between CAT and full ASES scores was -0.14, and the scores were within 5 points in 95% of cases (a 12-point difference is considered the threshold for clinical significance) and were clustered around zero. The correlation coefficients were 0.99, and the frequency distributions of the CAT and full ASES scores were nearly identical. The differences between scores were independent of the overall score, and no significant bias for CAT scores was found in either a positive or negative direction. CONCLUSION: The ASES CAT system lessens respondent burden with a negligible effect on score integrity.
Authors: Liam T Kane; Surena Namdari; Otho R Plummer; Pedro Beredjiklian; Alexander Vaccaro; Joseph A Abboud Journal: JB JS Open Access Date: 2020-03-12