Joseph Nguyen1, Robert Marx2, Chisa Hidaka3, Sean Wilson3, Stephen Lyman3. 1. Healthcare Research Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY, 10022, USA. NguyenJ@HSS.EDU. 2. Department of Orthopaedics, Hospital for Special Surgery, 535 East 70th Street, New York, NY, 10022, USA. 3. Healthcare Research Institute, Hospital for Special Surgery, 535 East 70th Street, New York, NY, 10022, USA.
Abstract
PURPOSE: Knee-specific patient reported outcome measures (PROMs) are important tools in evaluating the effectiveness of sports medicine interventions. The PROMs were originally developed for paper administration, but electronic data capture technologies offer potential benefits such as increased efficiency and accuracy. The aim of this study was to assess the validity of touch screen versus paper administration using several common knee-specific and general health surveys. METHODS: Agreement between scores was compared for knee-specific PROMs administered on paper versus computer; paper versus tablet; computer versus tablet in 60 patients per group undergoing ACL reconstruction. Surveys were given at pre-operative assessment and between 1 and 7 days later. Weighted kappa statistic (κ) and intraclass correlation coefficients (ICC) were calculated to test agreement between the two modalities in: IKDC Subjective Knee Form, Marx Activity Scale, Tegner Activity Level Scale, and Lysholm Knee Scale. SF-12 Physical and Mental Component Summary scores were also assessed. RESULTS: Response rate was over 90 %. Mean age was 29.6 ± 10.9 years, with patients in the paper-computer cohort being 4 years older than in the other groups. Agreement was substantial or better for all PROMs collected: IKDC Subjective (ICC: 0.79); Marx (ICC: 0.70); Lysholm (ICC: 0.65); and Tegner (κ = 0.67). Agreement for the SF-12 PCS (ICC: 0.77) and MCS (ICC: 0.73) was also found to have substantial agreement. CONCLUSION: In conclusion, touch screen-based PROMs are a valid capture method, providing reliable results relative to traditional paper survey administration. Digital methods of direct data capture may also foster multi-centre collaborations and allow for more accurate comparisons of outcomes between patient groups in clinical practice and orthopaedic research. LEVEL OF EVIDENCE: II.
PURPOSE: Knee-specific patient reported outcome measures (PROMs) are important tools in evaluating the effectiveness of sports medicine interventions. The PROMs were originally developed for paper administration, but electronic data capture technologies offer potential benefits such as increased efficiency and accuracy. The aim of this study was to assess the validity of touch screen versus paper administration using several common knee-specific and general health surveys. METHODS: Agreement between scores was compared for knee-specific PROMs administered on paper versus computer; paper versus tablet; computer versus tablet in 60 patients per group undergoing ACL reconstruction. Surveys were given at pre-operative assessment and between 1 and 7 days later. Weighted kappa statistic (κ) and intraclass correlation coefficients (ICC) were calculated to test agreement between the two modalities in: IKDC Subjective Knee Form, Marx Activity Scale, Tegner Activity Level Scale, and Lysholm Knee Scale. SF-12 Physical and Mental Component Summary scores were also assessed. RESULTS: Response rate was over 90 %. Mean age was 29.6 ± 10.9 years, with patients in the paper-computer cohort being 4 years older than in the other groups. Agreement was substantial or better for all PROMs collected: IKDC Subjective (ICC: 0.79); Marx (ICC: 0.70); Lysholm (ICC: 0.65); and Tegner (κ = 0.67). Agreement for the SF-12 PCS (ICC: 0.77) and MCS (ICC: 0.73) was also found to have substantial agreement. CONCLUSION: In conclusion, touch screen-based PROMs are a valid capture method, providing reliable results relative to traditional paper survey administration. Digital methods of direct data capture may also foster multi-centre collaborations and allow for more accurate comparisons of outcomes between patient groups in clinical practice and orthopaedic research. LEVEL OF EVIDENCE: II.
Authors: Andreas Mayr; Olaf Gefeller; Hans-Ulrich Prokosch; Anna Pirkl; Antje Fröhlich; Martina de Zwaan Journal: J Clin Epidemiol Date: 2012-06-27 Impact factor: 6.437
Authors: Karen K Briggs; Jack Lysholm; Yelverton Tegner; William G Rodkey; Mininder S Kocher; J Richard Steadman Journal: Am J Sports Med Date: 2009-03-04 Impact factor: 6.202
Authors: Belle L van Meer; Duncan E Meuffels; Maaike M Vissers; Sita M A Bierma-Zeinstra; Jan A N Verhaar; Caroline B Terwee; Max Reijman Journal: Arthroscopy Date: 2013-02-08 Impact factor: 4.772
Authors: Brooke E Patterson; Adam G Culvenor; Christian J Barton; Ali Guermazi; Joshua J Stefanik; Kay M Crossley Journal: Arthritis Care Res (Hoboken) Date: 2020-03 Impact factor: 4.794
Authors: Eric J Cotter; Charles P Hannon; Philip Locker; Annabelle Davey; Kevin C Wang; Nikhil N Verma; Brian J Cole Journal: Orthop J Sports Med Date: 2018-03-07
Authors: Gareth Davies; Daniel Yeomans; Zoe Tolkien; Irene A Kreis; Shelley Potter; Matthew D Gardiner; Abhilash Jain; James Henderson; Jane M Blazeby Journal: Trials Date: 2020-06-08 Impact factor: 2.279