Sean P Riley1, Brian T Swanson2, Stephen M Shaffer2, Steven F Sawyer3, Joshua A Cleland4. 1. Doctor of Physical Therapy Program, Sacred Heart University, Fairfield, CT, USA. 2. Department of Rehabilitation Sciences, University of Hartford, West Hartford, CT, USA. 3. Department of Rehabilitation Sciences and Center for Rehabilitation Research, Texas Tech University Health Sciences Center, Lubbock, Tx, USA. 4. Department of Public Health and Community Medicine, Tufts University School of Medicine, Boston, MA, USA.
Abstract
OBJECTIVES: To determine if there are any statistically significant associations between: 1) randomized clinical trials (RCTs) investigating physical therapy musculoskeletal interventions, 2) journal impact factor (JIF), 3) frequency of RCT citation, 4) whether prospective intent was identifiable, and 5) the Physiotherapy Evidence Database (PEDro) scores. METHODS: MEDLINE indexed RCTs addressing musculoskeletal interventions published between January 2016 and July 2020 in physical therapy journals were included. Two blinded reviewers identified the RCTs and extracted the variables of interest. RESULTS: With a familywise alpha adjustment, there was no statistically significant correlation between JIF and number of citations (rho = 0.187; p = 0.0280). Statistically significant weak positive correlations were identified between the JIF and prospectively registered RCTs (rho = 0.240; p = 0.0046), JIF and PEDro scores (rho = 0.250; p = 0.0031), and PEDro scores and prospectively registered RCTs (rho = 0.335; p < 0.0001). CONCLUSION: The findings of this study suggest that JIF and PEDro scores may not be accurate measures of RCT quality. Failing to ensure that published RCTs followed their prospective intent and using bibliometrics that fail to accurately measure what they propose appears to create untrustworthy preprocessed resources for practicing physical therapists during the evidence-based practice process. LEVEL OF EVIDENCE: 1a.
OBJECTIVES: To determine if there are any statistically significant associations between: 1) randomized clinical trials (RCTs) investigating physical therapy musculoskeletal interventions, 2) journal impact factor (JIF), 3) frequency of RCT citation, 4) whether prospective intent was identifiable, and 5) the Physiotherapy Evidence Database (PEDro) scores. METHODS: MEDLINE indexed RCTs addressing musculoskeletal interventions published between January 2016 and July 2020 in physical therapy journals were included. Two blinded reviewers identified the RCTs and extracted the variables of interest. RESULTS: With a familywise alpha adjustment, there was no statistically significant correlation between JIF and number of citations (rho = 0.187; p = 0.0280). Statistically significant weak positive correlations were identified between the JIF and prospectively registered RCTs (rho = 0.240; p = 0.0046), JIF and PEDro scores (rho = 0.250; p = 0.0031), and PEDro scores and prospectively registered RCTs (rho = 0.335; p < 0.0001). CONCLUSION: The findings of this study suggest that JIF and PEDro scores may not be accurate measures of RCT quality. Failing to ensure that published RCTs followed their prospective intent and using bibliometrics that fail to accurately measure what they propose appears to create untrustworthy preprocessed resources for practicing physical therapists during the evidence-based practice process. LEVEL OF EVIDENCE: 1a.
Authors: Andrea D Furlan; Antti Malmivaara; Roger Chou; Chris G Maher; Rick A Deyo; Mark Schoene; Gert Bronfort; Maurits W van Tulder Journal: Spine (Phila Pa 1976) Date: 2015-11 Impact factor: 3.468