Jordan P Barker1, Stephen D Simon, Jonathan Dubin. 1. 1Departments of Orthopaedic Surgery (J.P.B. and J.D.) and Biomedical & Health Informatics (S.D.S.), School of Medicine, University of Missouri - Kansas City, Kansas City, Missouri.
Abstract
BACKGROUND: The purpose of this investigation was to examine the methodology of clinical trials used by the U.S. Food and Drug Administration (FDA) to determine the safety and effectiveness of high-risk orthopaedic devices approved between 2001 and 2015. METHODS: Utilizing the FDA's online public database, this systematic review audited study design and methodological variables intended to minimize bias and confounding. An additional analysis of blinding as well as the Checklist to Evaluate a Report of a Nonpharmacological Trial (CLEAR NPT) was applied to the randomized controlled trials (RCTs). RESULTS: Of the 49 studies, 46 (94%) were prospective and 37 (76%) were randomized. Forty-seven (96%) of the studies were controlled in some form. Of 35 studies that reported it, blinding was utilized in 21 (60%), of which 8 (38%) were reported as single-blinded and 13 (62%) were reported as double-blinded. Of the 37 RCTs, outcome assessors were clearly blinded in 6 (16%), whereas 15 (41%) were deemed impossible to blind as implants could be readily discerned on imaging. When the CLEAR NPT was applied to the 37 RCTs, >70% of studies were deemed "unclear" in describing generation of allocation sequences, treatment allocation concealment, and adequate blinding of participants and outcome assessors. CONCLUSIONS: This study manifests the highly variable reporting and strength of clinical research methodology accepted by the FDA to approve high-risk orthopaedic devices.
BACKGROUND: The purpose of this investigation was to examine the methodology of clinical trials used by the U.S. Food and Drug Administration (FDA) to determine the safety and effectiveness of high-risk orthopaedic devices approved between 2001 and 2015. METHODS: Utilizing the FDA's online public database, this systematic review audited study design and methodological variables intended to minimize bias and confounding. An additional analysis of blinding as well as the Checklist to Evaluate a Report of a Nonpharmacological Trial (CLEAR NPT) was applied to the randomized controlled trials (RCTs). RESULTS: Of the 49 studies, 46 (94%) were prospective and 37 (76%) were randomized. Forty-seven (96%) of the studies were controlled in some form. Of 35 studies that reported it, blinding was utilized in 21 (60%), of which 8 (38%) were reported as single-blinded and 13 (62%) were reported as double-blinded. Of the 37 RCTs, outcome assessors were clearly blinded in 6 (16%), whereas 15 (41%) were deemed impossible to blind as implants could be readily discerned on imaging. When the CLEAR NPT was applied to the 37 RCTs, >70% of studies were deemed "unclear" in describing generation of allocation sequences, treatment allocation concealment, and adequate blinding of participants and outcome assessors. CONCLUSIONS: This study manifests the highly variable reporting and strength of clinical research methodology accepted by the FDA to approve high-risk orthopaedic devices.