Christopher S Bailey1, Charles G Fisher, Marcel F Dvorak. 1. Combined Neurosurgical and Orthopaedic Spine Program, Department of Orthopaedics, University of British Columbia, Vancouver Hospital and Health Sciences Centre, Vancouver, British Columbia, Canada.
Abstract
STUDY DESIGN: A literature review. OBJECTIVES: To determine the frequency of potential type II errors published in the spine surgical literature. SUMMARY OF BACKGROUND DATA: The randomized controlled trial is the strongest clinical evidence available in investigational medicine. Unfortunately, it is common for randomized controlled trials published in peer-reviewed journals not to report a primary question or a sample size calculation. When the null hypothesis is accepted and the power of a study is unreported, the validity of a study's findings may be significantly limited. To our knowledge, the spine literature has not been appraised to determine the frequency of type II errors. METHODS.: A literature search was conducted of MED-LINE, PubMed, and Cochrane databases, using the key words of "spine" and "surgery" between 1967 and 2002. Trials were included if they were of a 2-group randomized controlled trial design, which reported a nonsignificant difference in the primary outcome. The frequency of reporting the primary outcome and sample size calculation was determined. The sample size was assessed to determine whether the trial had sufficient patients to detect a 10%, 25%, and 35% relative difference in the primary outcome for a power of 80%. RESULTS: A total of 37 studies satisfied the inclusion criteria. Six studies reported a sample size calculation (17%). Of the remaining 31 studies, 5 explicitly stated a primary outcome (14%). The mean type II error (beta error) was 82%. CONCLUSION: The spine surgical literature is plagued with a high potential for type II error. A trial's methodology should be scrutinized to prevent misinterpretation of the results.
STUDY DESIGN: A literature review. OBJECTIVES: To determine the frequency of potential type II errors published in the spine surgical literature. SUMMARY OF BACKGROUND DATA: The randomized controlled trial is the strongest clinical evidence available in investigational medicine. Unfortunately, it is common for randomized controlled trials published in peer-reviewed journals not to report a primary question or a sample size calculation. When the null hypothesis is accepted and the power of a study is unreported, the validity of a study's findings may be significantly limited. To our knowledge, the spine literature has not been appraised to determine the frequency of type II errors. METHODS.: A literature search was conducted of MED-LINE, PubMed, and Cochrane databases, using the key words of "spine" and "surgery" between 1967 and 2002. Trials were included if they were of a 2-group randomized controlled trial design, which reported a nonsignificant difference in the primary outcome. The frequency of reporting the primary outcome and sample size calculation was determined. The sample size was assessed to determine whether the trial had sufficient patients to detect a 10%, 25%, and 35% relative difference in the primary outcome for a power of 80%. RESULTS: A total of 37 studies satisfied the inclusion criteria. Six studies reported a sample size calculation (17%). Of the remaining 31 studies, 5 explicitly stated a primary outcome (14%). The mean type II error (beta error) was 82%. CONCLUSION: The spine surgical literature is plagued with a high potential for type II error. A trial's methodology should be scrutinized to prevent misinterpretation of the results.
Authors: Patrick Vavken; Klemens M Heinrich; Christian Koppelhuber; Stefan Rois; Ronald Dorotka Journal: Clin Orthop Relat Res Date: 2009-03-31 Impact factor: 4.176
Authors: An-Wen Chan; Jennifer M Tetzlaff; Peter C Gøtzsche; Douglas G Altman; Howard Mann; Jesse A Berlin; Kay Dickersin; Asbjørn Hróbjartsson; Kenneth F Schulz; Wendy R Parulekar; Karmela Krleza-Jeric; Andreas Laupacis; David Moher Journal: BMJ Date: 2013-01-08
Authors: Marcel F Dvorak; Vanessa K Noonan; Nader Fallah; Charles G Fisher; Carly S Rivers; Henry Ahn; Eve C Tsai; A G Linassi; Sean D Christie; Najmedden Attabib; R John Hurlbert; Daryl R Fourney; Michael G Johnson; Michael G Fehlings; Brian Drew; Christopher S Bailey; Jérôme Paquet; Stefan Parent; Andrea Townson; Chester Ho; B C Craven; Dany Gagnon; Deborah Tsui; Richard Fox; Jean-Marc Mac-Thiong; Brian K Kwon Journal: J Neurotrauma Date: 2014-07-08 Impact factor: 5.269
Authors: Susan D Hanekom; Dina Brooks; Linda Denehy; Monika Fagevik-Olsén; Timothy C Hardcastle; Shamila Manie; Quinette Louw Journal: BMC Med Inform Decis Mak Date: 2012-02-06 Impact factor: 2.796