Alireza Mansouri1,2, Benjamin Cooper3, Samuel M Shin3, Douglas Kondziolka4,3. 1. Division of Neurosurgery, University of Toronto, Ontario, Canada; 2. Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada; 3. Radiation Oncology, NYU Langone Medical Center, New York University, New York, New York. 4. Departments of Neurosurgery and.
Abstract
OBJECTIVE: Randomized-controlled trials (RCTs) are advocated to provide high-level medical evidence. However, in neurosurgery, there are barriers to conducting RCTs. The authors of this study sought to analyze the quality of neurosurgical RCTs since 2000 to determine the adequacy of their design and reporting. METHODS: A search of the MEDLINE and EMBASE databases (2000-2014) was conducted. The medical subject heading (MeSH) terms used in the search included: "neurosurgery" OR "neurosurgical procedure," "brain neoplasms," "infarction" and "decompression," "carotid stenosis," "cerebral hemorrhage," and "spinal fusion." These studies were limited to RCTs, in humans, and in the English language. The Consolidated Standards for Reporting of Trials (CONSORT) and Jadad scales were used to assess the quality of RCT design and reporting. The standardized median times cited (median citations divided by years since publication) were used to assess impact. A pragmatic-explanatory continuum indicator summary-based scale was used to assess the design of the studies as primarily pragmatic or explanatory. RESULTS: Sixty-one articles were identified, and the following subspecialties were the most common: vascular (23, 37%), followed by functional neurosurgery and neurooncology (both 13, 21%). The following nations were the primary leaders in RCTs: US (25 studies, 41%), Germany (8 studies, 13%), and the United Kingdom (7 studies, 11%). Median sample size was 100 (interquartile range [IQR] 41.5-279). The majority of the studies (40, 66%) had pragmatic objectives. The median number of times cited overall was 69 (IQR 20.5-193). The combined median CONSORT score was 36 (IQR 27.5-39). Blinding was most deficiently reported. Other areas with a relatively low quality of reporting were sample size calculation (34.2% of surgical, 38.5% of drug, and 20% of device studies), allocation concealment (28.9% of surgical, 23.1% of drug, and 50% of device studies), and protocol implementation (18.4% of surgical, 23% of drug, and 20% of device studies). The quality of reporting did not correlate with the study impact. All studies had a median Jadad score ≤ 3. Thirty-three pragmatic studies (83%) and 5 explanatory studies (25%) met the design objectives. All pragmatic studies based on drug and device trials met their objectives, while 74% of pragmatic surgical trials met their objectives. CONCLUSIONS: The prevalence of neurosurgical RCTs is low. The quality of RCT design and reporting in neurosurgery is also low. Many study designs are not compatible with stated objectives. Pragmatic studies were more likely to meet design objectives. Given the role of RCTs as one of the highest levels of evidence, it is critical to improve on their methodology and reporting.
OBJECTIVE: Randomized-controlled trials (RCTs) are advocated to provide high-level medical evidence. However, in neurosurgery, there are barriers to conducting RCTs. The authors of this study sought to analyze the quality of neurosurgical RCTs since 2000 to determine the adequacy of their design and reporting. METHODS: A search of the MEDLINE and EMBASE databases (2000-2014) was conducted. The medical subject heading (MeSH) terms used in the search included: "neurosurgery" OR "neurosurgical procedure," "brain neoplasms," "infarction" and "decompression," "carotid stenosis," "cerebral hemorrhage," and "spinal fusion." These studies were limited to RCTs, in humans, and in the English language. The Consolidated Standards for Reporting of Trials (CONSORT) and Jadad scales were used to assess the quality of RCT design and reporting. The standardized median times cited (median citations divided by years since publication) were used to assess impact. A pragmatic-explanatory continuum indicator summary-based scale was used to assess the design of the studies as primarily pragmatic or explanatory. RESULTS: Sixty-one articles were identified, and the following subspecialties were the most common: vascular (23, 37%), followed by functional neurosurgery and neurooncology (both 13, 21%). The following nations were the primary leaders in RCTs: US (25 studies, 41%), Germany (8 studies, 13%), and the United Kingdom (7 studies, 11%). Median sample size was 100 (interquartile range [IQR] 41.5-279). The majority of the studies (40, 66%) had pragmatic objectives. The median number of times cited overall was 69 (IQR 20.5-193). The combined median CONSORT score was 36 (IQR 27.5-39). Blinding was most deficiently reported. Other areas with a relatively low quality of reporting were sample size calculation (34.2% of surgical, 38.5% of drug, and 20% of device studies), allocation concealment (28.9% of surgical, 23.1% of drug, and 50% of device studies), and protocol implementation (18.4% of surgical, 23% of drug, and 20% of device studies). The quality of reporting did not correlate with the study impact. All studies had a median Jadad score ≤ 3. Thirty-three pragmatic studies (83%) and 5 explanatory studies (25%) met the design objectives. All pragmatic studies based on drug and device trials met their objectives, while 74% of pragmatic surgical trials met their objectives. CONCLUSIONS: The prevalence of neurosurgical RCTs is low. The quality of RCT design and reporting in neurosurgery is also low. Many study designs are not compatible with stated objectives. Pragmatic studies were more likely to meet design objectives. Given the role of RCTs as one of the highest levels of evidence, it is critical to improve on their methodology and reporting.
Entities:
Keywords:
CONSORT; CONSORT = Consolidated Standards for Reporting of Trials; IQR = interquartile range; ISPOR = International Society for Pharmacoeconomics and Outcomes Research; JAMA = Journal of the American Medical Association; JNS = Journal of Neurosurgery; MeSH = medical subject headings; NASCET = North American Symptomatic Carotid Endarterectomy Trial; NEJM = New England Journal of Medicine; PCT = pragmatic RCT; PRECIS = pragmatic-explanatory continuum indicator summary; PROS = pragmatic registry-based observational studies; RCT = randomized controlled trial; STICH = Surgical Trial in Intracerebral Hemorrhage; publication; randomized controlled trial; trial design
Authors: Patricia Walicke; Aviva Abosch; Anthony Asher; Fred G Barker; Zoher Ghogawala; Robert Harbaugh; Lara Jehi; John Kestle; Walter Koroshetz; Roderick Little; Donald Rubin; Alex Valadka; Stephen Wisniewski; E Antonio Chiocca Journal: Neurosurgery Date: 2017-04-01 Impact factor: 4.654
Authors: Sebastian Arts; Jasper Hans van Lieshout; Martine van Bilsen; Cihat Karadag; Thomas Beez; Leonie van den Abbeele; Rene Aquarius; Saman Vinke; Ronald H M A Bartels; Erik J van Lindert; Daniel Hänggi; Hieronymus D Boogaarts Journal: Acta Neurochir (Wien) Date: 2022-09-23 Impact factor: 2.816
Authors: Lara Jehi; Marcia Morita-Sherman; Thomas E Love; Fabrice Bartolomei; William Bingaman; Kees Braun; Robyn M Busch; John Duncan; Walter J Hader; Guoming Luan; John D Rolston; Stephan Schuele; Laura Tassi; Sumeet Vadera; Shehryar Sheikh; Imad Najm; Amir Arain; Justin Bingaman; Beate Diehl; Jane de Tisi; Matea Rados; Pieter Van Eijsden; Sandra Wahby; Xiongfei Wang; Samuel Wiebe Journal: Ann Neurol Date: 2021-10-14 Impact factor: 11.274
Authors: Saksham Gupta; Ivo S Muskens; Luis Bradley Fandino; Alexander F C Hulsbergen; Marike L D Broekman Journal: World J Surg Date: 2018-09 Impact factor: 3.352
Authors: Felice Esposito; Filippo Flavio Angileri; Peter Kruse; Luigi Maria Cavallo; Domenico Solari; Vincenzo Esposito; Francesco Tomasello; Paolo Cappabianca Journal: PLoS One Date: 2016-04-27 Impact factor: 3.240