Valentin Danchev1,2,3, Yan Min4, John Borghi5, Mike Baiocchi4, John P A Ioannidis1,2,4,6. 1. Meta-Research Innovation Center at Stanford, Stanford University School of Medicine, Stanford, California. 2. Stanford Prevention Research Center, Department of Medicine, Stanford University School of Medicine, Stanford, California. 3. Now with Department of Sociology, University of Essex, Colchester, United Kingdom. 4. Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, California. 5. Lane Medical Library, Stanford University School of Medicine, Stanford, California. 6. Department of Biomedical Data Science, Stanford University School of Medicine, Stanford, California.
Abstract
Importance: The benefits of responsible sharing of individual-participant data (IPD) from clinical studies are well recognized, but stakeholders often disagree on how to align those benefits with privacy risks, costs, and incentives for clinical trialists and sponsors. The International Committee of Medical Journal Editors (ICMJE) required a data sharing statement (DSS) from submissions reporting clinical trials effective July 1, 2018. The required DSSs provide a window into current data sharing rates, practices, and norms among trialists and sponsors. Objective: To evaluate the implementation of the ICMJE DSS requirement in 3 leading medical journals: JAMA, Lancet, and New England Journal of Medicine (NEJM). Design, Setting, and Participants: This is a cross-sectional study of clinical trial reports published as articles in JAMA, Lancet, and NEJM between July 1, 2018, and April 4, 2020. Articles not eligible for DSS, including observational studies and letters or correspondence, were excluded. A MEDLINE/PubMed search identified 487 eligible clinical trials in JAMA (112 trials), Lancet (147 trials), and NEJM (228 trials). Two reviewers evaluated each of the 487 articles independently. Exposure: Publication of clinical trial reports in an ICMJE medical journal requiring a DSS. Main Outcomes and Measures: The primary outcomes of the study were declared data availability and actual data availability in repositories. Other captured outcomes were data type, access, and conditions and reasons for data availability or unavailability. Associations with funding sources were examined. Results: A total of 334 of 487 articles (68.6%; 95% CI, 64%-73%) declared data sharing, with nonindustry NIH-funded trials exhibiting the highest rates of declared data sharing (89%; 95% CI, 80%-98%) and industry-funded trials the lowest (61%; 95% CI, 54%-68%). However, only 2 IPD sets (0.6%; 95% CI, 0.0%-1.5%) were actually deidentified and publicly available as of April 10, 2020. The remaining were supposedly accessible via request to authors (143 of 334 articles [42.8%]), repository (89 of 334 articles [26.6%]), and company (78 of 334 articles [23.4%]). Among the 89 articles declaring that IPD would be stored in repositories, only 17 (19.1%) deposited data, mostly because of embargo and regulatory approval. Embargo was set in 47.3% of data-sharing articles (158 of 334), and in half of them the period exceeded 1 year or was unspecified. Conclusions and Relevance: Most trials published in JAMA, Lancet, and NEJM after the implementation of the ICMJE policy declared their intent to make clinical data available. However, a wide gap between declared and actual data sharing exists. To improve transparency and data reuse, journals should promote the use of unique pointers to data set location and standardized choices for embargo periods and access requirements.
Importance: The benefits of responsible sharing of individual-participant data (IPD) from clinical studies are well recognized, but stakeholders often disagree on how to align those benefits with privacy risks, costs, and incentives for clinical trialists and sponsors. The International Committee of Medical Journal Editors (ICMJE) required a data sharing statement (DSS) from submissions reporting clinical trials effective July 1, 2018. The required DSSs provide a window into current data sharing rates, practices, and norms among trialists and sponsors. Objective: To evaluate the implementation of the ICMJE DSS requirement in 3 leading medical journals: JAMA, Lancet, and New England Journal of Medicine (NEJM). Design, Setting, and Participants: This is a cross-sectional study of clinical trial reports published as articles in JAMA, Lancet, and NEJM between July 1, 2018, and April 4, 2020. Articles not eligible for DSS, including observational studies and letters or correspondence, were excluded. A MEDLINE/PubMed search identified 487 eligible clinical trials in JAMA (112 trials), Lancet (147 trials), and NEJM (228 trials). Two reviewers evaluated each of the 487 articles independently. Exposure: Publication of clinical trial reports in an ICMJE medical journal requiring a DSS. Main Outcomes and Measures: The primary outcomes of the study were declared data availability and actual data availability in repositories. Other captured outcomes were data type, access, and conditions and reasons for data availability or unavailability. Associations with funding sources were examined. Results: A total of 334 of 487 articles (68.6%; 95% CI, 64%-73%) declared data sharing, with nonindustry NIH-funded trials exhibiting the highest rates of declared data sharing (89%; 95% CI, 80%-98%) and industry-funded trials the lowest (61%; 95% CI, 54%-68%). However, only 2 IPD sets (0.6%; 95% CI, 0.0%-1.5%) were actually deidentified and publicly available as of April 10, 2020. The remaining were supposedly accessible via request to authors (143 of 334 articles [42.8%]), repository (89 of 334 articles [26.6%]), and company (78 of 334 articles [23.4%]). Among the 89 articles declaring that IPD would be stored in repositories, only 17 (19.1%) deposited data, mostly because of embargo and regulatory approval. Embargo was set in 47.3% of data-sharing articles (158 of 334), and in half of them the period exceeded 1 year or was unspecified. Conclusions and Relevance: Most trials published in JAMA, Lancet, and NEJM after the implementation of the ICMJE policy declared their intent to make clinical data available. However, a wide gap between declared and actual data sharing exists. To improve transparency and data reuse, journals should promote the use of unique pointers to data set location and standardized choices for embargo periods and access requirements.
Authors: Erik von Elm; Douglas G Altman; Matthias Egger; Stuart J Pocock; Peter C Gøtzsche; Jan P Vandenbroucke Journal: Ann Intern Med Date: 2007-10-16 Impact factor: 25.391
Authors: Bruce Alberts; Ralph J Cicerone; Stephen E Fienberg; Alexander Kamb; Marcia McNutt; Robert M Nerem; Randy Schekman; Richard Shiffrin; Victoria Stodden; Subra Suresh; Maria T Zuber; Barbara Kline Pope; Kathleen Hall Jamieson Journal: Science Date: 2015-06-26 Impact factor: 47.728
Authors: B A Nosek; G Alter; G C Banks; D Borsboom; S D Bowman; S J Breckler; S Buck; C D Chambers; G Chin; G Christensen; M Contestabile; A Dafoe; E Eich; J Freese; R Glennerster; D Goroff; D P Green; B Hesse; M Humphreys; J Ishiyama; D Karlan; A Kraut; A Lupia; P Mabry; T A Madon; N Malhotra; E Mayo-Wilson; M McNutt; E Miguel; E Levy Paluck; U Simonsohn; C Soderberg; B A Spellman; J Turitto; G VandenBos; S Vazire; E J Wagenmakers; R Wilson; T Yarkoni Journal: Science Date: 2015-06-26 Impact factor: 47.728
Authors: Natalie E Dean; Pierre-Stéphane Gsell; Ron Brookmeyer; Forrest W Crawford; Christl A Donnelly; Susan S Ellenberg; Thomas R Fleming; M Elizabeth Halloran; Peter Horby; Thomas Jaki; Philip R Krause; Ira M Longini; Sabue Mulangu; Jean-Jacques Muyembe-Tamfum; Martha C Nason; Peter G Smith; Rui Wang; Ana M Henao-Restrepo; Victor De Gruttola Journal: N Engl J Med Date: 2020-04-02 Impact factor: 176.079
Authors: Pauli Virtanen; Ralf Gommers; Travis E Oliphant; Matt Haberland; Tyler Reddy; David Cournapeau; Evgeni Burovski; Pearu Peterson; Warren Weckesser; Jonathan Bright; Stéfan J van der Walt; Matthew Brett; Joshua Wilson; K Jarrod Millman; Nikolay Mayorov; Andrew R J Nelson; Eric Jones; Robert Kern; Eric Larson; C J Carey; İlhan Polat; Yu Feng; Eric W Moore; Jake VanderPlas; Denis Laxalde; Josef Perktold; Robert Cimrman; Ian Henriksen; E A Quintero; Charles R Harris; Anne M Archibald; Antônio H Ribeiro; Fabian Pedregosa; Paul van Mulbregt Journal: Nat Methods Date: 2020-02-03 Impact factor: 28.547
Authors: Enrique Vazquez; Henri Gouraud; Florian Naudet; Cary P Gross; Harlan M Krumholz; Joseph S Ross; Joshua D Wallach Journal: Clin Trials Date: 2021-08-18 Impact factor: 2.486
Authors: Kristina Larson; Ida Sim; Megan von Isenburg; Marcia Levenstein; Frank Rockhold; Stan Neumann; Catherine D'Arcy; Elizabeth Graham; David Zuckerman; Rebecca Li Journal: Contemp Clin Trials Date: 2022-02-16 Impact factor: 2.261
Authors: Florian Naudet; Maximilian Siebert; Claude Pellen; Jeanne Gaba; Cathrine Axfors; Ioana Cristea; Valentin Danchev; Ulrich Mansmann; Christian Ohmann; Joshua D Wallach; David Moher; John P A Ioannidis Journal: PLoS Med Date: 2021-10-25 Impact factor: 11.069