S T Bogardus1, J Concato, A R Feinstein. 1. Department of Medicine, Yale University School of Medicine, New Haven, Conn 06504, USA. bogardus@gwpo.ynhh.com
Abstract
CONTEXT: A genetic basis has been identified for many medical conditions and some molecular tests have been commercialized. However, little attention has been given to the quality of clinical epidemiology in molecular studies. OBJECTIVE: To examine the clinical epidemiological quality of recent publications on molecular genetic analysis. DESIGN: Cross-sectional study of original research articles published in 1995, identified by manually searching 4 general clinical journals. Of 83 articles identified, 40 were selected for analysis; these 40 discussed molecular genetic techniques, studied 10 or more patients, and had inferential conclusions. MAIN OUTCOME MEASURE: Compliance of the selected articles with 7 methodological standards for clinical epidemiological science (reproducibility, objectivity, delineation of case group, adequacy of spectrum in case group, delineation of comparison group, adequacy of comparison group, and quantitative summary of results). RESULTS: Among the 40 inferential articles that studied 10 or more patients, only 5 (12.5%) complied with all 7 applicable standards, and 10 (25.0%) complied with all but 1 standard, whereas 25 articles (62.5%) failed to comply with 2 or more standards and 9 (22.5%) failed 4 or 5 standards. Most articles did not comply with standards for reproducibility (n = 25, 62.5%) or objectivity (n = 27, 67.5%); however, the majority of articles did comply with standards for adequacy of case group (n = 35, 87.5 %), adequacy of comparison group (n = 35, 87.5%), and quantitative summary of results (n = 36, 90%). CONCLUSIONS: Despite major laboratory advances in molecular genetic analysis, our data suggest that reported applications in clinical journals often have troubling omissions, deficiencies, and lack of attention to the different, but necessary, principles of clinical epidemiological science. Without suitable attention to fundamental methodological standards, the expected benefits of molecular genetic testing may not be achieved.
CONTEXT: A genetic basis has been identified for many medical conditions and some molecular tests have been commercialized. However, little attention has been given to the quality of clinical epidemiology in molecular studies. OBJECTIVE: To examine the clinical epidemiological quality of recent publications on molecular genetic analysis. DESIGN: Cross-sectional study of original research articles published in 1995, identified by manually searching 4 general clinical journals. Of 83 articles identified, 40 were selected for analysis; these 40 discussed molecular genetic techniques, studied 10 or more patients, and had inferential conclusions. MAIN OUTCOME MEASURE: Compliance of the selected articles with 7 methodological standards for clinical epidemiological science (reproducibility, objectivity, delineation of case group, adequacy of spectrum in case group, delineation of comparison group, adequacy of comparison group, and quantitative summary of results). RESULTS: Among the 40 inferential articles that studied 10 or more patients, only 5 (12.5%) complied with all 7 applicable standards, and 10 (25.0%) complied with all but 1 standard, whereas 25 articles (62.5%) failed to comply with 2 or more standards and 9 (22.5%) failed 4 or 5 standards. Most articles did not comply with standards for reproducibility (n = 25, 62.5%) or objectivity (n = 27, 67.5%); however, the majority of articles did comply with standards for adequacy of case group (n = 35, 87.5 %), adequacy of comparison group (n = 35, 87.5%), and quantitative summary of results (n = 36, 90%). CONCLUSIONS: Despite major laboratory advances in molecular genetic analysis, our data suggest that reported applications in clinical journals often have troubling omissions, deficiencies, and lack of attention to the different, but necessary, principles of clinical epidemiological science. Without suitable attention to fundamental methodological standards, the expected benefits of molecular genetic testing may not be achieved.
Authors: Erik von Elm; Douglas G Altman; Matthias Egger; Stuart J Pocock; Peter C Gøtzsche; Jan P Vandenbroucke Journal: Bull World Health Organ Date: 2007-11 Impact factor: 9.408
Authors: Julian Little; Julian P T Higgins; John P A Ioannidis; David Moher; France Gagnon; Erik von Elm; Muin J Khoury; Barbara Cohen; George Davey-Smith; Jeremy Grimshaw; Paul Scheet; Marta Gwinn; Robin E Williamson; Guang Yong Zou; Kim Hutchings; Candice Y Johnson; Valerie Tait; Miriam Wiens; Jean Golding; Cornelia van Duijn; John McLaughlin; Andrew Paterson; George Wells; Isabel Fortier; Matthew Freedman; Maja Zecevic; Richard King; Claire Infante-Rivard; Alex Stewart; Nick Birkett Journal: Hum Genet Date: 2009-02-01 Impact factor: 4.132
Authors: Julian Little; Julian P T Higgins; John P A Ioannidis; David Moher; France Gagnon; Erik von Elm; Muin J Khoury; Barbara Cohen; George Davey-Smith; Jeremy Grimshaw; Paul Scheet; Marta Gwinn; Robin E Williamson; Guang Yong Zou; Kim Hutchings; Candice Y Johnson; Valerie Tait; Miriam Wiens; Jean Golding; Cornelia van Duijn; John McLaughlin; Andrew Paterson; George Wells; Isabel Fortier; Matthew Freedman; Maja Zecevic; Richard King; Claire Infante-Rivard; Alex Stewart; Nick Birkett Journal: PLoS Med Date: 2009-02-03 Impact factor: 11.069