A Mackinnon1. 1. Centre for Youth Mental Health, University of Melbourne, Parkville, Victoria, Australia. Andrew.Mackinnon@unimelb.edu.au
Abstract
BACKGROUND: Multiple imputation (MI) is an advanced, principled method of dealing with missing data in statistical analyses, a common problem in medical research. This paper sought to document the use of MI in general medical journals and to evaluate the information provided to readers about the application of the procedure in studies. METHODS: Research articles using MI in analyses published in JAMA, New England Journal of Medicine, BMJ and the Lancet were identified using full text searches from the earliest date each journal offered such searches until the end of 2008. Ninety-nine articles were found. Studies were classified according to their design. RESULTS: Multiple imputation was used in 49 RCTs and 50 other types of studies. A third of the articles (n = 33) reported no details of the procedure used. In a third of these (n = 11), it was not possible to infer the approach used from references cited or software used. The nature of the imputation model was rarely reported. MI was frequently used as a secondary analysis (n = 40) either to justify reporting a simpler approach or as a form of sensitivity analysis. CONCLUSIONS: Whilst still relatively uncommon, the use of MI has risen substantially, particularly in trials. MI is rarely adequately reported, leading to doubt about its appropriateness in some cases. This gives rise to uncertainty about conclusions reached and poses a barrier to attempts to replicate analyses. Guidelines for the reporting of MI should be developed.
BACKGROUND: Multiple imputation (MI) is an advanced, principled method of dealing with missing data in statistical analyses, a common problem in medical research. This paper sought to document the use of MI in general medical journals and to evaluate the information provided to readers about the application of the procedure in studies. METHODS: Research articles using MI in analyses published in JAMA, New England Journal of Medicine, BMJ and the Lancet were identified using full text searches from the earliest date each journal offered such searches until the end of 2008. Ninety-nine articles were found. Studies were classified according to their design. RESULTS: Multiple imputation was used in 49 RCTs and 50 other types of studies. A third of the articles (n = 33) reported no details of the procedure used. In a third of these (n = 11), it was not possible to infer the approach used from references cited or software used. The nature of the imputation model was rarely reported. MI was frequently used as a secondary analysis (n = 40) either to justify reporting a simpler approach or as a form of sensitivity analysis. CONCLUSIONS: Whilst still relatively uncommon, the use of MI has risen substantially, particularly in trials. MI is rarely adequately reported, leading to doubt about its appropriateness in some cases. This gives rise to uncertainty about conclusions reached and poses a barrier to attempts to replicate analyses. Guidelines for the reporting of MI should be developed.
Authors: Stein J Janssen; Andrea S van der Heijden; Maarten van Dijke; John E Ready; Kevin A Raskin; Marco L Ferrone; Francis J Hornicek; Joseph H Schwab Journal: Clin Orthop Relat Res Date: 2015-07-09 Impact factor: 4.176
Authors: Caroline A Thompson; Derek B Boothroyd; Katherine G Hastings; Mark R Cullen; Latha P Palaniappan; David H Rehkopf Journal: Am J Epidemiol Date: 2018-02-01 Impact factor: 4.897
Authors: Camilla Jerlang Christiani; Jens R M Jepsen; Anne Thorup; Nicoline Hemager; Ditte Ellersgaard; Katrine S Spang; Birgitte K Burton; Maja Gregersen; Anne Søndergaard; Aja N Greve; Ditte L Gantriis; Gry Poulsen; Md Jamal Uddin; Larry J Seidman; Ole Mors; Kerstin J Plessen; Merete Nordentoft Journal: Schizophr Bull Date: 2019-10-24 Impact factor: 9.306
Authors: Minjae Lee; Mohammad H Rahbar; Lianne S Gensler; Matthew Brown; Michael Weisman; John D Reveille Journal: J Biopharm Stat Date: 2019-11-15 Impact factor: 1.051
Authors: Kathleen M Carroll; Brian D Kiluk; Charla Nich; Elise E DeVito; Suzanne Decker; Donna LaPaglia; Dianne Duffey; Theresa A Babuscio; Samuel A Ball Journal: Drug Alcohol Depend Date: 2014-01-31 Impact factor: 4.492
Authors: Anandi N Sheth; Ighovwerha Ofotokun; Kate Buchacz; Carl Armon; Joan S Chmiel; Rachel L D Hart; Rose Baker; John T Brooks; Frank J Palella Journal: J Acquir Immune Defic Syndr Date: 2016-01-01 Impact factor: 3.731
Authors: Christianne L Roumie; Adriana M Hung; Robert A Greevy; Carlos G Grijalva; Xulei Liu; Harvey J Murff; Tom A Elasy; Marie R Griffin Journal: Ann Intern Med Date: 2012-11-06 Impact factor: 25.391
Authors: Leslie J Bisson; Melissa A Kluczynski; William M Wind; Marc S Fineberg; Geoffrey A Bernas; Michael A Rauh; John M Marzo; Zehua Zhou; Jiwei Zhao Journal: J Bone Joint Surg Am Date: 2017-07-05 Impact factor: 5.284