Benjamin S Wessler1, Lana Lai Yh1, Whitney Kramer1, Michael Cangelosi1, Gowri Raman1, Jennifer S Lutz1, David M Kent2. 1. From the Division of Cardiology, Tufts Medical Center, Boston, MA (B.S.W.); Predictive Analytics and Comparative Effectiveness (PACE) Center, Institute for Clinical Research and Health Policy Studies (ICRHPS), Tufts Medical Center/Tufts University School of Medicine, Boston, MA (B.S.W., L.L.Y., J.S.L., D.M.K.); Business Intelligence and Analytics, Iora Health, Cambridge, MA (W.K.); Health Economics and Reimbursement, Boston Scientific, Marlborough, MA (M.C.); and Center for Clinical Evidence Synthesis, ICRHPS, Medical Center/Tufts University School of Medicine, Boston, MA (G.R.). 2. From the Division of Cardiology, Tufts Medical Center, Boston, MA (B.S.W.); Predictive Analytics and Comparative Effectiveness (PACE) Center, Institute for Clinical Research and Health Policy Studies (ICRHPS), Tufts Medical Center/Tufts University School of Medicine, Boston, MA (B.S.W., L.L.Y., J.S.L., D.M.K.); Business Intelligence and Analytics, Iora Health, Cambridge, MA (W.K.); Health Economics and Reimbursement, Boston Scientific, Marlborough, MA (M.C.); and Center for Clinical Evidence Synthesis, ICRHPS, Medical Center/Tufts University School of Medicine, Boston, MA (G.R.). dkent1@tuftsmedicalcenter.org.
Abstract
BACKGROUND: Clinical prediction models (CPMs) estimate the probability of clinical outcomes and hold the potential to improve decision making and individualize care. For patients with cardiovascular disease, there are numerous CPMs available although the extent of this literature is not well described. METHODS AND RESULTS: We conducted a systematic review for articles containing CPMs for cardiovascular disease published between January 1990 and May 2012. Cardiovascular disease includes coronary heart disease, heart failure, arrhythmias, stroke, venous thromboembolism, and peripheral vascular disease. We created a novel database and characterized CPMs based on the stage of development, population under study, performance, covariates, and predicted outcomes. There are 796 models included in this database. The number of CPMs published each year is increasing steadily over time. Seven hundred seventeen (90%) are de novo CPMs, 21 (3%) are CPM recalibrations, and 58 (7%) are CPM adaptations. This database contains CPMs for 31 index conditions, including 215 CPMs for patients with coronary artery disease, 168 CPMs for population samples, and 79 models for patients with heart failure. There are 77 distinct index/outcome pairings. Of the de novo models in this database, 450 (63%) report a c-statistic and 259 (36%) report some information on calibration. CONCLUSIONS: There is an abundance of CPMs available for a wide assortment of cardiovascular disease conditions, with substantial redundancy in the literature. The comparative performance of these models, the consistency of effects and risk estimates across models and the actual and potential clinical impact of this body of literature is poorly understood.
BACKGROUND: Clinical prediction models (CPMs) estimate the probability of clinical outcomes and hold the potential to improve decision making and individualize care. For patients with cardiovascular disease, there are numerous CPMs available although the extent of this literature is not well described. METHODS AND RESULTS: We conducted a systematic review for articles containing CPMs for cardiovascular disease published between January 1990 and May 2012. Cardiovascular disease includes coronary heart disease, heart failure, arrhythmias, stroke, venous thromboembolism, and peripheral vascular disease. We created a novel database and characterized CPMs based on the stage of development, population under study, performance, covariates, and predicted outcomes. There are 796 models included in this database. The number of CPMs published each year is increasing steadily over time. Seven hundred seventeen (90%) are de novo CPMs, 21 (3%) are CPM recalibrations, and 58 (7%) are CPM adaptations. This database contains CPMs for 31 index conditions, including 215 CPMs for patients with coronary artery disease, 168 CPMs for population samples, and 79 models for patients with heart failure. There are 77 distinct index/outcome pairings. Of the de novo models in this database, 450 (63%) report a c-statistic and 259 (36%) report some information on calibration. CONCLUSIONS: There is an abundance of CPMs available for a wide assortment of cardiovascular disease conditions, with substantial redundancy in the literature. The comparative performance of these models, the consistency of effects and risk estimates across models and the actual and potential clinical impact of this body of literature is poorly understood.
Authors: Alan S Go; Dariush Mozaffarian; Véronique L Roger; Emelia J Benjamin; Jarett D Berry; Michael J Blaha; Shifan Dai; Earl S Ford; Caroline S Fox; Sheila Franco; Heather J Fullerton; Cathleen Gillespie; Susan M Hailpern; John A Heit; Virginia J Howard; Mark D Huffman; Suzanne E Judd; Brett M Kissela; Steven J Kittner; Daniel T Lackland; Judith H Lichtman; Lynda D Lisabeth; Rachel H Mackey; David J Magid; Gregory M Marcus; Ariane Marelli; David B Matchar; Darren K McGuire; Emile R Mohler; Claudia S Moy; Michael E Mussolino; Robert W Neumar; Graham Nichol; Dilip K Pandey; Nina P Paynter; Matthew J Reeves; Paul D Sorlie; Joel Stein; Amytis Towfighi; Tanya N Turan; Salim S Virani; Nathan D Wong; Daniel Woo; Melanie B Turner Journal: Circulation Date: 2013-12-18 Impact factor: 29.690
Authors: Clyde W Yancy; Mariell Jessup; Biykem Bozkurt; Javed Butler; Donald E Casey; Mark H Drazner; Gregg C Fonarow; Stephen A Geraci; Tamara Horwich; James L Januzzi; Maryl R Johnson; Edward K Kasper; Wayne C Levy; Frederick A Masoudi; Patrick E McBride; John J V McMurray; Judith E Mitchell; Pamela N Peterson; Barbara Riegel; Flora Sam; Lynne W Stevenson; W H Wilson Tang; Emily J Tsai; Bruce L Wilkoff Journal: Circulation Date: 2013-06-05 Impact factor: 29.690
Authors: David C Goff; Donald M Lloyd-Jones; Glen Bennett; Sean Coady; Ralph B D'Agostino; Raymond Gibbons; Philip Greenland; Daniel T Lackland; Daniel Levy; Christopher J O'Donnell; Jennifer G Robinson; J Sanford Schwartz; Susan T Shero; Sidney C Smith; Paul Sorlie; Neil J Stone; Peter W F Wilson; Harmon S Jordan; Lev Nevo; Janusz Wnek; Jeffrey L Anderson; Jonathan L Halperin; Nancy M Albert; Biykem Bozkurt; Ralph G Brindis; Lesley H Curtis; David DeMets; Judith S Hochman; Richard J Kovacs; E Magnus Ohman; Susan J Pressler; Frank W Sellke; Win-Kuang Shen; Sidney C Smith; Gordon F Tomaselli Journal: Circulation Date: 2013-11-12 Impact factor: 29.690
Authors: Craig T January; L Samuel Wann; Joseph S Alpert; Hugh Calkins; Joaquin E Cigarroa; Joseph C Cleveland; Jamie B Conti; Patrick T Ellinor; Michael D Ezekowitz; Michael E Field; Katherine T Murray; Ralph L Sacco; William G Stevenson; Patrick J Tchou; Cynthia M Tracy; Clyde W Yancy Journal: J Am Coll Cardiol Date: 2014-03-28 Impact factor: 24.094
Authors: David C Goff; Donald M Lloyd-Jones; Glen Bennett; Sean Coady; Ralph B D'Agostino; Raymond Gibbons; Philip Greenland; Daniel T Lackland; Daniel Levy; Christopher J O'Donnell; Jennifer G Robinson; J Sanford Schwartz; Susan T Shero; Sidney C Smith; Paul Sorlie; Neil J Stone; Peter W F Wilson Journal: J Am Coll Cardiol Date: 2013-11-12 Impact factor: 24.094
Authors: Anil K Chaturvedi; Hormuzd A Katki; Stephanie A Kovalchik; Martin Tammemagi; Christine D Berg; Neil E Caporaso; Tom L Riley; Mary Korch; Gerard A Silvestri Journal: N Engl J Med Date: 2013-07-18 Impact factor: 91.245
Authors: S Yusuf; D Zucker; P Peduzzi; L D Fisher; T Takaro; J W Kennedy; K Davis; T Killip; E Passamani; R Norris Journal: Lancet Date: 1994-08-27 Impact factor: 79.321
Authors: Daniel T Lackland; Edward J Roccella; Anne F Deutsch; Myriam Fornage; Mary G George; George Howard; Brett M Kissela; Steven J Kittner; Judith H Lichtman; Lynda D Lisabeth; Lee H Schwamm; Eric E Smith; Amytis Towfighi Journal: Stroke Date: 2013-12-05 Impact factor: 7.914
Authors: Jessica K Paulus; Benjamin S Wessler; Christine Lundquist; Lana L Y Lai; Gowri Raman; Jennifer S Lutz; David M Kent Journal: Circ Cardiovasc Qual Outcomes Date: 2016-02
Authors: Ankur Pandya; Stephen Sy; Sylvia Cho; Sartaj Alam; Milton C Weinstein; Thomas A Gaziano Journal: Med Decis Making Date: 2017-05-10 Impact factor: 2.583
Authors: David M Kent; Jason Nelson; Issa J Dahabreh; Peter M Rothwell; Douglas G Altman; Rodney A Hayward Journal: Int J Epidemiol Date: 2016-12-01 Impact factor: 7.196
Authors: David M Kent; David van Klaveren; Jessica K Paulus; Ralph D'Agostino; Steve Goodman; Rodney Hayward; John P A Ioannidis; Bray Patrick-Lake; Sally Morton; Michael Pencina; Gowri Raman; Joseph S Ross; Harry P Selker; Ravi Varadhan; Andrew Vickers; John B Wong; Ewout W Steyerberg Journal: Ann Intern Med Date: 2019-11-12 Impact factor: 25.391
Authors: Jessica K Paulus; Lana Y H Lai; Christine Lundquist; Ali Daneshmand; Hannah Buettner; Jennifer S Lutz; Gowri Raman; Benjamin S Wessler; David M Kent Journal: J Am Heart Assoc Date: 2016-05-05 Impact factor: 5.501
Authors: Johanna A A G Damen; Lotty Hooft; Ewoud Schuit; Thomas P A Debray; Gary S Collins; Ioanna Tzoulaki; Camille M Lassale; George C M Siontis; Virginia Chiocchia; Corran Roberts; Michael Maia Schlüssel; Stephen Gerry; James A Black; Pauline Heus; Yvonne T van der Schouw; Linda M Peelen; Karel G M Moons Journal: BMJ Date: 2016-05-16