Mark D Neuman1, Jennifer N Goldstein2, Michael A Cirullo3, J Sanford Schwartz4. 1. Department of Anesthesiology and Critical Care, Perelman School of Medicine, University of Pennsylvania, Philadelphia2Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia. 2. Division of General Internal Medicine, Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia. 3. Department of Anesthesiology and Critical Care, Perelman School of Medicine, University of Pennsylvania, Philadelphia. 4. Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia3Division of General Internal Medicine, Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia4Department of Health Care Management.
Abstract
IMPORTANCE: Little is known regarding the durability of clinical practice guideline recommendations over time. OBJECTIVE: To characterize variations in the durability of class I ("procedure/treatment should be performed/administered") American College of Cardiology/American Heart Association (ACC/AHA) guideline recommendations. DESIGN, SETTING, AND PARTICIPANTS: Textual analysis by 4 independent reviewers of 11 guidelines published between 1998 and 2007 and revised between 2006 and 2013. MAIN OUTCOMES AND MEASURES: We abstracted all class I recommendations from the first of the 2 most recent versions of each guideline and identified corresponding recommendations in the subsequent version. We classified recommendations replaced by less determinate or contrary recommendations as having been downgraded or reversed; we classified recommendations for which no corresponding item could be identified as having been omitted. We tested for differences in the durability of recommendations according to guideline topic and underlying level of evidence using bivariable hypothesis tests and conditional logistic regression. RESULTS: Of 619 index recommendations, 495 (80.0%; 95% CI, 76.6%-83.1%) were retained in the subsequent guideline version, 57 (9.2%; 95% CI, 7.0%-11.8%) were downgraded or reversed, and 67 (10.8%; 95% CI, 8.4%-13.3%) were omitted. The percentage of recommendations retained varied across guidelines from 15.4% (95% CI, 1.9%-45.4%) to 94.1% (95% CI, 80.3%-99.3%; P < .001). Among recommendations with available information on level of evidence, 90.5% (95% CI, 83.2%-95.3%) of recommendations supported by multiple randomized studies were retained, vs 81.0% (95% CI, 74.8%-86.3%) of recommendations supported by 1 randomized trial or observational data and 73.7% (95% CI, 65.8%-80.5%) of recommendations supported by opinion (P = .001). After accounting for guideline-level factors, the probability of being downgraded, reversed, or omitted was greater for recommendations based on opinion (odds ratio, 3.14; 95% CI, 1.69-5.85; P < .001) or on 1 trial or observational data (odds ratio, 3.49; 95% CI, 1.45-8.41; P = .005) vs recommendations based on multiple trials. CONCLUSIONS AND RELEVANCE: The durability of class I cardiology guideline recommendations for procedures and treatments promulgated by the ACC/AHA varied across individual guidelines and levels of evidence. Downgrades, reversals, and omissions were most common among recommendations not supported by multiple randomized studies.
IMPORTANCE: Little is known regarding the durability of clinical practice guideline recommendations over time. OBJECTIVE: To characterize variations in the durability of class I ("procedure/treatment should be performed/administered") American College of Cardiology/American Heart Association (ACC/AHA) guideline recommendations. DESIGN, SETTING, AND PARTICIPANTS: Textual analysis by 4 independent reviewers of 11 guidelines published between 1998 and 2007 and revised between 2006 and 2013. MAIN OUTCOMES AND MEASURES: We abstracted all class I recommendations from the first of the 2 most recent versions of each guideline and identified corresponding recommendations in the subsequent version. We classified recommendations replaced by less determinate or contrary recommendations as having been downgraded or reversed; we classified recommendations for which no corresponding item could be identified as having been omitted. We tested for differences in the durability of recommendations according to guideline topic and underlying level of evidence using bivariable hypothesis tests and conditional logistic regression. RESULTS: Of 619 index recommendations, 495 (80.0%; 95% CI, 76.6%-83.1%) were retained in the subsequent guideline version, 57 (9.2%; 95% CI, 7.0%-11.8%) were downgraded or reversed, and 67 (10.8%; 95% CI, 8.4%-13.3%) were omitted. The percentage of recommendations retained varied across guidelines from 15.4% (95% CI, 1.9%-45.4%) to 94.1% (95% CI, 80.3%-99.3%; P < .001). Among recommendations with available information on level of evidence, 90.5% (95% CI, 83.2%-95.3%) of recommendations supported by multiple randomized studies were retained, vs 81.0% (95% CI, 74.8%-86.3%) of recommendations supported by 1 randomized trial or observational data and 73.7% (95% CI, 65.8%-80.5%) of recommendations supported by opinion (P = .001). After accounting for guideline-level factors, the probability of being downgraded, reversed, or omitted was greater for recommendations based on opinion (odds ratio, 3.14; 95% CI, 1.69-5.85; P < .001) or on 1 trial or observational data (odds ratio, 3.49; 95% CI, 1.45-8.41; P = .005) vs recommendations based on multiple trials. CONCLUSIONS AND RELEVANCE: The durability of class I cardiology guideline recommendations for procedures and treatments promulgated by the ACC/AHA varied across individual guidelines and levels of evidence. Downgrades, reversals, and omissions were most common among recommendations not supported by multiple randomized studies.
Authors: John A Spertus; Kim A Eagle; Harlan M Krumholz; Kristi R Mitchell; Sharon-Lise T Normand Journal: Circulation Date: 2005-04-05 Impact factor: 29.690
Authors: Sidney C Smith; Jerilyn Allen; Steven N Blair; Robert O Bonow; Lawrence M Brass; Gregg C Fonarow; Scott M Grundy; Loren Hiratzka; Daniel Jones; Harlan M Krumholz; Lori Mosca; Richard C Pasternak; Thomas Pearson; Marc A Pfeffer; Kathryn A Taubert Journal: Circulation Date: 2006-05-16 Impact factor: 29.690
Authors: Sidney C Smith; Ted E Feldman; John W Hirshfeld; Alice K Jacobs; Morton J Kern; Spencer B King; Douglass A Morrison; William W O'Neil; Hartzell V Schaff; Patrick L Whitlow; David O Williams; Elliott M Antman; Cynthia D Adams; Jeffrey L Anderson; David P Faxon; Valentin Fuster; Jonathan L Halperin; Loren F Hiratzka; Sharon Ann Hunt; Rick Nishimura; Joseph P Ornato; Richard L Page; Barbara Riegel Journal: Circulation Date: 2006-02-21 Impact factor: 29.690
Authors: T J Ryan; J L Anderson; E M Antman; B A Braniff; N H Brooks; R M Califf; L D Hillis; L F Hiratzka; E Rapaport; B J Riegel; R O Russell; E E Smith; W D Weaver Journal: J Am Coll Cardiol Date: 1996-11-01 Impact factor: 24.094
Authors: R L Frye; J J Collins; R W DeSanctis; H T Dodge; L S Dreifus; C Fisch; L S Geths; P C Gillette; V Parsonnet; J Reeves Journal: Circulation Date: 1984-08 Impact factor: 29.690
Authors: Sharon Ann Hunt; William T Abraham; Marshall H Chin; Arthur M Feldman; Gary S Francis; Theodore G Ganiats; Mariell Jessup; Marvin A Konstam; Donna M Mancini; Keith Michl; John A Oates; Peter S Rahko; Marc A Silver; Lynne Warner Stevenson; Clyde W Yancy; Elliott M Antman; Sidney C Smith; Cynthia D Adams; Jeffrey L Anderson; David P Faxon; Valentin Fuster; Jonathan L Halperin; Loren F Hiratzka; Alice K Jacobs; Rick Nishimura; Joseph P Ornato; Richard L Page; Barbara Riegel Journal: Circulation Date: 2005-09-13 Impact factor: 29.690
Authors: Elliott M Antman; Daniel T Anbe; Paul Wayne Armstrong; Eric R Bates; Lee A Green; Mary Hand; Judith S Hochman; Harlan M Krumholz; Frederick G Kushner; Gervasio A Lamas; Charles J Mullany; Joseph P Ornato; David L Pearle; Michael A Sloan; Sidney C Smith; Joseph S Alpert; Jeffrey L Anderson; David P Faxon; Valentin Fuster; Raymond J Gibbons; Gabriel Gregoratos; Jonathan L Halperin; Loren F Hiratzka; Sharon Ann Hunt; Alice K Jacobs Journal: Circulation Date: 2004-08-31 Impact factor: 29.690
Authors: Raymond J Gibbons; Jonathan Abrams; Kanu Chatterjee; Jennifer Daley; Prakash C Deedwania; John S Douglas; T Bruce Ferguson; Stephan D Fihn; Theodore D Fraker; Julius M Gardin; Robert A O'Rourke; Richard C Pasternak; Sankey V Williams Journal: J Am Coll Cardiol Date: 2003-01-01 Impact factor: 24.094
Authors: R O Bonow; B Carabello; A C de Leon; L H Edmunds; B J Fedderly; M D Freed; W H Gaasch; C R McKay; R A Nishimura; P T O'Gara; R A O'Rourke; S H Rahimtoola; J L Ritchie; M D Cheitlin; K A Eagle; T J Gardner; A Garson; R J Gibbons; R O Russell; T J Ryan; S C Smith Journal: Circulation Date: 1998-11-03 Impact factor: 29.690
Authors: Laura Martínez García; Andrea Juliana Sanabria; Elvira García Alvarez; Maria Mar Trujillo-Martín; Itziar Etxeandia-Ikobaltzeta; Anna Kotzeva; David Rigau; Arturo Louro-González; Leticia Barajas-Nava; Petra Díaz Del Campo; Maria-Dolors Estrada; Ivan Solà; Javier Gracia; Flavia Salcedo-Fernandez; Jennifer Lawson; R Brian Haynes; Pablo Alonso-Coello Journal: CMAJ Date: 2014-09-08 Impact factor: 8.262
Authors: Katrin Uhlig; Jeffrey S Berns; Serena Carville; Wiley Chan; Michael Cheung; Gordon H Guyatt; Allyson Hart; Sandra Zelman Lewis; Marcello Tonelli; Angela C Webster; Timothy J Wilt; Bertram L Kasiske Journal: Kidney Int Date: 2016-04 Impact factor: 10.612