James S Rosneck1, Joel Hughes, John Gunstad, Richard Josephson, Donald A Noe, Donna Waechter. 1. James S. Rosneck, MS, RN Manager, Cardiovascular and Pulmonary Rehabilitation, and Administrative Director, Center for Cardiovascular Research, Summa Health System, Akron; Associate Professor, Department of Sports Science and Wellness Education, The University of Akron, Ohio. Joel Hughes, PhD Director, Applied Psychology Center, and Associate Professor, Psychology Department, Kent State University; Scientific Director, Center for Cardiovascular Research, Summa Health System, Akron; Adjunct Assistant Professor, Francis Payne Bolton School of Nursing, and Adjunct Assistant Professor, Department of Medicine, Case Western Reserve University, Cleveland, Ohio. John Gunstad, PhD Associate Professor, Psychology Department, Kent State University; Research Associate, Center for Cardiovascular Research, Summa Health System, Akron; Adjunct Assistant Professor, Department of Medicine, Case Western Reserve University, Cleveland, Ohio. Richard Josephson, MS, MD Professor of Medicine, Case Western Reserve University School of Medicine, Cleveland; Director, Cardiac Intensive Care Unit/Director, Cardiovascular and Pulmonary Rehabilitation, Harrington Heart & Vascular Institute, University Hospitals Health System, Cleveland, Ohio. Donald A. Noe, BSE Research Associate, Department of Research Administration, Summa Health System, Akron, Ohio. Donna Waechter, PhD Coordinator, Center for Cardiovascular Research, Summa Health System, Akron; Adjunct Professor, Psychology Department, Kent State University, Ohio.
Abstract
PURPOSE: This article describes the systematic construction and psychometric analysis of a knowledge assessment instrument for phase II cardiac rehabilitation (CR) patients measuring risk modification disease management knowledge and behavioral outcomes derived from national standards relevant to secondary prevention and management of cardiovascular disease. METHODS: First, using adult curriculum based on disease-specific learning outcomes and competencies, a systematic test item development process was completed by clinical staff. Second, a panel of educational and clinical experts used an iterative process to identify test content domain and arrive at consensus in selecting items meeting criteria. Third, the resulting 31-question instrument, the Cardiac Knowledge Assessment Tool (CKAT), was piloted in CR patients to ensure use of application. Validity and reliability analyses were performed on 3638 adults before test administrations with additional focused analyses on 1999 individuals completing both pretreatment and posttreatment administrations within 6 months. RESULTS: Evidence of CKAT content validity was substantiated, with 85% agreement among content experts. Evidence of construct validity was demonstrated via factor analysis identifying key underlying factors. Estimates of internal consistency, for example, Cronbach's α = .852 and Spearman-Brown split-half reliability = 0.817 on pretesting, support test reliability. Item analysis, using point biserial correlation, measured relationships between performance on single items and total score (P < .01). Analyses using item difficulty and item discrimination indices further verified item stability and validity of the CKAT. CONCLUSIONS: A knowledge instrument specifically designed for an adult CR population was systematically developed and tested in a large representative patient population, satisfying psychometric parameters, including validity and reliability.
PURPOSE: This article describes the systematic construction and psychometric analysis of a knowledge assessment instrument for phase II cardiac rehabilitation (CR) patients measuring risk modification disease management knowledge and behavioral outcomes derived from national standards relevant to secondary prevention and management of cardiovascular disease. METHODS: First, using adult curriculum based on disease-specific learning outcomes and competencies, a systematic test item development process was completed by clinical staff. Second, a panel of educational and clinical experts used an iterative process to identify test content domain and arrive at consensus in selecting items meeting criteria. Third, the resulting 31-question instrument, the Cardiac Knowledge Assessment Tool (CKAT), was piloted in CR patients to ensure use of application. Validity and reliability analyses were performed on 3638 adults before test administrations with additional focused analyses on 1999 individuals completing both pretreatment and posttreatment administrations within 6 months. RESULTS: Evidence of CKAT content validity was substantiated, with 85% agreement among content experts. Evidence of construct validity was demonstrated via factor analysis identifying key underlying factors. Estimates of internal consistency, for example, Cronbach's α = .852 and Spearman-Brown split-half reliability = 0.817 on pretesting, support test reliability. Item analysis, using point biserial correlation, measured relationships between performance on single items and total score (P < .01). Analyses using item difficulty and item discrimination indices further verified item stability and validity of the CKAT. CONCLUSIONS: A knowledge instrument specifically designed for an adult CR population was systematically developed and tested in a large representative patient population, satisfying psychometric parameters, including validity and reliability.
Authors: Sidney C Smith; Jerilyn Allen; Steven N Blair; Robert O Bonow; Lawrence M Brass; Gregg C Fonarow; Scott M Grundy; Loren Hiratzka; Daniel Jones; Harlan M Krumholz; Lori Mosca; Richard C Pasternak; Thomas Pearson; Marc A Pfeffer; Kathryn A Taubert Journal: Circulation Date: 2006-05-16 Impact factor: 29.690
Authors: Randal J Thomas; Marjorie King; Karen Lui; Neil Oldridge; Ileana L Piña; John Spertus; Robert O Bonow; N A Mark Estes; David C Goff; Kathleen L Grady; Ann R Hiniker; Frederick A Masoudi; Martha J Radford; John S Rumsfeld; Gayle R Whitman Journal: J Am Coll Cardiol Date: 2007-10-02 Impact factor: 24.094
Authors: Katherine A Rawson; John Gunstad; Joel Hughes; Mary Beth Spitznagel; Vanessa Potter; Donna Waechter; James Rosneck Journal: J Gen Intern Med Date: 2009-11-03 Impact factor: 5.128