Diane U Jette1, Mary Stilphen2, Vinoth K Ranganathan3, Sandra Passek4, Frederick S Frost5, Alan M Jette6. 1. D.U. Jette, PT, DSc, FAPTA, Physical Therapy Program, MGH Institute of Health Professions, 36 First Ave, Charlestown Navy Yard, Boston, MA 02129 (USA), and Rehabilitation and Movement Science, University of Vermont, Burlington, Vermont. djette@mghihp.edu. 2. M. Stilphen, PT, DPT, Rehabilitation and Sports Therapy Department, Cleveland Clinic, Cleveland, Ohio. 3. V.K. Ranganathan, MS, MBA, Physical Medicine and Rehabilitation Department, Cleveland Clinic. 4. S. Passek, PT, DPT, Physical Medicine and Rehabilitation Department, Cleveland Clinic. 5. F.S. Frost, MD, Physical Medicine and Rehabilitation Department, Cleveland Clinic. 6. A.M. Jette, PT, PhD, FAPTA, School of Public Health, Health and Disability Research Institute, Boston University Medical Campus, Boston, Massachusetts.
Abstract
BACKGROUND: The interrater reliability of 2 new inpatient functional short-form measures, Activity Measure for Post-Acute Care (AM-PAC) "6-Clicks" basic mobility and daily activity scores, has yet to be established. OBJECTIVE: The purpose of this study was to examine the interrater reliability of AM-PAC "6-Clicks" measures. DESIGN: A prospective observational study was conducted. METHODS: Four pairs of physical therapists rated basic mobility and 4 pairs of occupational therapists rated daily activity of patients in 1 of 4 hospital services. One therapist in a pair was the primary therapist directing the assessment while the other therapist observed. Each therapist was unaware of the other's AM-PAC "6-Clicks" scores. Reliability was assessed with intraclass correlation coefficients (ICCs), Bland-Altman plots, and weighted kappa. RESULTS: The ICCs for the overall reliability of basic mobility and daily activity were .849 (95% confidence interval [CI]=.784, .895) and .783 (95% CI=.696, .847), respectively. The ICCs for the reliability of each pair of raters ranged from .581 (95% CI=.260, .789) to .960 (95% CI=.897, .983) for basic mobility and .316 (95% CI=-.061, .611) to .907 (95% CI=.801, .958) for daily activity. The weighted kappa values for item agreement ranged from .492 (95% CI=.382, .601) to .712 (95% CI=.607, .816) for basic mobility and .251 (95% CI=.057, .445) to .751 (95% CI=.653, .848) for daily activity. Mean differences between raters' scores were near zero. LIMITATIONS: Raters were from one health system. Each pair of raters assessed different patients in different services. CONCLUSIONS: The ICCs for AM-PAC "6-Clicks" total scores were very high. Levels of agreement varied across pairs of raters, from large to nearly perfect for physical therapists and from moderate to nearly perfect for occupational therapists. Levels of agreement for individual item scores ranged from small to very large.
BACKGROUND: The interrater reliability of 2 new inpatient functional short-form measures, Activity Measure for Post-Acute Care (AM-PAC) "6-Clicks" basic mobility and daily activity scores, has yet to be established. OBJECTIVE: The purpose of this study was to examine the interrater reliability of AM-PAC "6-Clicks" measures. DESIGN: A prospective observational study was conducted. METHODS: Four pairs of physical therapists rated basic mobility and 4 pairs of occupational therapists rated daily activity of patients in 1 of 4 hospital services. One therapist in a pair was the primary therapist directing the assessment while the other therapist observed. Each therapist was unaware of the other's AM-PAC "6-Clicks" scores. Reliability was assessed with intraclass correlation coefficients (ICCs), Bland-Altman plots, and weighted kappa. RESULTS: The ICCs for the overall reliability of basic mobility and daily activity were .849 (95% confidence interval [CI]=.784, .895) and .783 (95% CI=.696, .847), respectively. The ICCs for the reliability of each pair of raters ranged from .581 (95% CI=.260, .789) to .960 (95% CI=.897, .983) for basic mobility and .316 (95% CI=-.061, .611) to .907 (95% CI=.801, .958) for daily activity. The weighted kappa values for item agreement ranged from .492 (95% CI=.382, .601) to .712 (95% CI=.607, .816) for basic mobility and .251 (95% CI=.057, .445) to .751 (95% CI=.653, .848) for daily activity. Mean differences between raters' scores were near zero. LIMITATIONS: Raters were from one health system. Each pair of raters assessed different patients in different services. CONCLUSIONS: The ICCs for AM-PAC "6-Clicks" total scores were very high. Levels of agreement varied across pairs of raters, from large to nearly perfect for physical therapists and from moderate to nearly perfect for occupational therapists. Levels of agreement for individual item scores ranged from small to very large.
Authors: Ylinne T Lynch; Brendan J Clark; Madison Macht; S David White; Heather Taylor; Tim Wimbish; Marc Moss Journal: J Crit Care Date: 2017-02-15 Impact factor: 3.425
Authors: Joshua K Johnson; Michael B Rothberg; Kellie Adams; Brittany Lapin; Tamra Keeney; Mary Stilphen; Francois Bethoux; Janet K Freburger Journal: Med Care Date: 2022-03-16 Impact factor: 3.178
Authors: Elizabeth Marfeo; Pengsheng Ni; Chun Wang; David Weiss; Andrea L Cheville Journal: Arch Phys Med Rehabil Date: 2021-12-26 Impact factor: 4.060
Authors: John C Probasco; Annette Lavezza; Andre Cassell; Tenise Shakes; Angie Feurer; Holly Russell; Hilary Sporney; Margie Burnett; Chepkorir Maritim; Victor Urrutia; H Adrian Puttgen; Michael Friedman; Erik H Hoyer Journal: Neurohospitalist Date: 2017-09-12
Authors: Andrea L Cheville; Chun Wang; Kathleen J Yost; Jeanne A Teresi; Mildred Ramirez; Katja Ocepek-Welikson; Pengsheng Ni; Elizabeth Marfeo; Tamra Keeney; Jeffrey R Basford; David J Weiss Journal: Arch Rehabil Res Clin Transl Date: 2021-02-16