Denise F Polit1. 1. Humanalysis, Inc., Saratoga Springs, NY, USA, denisefpolit@gmail.com.
Abstract
PURPOSE: To focus attention on the need for rigorous and carefully designed test-retest reliability assessments for new patient-reported outcomes and to encourage retest researchers to be thoughtful, ambitious, and creative in their retest efforts. METHODS: The paper outlines key challenges that confront retest researchers, calls attention to some limitations in meeting those challenges, and describes some strategies to improve retest research. RESULTS: Modest retest coefficients are often reported as acceptable, and many important decisions-such as the retest interval-appear not to be evidence-based. Retest assessments are seldom undertaken before a measure has been finalized, which rules out using retest data to select strong, reproducible items. CONCLUSIONS: Strategies for improving retest research include seeking input from patients or experts regarding the stability of the construct to support decisions about the retest interval, analyzing item-level retest data to identify items to revise or discard, establishing a priori standards of acceptability for reliability coefficients, using large, heterogeneous, and representative retest samples and collecting follow-up data to better understand consistent and inconsistent responses over time.
PURPOSE: To focus attention on the need for rigorous and carefully designed test-retest reliability assessments for new patient-reported outcomes and to encourage retest researchers to be thoughtful, ambitious, and creative in their retest efforts. METHODS: The paper outlines key challenges that confront retest researchers, calls attention to some limitations in meeting those challenges, and describes some strategies to improve retest research. RESULTS: Modest retest coefficients are often reported as acceptable, and many important decisions-such as the retest interval-appear not to be evidence-based. Retest assessments are seldom undertaken before a measure has been finalized, which rules out using retest data to select strong, reproducible items. CONCLUSIONS: Strategies for improving retest research include seeking input from patients or experts regarding the stability of the construct to support decisions about the retest interval, analyzing item-level retest data to identify items to revise or discard, establishing a priori standards of acceptability for reliability coefficients, using large, heterogeneous, and representative retest samples and collecting follow-up data to better understand consistent and inconsistent responses over time.
Authors: Delphine S Courvoisier; Stéphane Cullati; Chiara S Haller; Ralph E Schmidt; Guy Haller; Thomas Agoritsas; Thomas V Perneger Journal: Med Care Date: 2013-03 Impact factor: 2.983
Authors: Janelle Yorke; Jeffrey Swigris; Anne-Marie Russell; Shakeeb H Moosavi; Georges Ng Man Kwong; Mark Longshaw; Paul W Jones Journal: Chest Date: 2010-07-01 Impact factor: 9.410
Authors: Caroline B Terwee; Lidwine B Mokkink; Dirk L Knol; Raymond W J G Ostelo; Lex M Bouter; Henrica C W de Vet Journal: Qual Life Res Date: 2011-07-06 Impact factor: 4.147
Authors: Michael Brundage; Jane Blazeby; Dennis Revicki; Brenda Bass; Henrica de Vet; Helen Duffy; Fabio Efficace; Madeleine King; Cindy L K Lam; David Moher; Jane Scott; Jeff Sloan; Claire Snyder; Susan Yount; Melanie Calvert Journal: Qual Life Res Date: 2012-09-18 Impact factor: 4.147
Authors: Wan Ling Lee; Karuthan Chinna; Awang Bulgiba; Khatijah Lim Abdullah; Imran Zainal Abidin; Stefan Höfer Journal: Qual Life Res Date: 2015-08-09 Impact factor: 4.147
Authors: Katrien Vermeulen; Maxim Woestyn; Kristine Oostra; Sybille Geers; Kristien Ryngaert; Kimberley Van de Velde; Filip Descheemaeker; Stijn De Baets; Dominique Van de Velde Journal: J Occup Rehabil Date: 2019-09
Authors: Hemail M Alsubaie; Suhail I Sayed; Albaraa Y Alsini; Haddad H Alkaff; Osama A Margalani; Ahmed Abu-Zaid; Omar A Abu-Suliman; Ameen Z Alherabi; Saeed A Alghamdi; Essam Saleh; Mohammad A Alessa; Sherif K Abdelmonim Journal: Dysphagia Date: 2021-08-24 Impact factor: 2.733
Authors: Veronica De Simone; Francesco Litta; Roberto Persiani; Gianluca Rizzo; Luigi Sofo; Roberta Menghi; Francesco Santullo; Alberto Biondi; Claudio Coco; Franco Sacchetti; Fabio Longo; Miriam Attalla El Halabieh; Rossana Moroni; Carlo Ratto Journal: Front Surg Date: 2022-06-20
Authors: Phuong H Nguyen; Maku E Ocansey; Meghan Miller; Dung T K Le; Rebecca J Schmidt; Elizabeth L Prado Journal: Autism Res Date: 2019-07-29 Impact factor: 5.216