Steven D Targum1, J Cara Pendergrass1, Sang Lee1, Antony Loebel2,3. 1. Bracket Global, LLC, Boston, Massachusetts, USA. 2. Sunovion Pharmaceuticals, Fort Lee, New Jersey, USA. 3. Sunovion Pharmaceuticals, Marlborough, Massachusetts, USA.
Abstract
OBJECTIVES: Site-independent ratings surveillance assessed ratings reliability in a clinical trial. METHODS: Inter-rater reliability was assessed at the screen visit in a 6-week, double-blind, placebo-controlled study of lurasidone for the treatment of major depressive disorder (MDD) with subthreshold hypomanic ("mixed") symptoms (clinicaltrials.gov NCT01421134). Site-based Montgomery-Asberg Depression Rating Scale (MADRS) and Young Mania Rating Scale (YMRS) interviews were paired with 184 site-independent ratings derived from audio-digital recordings. RESULTS: The paired MADRS and YMRS scores were highly correlated (r = 0.708 and 0.885, respectively) and generated minimal scoring discordance. The surveillance program identified 14 MADRS scores (7.6% of this sample) that were below the study entry criterion (MADRS ≥26) and resulted in screen failure. When present, paired scoring discordance was associated with symptom severity, interview length, interview quality, and the level of patient cooperation. Higher severity scores (MADRS ≥40 and YMRS ≥15) were associated with greater paired scoring discordance. Further, MADRS scores <30 and short MADRS interviews conducted in ≤12 min revealed significantly more pairs of discordant outliers (p = 0.04 and 0.009, respectively). CONCLUSIONS: The findings suggest that MDD patients with mixed features can be reliably assessed, that paired site-based and site-independent assessments were generally concordant, and that ratings surveillance may reinforce ratings precision.
RCT Entities:
OBJECTIVES: Site-independent ratings surveillance assessed ratings reliability in a clinical trial. METHODS: Inter-rater reliability was assessed at the screen visit in a 6-week, double-blind, placebo-controlled study of lurasidone for the treatment of major depressive disorder (MDD) with subthreshold hypomanic ("mixed") symptoms (clinicaltrials.gov NCT01421134). Site-based Montgomery-Asberg Depression Rating Scale (MADRS) and Young Mania Rating Scale (YMRS) interviews were paired with 184 site-independent ratings derived from audio-digital recordings. RESULTS: The paired MADRS and YMRS scores were highly correlated (r = 0.708 and 0.885, respectively) and generated minimal scoring discordance. The surveillance program identified 14 MADRS scores (7.6% of this sample) that were below the study entry criterion (MADRS ≥26) and resulted in screen failure. When present, paired scoring discordance was associated with symptom severity, interview length, interview quality, and the level of patient cooperation. Higher severity scores (MADRS ≥40 and YMRS ≥15) were associated with greater paired scoring discordance. Further, MADRS scores <30 and short MADRS interviews conducted in ≤12 min revealed significantly more pairs of discordant outliers (p = 0.04 and 0.009, respectively). CONCLUSIONS: The findings suggest that MDDpatients with mixed features can be reliably assessed, that paired site-based and site-independent assessments were generally concordant, and that ratings surveillance may reinforce ratings precision.
Authors: Joan Shen; Kenneth A Kobak; Yonggang Zhao; Madeline M Alexander; John M Kane Journal: J Clin Psychopharmacol Date: 2008-12 Impact factor: 3.153
Authors: Trisha Suppes; Jim Mintz; Susan L McElroy; Lori L Altshuler; Ralph W Kupka; Mark A Frye; Paul E Keck; Willem A Nolen; Gabriele S Leverich; Heinz Grunze; A John Rush; Robert M Post Journal: Arch Gen Psychiatry Date: 2005-10
Authors: Steven D Targum; J Cara Pendergrass; Chelsea Toner; Mahnaz Asgharnejad; Daniel J Burch Journal: Eur Neuropsychopharmacol Date: 2014-09-06 Impact factor: 4.600
Authors: Rob McCarney; James Warner; Steve Iliffe; Robbert van Haselen; Mark Griffin; Peter Fisher Journal: BMC Med Res Methodol Date: 2007-07-03 Impact factor: 4.615