Richard S E Keefe1, Vicki G Davis2, Philip D Harvey3, Alexandra S Atkins2, George M Haig4, Owen Hagino5, Stephen Marder6, Dana C Hilt7, Daniel Umbricht8. 1. Department of Psychiatry and Behavioral Sciences, Duke University, Duke University Medical Center, Durham, North Carolina2NeuroCog Trials, Durham, North Carolina. 2. NeuroCog Trials, Durham, North Carolina. 3. Department of Psychiatry and Behavioral Sciences, University of Miami, Miami, Florida. 4. Neuroscience Development, Abbvie, North Chicago, Illinois. 5. Research and Development, Immunology and Inflammation, Sanofi, Bridgewater, New Jersey. 6. Semel Institute for Neuroscience at the University of California, Los Angeles. 7. Drug Development, FORUM Pharmaceuticals, Waltham, Massachusetts. 8. Neuroscience, Ophthalmology, Rare Diseases, Roche Pharma Research and Early Development, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Basel, Switzerland.
Abstract
Importance: Patients' previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. Objectives: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. Design, Setting, and Participants: A blinded review was conducted of data from 813 patients with schizophrenia who were treated withplacebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. Interventions: Placebo compared with various experimental drug treatments. Main Outcomes and Measures: Composite score on the MCCB. Results: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). Conclusions and Relevance: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.
RCT Entities:
Importance: Patients' previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. Objectives: To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. Design, Setting, and Participants: A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. Interventions: Placebo compared with various experimental drug treatments. Main Outcomes and Measures: Composite score on the MCCB. Results: Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). Conclusions and Relevance: Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.
Authors: Terry E Goldberg; Richard S E Keefe; Robert S Goldman; Delbert G Robinson; Philip D Harvey Journal: Neuropsychopharmacology Date: 2010-01-20 Impact factor: 7.853
Authors: George M Haig; Earle E Bain; Weining Z Robieson; Jeffrey D Baker; Ahmed A Othman Journal: Am J Psychiatry Date: 2016-03-04 Impact factor: 18.112
Authors: Robert W Buchanan; Richard S E Keefe; Jeffrey A Lieberman; Deanna M Barch; John G Csernansky; Donald C Goff; James M Gold; Michael F Green; L Fredrik Jarskog; Daniel C Javitt; David Kimhy; Michael S Kraus; Joseph P McEvoy; Raquelle I Mesholam-Gately; Larry J Seidman; M Patricia Ball; Robert P McMahon; Robert S Kern; James Robinson; Stephen R Marder Journal: Biol Psychiatry Date: 2010-12-08 Impact factor: 13.382
Authors: Daniel Umbricht; Richard S E Keefe; Stephen Murray; David A Lowe; Richard Porter; George Garibaldi; Luca Santarelli Journal: Neuropsychopharmacology Date: 2014-01-27 Impact factor: 7.853
Authors: Richard S E Keefe; Terry E Goldberg; Philip D Harvey; James M Gold; Margaret P Poe; Leigh Coughenour Journal: Schizophr Res Date: 2004-06-01 Impact factor: 4.939
Authors: Robert S Kern; Keith H Nuechterlein; Michael F Green; Lyle E Baade; Wayne S Fenton; James M Gold; Richard S E Keefe; Raquelle Mesholam-Gately; Jim Mintz; Larry J Seidman; Ellen Stover; Stephen R Marder Journal: Am J Psychiatry Date: 2008-01-02 Impact factor: 18.112
Authors: George M Haig; Earle Bain; Weining Robieson; Ahmed A Othman; Jeffrey Baker; Robert A Lenz Journal: Schizophr Bull Date: 2014-02-10 Impact factor: 9.306
Authors: Suzanne N Avery; Kristan Armstrong; Jennifer U Blackford; Neil D Woodward; Neal Cohen; Stephan Heckers Journal: Schizophr Res Date: 2019-08-08 Impact factor: 4.939
Authors: Margaret M McClure; Fiona Graff; Joseph Triebwasser; Mercedes Perez-Rodriguez; Daniel R Rosell; Harold Koenigsberg; Erin A Hazlett; Larry J Siever; Philip D Harvey; Antonia S New Journal: Am J Psychiatry Date: 2019-01-18 Impact factor: 18.112
Authors: David Fraguas; Covadonga M Díaz-Caneja; Laura Pina-Camacho; Daniel Umbricht; Celso Arango Journal: Schizophr Bull Date: 2019-01-01 Impact factor: 9.306
Authors: Gabrielle E Hodgins; Jared G Blommel; Boadie W Dunlop; Dan Iosifescu; Sanjay J Mathew; Thomas C Neylan; Helen S Mayberg; Philip D Harvey Journal: J Clin Psychopharmacol Date: 2018-06 Impact factor: 3.153