Bradley E Gray1, Robert P McMahon1, Michael F Green2, Larry J Seidman3, Raquelle I Mesholam-Gately3, Robert S Kern2, Keith H Nuechterlein2, Richard S Keefe4, James M Gold5. 1. Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, PO Box 21247, Baltimore, MD 21228, USA. 2. Semel Institute for Neuroscience and Human Behavior, UCLA, Los Angeles, CA 90095, USA; VA Greater Los Angeles Healthcare System, Los Angeles, CA 90073, USA. 3. Massachusetts Mental Health Center, Public Psychiatry Division of the Beth Israel Deaconess Medical Center, Harvard Medical School Department of Psychiatry, Boston, MA 02115, USA. 4. Department of Psychiatry, Translational Neuroscience, Duke University School of Medicine, Durham, NC 27710, USA. 5. Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, PO Box 21247, Baltimore, MD 21228, USA. Electronic address: jgold@mprc.umaryland.edu.
Abstract
OBJECTIVE: Clinicians often need to evaluate the treatment response of an individual person and to know that observed change is true improvement or worsening beyond usual week-to-week changes. This paper gives clinicians tools to evaluate individual changes on the MATRICS Consensus Cognitive Battery (MCCB). We compare three different approaches: a descriptive analysis of MCCB test-retest performance with no intervention, a reliable change index (RCI) approach controlling for average practice effects, and a regression approach. METHOD: Data were gathered as part of the MATRICS PASS study (Nuechterlein et al., 2008). A total of 159 people with schizophrenia completed the MCCB at baseline and 4weeks later. Data were analyzed using an RCI and a regression formula establishing confidence intervals. RESULTS: The RCI and regression approaches agree within one point when baseline values are close to the sample mean. However, the regression approach offers more accurate limits for expected change at the tails of the distribution of baseline scores. CONCLUSIONS: Although both approaches have their merits, the regression approach provides the most accurate measure of significant change across the full range of scores. As the RCI does not account for regression to the mean and has confidence limits that remain constant across baseline scores, the RCI approach effectively gives narrower confidence limits around an inaccurately predicted average change value. Further, despite the high test-retest reliability of the MCCB, a change in an individual's score must be relatively large to be confident that it is beyond normal month-to-month variation.
OBJECTIVE: Clinicians often need to evaluate the treatment response of an individual person and to know that observed change is true improvement or worsening beyond usual week-to-week changes. This paper gives clinicians tools to evaluate individual changes on the MATRICS Consensus Cognitive Battery (MCCB). We compare three different approaches: a descriptive analysis of MCCB test-retest performance with no intervention, a reliable change index (RCI) approach controlling for average practice effects, and a regression approach. METHOD: Data were gathered as part of the MATRICS PASS study (Nuechterlein et al., 2008). A total of 159 people with schizophrenia completed the MCCB at baseline and 4weeks later. Data were analyzed using an RCI and a regression formula establishing confidence intervals. RESULTS: The RCI and regression approaches agree within one point when baseline values are close to the sample mean. However, the regression approach offers more accurate limits for expected change at the tails of the distribution of baseline scores. CONCLUSIONS: Although both approaches have their merits, the regression approach provides the most accurate measure of significant change across the full range of scores. As the RCI does not account for regression to the mean and has confidence limits that remain constant across baseline scores, the RCI approach effectively gives narrower confidence limits around an inaccurately predicted average change value. Further, despite the high test-retest reliability of the MCCB, a change in an individual's score must be relatively large to be confident that it is beyond normal month-to-month variation.
Authors: Daniel C Javitt; Robert W Buchanan; Richard S E Keefe; Robert Kern; Robert P McMahon; Michael F Green; Jeffrey Lieberman; Donald C Goff; John G Csernansky; Joseph P McEvoy; Fred Jarskog; Larry J Seidman; James M Gold; David Kimhy; Karen S Nolan; Deanna S Barch; M Patricia Ball; James Robinson; Stephen R Marder Journal: Schizophr Res Date: 2011-12-12 Impact factor: 4.939
Authors: Richard S E Keefe; Kolleen Hurley Fox; Philip D Harvey; Josephine Cucchiaro; Cynthia Siu; Antony Loebel Journal: Schizophr Res Date: 2010-12-31 Impact factor: 4.939
Authors: Michael F Green; Keith H Nuechterlein; Robert S Kern; Lyle E Baade; Wayne S Fenton; James M Gold; Richard S E Keefe; Raquelle Mesholam-Gately; Larry J Seidman; Ellen Stover; Stephen R Marder Journal: Am J Psychiatry Date: 2008-01-02 Impact factor: 18.112
Authors: Keith H Nuechterlein; Michael F Green; Robert S Kern; Lyle E Baade; Deanna M Barch; Jonathan D Cohen; Susan Essock; Wayne S Fenton; Frederick J Frese; James M Gold; Terry Goldberg; Robert K Heaton; Richard S E Keefe; Helena Kraemer; Raquelle Mesholam-Gately; Larry J Seidman; Ellen Stover; Daniel R Weinberger; Alexander S Young; Steven Zalcman; Stephen R Marder Journal: Am J Psychiatry Date: 2008-01-02 Impact factor: 18.112
Authors: Robert W Buchanan; Richard S E Keefe; Jeffrey A Lieberman; Deanna M Barch; John G Csernansky; Donald C Goff; James M Gold; Michael F Green; L Fredrik Jarskog; Daniel C Javitt; David Kimhy; Michael S Kraus; Joseph P McEvoy; Raquelle I Mesholam-Gately; Larry J Seidman; M Patricia Ball; Robert P McMahon; Robert S Kern; James Robinson; Stephen R Marder Journal: Biol Psychiatry Date: 2010-12-08 Impact factor: 13.382
Authors: R K Heaton; N Temkin; S Dikmen; N Avitable; M J Taylor; T D Marcotte; I Grant Journal: Arch Clin Neuropsychol Date: 2001-01 Impact factor: 2.813
Authors: Terry E Goldberg; Robert S Goldman; Katherine E Burdick; Anil K Malhotra; Todd Lencz; Raman C Patel; Margaret G Woerner; Nina R Schooler; John M Kane; Delbert G Robinson Journal: Arch Gen Psychiatry Date: 2007-10
Authors: A M Sánchez-Torres; L Moreno-Izco; R Lorente-Omeñaca; B Cabrera; A Lobo; A M González-Pinto; J Merchán-Naranjo; I Corripio; E Vieta; E de la Serna; A Butjosa; F Contreras; S Sarró; G Mezquida; M Ribeiro; M Bernardo; M J Cuesta Journal: Eur Arch Psychiatry Clin Neurosci Date: 2017-11-21 Impact factor: 5.270
Authors: Nicholas J K Breitborde; Emily K Bell; David Dawley; Cindy Woolverton; Alan Ceaser; Allison C Waters; Spencer C Dawson; Andrew W Bismark; Angelina J Polsinelli; Lisa Bartolomeo; Jessica Simmons; Beth Bernstein; Patricia Harrison-Monroe Journal: BMC Psychiatry Date: 2015-10-28 Impact factor: 3.630
Authors: Ney Alliey-Rodriguez; Tamar A Grey; Rebecca Shafee; Huma Asif; Olivia Lutz; Nicolas R Bolo; Jaya Padmanabhan; Neeraj Tandon; Madeline Klinger; Katherine Reis; Jonathan Spring; Lucas Coppes; Victor Zeng; Rachal R Hegde; Dung T Hoang; Deepthi Bannai; Uzma Nawaz; Philip Henson; Siyuan Liu; Diane Gage; Steven McCarroll; Jeffrey R Bishop; Scot Hill; James L Reilly; Rebekka Lencer; Brett A Clementz; Peter Buckley; David C Glahn; Shashwath A Meda; Balaji Narayanan; Godfrey Pearlson; Matcheri S Keshavan; Elena I Ivleva; Carol Tamminga; John A Sweeney; David Curtis; Judith A Badner; Sarah Keedy; Judith Rapoport; Chunyu Liu; Elliot S Gershon Journal: Transl Psychiatry Date: 2019-09-17 Impact factor: 6.222
Authors: Richard S E Keefe; George M Haig; Stephen R Marder; Philip D Harvey; Eduardo Dunayevich; Alice Medalia; Michael Davidson; Ilise Lombardo; Christopher R Bowie; Robert W Buchanan; Dragana Bugarski-Kirola; William T Carpenter; John T Csernansky; Pedro L Dago; Dante M Durand; Frederick J Frese; Donald C Goff; James M Gold; Christine I Hooker; Alex Kopelowicz; Antony Loebel; Susan R McGurk; Lewis A Opler; Amy E Pinkham; Robert G Stern Journal: Schizophr Bull Date: 2015-09-11 Impact factor: 9.306