Jeanette M Johnstone1,2, Brenda M Y Leung3, Priya Srikanth4, Irene Hatsu5, Leanna Perez5, Barbara Gracious6,7, Gabriella Tost2, Michael G Aman8, Kenneth D Gadow9, Robert L Findling10, Oscar Bukstein11, L Eugene Arnold6. 1. Helfgott Research Institute, National University of Natural Medicine, Portland, Oregon. 2. Department of Child and Adolescent Psychiatry, Oregon Health & Science University, Portland, Oregon. 3. Faculty of Health Sciences, University of Lethbridge, Lethbridge, Alberta, Canada. 4. School of Public Health, Oregon Health & Science University-Portland State University (OHSU-PSU Program), Portland, Oregon. 5. Department of Human Sciences, The Ohio State University, Columbus, Ohio. 6. Department of Psychiatry and Behavioral Health, The Ohio State University, Columbus, Ohio. 7. Orange Park Medical Center, Orange Park, Florida. 8. The Nisonger Center UCEDD and Department of Psychology, The Ohio State University, Columbus, Ohio. 9. Department of Psychiatry, Stony Brook University, Stony Brook, New York. 10. Department of Psychiatry, Johns Hopkins University, Baltimore, Maryland. 11. Department of Psychiatry, Boston Children's Hospital, Boston, Massachusetts.
Abstract
Objective: Study goals were to (1) provide a rationale for developing a composite primary outcome score that includes symptom severity for attention-deficit/hyperactivity disorder (ADHD) and emotional dysregulation, plus symptom-induced impairment; (2) demonstrate weighting methods to calculate the composite score using a sample of children diagnosed with ADHD and aggression; and (3) identify the optimal weighting method most sensitive to change, as measured by effect sizes. Methods: We conducted secondary data analyses from the previously conducted Treatment of Severe Childhood Aggression (TOSCA) study. Children aged 6-12 years were recruited through academic medical centers or community referrals. The composite primary outcome comprised the ADHD, oppositional defiant disorder, disruptive mood dysregulation disorder, and peer conflict subscales from the Child and Adolescent Symptom Inventory (CASI), a DSM (Diagnostic and Statistical Manual)-referenced rating scale of symptom severity and symptom-induced impairment. Five weighting methods were tested based on input from senior statisticians. Results: The composite score demonstrated a larger (Cohen's d) effect size than the individual CASI subscales, irrespective of the weighting method (10%-55% larger). Across all weighting methods, effect sizes were similar and substantial: approximately a two-standard deviation symptom reduction (range: -1.97 to -2.04), highest for equal item and equal subscale weighting, was demonstrated, from baseline to week 9, among all TOSCA participants. The composite score showed a medium positive correlation with the Clinical Global Impressions-Severity scores, 0.46-0.47 for all weighting methods. Conclusions: A composite score that included severity and impairment ratings of ADHD and emotional dysregulation demonstrated a more robust pre-post change than individual subscales. This composite may be a more useful indicator of clinically relevant improvement in heterogeneous samples with ADHD than single subscales, avoiding some of the statistical limitations associated with multiple comparisons. Among the five similar weighting methods, the two best appear to be the equal item and equal subscale weighting methods.
Objective: Study goals were to (1) provide a rationale for developing a composite primary outcome score that includes symptom severity for attention-deficit/hyperactivity disorder (ADHD) and emotional dysregulation, plus symptom-induced impairment; (2) demonstrate weighting methods to calculate the composite score using a sample of children diagnosed with ADHD and aggression; and (3) identify the optimal weighting method most sensitive to change, as measured by effect sizes. Methods: We conducted secondary data analyses from the previously conducted Treatment of Severe Childhood Aggression (TOSCA) study. Children aged 6-12 years were recruited through academic medical centers or community referrals. The composite primary outcome comprised the ADHD, oppositional defiant disorder, disruptive mood dysregulation disorder, and peer conflict subscales from the Child and Adolescent Symptom Inventory (CASI), a DSM (Diagnostic and Statistical Manual)-referenced rating scale of symptom severity and symptom-induced impairment. Five weighting methods were tested based on input from senior statisticians. Results: The composite score demonstrated a larger (Cohen's d) effect size than the individual CASI subscales, irrespective of the weighting method (10%-55% larger). Across all weighting methods, effect sizes were similar and substantial: approximately a two-standard deviation symptom reduction (range: -1.97 to -2.04), highest for equal item and equal subscale weighting, was demonstrated, from baseline to week 9, among all TOSCA participants. The composite score showed a medium positive correlation with the Clinical Global Impressions-Severity scores, 0.46-0.47 for all weighting methods. Conclusions: A composite score that included severity and impairment ratings of ADHD and emotional dysregulation demonstrated a more robust pre-post change than individual subscales. This composite may be a more useful indicator of clinically relevant improvement in heterogeneous samples with ADHD than single subscales, avoiding some of the statistical limitations associated with multiple comparisons. Among the five similar weighting methods, the two best appear to be the equal item and equal subscale weighting methods.
Authors: Kenneth D Gadow; L Eugene Arnold; Brooke S G Molina; Robert L Findling; Oscar G Bukstein; Nicole V Brown; Nora K McNamara; E Victoria Rundberg-Rivera; Xiaobai Li; Heidi L Kipp; Jayne Schneider; Cristan A Farmer; Jennifer L Baker; Joyce Sprafkin; Robert R Rice; Srihari S Bangalore; Eric M Butter; Kristin A Buchan-Page; Elizabeth A Hurt; Adrienne B Austin; Sabrina N Grondhuis; Michael G Aman Journal: J Am Acad Child Adolesc Psychiatry Date: 2014-06-12 Impact factor: 8.829
Authors: J M Swanson; H C Kraemer; S P Hinshaw; L E Arnold; C K Conners; H B Abikoff; W Clevenger; M Davies; G R Elliott; L L Greenhill; L Hechtman; B Hoza; P S Jensen; J S March; J H Newcorn; E B Owens; W E Pelham; E Schiller; J B Severe; S Simpson; B Vitiello; K Wells; T Wigal; M Wu Journal: J Am Acad Child Adolesc Psychiatry Date: 2001-02 Impact factor: 8.829
Authors: Sarah L Karalunas; Damien Fair; Erica D Musser; Kamari Aykes; Swathi P Iyer; Joel T Nigg Journal: JAMA Psychiatry Date: 2014-09 Impact factor: 21.596
Authors: James M Swanson; Sabrina Schuck; Miranda Mann Porter; Caryn Carlson; Catharina A Hartman; Joseph A Sergeant; Walter Clevenger; Michael Wasdell; Richard McCleary; Kimberley Lakes; Timothy Wigal Journal: Int J Educ Psychol Assess Date: 2012-04
Authors: Alisha M Bruton; Angela Senders; Gabriella Tost; Hayleigh Ast; Lisa M Robinette; Brenda Leung; Irene E Hatsu; L Eugene Arnold; Jeanette M Johnstone Journal: Disabil Rehabil Date: 2022-03-10 Impact factor: 2.439
Authors: Jeanette M Johnstone; Irene Hatsu; Gabriella Tost; Priya Srikanth; Leanna P Eiterman; Alisha M Bruton; Hayleigh K Ast; Lisa M Robinette; Madeline M Stern; Elizabeth G Millington; Barbara L Gracious; Andrew J Hughes; Brenda M Y Leung; L Eugene Arnold Journal: J Am Acad Child Adolesc Psychiatry Date: 2021-07-22 Impact factor: 13.113
Authors: Annick Bosch; Margreet Bierens; Ardine G de Wit; Verena Ly; Jessica van der Velde; Heleen de Boer; Gerry van Beek; Danielle Appelman; Sacha Visser; Lisa Bos; Jolanda van der Meer; Niki Kamphuis; Jos M T Draaisma; Rogier Donders; Gigi H H van de Loo-Neus; Pieter J Hoekstra; Marco Bottelier; Alejandro Arias-Vasquez; Helen Klip; Jan K Buitelaar; Saskia W van den Berg; Nanda N Rommelse Journal: BMC Psychiatry Date: 2020-05-27 Impact factor: 3.630