Kelly L Zuromski1,2, Berk Ustun3, Irving Hwang2, Terence M Keane4,5, Brian P Marx4,5, Murray B Stein6,7,8, Robert J Ursano9, Ronald C Kessler2. 1. Department of Psychology, Harvard University, Cambridge, Massachusetts. 2. Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts. 3. Center for Research on Computation and Society, John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts. 4. National Center for PTSD, Behavioral Science Division, VA Boston Healthcare System, Boston, Massachusetts. 5. Department of Psychiatry, Boston University School of Medicine, Massachusetts. 6. Department of Psychiatry, University of California San Diego, La Jolla, California. 7. Department of Family Medicine and Public Health, University of California San Diego, La Jolla, California. 8. VA San Diego Healthcare System, San Diego, California. 9. Department of Psychiatry, Center for the Study of Traumatic Stress, Uniformed Services University of the Health Sciences, Bethesda, Maryland.
Abstract
BACKGROUND: Although several short-forms of the posttraumatic stress disorder (PTSD) Checklist (PCL) exist, all were developed using heuristic methods. This report presents the results of analyses designed to create an optimal short-form PCL for DSM-5 (PCL-5) using both machine learning and conventional scale development methods. METHODS: The short-form scales were developed using independent datasets collected by the Army Study to Assess Risk and Resilience among Service members. We began by using a training dataset (n = 8,917) to fit short-form scales with between 1 and 8 items using different statistical methods (exploratory factor analysis, stepwise logistic regression, and a new machine learning method to find an optimal integer-scored short-form scale) to predict dichotomous PTSD diagnoses determined using the full PCL-5. A smaller subset of best short-form scales was then evaluated in an independent validation sample (n = 11,728) to select one optimal short-form scale based on multiple operating characteristics (area under curve [AUC], calibration, sensitivity, specificity, net benefit). RESULTS: Inspection of AUCs in the training sample and replication in the validation sample led to a focus on 4-item integer-scored short-form scales selected with stepwise regression. Brier scores in the validation sample showed that a number of these scales had comparable calibration (0.015-0.032) and AUC (0.984-0.994), but that one had consistently highest net benefit across a plausible range of decision thresholds. CONCLUSIONS: The recommended 4-item integer-scored short-form PCL-5 generates diagnoses that closely parallel those of the full PCL-5, making it well-suited for screening.
BACKGROUND: Although several short-forms of the posttraumatic stress disorder (PTSD) Checklist (PCL) exist, all were developed using heuristic methods. This report presents the results of analyses designed to create an optimal short-form PCL for DSM-5 (PCL-5) using both machine learning and conventional scale development methods. METHODS: The short-form scales were developed using independent datasets collected by the Army Study to Assess Risk and Resilience among Service members. We began by using a training dataset (n = 8,917) to fit short-form scales with between 1 and 8 items using different statistical methods (exploratory factor analysis, stepwise logistic regression, and a new machine learning method to find an optimal integer-scored short-form scale) to predict dichotomous PTSD diagnoses determined using the full PCL-5. A smaller subset of best short-form scales was then evaluated in an independent validation sample (n = 11,728) to select one optimal short-form scale based on multiple operating characteristics (area under curve [AUC], calibration, sensitivity, specificity, net benefit). RESULTS: Inspection of AUCs in the training sample and replication in the validation sample led to a focus on 4-item integer-scored short-form scales selected with stepwise regression. Brier scores in the validation sample showed that a number of these scales had comparable calibration (0.015-0.032) and AUC (0.984-0.994), but that one had consistently highest net benefit across a plausible range of decision thresholds. CONCLUSIONS: The recommended 4-item integer-scored short-form PCL-5 generates diagnoses that closely parallel those of the full PCL-5, making it well-suited for screening.
Authors: Jennifer H Wortmann; Alexander H Jordan; Frank W Weathers; Patricia A Resick; Katherine A Dondanville; Brittany Hall-Clark; Edna B Foa; Stacey Young-McCaughan; Jeffrey S Yarvis; Elizabeth A Hembree; Jim Mintz; Alan L Peterson; Brett T Litz Journal: Psychol Assess Date: 2016-01-11
Authors: K C Koenen; A Ratanatharathorn; L Ng; K A McLaughlin; E J Bromet; D J Stein; E G Karam; A Meron Ruscio; C Benjet; K Scott; L Atwoli; M Petukhova; C C W Lim; S Aguilar-Gaxiola; A Al-Hamzawi; J Alonso; B Bunting; M Ciutan; G de Girolamo; L Degenhardt; O Gureje; J M Haro; Y Huang; N Kawakami; S Lee; F Navarro-Mateu; B-E Pennell; M Piazza; N Sampson; M Ten Have; Y Torres; M C Viana; D Williams; M Xavier; R C Kessler Journal: Psychol Med Date: 2017-04-07 Impact factor: 7.723
Authors: Berk Ustun; Lenard A Adler; Cynthia Rudin; Stephen V Faraone; Thomas J Spencer; Patricia Berglund; Michael J Gruber; Ronald C Kessler Journal: JAMA Psychiatry Date: 2017-05-01 Impact factor: 21.596
Authors: R C Kessler; J R Calabrese; P A Farley; M J Gruber; M A Jewell; W Katon; P E Keck; A A Nierenberg; N A Sampson; M K Shear; A C Shillington; M B Stein; M E Thase; H-U Wittchen Journal: Psychol Med Date: 2012-10-18 Impact factor: 7.723
Authors: Charles W Hoge; Lyndon A Riviere; Joshua E Wilk; Richard K Herrell; Frank W Weathers Journal: Lancet Psychiatry Date: 2014-08-14 Impact factor: 27.083
Authors: Ben Van Calster; Laure Wynants; Jan F M Verbeek; Jan Y Verbakel; Evangelia Christodoulou; Andrew J Vickers; Monique J Roobol; Ewout W Steyerberg Journal: Eur Urol Date: 2018-09-19 Impact factor: 20.096
Authors: Jutta Joormann; Hannah N Ziobrowski; Andrew J King; Sarah M Gildea; Sue Lee; Nancy A Sampson; Stacey L House; Francesca L Beaudoin; Xinming An; Jennifer S Stevens; Donglin Zeng; Thomas C Neylan; Gari D Clifford; Sarah D Linnstaedt; Laura T Germine; Kenneth A Bollen; Scott L Rauch; John P Haran; Alan B Storrow; Paul I Musey; Phyllis L Hendry; Sophia Sheikh; Christopher W Jones; Brittany E Punches; Meghan E McGrath; Lauren A Hudak; Jose L Pascual; Mark J Seamon; Anna M Chang; Claire Pearson; David A Peak; Robert M Domeier; Niels K Rathlev; Brian J O'Neil; Leon D Sanchez; Steven E Bruce; Mark W Miller; Robert H Pietrzak; Deanna M Barch; Diego A Pizzagalli; Steven E Harte; James M Elliott; Karestan C Koenen; Samuel A McLean; Ronald C Kessler Journal: Depress Anxiety Date: 2021-11-15 Impact factor: 6.505
Authors: Robert M Bossarte; Ronald C Kessler; Andrew A Nierenberg; Ambarish Chattopadhyay; Pim Cuijpers; Angel Enrique; Phyllis M Foxworth; Sarah M Gildea; Bea Herbeck Belnap; Marc W Haut; Kari B Law; William D Lewis; Howard Liu; Alexander R Luedtke; Wilfred R Pigeon; Larry A Rhodes; Derek Richards; Bruce L Rollman; Nancy A Sampson; Cara M Stokes; John Torous; Tyler D Webb; Jose R Zubizarreta Journal: Trials Date: 2022-06-20 Impact factor: 2.728
Authors: Thomas C Neylan; Ronald C Kessler; Kerry J Ressler; Gari Clifford; Francesca L Beaudoin; Xinming An; Jennifer S Stevens; Donglin Zeng; Sarah D Linnstaedt; Laura T Germine; Sophia Sheikh; Alan B Storrow; Brittany E Punches; Kamran Mohiuddin; Nina T Gentile; Meghan E McGrath; Sanne J H van Rooij; John P Haran; David A Peak; Robert M Domeier; Claire Pearson; Leon D Sanchez; Niels K Rathlev; William F Peacock; Steven E Bruce; Jutta Joormann; Deanna M Barch; Diego A Pizzagalli; John F Sheridan; Steven E Harte; James M Elliott; Irving Hwang; Maria V Petukhova; Nancy A Sampson; Karestan C Koenen; Samuel A McLean Journal: Sleep Date: 2021-03-12 Impact factor: 5.849
Authors: Yara Mekawi; Madison W Silverstein; Aisha Walker; Martha Ishiekwene; Sierra Carter; Vasiliki Michopoulos; Jennifer S Stevens; Abigail Powers Journal: J Anxiety Disord Date: 2022-03-10
Authors: Robyn E Shields; Stephanie Korol; R Nicholas Carleton; Megan McElheran; Andrea M Stelnicki; Dianne Groll; Gregory S Anderson Journal: Int J Environ Res Public Health Date: 2021-04-03 Impact factor: 3.390
Authors: P Mortier; G Vilagut; M Ferrer; I Alayo; R Bruffaerts; P Cristóbal-Narváez; I Del Cura-González; J Domènech-Abella; M Felez-Nobrega; B Olaya; J I Pijoan; E Vieta; V Pérez-Solà; R C Kessler; J M Haro; J Alonso Journal: Epidemiol Psychiatr Sci Date: 2021-02-17 Impact factor: 6.892