A J Rosellini1, J Monahan2, A E Street3, S G Heeringa4, E D Hill1, M Petukhova1, B Y Reis5, N A Sampson1, P Bliese6, M Schoenbaum7, M B Stein8, R J Ursano9, R C Kessler1. 1. Department of Health Care Policy,Harvard Medical School,Boston,MA,USA. 2. School of Law,University of Virginia,Charlottesville,VA,USA. 3. National Center for PTSD,VA Boston Healthcare System,Boston,MA,USA. 4. Institute for Social Research, University of Michigan,Ann Arbor,MI,USA. 5. Predictive Medicine Group,Boston Children's Hospital and Harvard Medical School,Boston,MA,USA. 6. Darla Moore School of Business,University of South Carolina,Columbia,South Carolina,USA. 7. Office of Science Policy, Planning and Communications,National Institute of Mental Health,Bethesda,MD,USA. 8. Departments of Psychiatry and Family Medicine & Public Health,University of California San Diego,La Jolla,CA,USA. 9. Department of Psychiatry,Center for the Study of Traumatic Stress,Uniformed Services University School of Medicine,Bethesda,MD,USA.
Abstract
BACKGROUND: Although interventions exist to reduce violent crime, optimal implementation requires accurate targeting. We report the results of an attempt to develop an actuarial model using machine learning methods to predict future violent crimes among US Army soldiers. METHOD: A consolidated administrative database for all 975 057 soldiers in the US Army in 2004-2009 was created in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Of these soldiers, 5771 committed a first founded major physical violent crime (murder-manslaughter, kidnapping, aggravated arson, aggravated assault, robbery) over that time period. Temporally prior administrative records measuring socio-demographic, Army career, criminal justice, medical/pharmacy, and contextual variables were used to build an actuarial model for these crimes separately among men and women using machine learning methods (cross-validated stepwise regression, random forests, penalized regressions). The model was then validated in an independent 2011-2013 sample. RESULTS: Key predictors were indicators of disadvantaged social/socioeconomic status, early career stage, prior crime, and mental disorder treatment. Area under the receiver-operating characteristic curve was 0.80-0.82 in 2004-2009 and 0.77 in the 2011-2013 validation sample. Of all administratively recorded crimes, 36.2-33.1% (male-female) were committed by the 5% of soldiers having the highest predicted risk in 2004-2009 and an even higher proportion (50.5%) in the 2011-2013 validation sample. CONCLUSIONS: Although these results suggest that the models could be used to target soldiers at high risk of violent crime perpetration for preventive interventions, final implementation decisions would require further validation and weighing of predicted effectiveness against intervention costs and competing risks.
BACKGROUND: Although interventions exist to reduce violent crime, optimal implementation requires accurate targeting. We report the results of an attempt to develop an actuarial model using machine learning methods to predict future violent crimes among US Army soldiers. METHOD: A consolidated administrative database for all 975 057 soldiers in the US Army in 2004-2009 was created in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Of these soldiers, 5771 committed a first founded major physical violent crime (murder-manslaughter, kidnapping, aggravated arson, aggravated assault, robbery) over that time period. Temporally prior administrative records measuring socio-demographic, Army career, criminal justice, medical/pharmacy, and contextual variables were used to build an actuarial model for these crimes separately among men and women using machine learning methods (cross-validated stepwise regression, random forests, penalized regressions). The model was then validated in an independent 2011-2013 sample. RESULTS: Key predictors were indicators of disadvantaged social/socioeconomic status, early career stage, prior crime, and mental disorder treatment. Area under the receiver-operating characteristic curve was 0.80-0.82 in 2004-2009 and 0.77 in the 2011-2013 validation sample. Of all administratively recorded crimes, 36.2-33.1% (male-female) were committed by the 5% of soldiers having the highest predicted risk in 2004-2009 and an even higher proportion (50.5%) in the 2011-2013 validation sample. CONCLUSIONS: Although these results suggest that the models could be used to target soldiers at high risk of violent crime perpetration for preventive interventions, final implementation decisions would require further validation and weighing of predicted effectiveness against intervention costs and competing risks.
Entities:
Keywords:
Actuarial model; crime perpetration; machine learning; military violence; physical violence; risk model
Authors: Amy M Millikan; Michael R Bell; M Shayne Gallaway; Maureen T Lagana; Anthony L Cox; Michael G Sweda Journal: Mil Med Date: 2012-04 Impact factor: 1.437
Authors: Robert J Ursano; Lisa J Colpe; Steven G Heeringa; Ronald C Kessler; Michael Schoenbaum; Murray B Stein Journal: Psychiatry Date: 2014 Impact factor: 2.458
Authors: Eric B Elbogen; Michelle Cueva; H Ryan Wagner; Shoba Sreenivasan; Mira Brancu; Jean C Beckham; Lynn Van Male Journal: Am J Psychiatry Date: 2014-07 Impact factor: 18.112
Authors: Amy E Street; Anthony J Rosellini; Robert J Ursano; Steven G Heeringa; Eric D Hill; John Monahan; James A Naifeh; Maria V Petukhova; Ben Y Reis; Nancy A Sampson; Paul D Bliese; Murray B Stein; Alan M Zaslavsky; Ronald C Kessler Journal: Clin Psychol Sci Date: 2016-07-29
Authors: Eric B Elbogen; H Ryan Wagner; Nathan A Kimbrel; Mira Brancu; Jennifer Naylor; Robert Graziano; Eric Crawford Journal: Psychol Assess Date: 2017-06-19
Authors: Anthony J Rosellini; John Monahan; Amy E Street; Eric D Hill; Maria Petukhova; Ben Y Reis; Nancy A Sampson; David M Benedek; Paul Bliese; Murray B Stein; Robert J Ursano; Ronald C Kessler Journal: J Psychiatr Res Date: 2016-09-30 Impact factor: 4.791
Authors: Anthony J Rosellini; John Monahan; Amy E Street; Maria V Petukhova; Nancy A Sampson; David M Benedek; Paul Bliese; Murray B Stein; Robert J Ursano; Ronald C Kessler Journal: Am J Prev Med Date: 2017-08-14 Impact factor: 5.043
Authors: A J Rosellini; M B Stein; D M Benedek; P D Bliese; W T Chiu; I Hwang; J Monahan; M K Nock; M V Petukhova; N A Sampson; A E Street; A M Zaslavsky; R J Ursano; R C Kessler Journal: Psychol Med Date: 2017-04-04 Impact factor: 7.723
Authors: Robert J Ursano; Ronald C Kessler; James A Naifeh; Holly B Herberman Mash; Matthew K Nock; Pablo A Aliaga; Carol S Fullerton; Gary H Wynn; Tsz Hin H Ng; Hieu M Dinh; Nancy A Sampson; Tzu-Cheg Kao; Steven G Heeringa; Murray B Stein Journal: JAMA Psychiatry Date: 2018-10-01 Impact factor: 21.596
Authors: Kelly L Zuromski; Samantha L Bernecker; Carol Chu; Chelsey R Wilks; Peter M Gutierrez; Thomas E Joiner; Howard Liu; James A Naifeh; Matthew K Nock; Nancy A Sampson; Alan M Zaslavsky; Murray B Stein; Robert J Ursano; Ronald C Kessler Journal: J Psychiatr Res Date: 2019-12-07 Impact factor: 4.791