Charles Marks1, Daniela Abramovitz2, Christl A Donnelly3, Gabriel Carrasco-Escobar4, Rocío Carrasco-Hernández2, Daniel Ciccarone5, Arturo González-Izquierdo6, Natasha K Martin7, Steffanie A Strathdee2, Davey M Smith2, Annick Bórquez2. 1. Interdisciplinary Research on Substance Use Joint Doctoral Program, San Diego State University and University of California, San Diego, CA, USA. Electronic address: cmarks@sdsu.edu. 2. Department of Medicine, University of California, San Diego, CA, USA. 3. Department of Statistics, University of Oxford, Oxford, UK; MRC Centre for Global Infectious Disease Analysis, Department of Infectious Disease Epidemiology, Imperial College London, London, UK. 4. Department of Medicine, University of California, San Diego, CA, USA; Health Innovation Lab, Institute of Tropical Medicine "Alexander von Humboldt", Universidad Peruana Cayetano Heredia, Lima, Peru. 5. Department of Family and Community Medicine, University of California, San Francisco, CA, USA. 6. Institute of Health Informatics, University College London, London, UK. 7. Department of Medicine, University of California, San Diego, CA, USA; Population Health Sciences, University of Bristol, Bristol, UK.
Abstract
BACKGROUND: The emergence of fentanyl around 2013 represented a new, deadly stage of the opioid epidemic in the USA. We aimed to develop a statistical regression approach to identify counties at the highest risk of high overdose mortality in the subsequent years by predicting annual county-level overdose death rates across the contiguous USA and to validate our approach against observed overdose mortality data collected between 2013 and 2018. METHODS: We fit mixed-effects negative binomial regression models to predict overdose death rates in the subsequent year for 2013-18 for all contiguous state counties in the USA (ie, excluding Alaska and Hawaii). We used publicly available county-level data related to health-care access, drug markets, socio-demographics, and the geographical spread of opioid overdose as model predictors. The crude number of county-level overdose deaths was extracted from restricted US Centers for Disease Control and Prevention mortality records. To predict county-level overdose rates for the year 201X: (1) a model was trained on county-level predictor data for the years 2010-201(X-2) paired with county-level overdose deaths for the year 2011-201(X-1); (2) county-level predictor data for the year 201(X-1) was fed into the model to predict the 201X county-level crude number of overdose deaths; and (3) the latter were converted to a population-adjusted rate. For comparison, we generated a benchmark set of predictions by applying the observed slope of change in overdose death rates in the previous year to 201(X-1) rates. To assess the predictive performance of the model, we compared predicted values (of both the model and benchmark) to observed values by (1) calculating the mean average error, root mean squared error, and Spearman's correlation coefficient and (2) assessing the proportion of counties in the top decile (10%) of overdose death rates that were correctly predicted as such. Finally, in a post-hoc analysis, we sought to identify variables with greatest predictive utility. FINDINGS: Between 2013 and 2018, among the 3106 US counties included, our modelling approach outperformed the benchmark strategy across all metrics. The observed average county-level overdose death rate rose from 11·8 per 100 000 people in 2013 to 15·4 in 2017 before falling to 14·6 in 2018. Our negative binomal modelling approach similarly identified an increasing trend, predicting an average 11·8 deaths per 100 000 in 2013, up to 15·1 in 2017, and increasing further to 16·4 in 2018. The benchmark model over-predicted average death rates each year, ranging from 13·0 per 100 000 in 2013 to 18·3 in 2018. Our modelling approach successfully ranked counties by overdose death rate identifying between 42% and 57% of counties in the top decile of overdose mortality (compared with 29% and 43% using the benchmark) each year and identified 194 of the 808 counties with emergent overdose outbreaks (ie, newly entered the top decile) across the study period, versus 31 using the benchmark. In the post-hoc analysis, we identified geospatial proximity of overdose in nearby counties, opioid prescription rate, presence of an urgent care facility, and several economic indicators as the variables with the greatest predictive utility. INTERPRETATION: Our model shows that a regression approach can effectively predict county-level overdose death rates and serve as a risk assessment tool to identify future high mortality counties throughout an emerging drug use epidemic. FUNDING: National Institute on Drug Abuse.
BACKGROUND: The emergence of fentanyl around 2013 represented a new, deadly stage of the opioid epidemic in the USA. We aimed to develop a statistical regression approach to identify counties at the highest risk of high overdose mortality in the subsequent years by predicting annual county-level overdose death rates across the contiguous USA and to validate our approach against observed overdose mortality data collected between 2013 and 2018. METHODS: We fit mixed-effects negative binomial regression models to predict overdose death rates in the subsequent year for 2013-18 for all contiguous state counties in the USA (ie, excluding Alaska and Hawaii). We used publicly available county-level data related to health-care access, drug markets, socio-demographics, and the geographical spread of opioid overdose as model predictors. The crude number of county-level overdose deaths was extracted from restricted US Centers for Disease Control and Prevention mortality records. To predict county-level overdose rates for the year 201X: (1) a model was trained on county-level predictor data for the years 2010-201(X-2) paired with county-level overdose deaths for the year 2011-201(X-1); (2) county-level predictor data for the year 201(X-1) was fed into the model to predict the 201X county-level crude number of overdose deaths; and (3) the latter were converted to a population-adjusted rate. For comparison, we generated a benchmark set of predictions by applying the observed slope of change in overdose death rates in the previous year to 201(X-1) rates. To assess the predictive performance of the model, we compared predicted values (of both the model and benchmark) to observed values by (1) calculating the mean average error, root mean squared error, and Spearman's correlation coefficient and (2) assessing the proportion of counties in the top decile (10%) of overdose death rates that were correctly predicted as such. Finally, in a post-hoc analysis, we sought to identify variables with greatest predictive utility. FINDINGS: Between 2013 and 2018, among the 3106 US counties included, our modelling approach outperformed the benchmark strategy across all metrics. The observed average county-level overdose death rate rose from 11·8 per 100 000 people in 2013 to 15·4 in 2017 before falling to 14·6 in 2018. Our negative binomal modelling approach similarly identified an increasing trend, predicting an average 11·8 deaths per 100 000 in 2013, up to 15·1 in 2017, and increasing further to 16·4 in 2018. The benchmark model over-predicted average death rates each year, ranging from 13·0 per 100 000 in 2013 to 18·3 in 2018. Our modelling approach successfully ranked counties by overdose death rate identifying between 42% and 57% of counties in the top decile of overdose mortality (compared with 29% and 43% using the benchmark) each year and identified 194 of the 808 counties with emergent overdose outbreaks (ie, newly entered the top decile) across the study period, versus 31 using the benchmark. In the post-hoc analysis, we identified geospatial proximity of overdose in nearby counties, opioid prescription rate, presence of an urgent care facility, and several economic indicators as the variables with the greatest predictive utility. INTERPRETATION: Our model shows that a regression approach can effectively predict county-level overdose death rates and serve as a risk assessment tool to identify future high mortality counties throughout an emerging drug use epidemic. FUNDING: National Institute on Drug Abuse.
Authors: Svetla Slavova; Daniella Bradley O'Brien; Kathleen Creppage; Dan Dao; Anna Fondario; Elizabeth Haile; Beth Hume; Thomas W Largo; Claire Nguyen; Jennifer C Sabel; Dagan Wright Journal: Public Health Rep Date: 2015 Jul-Aug Impact factor: 2.792
Authors: Hawre Jalal; Jeanine M Buchanich; Mark S Roberts; Lauren C Balmert; Kun Zhang; Donald S Burke Journal: Science Date: 2018-09-21 Impact factor: 47.728
Authors: Chelsea L Shover; Titilola O Falasinnu; Candice L Dwyer; Nayelie Benitez Santos; Nicole J Cunningham; Rohan B Freedman; Noel A Vest; Keith Humphreys Journal: Drug Alcohol Depend Date: 2020-09-28 Impact factor: 4.492
Authors: Barbara Tempalski; Leslie D Williams; Marynia Kolak; Danielle C Ompad; Julia Koschinsky; Sara L McLafferty Journal: J Urban Health Date: 2022-06-07 Impact factor: 5.801
Authors: Karli R Hochstatter; Sonal Rastogi; Kathryn Klein; Cameron Tait-Ozer; Nabila El-Bassel; Jason Graham Journal: BMC Public Health Date: 2022-07-08 Impact factor: 4.135