Nicole M Wagner1, Ingrid A Binswanger2, Susan M Shetterly3, Deborah J Rinehart4, Kris F Wain5, Christian Hopfer6, Jason M Glanz7. 1. Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus, 13199 E Montview Blvd, Suite 300, Aurora, CO, 80045, USA; Institute for Health Research, Kaiser Permanente Colorado, 2550 S. Parker Road, Suite 200, Aurora, CO, 80014, USA. Electronic address: Nicole.Wagner@cuanschutz.edu. 2. Institute for Health Research, Kaiser Permanente Colorado, 2550 S. Parker Road, Suite 200, Aurora, CO, 80014, USA; Colorado Permanente Medical Group, P.C., 10350 E. Dakota Ave., Denver, CO, 80247, USA; Division of General Internal Medicine, School of Medicine, University of Colorado Anschutz Medical Campus, 12631 E 17thAve., Aurora, CO, 80045, USA. Electronic address: Ingrid.A.Binswanger@kp.org. 3. Institute for Health Research, Kaiser Permanente Colorado, 2550 S. Parker Road, Suite 200, Aurora, CO, 80014, USA. Electronic address: Susan.Shetterly@kp.org. 4. Division of General Internal Medicine, School of Medicine, University of Colorado Anschutz Medical Campus, 12631 E 17thAve., Aurora, CO, 80045, USA; Center for Health Systems Research, Denver Health Hospital and Authority, 777 Bannock St., M.C 6551, Denver, CO, 80204, USA. Electronic address: Deborah.Rinehart@dhha.org. 5. Institute for Health Research, Kaiser Permanente Colorado, 2550 S. Parker Road, Suite 200, Aurora, CO, 80014, USA. Electronic address: Kris.F.Wain@kp.org. 6. Department of Psychiatry, School of Medicine, University of Colorado Anschutz, 13001 East 17thPlace, Q20-C2000, Aurora, CO, 80045, USA. Electronic address: Christian.Hopfer@cuanschutz.edu. 7. Institute for Health Research, Kaiser Permanente Colorado, 2550 S. Parker Road, Suite 200, Aurora, CO, 80014, USA; Department of Epidemiology, University of Colorado School of Public Health, 13001 East 17thPlace, 3rd Floor, Aurora, CO, 80045, USA. Electronic address: Jason.M.Glanz@kp.org.
Abstract
BACKGROUND: Youth are vulnerable to opioid use initiation and its complications. With growing rates of opioid overdose, strategies to identify youth at risk of opioid use disorder (OUD) to efficiently focus prevention interventions are needed. This study developed and validated a prediction model of OUD in youth aged 14-18 years. METHODS: The model was developed in a Colorado healthcare system (derivation site) using Cox proportional hazards regression analysis. Model predictors and outcomes were identified using electronic health record data. The model was externally validated in a separate Denver safety net health system (validation site). Youth were followed for up to 3.5 years. We evaluated internal and external validity using discrimination and calibration. RESULTS: The derivation cohort included 76,603 youth, of whom 108 developed an OUD diagnosis. The model contained 3 predictors (smoking status, mental health diagnosis, and non-opioid substance use or disorder) and demonstrated good calibration (p = 0.90) and discrimination (bootstrap-corrected C-statistic = 0.76: 95 % CI = 0.70, 0.82). Sensitivity and specificity were 57 % and 84 % respectively with a positive predictive value (PPV) of 0.49 %. The validation cohort included 45,790 youth of whom, 74 developed an OUD diagnoses. The model demonstrated poorer calibration (p < 0.001) but good discrimination (C-statistic = 0.89; 95 % CI = 0.84, 0.95), sensitivity of 87.8 % specificity of 68.6 %, and PPV of 0.45 %. CONCLUSIONS: In two Colorado healthcare systems, the prediction model identified 57-88 % of subsequent OUD diagnoses in youth. However, PPV < 1% suggests universal prevention strategies for opioid use in youth may be the best health system approach.
BACKGROUND: Youth are vulnerable to opioid use initiation and its complications. With growing rates of opioid overdose, strategies to identify youth at risk of opioid use disorder (OUD) to efficiently focus prevention interventions are needed. This study developed and validated a prediction model of OUD in youth aged 14-18 years. METHODS: The model was developed in a Colorado healthcare system (derivation site) using Cox proportional hazards regression analysis. Model predictors and outcomes were identified using electronic health record data. The model was externally validated in a separate Denver safety net health system (validation site). Youth were followed for up to 3.5 years. We evaluated internal and external validity using discrimination and calibration. RESULTS: The derivation cohort included 76,603 youth, of whom 108 developed an OUD diagnosis. The model contained 3 predictors (smoking status, mental health diagnosis, and non-opioid substance use or disorder) and demonstrated good calibration (p = 0.90) and discrimination (bootstrap-corrected C-statistic = 0.76: 95 % CI = 0.70, 0.82). Sensitivity and specificity were 57 % and 84 % respectively with a positive predictive value (PPV) of 0.49 %. The validation cohort included 45,790 youth of whom, 74 developed an OUD diagnoses. The model demonstrated poorer calibration (p < 0.001) but good discrimination (C-statistic = 0.89; 95 % CI = 0.84, 0.95), sensitivity of 87.8 % specificity of 68.6 %, and PPV of 0.45 %. CONCLUSIONS: In two Colorado healthcare systems, the prediction model identified 57-88 % of subsequent OUD diagnoses in youth. However, PPV < 1% suggests universal prevention strategies for opioid use in youth may be the best health system approach.
Authors: Avik Chatterjee; Marc R Larochelle; Ziming Xuan; Na Wang; Dana Bernson; Michael Silverstein; Scott E Hadland; Thomas Land; Jeffrey H Samet; Alexander Y Walley; Sarah M Bagley Journal: Drug Alcohol Depend Date: 2018-10-25 Impact factor: 4.492
Authors: Shari Van Hook; Sion Kim Harris; Traci Brooks; Peggy Carey; Robert Kossack; John Kulig; John R Knight Journal: J Adolesc Health Date: 2007-02-15 Impact factor: 5.012
Authors: Timothy R Hylan; Michael Von Korff; Kathleen Saunders; Elizabeth Masters; Roy E Palmer; David Carrell; David Cronkite; Jack Mardekian; David Gross Journal: J Pain Date: 2015-01-29 Impact factor: 5.820
Authors: Scott E Hadland; J Frank Wharam; Mark A Schuster; Fang Zhang; Jeffrey H Samet; Marc R Larochelle Journal: JAMA Pediatr Date: 2017-08-01 Impact factor: 16.193
Authors: Amy S B Bohnert; Marcia Valenstein; Matthew J Bair; Dara Ganoczy; John F McCarthy; Mark A Ilgen; Frederic C Blow Journal: JAMA Date: 2011-04-06 Impact factor: 56.272
Authors: Leonieke C van Boekel; Evelien P M Brouwers; Jaap van Weeghel; Henk F L Garretsen Journal: Drug Alcohol Depend Date: 2013-03-13 Impact factor: 4.492