Eric M Schmidt1,2, Shalini Gupta1, Thomas Bowe1, Laura S Ellerbe1, Tyler E Phelps1, John W Finney1, Steven M Asch1, Keith Humphreys1, Jodie Trafton1,3, Megan Vanneman1,2, Alex H S Harris1. 1. a Center for Innovation to Implementation (Ci2i) , VA Palo Alto Health Care System , Menlo Park , California , USA. 2. b Center for Health Policy/Primary Care and Outcomes Research (CHP/PCOR) and the Division of General Medical Disciplines , Stanford , California , USA. 3. c Program Evaluation and Resource Center , Office of Mental Health Operations, VA Palo Alto Health Care System , Menlo Park , California , USA.
Abstract
BACKGROUND: Measures of substance use disorder (SUD) treatment quality are essential tools for performance improvement. The Veterans Health Administration (VHA) developed a measure of access to and engagement in intensive outpatient programs (IOPs) for SUD. However, predictive validity, or associations between this measure and treatment outcomes, has not been examined. METHODS: Data on veterans with SUD came from 3 samples: the Outcomes Monitoring Project (N = 5436), a national evaluation of VHA mental health services (N = 339,887), and patients receiving detoxification services (N = 23,572). Propensity score-weighted mixed-effects regressions modeled associations between receiving at least 1 week of IOP treatment and patient outcomes, controlling for facility-level performance and a random effect for facility. RESULTS: Propensity score weighting reduced or eliminated observable baseline differences between patient groups. Patients who accessed IOPs versus those who did not reported significantly reduced alcohol- and drug-related symptom severity, with significantly fewer past-month days drinking alcohol (b = 1.83, P < .001) and fewer past-month days intoxicated (b = 1.55, P < .001). Patients who received IOP after detoxification services had higher 6-month utilization of SUD outpatient visits (b = 2.09, P < .001), more subsequent detoxification episodes (b = 0.25, P < .001), and lower odds of 2-year mortality (odds ratio [OR] = 0.68, 95% confidence interval [CI]: 0.61-0.75; P < .001). CONCLUSIONS: Receiving at least 1 week of SUD treatment in an IOP was associated with higher follow-up utilization, improved health outcomes, and reduced mortality. These associations lend support to the predictive validity of VHA's IOP quality measure. Future research should focus on measure feasibility and validity outside of VHA, and whether predictive validity is maintained once this quality measure is tied to performance incentives.
BACKGROUND: Measures of substance use disorder (SUD) treatment quality are essential tools for performance improvement. The Veterans Health Administration (VHA) developed a measure of access to and engagement in intensive outpatient programs (IOPs) for SUD. However, predictive validity, or associations between this measure and treatment outcomes, has not been examined. METHODS: Data on veterans with SUD came from 3 samples: the Outcomes Monitoring Project (N = 5436), a national evaluation of VHA mental health services (N = 339,887), and patients receiving detoxification services (N = 23,572). Propensity score-weighted mixed-effects regressions modeled associations between receiving at least 1 week of IOP treatment and patient outcomes, controlling for facility-level performance and a random effect for facility. RESULTS: Propensity score weighting reduced or eliminated observable baseline differences between patient groups. Patients who accessed IOPs versus those who did not reported significantly reduced alcohol- and drug-related symptom severity, with significantly fewer past-month days drinking alcohol (b = 1.83, P < .001) and fewer past-month days intoxicated (b = 1.55, P < .001). Patients who received IOP after detoxification services had higher 6-month utilization of SUD outpatient visits (b = 2.09, P < .001), more subsequent detoxification episodes (b = 0.25, P < .001), and lower odds of 2-year mortality (odds ratio [OR] = 0.68, 95% confidence interval [CI]: 0.61-0.75; P < .001). CONCLUSIONS: Receiving at least 1 week of SUD treatment in an IOP was associated with higher follow-up utilization, improved health outcomes, and reduced mortality. These associations lend support to the predictive validity of VHA's IOP quality measure. Future research should focus on measure feasibility and validity outside of VHA, and whether predictive validity is maintained once this quality measure is tied to performance incentives.
Authors: Meredith G Harris; Chrianna Bharat; Meyer D Glantz; Nancy A Sampson; Ali Al-Hamzawi; Jordi Alonso; Ronny Bruffaerts; José Miguel Caldas de Almeida; Alfredo H Cia; Giovanni de Girolamo; Silvia Florescu; Oye Gureje; Josep Maria Haro; Hristo Hinkov; Elie G Karam; Georges Karam; Sing Lee; Jean-Pierre Lépine; Daphna Levinson; Victor Makanjuola; John McGrath; Zeina Mneimneh; Fernando Navarro-Mateu; Marina Piazza; José Posada-Villa; Charlene Rapsey; Hisateru Tachimori; Margreet Ten Have; Yolanda Torres; Maria Carmen Viana; Somnath Chatterji; Alan M Zaslavsky; Ronald C Kessler; Louisa Degenhardt Journal: Addiction Date: 2019-06-02 Impact factor: 6.526
Authors: Amy M Kilbourne; Kathryn Beck; Brigitta Spaeth-Rublee; Parashar Ramanuj; Robert W O'Brien; Naomi Tomoyasu; Harold Alan Pincus Journal: World Psychiatry Date: 2018-02 Impact factor: 49.548
Authors: Steven L Proctor; Brittney Gursky-Landa; Jacob T Kannarkat; Johnny Guimaraes; John W Newcomer Journal: J Behav Health Serv Res Date: 2022-02-22 Impact factor: 1.475