Zachary Bouck1,2, Andrea C Tricco3,4, Laura C Rosella1,5, Vicki Ling5, Tara Gomes5,6, Mina Tadrous6,7, Matthew P Fox8,9, Ayden I Scheim2,10, Dan Werb2,3,11. 1. From the Epidemiology Division, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada. 2. Centre on Drug Policy Evaluation, St. Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada. 3. Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada. 4. Knowledge Translation Program, St. Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada. 5. ICES, Toronto, ON, Canada. 6. Ontario Drug Policy Research Network, Toronto, ON, Canada. 7. Women's College Research Institute, Women's College Hospital, Toronto, ON, Canada. 8. Department of Epidemiology, Boston University School of Public Health, Boston, MA. 9. Department of Global Health, Boston University School of Public Health, Boston, MA. 10. Dornsife School of Public Health, Drexel University, Philadelphia, PA. 11. Division of Infectious Diseases and Global Public Health, University of California San Diego, La Jolla, CA.
Abstract
BACKGROUND: Studies of people who inject drugs (PWID) commonly use questionnaires to determine whether participants are currently, or have recently been, on opioid agonist treatment for opioid use disorder. However, these previously unvalidated self-reported treatment measures may be susceptible to inaccurate reporting. METHODS: We linked baseline questionnaire data from 521 PWID in the Ontario integrated Supervised Injection Services cohort in Toronto (November 2018-March 2020) with record-level health administrative data. We assessed the validity (sensitivity, specificity, positive and negative predictive value [PPV and NPV]) of self-reported recent (in the past 6 months) and current (as of interview) opioid agonist treatment with methadone or buprenorphine-naloxone relative to prescription dispensation records from a provincial narcotics monitoring system, considered the reference standard. RESULTS: For self-reported recent opioid agonist treatment, sensitivity was 78% (95% CI = 72, 83), specificity was 90% (95% CI = 86, 94), PPV was 90% (95% CI = 85, 93), and NPV was 79% (95% CI = 74, 84). For self-reported current opioid agonist treatment, sensitivity was 84% (95% CI = 78, 90), specificity was 87% (95% CI = 83, 91), PPV was 74% (95% CI = 67, 81), and NPV was 93% (95% CI = 89, 95). CONCLUSIONS: Self-reported opioid agonist treatment measures were fairly accurate among PWID, with some exceptions. Inaccurate recall due to a lengthy lookback window may explain underreporting of recent treatment, whereas social desirability bias may have led to overreporting of current treatment. These validation data could be used in future studies of PWID to adjust for misclassification in similar self-reported treatment measures.
BACKGROUND: Studies of people who inject drugs (PWID) commonly use questionnaires to determine whether participants are currently, or have recently been, on opioid agonist treatment for opioid use disorder. However, these previously unvalidated self-reported treatment measures may be susceptible to inaccurate reporting. METHODS: We linked baseline questionnaire data from 521 PWID in the Ontario integrated Supervised Injection Services cohort in Toronto (November 2018-March 2020) with record-level health administrative data. We assessed the validity (sensitivity, specificity, positive and negative predictive value [PPV and NPV]) of self-reported recent (in the past 6 months) and current (as of interview) opioid agonist treatment with methadone or buprenorphine-naloxone relative to prescription dispensation records from a provincial narcotics monitoring system, considered the reference standard. RESULTS: For self-reported recent opioid agonist treatment, sensitivity was 78% (95% CI = 72, 83), specificity was 90% (95% CI = 86, 94), PPV was 90% (95% CI = 85, 93), and NPV was 79% (95% CI = 74, 84). For self-reported current opioid agonist treatment, sensitivity was 84% (95% CI = 78, 90), specificity was 87% (95% CI = 83, 91), PPV was 74% (95% CI = 67, 81), and NPV was 93% (95% CI = 89, 95). CONCLUSIONS: Self-reported opioid agonist treatment measures were fairly accurate among PWID, with some exceptions. Inaccurate recall due to a lengthy lookback window may explain underreporting of recent treatment, whereas social desirability bias may have led to overreporting of current treatment. These validation data could be used in future studies of PWID to adjust for misclassification in similar self-reported treatment measures.