Ross L Peterson1, Joseph S Koopmeiners1, Tracy T Smith2, Sharon E Murphy3, Eric C Donny4, David M Vock1. 1. Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN, USA. 2. Division of Addiction Sciences, Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA. 3. Department of Biochemistry, Molecular Biology and Biophysics and Masonic Cancer Center, University of Minnesota, Minneapolis, MN, USA. 4. Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA.
Abstract
INTRODUCTION: Participant noncompliance, in which participants do not follow their assigned treatment protocol, has long complicated the interpretation of randomized clinical trials. No gold standard has been identified for detecting noncompliance, but in some trials participants' biomarkers can provide objective information that suggests exposure to non-study treatments. However, existing methods are limited to retrospectively detecting noncompliance at a single time point based on a single biomarker measurement. We propose a novel method that can leverage participants' full biomarker history to detect noncompliance across multiple time points. Conditional on longitudinal biomarker data, our method can estimate the probability of compliance at (1) a single time point of the trial, (2) all time points, and (3) a future time point. METHODS: Across time points, we model the biomarker as a mixture density with (latent) components corresponding to longitudinal patterns of compliance. To estimate the mixture density, we fit mixed effects models for both compliance and the biomarker. We use the mixture density to derive compliance probabilities that condition on the longitudinal biomarker data. We evaluate our compliance probabilities by simulation and apply them to a trial in which current smokers were asked to only smoke low nicotine study cigarettes (Center for the Evaluation of Nicotine in Cigarettes Project 1 Study 2). In the simulation, we investigated three different effects of compliance on the biomarker, as well as the effect of misspecification of the covariance structures. We compared probability estimators (1) and (2) to those that ignore the longitudinal correlation in the data according to area under the receiver operating characteristic curve. We evaluated estimator (3) by plotting its calibration lines. For Center for the Evaluation of Nicotine in Cigarettes Project 1 Study 2, we compared estimators (1) and (3) to a probability estimator of compliance at the last time point that ignores the longitudinal correlation. RESULTS: In the simulation, for both compliance at the last time point and at all time points, conditioning on the longitudinal biomarker data uniformly raised area under the receiver operating characteristic curve across all three compliance effect scenarios. The gains in area under the receiver operating characteristic curve were smaller under misspecification. The calibration lines for the prediction of compliance closely followed 45°, though with additional variability under misspecification. For compliance at the last time point of Center for the Evaluation of Nicotine in Cigarettes Project 1 Study 2, conditioning on participants' full biomarker history boosted area under the receiver operating characteristic curve by three percentage points. The prediction probabilities somewhat accurately approximated the non-longitudinal compliance probabilities. DISCUSSION: Compared to existing methods that only use a single biomarker measurement, our method can account for the longitudinal correlation in the biomarker and compliance to more accurately identify noncompliant participants. Our method can also use participants' biomarker history to predict compliance at a future time point.
INTRODUCTION: Participant noncompliance, in which participants do not follow their assigned treatment protocol, has long complicated the interpretation of randomized clinical trials. No gold standard has been identified for detecting noncompliance, but in some trials participants' biomarkers can provide objective information that suggests exposure to non-study treatments. However, existing methods are limited to retrospectively detecting noncompliance at a single time point based on a single biomarker measurement. We propose a novel method that can leverage participants' full biomarker history to detect noncompliance across multiple time points. Conditional on longitudinal biomarker data, our method can estimate the probability of compliance at (1) a single time point of the trial, (2) all time points, and (3) a future time point. METHODS: Across time points, we model the biomarker as a mixture density with (latent) components corresponding to longitudinal patterns of compliance. To estimate the mixture density, we fit mixed effects models for both compliance and the biomarker. We use the mixture density to derive compliance probabilities that condition on the longitudinal biomarker data. We evaluate our compliance probabilities by simulation and apply them to a trial in which current smokers were asked to only smoke low nicotine study cigarettes (Center for the Evaluation of Nicotine in Cigarettes Project 1 Study 2). In the simulation, we investigated three different effects of compliance on the biomarker, as well as the effect of misspecification of the covariance structures. We compared probability estimators (1) and (2) to those that ignore the longitudinal correlation in the data according to area under the receiver operating characteristic curve. We evaluated estimator (3) by plotting its calibration lines. For Center for the Evaluation of Nicotine in Cigarettes Project 1 Study 2, we compared estimators (1) and (3) to a probability estimator of compliance at the last time point that ignores the longitudinal correlation. RESULTS: In the simulation, for both compliance at the last time point and at all time points, conditioning on the longitudinal biomarker data uniformly raised area under the receiver operating characteristic curve across all three compliance effect scenarios. The gains in area under the receiver operating characteristic curve were smaller under misspecification. The calibration lines for the prediction of compliance closely followed 45°, though with additional variability under misspecification. For compliance at the last time point of Center for the Evaluation of Nicotine in Cigarettes Project 1 Study 2, conditioning on participants' full biomarker history boosted area under the receiver operating characteristic curve by three percentage points. The prediction probabilities somewhat accurately approximated the non-longitudinal compliance probabilities. DISCUSSION: Compared to existing methods that only use a single biomarker measurement, our method can account for the longitudinal correlation in the biomarker and compliance to more accurately identify noncompliant participants. Our method can also use participants' biomarker history to predict compliance at a future time point.
Authors: Dorothy K Hatsukami; Xianghua Luo; Joni A Jensen; Mustafa al'Absi; Sharon S Allen; Steven G Carmella; Menglan Chen; Paul M Cinciripini; Rachel Denlinger-Apte; David J Drobes; Joseph S Koopmeiners; Tonya Lane; Chap T Le; Scott Leischow; Kai Luo; F Joseph McClernon; Sharon E Murphy; Viviana Paiano; Jason D Robinson; Herbert Severson; Christopher Sipe; Andrew A Strasser; Lori G Strayer; Mei Kuen Tang; Ryan Vandrey; Stephen S Hecht; Neal L Benowitz; Eric C Donny Journal: JAMA Date: 2018-09-04 Impact factor: 56.272
Authors: Tracy T Smith; Joseph S Koopmeiners; Katelyn M Tessier; Esa M Davis; Cynthia A Conklin; Rachel L Denlinger-Apte; Tonya Lane; Sharon E Murphy; Jennifer W Tidey; Dorothy K Hatsukami; Eric C Donny Journal: Am J Prev Med Date: 2019-10 Impact factor: 5.043