Mohammod Mostazir1, Rod S Taylor2, William Henley2, Ed Watkins3. 1. College of life and Environmental Sciences (CLES), University of Exeter, EX4 4QG, Exeter, United Kingdom. Electronic address: m.mostazir@exeter.ac.uk. 2. Institute of Health Research, University of Exeter Medical School, University of Exeter, EX1 2LU, Exeter, United Kingdom. 3. Mood Disorders Research, School of Psychology, College of Life & Environmental Sciences, University of Exeter, EX4 4QG, Exeter, United Kingdom.
Abstract
OBJECTIVE: To undertake a methodological review of statistical methods used in randomized controlled trials (RCTs) for handling intervention nonadherence. STUDY DESIGN AND SETTING: Bibliographic databases were searched using predefined search terms. RESULTS: A substantive number of identified studies (56%) were excluded as they only used naive per protocol analysis for handling nonadherence. Our review included 58 articles published between 1991 and 2015. A total of 88 methodological applications were made by these studies. The two most used methods were complier average causal effect (56%) and instrumental variable (23%) predominantly with the use of maximum likelihood (ML) estimators. These alternative applications typically produced treatment effects greater than the intention-to-treat effect but as their standard errors were larger there was no statistical difference between the methods. CONCLUSION: A substantive proportion of RCTs rely on naive per protocol for handling nonadherence. Recent years have seen an increasing number of applications of more appropriate statistical methods, in particular complier average causal effect and instrumental variable methods. However, these later methods rely on strong underlying assumptions that may be vulnerable to violation. More empirical studies are needed that directly compare the usability and performance of different statistical methods for nonadherence in RCTs.
OBJECTIVE: To undertake a methodological review of statistical methods used in randomized controlled trials (RCTs) for handling intervention nonadherence. STUDY DESIGN AND SETTING: Bibliographic databases were searched using predefined search terms. RESULTS: A substantive number of identified studies (56%) were excluded as they only used naive per protocol analysis for handling nonadherence. Our review included 58 articles published between 1991 and 2015. A total of 88 methodological applications were made by these studies. The two most used methods were complier average causal effect (56%) and instrumental variable (23%) predominantly with the use of maximum likelihood (ML) estimators. These alternative applications typically produced treatment effects greater than the intention-to-treat effect but as their standard errors were larger there was no statistical difference between the methods. CONCLUSION: A substantive proportion of RCTs rely on naive per protocol for handling nonadherence. Recent years have seen an increasing number of applications of more appropriate statistical methods, in particular complier average causal effect and instrumental variable methods. However, these later methods rely on strong underlying assumptions that may be vulnerable to violation. More empirical studies are needed that directly compare the usability and performance of different statistical methods for nonadherence in RCTs.
Authors: Thomas M Wassenaar; Wilby Williamson; Heidi Johansen-Berg; Helen Dawes; Nia Roberts; Charlie Foster; Claire E Sexton Journal: Int J Behav Nutr Phys Act Date: 2020-06-22 Impact factor: 6.457
Authors: Abualbishr Alshreef; Nicholas Latimer; Paul Tappenden; Ruth Wong; Dyfrig Hughes; James Fotheringham; Simon Dixon Journal: Med Decis Making Date: 2019-10-24 Impact factor: 2.583
Authors: Matthew Dodd; Katherine Fielding; James R Carpenter; Jennifer A Thompson; Diana Elbourne Journal: BMJ Open Date: 2022-01-12 Impact factor: 2.692