Danielle E Jake-Schoffman1, Susan D Brown2, Michael Baiocchi3, Jessica L Bibeau4, Jennifer Daubenmier5, Assiamira Ferrara6, Maren N Galarce6, Wendy Hartogensis7, Frederick M Hecht7, Monique M Hedderson6, Patricia J Moran7, Sherry L Pagoto4, Ai-Lin Tsai6, Molly E Waring4, Michaela Kiernan8. 1. Department of Health Education & Behavior, College of Health and Human Performance, University of Florida, Gainesville, Florida. Electronic address: djakeschoffman@ufl.edu. 2. Division of Research, Kaiser Permanente Northern California, Oakland, California; Department of Internal Medicine, University of California, Davis, Sacramento, California. 3. Department of Epidemiology & Population Health, Stanford University School of Medicine, Stanford, California. 4. Department of Allied Health Sciences, College of Agriculture, Health and Natural Resources, University of Connecticut, Storrs, Connecticut. 5. The Institute for Holistic Health Studies, San Francisco State University, San Francisco, California. 6. Division of Research, Kaiser Permanente Northern California, Oakland, California. 7. UCSF Osher Center for Integrative Medicine, University of California San Francisco, San Francisco, California. 8. Stanford Prevention Research Center, Department of Medicine, Stanford University School of Medicine, Stanford, California.
Abstract
INTRODUCTION: Suboptimal and differential participant engagement in randomized trials-including retention at primary outcome assessments and attendance at intervention sessions-undermines rigor, internal validity, and trial conclusions. METHODS: First, this study describes Methods-Motivational Interviewing approach and strategies for implementation. This approach engages potential participants before randomization through interactive, prerequisite orientation sessions that illustrate the scientific rationale behind trial methods in accessible language and use motivational interviewing to diffuse ambivalence about participation. Then, this study examines the potential improvements in retention (proportion of participants assessed at follow-up visits) and attendance (e.g., mean percentage of intervention sessions attended, percentage of participants who attended 0 sessions) in 3 randomized weight-management trials that quickly added prerequisite orientations to their protocols following early signs of suboptimal or differential participant engagement (Supporting Health by Integrating Nutrition and Exercise [2009-2013, n=194]; Get Social [2016-2020, n=217]; GestationaL Weight Gain and Optimal Wellness [2014-2018, n=389]). Using a pre-post analytical design, adjusted estimates from regression models controlling for condition and assessment timepoint (analyses from 2020) are reported. RESULTS: After adding prerequisite orientations, all 3 trials attained higher participant engagement. Retention at assessments was 11.4% and 17.3% higher (Get Social and Supporting Health by Integrating Nutrition and Exercise, respectively). Mean percentage of attendance at intervention sessions was 8.8% higher (GestationaL Weight Gain and Optimal Wellness), and 10.1% fewer participants attended 0 intervention sessions (Get Social). Descriptively, all the remaining retention and attendance outcomes were consistently higher but were nonsignificant. Across the trials, adding prerequisite orientations did not impact the proportion of eligible participants enrolled or the baseline demographics. CONCLUSIONS: The Methods-Motivational Interviewing approach shows promise for increasing the rigor of randomized trials and is readily adaptable to in-person, webinar, and conference call formats. TRIAL REGISTRATION: All 3 trials are registered at www.clinicaltrials.gov (Supporting Health by Integrating Nutrition and Exercise: NCT00960414; Get Social: NCT02646618; and GestationaL Weight Gain and Optimal Wellness: NCT02130232).
INTRODUCTION: Suboptimal and differential participant engagement in randomized trials-including retention at primary outcome assessments and attendance at intervention sessions-undermines rigor, internal validity, and trial conclusions. METHODS: First, this study describes Methods-Motivational Interviewing approach and strategies for implementation. This approach engages potential participants before randomization through interactive, prerequisite orientation sessions that illustrate the scientific rationale behind trial methods in accessible language and use motivational interviewing to diffuse ambivalence about participation. Then, this study examines the potential improvements in retention (proportion of participants assessed at follow-up visits) and attendance (e.g., mean percentage of intervention sessions attended, percentage of participants who attended 0 sessions) in 3 randomized weight-management trials that quickly added prerequisite orientations to their protocols following early signs of suboptimal or differential participant engagement (Supporting Health by Integrating Nutrition and Exercise [2009-2013, n=194]; Get Social [2016-2020, n=217]; GestationaL Weight Gain and Optimal Wellness [2014-2018, n=389]). Using a pre-post analytical design, adjusted estimates from regression models controlling for condition and assessment timepoint (analyses from 2020) are reported. RESULTS: After adding prerequisite orientations, all 3 trials attained higher participant engagement. Retention at assessments was 11.4% and 17.3% higher (Get Social and Supporting Health by Integrating Nutrition and Exercise, respectively). Mean percentage of attendance at intervention sessions was 8.8% higher (GestationaL Weight Gain and Optimal Wellness), and 10.1% fewer participants attended 0 intervention sessions (Get Social). Descriptively, all the remaining retention and attendance outcomes were consistently higher but were nonsignificant. Across the trials, adding prerequisite orientations did not impact the proportion of eligible participants enrolled or the baseline demographics. CONCLUSIONS: The Methods-Motivational Interviewing approach shows promise for increasing the rigor of randomized trials and is readily adaptable to in-person, webinar, and conference call formats. TRIAL REGISTRATION: All 3 trials are registered at www.clinicaltrials.gov (Supporting Health by Integrating Nutrition and Exercise: NCT00960414; Get Social: NCT02646618; and GestationaL Weight Gain and Optimal Wellness: NCT02130232).
Authors: Michaela Kiernan; Susan D Brown; Danielle E Schoffman; Katherine Lee; Abby C King; C Barr Taylor; Nina C Schleicher; Michael G Perri Journal: J Consult Clin Psychol Date: 2012-10-29
Authors: Bonnie Spring; Angela F Pfammatter; Sara H Marchese; Tammy Stump; Christine Pellegrini; H Gene McFadden; Donald Hedeker; Juned Siddique; Neil Jordan; Linda M Collins Journal: Obesity (Silver Spring) Date: 2020-07-12 Impact factor: 5.002
Authors: Kenneth E Freedland; Abby C King; Walter T Ambrosius; Evan Mayo-Wilson; David C Mohr; Susan M Czajkowski; Lehana Thabane; Linda M Collins; George W Rebok; Shaun P Treweek; Thomas D Cook; Jack D Edinger; Catherine M Stoney; Rebecca A Campo; Deborah Young-Hyman; William T Riley Journal: J Clin Epidemiol Date: 2019-02-28 Impact factor: 6.437
Authors: Stephanie L Fitzpatrick; Robert Jeffery; Karen C Johnson; Cathy C Roche; Brent Van Dorsten; Molly Gee; Ruby Ann Johnson; Jeanne Charleston; Kathy Dotson; Michael P Walkup; Felicia Hill-Briggs; Frederick L Brancati Journal: Obesity (Silver Spring) Date: 2014-01 Impact factor: 5.002
Authors: Jo Rick; Jonathan Graffy; Peter Knapp; Nicola Small; David J Collier; Sandra Eldridge; Anne Kennedy; Chris Salisbury; Shaun Treweek; David Torgerson; Paul Wallace; Vichithranie Madurasinghe; Adwoa Hughes-Morley; Peter Bower Journal: Trials Date: 2014-10-25 Impact factor: 2.279
Authors: Jennifer Daubenmier; Patricia J Moran; Jean Kristeller; Michael Acree; Peter Bacchetti; Margaret E Kemeny; Mary Dallman; Robert H Lustig; Carl Grunfeld; Douglas F Nixon; Jeffrey M Milush; Veronica Goldman; Barbara Laraia; Kevin D Laugero; Leslie Woodhouse; Elissa S Epel; Frederick M Hecht Journal: Obesity (Silver Spring) Date: 2016-03-09 Impact factor: 5.002
Authors: Debra A Standiford; Nancy Morwessel; Franziska K Bishop; Joan M Thomas; Emily Smith; Jamie Crandell; Kimberly A Driscoll; Christine M Hunter; Jessica C Kichler; David M Maahs; Elizabeth J Mayer-Davis; Michael Seid Journal: Contemp Clin Trials Commun Date: 2018-09-21
Authors: Susan D Brown; Monique M Hedderson; Nancy Gordon; Cheryl L Albright; Ai-Lin Tsai; Charles P Quesenberry; Assiamira Ferrara Journal: Transl Behav Med Date: 2022-07-18 Impact factor: 3.626
Authors: Sherry L Pagoto; Matthew W Schroeder; Ran Xu; Molly E Waring; Laurie Groshon; Jared M Goetz; Christie Idiong; Haley Troy; Joseph DiVito; Richard Bannor Journal: JMIR Form Res Date: 2022-05-06