Denise A Esserman1, Thomas M Gill2, Michael E Miller3, Erich J Greene1, James D Dziura1, Thomas G Travison4, Can Meng1, Peter N Peduzzi1. 1. Yale Center for Analytical Sciences, Yale University, New Haven, CT, USA. 2. Department of Internal Medicine, Yale School of Medicine, New Haven, CT, USA. 3. Wake Forest University School of Medicine, Winston-Salem, NC, USA. 4. Marcus Institute for Aging Research, Hebrew SeniorLife, Harvard Medical School, Boston, MA, USA.
Abstract
BACKGROUND/AIM: In clinical trials, there is potential for bias from unblinded observers that may influence ascertainment of outcomes. This issue arose in the Strategies to Reduce Injuries and Develop Confidence in Elders trial, a cluster randomized trial to test a multicomponent intervention versus enhanced usual care (control) to prevent serious fall injuries, originally defined as a fall injury leading to medical attention. An unblinded nurse falls care manager administered the intervention, while the usual care arm did not involve contact with a falls care manager. Thus, there was an opportunity for falls care managers to refer participants reporting falls to seek medical attention. Since this type of observer bias could not occur in the usual care arm, there was potential for additional falls to be reported in the intervention arm, leading to dilution of the intervention effect and a reduction in study power. We describe the clinical basis for ascertainment bias, the statistical approach used to assess it, and its effect on study power. METHODS: The prespecified interim monitoring plan included a decision algorithm for assessing ascertainment bias and adapting (revising) the primary outcome definition, if necessary. The original definition categorized serious fall injuries requiring medical attention into Type 1 (fracture other than thoracic/lumbar vertebral, joint dislocation, cut requiring closure) and Type 2 (head injury, sprain or strain, bruising or swelling, other). The revised definition, proposed by the monitoring plan, excluded Type 2 injuries that did not necessarily require an overnight hospitalization since these would be most subject to bias. These injuries were categorized into those with (Type 2b) and without (Type 2c) medical attention. The remaining Type 2a injuries required medical attention and an overnight hospitalization. We used the ratio of 2b/(2b + 2c) in intervention versus control as a measure of ascertainment bias; ratios > 1 indicated the likelihood of falls care manager bias. We determined the effect of ascertainment bias on study power for the revised (Types 1 and 2a) versus original definition (Types 1, 2a, and 2b). RESULTS: The estimate of ascertainment bias was 1.14 (95% confidence interval: 0.98, 1.30), providing evidence of the likelihood of falls care manager bias. We estimated that this bias diluted the hazard ratio from the hypothesized 0.80 to 0.86 and reduced power to under 80% for the original primary outcome definition. In contrast, adapting the revised definition maintained study power at nearly 90%. CONCLUSION: There was evidence of ascertainment bias in the Strategies to Reduce Injuries and Develop Confidence in Elders trial. The decision to adapt the primary outcome definition reduced the likelihood of this bias while preserving the intervention effect and study power.
RCT Entities:
BACKGROUND/AIM: In clinical trials, there is potential for bias from unblinded observers that may influence ascertainment of outcomes. This issue arose in the Strategies to Reduce Injuries and Develop Confidence in Elders trial, a cluster randomized trial to test a multicomponent intervention versus enhanced usual care (control) to prevent serious fall injuries, originally defined as a fall injury leading to medical attention. An unblinded nurse falls care manager administered the intervention, while the usual care arm did not involve contact with a falls care manager. Thus, there was an opportunity for falls care managers to refer participants reporting falls to seek medical attention. Since this type of observer bias could not occur in the usual care arm, there was potential for additional falls to be reported in the intervention arm, leading to dilution of the intervention effect and a reduction in study power. We describe the clinical basis for ascertainment bias, the statistical approach used to assess it, and its effect on study power. METHODS: The prespecified interim monitoring plan included a decision algorithm for assessing ascertainment bias and adapting (revising) the primary outcome definition, if necessary. The original definition categorized serious fall injuries requiring medical attention into Type 1 (fracture other than thoracic/lumbar vertebral, joint dislocation, cut requiring closure) and Type 2 (head injury, sprain or strain, bruising or swelling, other). The revised definition, proposed by the monitoring plan, excluded Type 2 injuries that did not necessarily require an overnight hospitalization since these would be most subject to bias. These injuries were categorized into those with (Type 2b) and without (Type 2c) medical attention. The remaining Type 2a injuries required medical attention and an overnight hospitalization. We used the ratio of 2b/(2b + 2c) in intervention versus control as a measure of ascertainment bias; ratios > 1 indicated the likelihood of falls care manager bias. We determined the effect of ascertainment bias on study power for the revised (Types 1 and 2a) versus original definition (Types 1, 2a, and 2b). RESULTS: The estimate of ascertainment bias was 1.14 (95% confidence interval: 0.98, 1.30), providing evidence of the likelihood of falls care manager bias. We estimated that this bias diluted the hazard ratio from the hypothesized 0.80 to 0.86 and reduced power to under 80% for the original primary outcome definition. In contrast, adapting the revised definition maintained study power at nearly 90%. CONCLUSION: There was evidence of ascertainment bias in the Strategies to Reduce Injuries and Develop Confidence in Elders trial. The decision to adapt the primary outcome definition reduced the likelihood of this bias while preserving the intervention effect and study power.
Entities:
Keywords:
Cluster randomized trial; adjudication; ascertainment bias; hazard ratio; power
Authors: Shalender Bhasin; Thomas M Gill; David B Reuben; Nancy K Latham; David A Ganz; Erich J Greene; James Dziura; Shehzad Basaria; Jerry H Gurwitz; Patricia C Dykes; Siobhan McMahon; Thomas W Storer; Priscilla Gazarian; Michael E Miller; Thomas G Travison; Denise Esserman; Martha B Carnie; Lori Goehring; Maureen Fagan; Susan L Greenspan; Neil Alexander; Jocelyn Wiggins; Fred Ko; Albert L Siu; Elena Volpi; Albert W Wu; Jeremy Rich; Stephen C Waring; Robert B Wallace; Carri Casteel; Neil M Resnick; Jay Magaziner; Peter Charpentier; Charles Lu; Katy Araujo; Haseena Rajeevan; Can Meng; Heather Allore; Brooke F Brawley; Rich Eder; Joanne M McGloin; Eleni A Skokos; Pamela W Duncan; Dorothy Baker; Chad Boult; Rosaly Correa-de-Araujo; Peter Peduzzi Journal: N Engl J Med Date: 2020-07-09 Impact factor: 91.245
Authors: Marco Pahor; Jack M Guralnik; Walter T Ambrosius; Steven Blair; Denise E Bonds; Timothy S Church; Mark A Espeland; Roger A Fielding; Thomas M Gill; Erik J Groessl; Abby C King; Stephen B Kritchevsky; Todd M Manini; Mary M McDermott; Michael E Miller; Anne B Newman; W Jack Rejeski; Kaycee M Sink; Jeff D Williamson Journal: JAMA Date: 2014-06-18 Impact factor: 56.272
Authors: David B Reuben; Priscilla Gazarian; Neil Alexander; Katy Araujo; Dorothy Baker; Jonathan F Bean; Chad Boult; Peter Charpentier; Pamela Duncan; Nancy Latham; Rosanne M Leipzig; Lisa M Quintiliani; Thomas Storer; Siobhan McMahon Journal: J Am Geriatr Soc Date: 2017-10-17 Impact factor: 5.562
Authors: Shalender Bhasin; Thomas M Gill; David B Reuben; Nancy K Latham; Jerry H Gurwitz; Patricia Dykes; Siobhan McMahon; Thomas W Storer; Pamela W Duncan; David A Ganz; Shehzad Basaria; Michael E Miller; Thomas G Travison; Erich J Greene; James Dziura; Denise Esserman; Heather Allore; Martha B Carnie; Maureen Fagan; Catherine Hanson; Dorothy Baker; Susan L Greenspan; Neil Alexander; Fred Ko; Albert L Siu; Elena Volpi; Albert W Wu; Jeremy Rich; Stephen C Waring; Robert Wallace; Carri Casteel; Jay Magaziner; Peter Charpentier; Charles Lu; Katy Araujo; Haseena Rajeevan; Scott Margolis; Richard Eder; Joanne M McGloin; Eleni Skokos; Jocelyn Wiggins; Lawrence Garber; Steven B Clauser; Rosaly Correa-De-Araujo; Peter Peduzzi Journal: J Gerontol A Biol Sci Med Sci Date: 2018-07-09 Impact factor: 6.053
Authors: Erich J Greene; Peter Peduzzi; James Dziura; Can Meng; Michael E Miller; Thomas G Travison; Denise Esserman Journal: Stat Med Date: 2020-12-14 Impact factor: 2.373
Authors: David A Ganz; Albert L Siu; Jay Magaziner; Nancy K Latham; Thomas G Travison; Nancy P Lorenze; Charles Lu; Rixin Wang; Erich J Greene; Cynthia L Stowe; Lea N Harvin; Katy L B Araujo; Jerry H Gurwitz; Yuri Agrawal; Rosaly Correa-De-Araujo; Peter Peduzzi; Thomas M Gill Journal: Inj Epidemiol Date: 2019-04-15