Greg D Sacks1, Aaron J Dawes, Susan L Ettner, Robert H Brook, Craig R Fox, Marcia M Russell, Clifford Y Ko, Melinda Maggard-Gibbons. 1. *Department of Surgery, UCLA David Geffen School of Medicine, Los Angeles, CA †VA Greater Los Angeles Healthcare System, Los Angeles, CA ‡Department of Health Policy and Management, UCLA Fielding School of Public Health, Los Angeles, CA §Department of Medicine, UCLA David Geffen School of Medicine, Los Angeles, CA ||RAND Corporation, Los Angeles, CA ¶UCLA Anderson School of Management, Los Angeles, CA #Department of Psychology, UCLA College of Letters and Sciences, Los Angeles, CA.
Abstract
OBJECTIVE: The aim of this study was to determine whether exposure to data from a risk calculator influences surgeons' assessments of risk and in turn, their decisions to operate. BACKGROUND: Little is known about how risk calculators inform clinical judgment and decision-making. METHODS: We asked a national sample of surgeons to assess the risks (probability of serious complications or death) and benefits (recovery) of operative and nonoperative management and to rate their likelihood of recommending an operation (5-point scale) for 4 detailed clinical vignettes wherein the best treatment strategy was uncertain. Surgeons were randomized to the clinical vignettes alone (control group; n = 384) or supplemented by data from a risk calculator (risk calculator group; n = 395). We compared surgeons' judgments and decisions between the groups. RESULTS: Surgeons exposed to the risk calculator judged levels of operative risk that more closely approximated the risk calculator value (RCV) compared with surgeons in the control group [mesenteric ischemia: 43.7% vs 64.6%, P < 0.001 (RCV = 25%); gastrointestinal bleed: 47.7% vs 53.4%, P < 0.001 (RCV = 38%); small bowel obstruction: 13.6% vs 17.5%, P < 0.001 (RCV = 14%); appendicitis: 13.4% vs 24.4%, P < 0.001 (RCV = 5%)]. Surgeons exposed to the risk calculator also varied less in their assessment of operative risk (standard deviations: mesenteric ischemia 20.2% vs 23.2%, P = 0.01; gastrointestinal bleed 17.4% vs 24.1%, P < 0.001; small bowel obstruction 10.6% vs 14.9%, P < 0.001; appendicitis 15.2% vs 21.8%, P < 0.001). However, averaged across the 4 vignettes, the 2 groups did not differ in their reported likelihood of recommending an operation (mean 3.7 vs 3.7, P = 0.76). CONCLUSIONS: Exposure to risk calculator data leads to less varied and more accurate judgments of operative risk among surgeons, and thus may help inform discussions of treatment options between surgeons and patients. Interestingly, it did not alter their reported likelihood of recommending an operation.
RCT Entities:
OBJECTIVE: The aim of this study was to determine whether exposure to data from a risk calculator influences surgeons' assessments of risk and in turn, their decisions to operate. BACKGROUND: Little is known about how risk calculators inform clinical judgment and decision-making. METHODS: We asked a national sample of surgeons to assess the risks (probability of serious complications or death) and benefits (recovery) of operative and nonoperative management and to rate their likelihood of recommending an operation (5-point scale) for 4 detailed clinical vignettes wherein the best treatment strategy was uncertain. Surgeons were randomized to the clinical vignettes alone (control group; n = 384) or supplemented by data from a risk calculator (risk calculator group; n = 395). We compared surgeons' judgments and decisions between the groups. RESULTS: Surgeons exposed to the risk calculator judged levels of operative risk that more closely approximated the risk calculator value (RCV) compared with surgeons in the control group [mesenteric ischemia: 43.7% vs 64.6%, P < 0.001 (RCV = 25%); gastrointestinal bleed: 47.7% vs 53.4%, P < 0.001 (RCV = 38%); small bowel obstruction: 13.6% vs 17.5%, P < 0.001 (RCV = 14%); appendicitis: 13.4% vs 24.4%, P < 0.001 (RCV = 5%)]. Surgeons exposed to the risk calculator also varied less in their assessment of operative risk (standard deviations: mesenteric ischemia 20.2% vs 23.2%, P = 0.01; gastrointestinal bleed 17.4% vs 24.1%, P < 0.001; small bowel obstruction 10.6% vs 14.9%, P < 0.001; appendicitis 15.2% vs 21.8%, P < 0.001). However, averaged across the 4 vignettes, the 2 groups did not differ in their reported likelihood of recommending an operation (mean 3.7 vs 3.7, P = 0.76). CONCLUSIONS: Exposure to risk calculator data leads to less varied and more accurate judgments of operative risk among surgeons, and thus may help inform discussions of treatment options between surgeons and patients. Interestingly, it did not alter their reported likelihood of recommending an operation.
Authors: T Sammour; L Cohen; A I Karunatillake; M Lewis; M J Lawrence; A Hunter; J W Moore; M L Thomas Journal: Tech Coloproctol Date: 2017-10-28 Impact factor: 3.781
Authors: Elisa M Müller; Eva Herrmann; Thomas Schmandra; Thomas F Weigel; Ernst Hanisch; Alexander Buia Journal: World J Surg Date: 2020-06 Impact factor: 3.352
Authors: Ferran Pellisé; Alba Vila-Casademunt; Susana Núñez-Pereira; Sleiman Haddad; Justin S Smith; Michael P Kelly; Ahmet Alanay; Christopher Shaffrey; Javier Pizones; Çaglar Yilgor; Ibrahim Obeid; Douglas Burton; Frank Kleinstück; Tamas Fekete; Shay Bess; Munish Gupta; Markus Loibl; Eric O Klineberg; Francisco J Sánchez Pérez-Grueso; Miquel Serra-Burriel; Christopher P Ames Journal: Eur Spine J Date: 2022-03-28 Impact factor: 2.721
Authors: Andrew S Miller; Kathryn Boyce; Benjamin Box; Matthew D Clarke; Sarah E Duff; Niamh M Foley; Richard J Guy; Lisa H Massey; George Ramsay; Dominic A J Slade; James A Stephenson; Phil J Tozer; Danette Wright Journal: Colorectal Dis Date: 2021-02 Impact factor: 3.917
Authors: Samantha Bunzli; Elizabeth Nelson; Anthony Scott; Simon French; Peter Choong; Michelle Dowsey Journal: BMJ Open Date: 2017-11-12 Impact factor: 2.692
Authors: Shreyus S Kulkarni; Alexandra Briggs; Olivia A Sacks; Matthew R Rosengart; Douglas B White; Amber E Barnato; Andrew B Peitzman; Deepika Mohan Journal: Ann Surg Date: 2021-12-01 Impact factor: 13.787