Ira L Leeds1, Andrew J Rosenblum2, Paul E Wise3, Anthony C Watkins4, Matthew I Goldblatt5, Elliott R Haut6, Jonathan E Efron1, Fabian M Johnston7. 1. Department of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD. 2. Johns Hopkins University Bloomberg School of Public Health, Baltimore, MD. 3. Department of Surgery, Washington University School of Medicine in St. Louis, MO. 4. Department of Surgery, Weill Cornell Medical College, New York, NY. 5. Department of Surgery, Medical College of Wisconsin, Milwaukee, WI. 6. Department of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD; Johns Hopkins University Bloomberg School of Public Health, Baltimore, MD. 7. Department of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD. Electronic address: fjohnst4@jhmi.edu.
Abstract
BACKGROUND: Accurate risk assessment before surgery is complex and hampered by behavioral factors. Underutilized risk-based decision-support tools may counteract these barriers. The purpose of this study was to identify perceptions of and barriers to the use of surgical risk-assessment tools and assess the importance of data framing as a barrier to adoption in surgical trainees. METHODS: We distributed a survey and risk assessment activity to surgical trainees at four training institutions. The primary outcomes of this study were descriptive risk assessment practices currently performed by residents, identifiable influences and obstacles to adoption, and the variability of preference sets when comparing modified System Usability Scores of a current risk calculator to a purpose-built calculator revision. Risk calculator comparison responses were compared with simple and multivariable regression to identify predictors for preferentiality. RESULTS: We collected responses from 124 surgical residents (39% response rate). Participants endorsed familiarity with direct verbal communication (100%), sketch diagrams (87%), and brochures (59%). The most contemporary risk communication frameworks, such as best-worst case scenario framing (38%), case-specific risk calculators (43%), and all-procedure calculators (52%) were the least familiar. Usage favored traditional models of communication with only 26% of residents regularly using a strategy other than direct verbal discussion or anatomic sketch diagrams. Barriers limiting routine use included lack of electronic and clinical workflow integration. The mean modified System Usability Scores domain scores were widely dispersed for all domains, and no domain demonstrated one calculator's superiority over another. CONCLUSION: Risk assessment tools are underutilized by trainees. Of importance, preference sets of clinicians appear to be unpredictable and may benefit more from a customizable, bespoke approach.
BACKGROUND: Accurate risk assessment before surgery is complex and hampered by behavioral factors. Underutilized risk-based decision-support tools may counteract these barriers. The purpose of this study was to identify perceptions of and barriers to the use of surgical risk-assessment tools and assess the importance of data framing as a barrier to adoption in surgical trainees. METHODS: We distributed a survey and risk assessment activity to surgical trainees at four training institutions. The primary outcomes of this study were descriptive risk assessment practices currently performed by residents, identifiable influences and obstacles to adoption, and the variability of preference sets when comparing modified System Usability Scores of a current risk calculator to a purpose-built calculator revision. Risk calculator comparison responses were compared with simple and multivariable regression to identify predictors for preferentiality. RESULTS: We collected responses from 124 surgical residents (39% response rate). Participants endorsed familiarity with direct verbal communication (100%), sketch diagrams (87%), and brochures (59%). The most contemporary risk communication frameworks, such as best-worst case scenario framing (38%), case-specific risk calculators (43%), and all-procedure calculators (52%) were the least familiar. Usage favored traditional models of communication with only 26% of residents regularly using a strategy other than direct verbal discussion or anatomic sketch diagrams. Barriers limiting routine use included lack of electronic and clinical workflow integration. The mean modified System Usability Scores domain scores were widely dispersed for all domains, and no domain demonstrated one calculator's superiority over another. CONCLUSION: Risk assessment tools are underutilized by trainees. Of importance, preference sets of clinicians appear to be unpredictable and may benefit more from a customizable, bespoke approach.
Authors: Vivian Hsiao; Dawn M Elfenbein; Susan C Pitt; Kristin L Long; Rebecca S Sippel; David F Schneider Journal: J Surg Res Date: 2021-12-10 Impact factor: 2.192
Authors: Tyler J Loftus; Amanda C Filiberto; Jeremy Balch; Alexander L Ayzengart; Patrick J Tighe; Parisa Rashidi; Azra Bihorac; Gilbert R Upchurch Journal: J Surg Res Date: 2020-04-24 Impact factor: 2.192
Authors: Tyler J Loftus; Patrick J Tighe; Amanda C Filiberto; Philip A Efron; Scott C Brakenridge; Alicia M Mohr; Parisa Rashidi; Gilbert R Upchurch; Azra Bihorac Journal: JAMA Surg Date: 2020-02-01 Impact factor: 14.766
Authors: Tyler J Loftus; Amanda C Filiberto; Yanjun Li; Jeremy Balch; Allyson C Cook; Patrick J Tighe; Philip A Efron; Gilbert R Upchurch; Parisa Rashidi; Xiaolin Li; Azra Bihorac Journal: Surgery Date: 2020-06-13 Impact factor: 3.982
Authors: Amanda C Filiberto; Tezcan Ozrazgat-Baslanti; Tyler J Loftus; Ying-Chih Peng; Shounak Datta; Philip Efron; Gilbert R Upchurch; Azra Bihorac; Michol A Cooper Journal: Surgery Date: 2021-02-27 Impact factor: 4.348
Authors: Nisha Pradhan; Adam R Dyas; Michael R Bronsert; Anne Lambert-Kerzner; William G Henderson; Howe Qiu; Kathryn L Colborn; Nicholas J Mason; Robert A Meguid Journal: Patient Saf Surg Date: 2022-03-17
Authors: Tyler J Loftus; Jeremy A Balch; Matthew M Ruppert; Patrick J Tighe; William R Hogan; Parisa Rashidi; Gilbert R Upchurch; Azra Bihorac Journal: Ann Surg Date: 2022-02-01 Impact factor: 13.787