Rivka C Ihejirika1, Rachel V Thakore1, Vasanth Sathiyakumar1, Jesse M Ehrenfeld1, William T Obremskey1, Manish K Sethi2. 1. The Vanderbilt Orthopaedic Institute Center for Health Policy, Vanderbilt University, Suite 4200, South Tower, MCE, Nashville, TN 37221, United States. 2. The Vanderbilt Orthopaedic Institute Center for Health Policy, Vanderbilt University, Suite 4200, South Tower, MCE, Nashville, TN 37221, United States. Electronic address: Manish.K.Sethi@vanderbilt.edu.
Abstract
OBJECTIVES: Although recent literature has demonstrated the utility of the ASA score in predicting postoperative length of stay, complication risk and potential utilization of other hospital resources, the ASA score has been inconsistently assigned by anaesthesia providers. This study tested the reliability of assignment of the ASA score classification by both attending anaesthesiologists and anaesthesia residents specifically among the orthopaedic trauma patient population. METHODS: Nine case-based scenarios were created involving preoperative patients with isolated operative orthopaedic trauma injuries. The cases were created and assigned a reference score by both an attending anaesthesiologist and orthopaedic trauma surgeon. Attending and resident anaesthesiologists were asked to assign an ASA score for each case. Rater versus reference and inter-rater agreement amongst respondents was then analyzed utilizing Fleiss's Kappa and weighted and unweighted Cohen's Kappa. RESULTS: Thirty three individuals provided ASA scores for each of the scenarios. The average rater versus reference reliability was substantial (Kw=0.78, SD=0.131, 95% CI=0.73-0.83). The average rater versus reference Kuw was also substantial (Kuw=0.64, SD=0.21, 95% CI=0.56-0.71). The inter-rater reliability as evaluated by Fleiss's Kappa was moderate (K=0.51, p<.001). An inter-rater comparison within the group of attendings (K=0.50, p<.001) and within the group of residents were both moderate (K=0.55, p<.001). There was a significant increase in the level of inter-rater reliability from the self-reported 'very uncomfortable' participants to the 'very comfortable' participants (uncomfortable K=0.43, comfortable K=0.59, p<.001). CONCLUSIONS: This study shows substantial agreement strength for reliability of the ASA score among anaesthesiologists when evaluating orthopaedic trauma patients. The significant increase in inter-rater reliability based on anaesthesiologists' comfort with the ASA scoring method implies a need for further evaluation of ASA assessment training and routine use on the ground. These findings support the use of the ASA score as a statistically reliable tool in orthopaedic trauma.
OBJECTIVES: Although recent literature has demonstrated the utility of the ASA score in predicting postoperative length of stay, complication risk and potential utilization of other hospital resources, the ASA score has been inconsistently assigned by anaesthesia providers. This study tested the reliability of assignment of the ASA score classification by both attending anaesthesiologists and anaesthesia residents specifically among the orthopaedic traumapatient population. METHODS: Nine case-based scenarios were created involving preoperative patients with isolated operative orthopaedic trauma injuries. The cases were created and assigned a reference score by both an attending anaesthesiologist and orthopaedic trauma surgeon. Attending and resident anaesthesiologists were asked to assign an ASA score for each case. Rater versus reference and inter-rater agreement amongst respondents was then analyzed utilizing Fleiss's Kappa and weighted and unweighted Cohen's Kappa. RESULTS: Thirty three individuals provided ASA scores for each of the scenarios. The average rater versus reference reliability was substantial (Kw=0.78, SD=0.131, 95% CI=0.73-0.83). The average rater versus reference Kuw was also substantial (Kuw=0.64, SD=0.21, 95% CI=0.56-0.71). The inter-rater reliability as evaluated by Fleiss's Kappa was moderate (K=0.51, p<.001). An inter-rater comparison within the group of attendings (K=0.50, p<.001) and within the group of residents were both moderate (K=0.55, p<.001). There was a significant increase in the level of inter-rater reliability from the self-reported 'very uncomfortable' participants to the 'very comfortable' participants (uncomfortable K=0.43, comfortable K=0.59, p<.001). CONCLUSIONS: This study shows substantial agreement strength for reliability of the ASA score among anaesthesiologists when evaluating orthopaedic traumapatients. The significant increase in inter-rater reliability based on anaesthesiologists' comfort with the ASA scoring method implies a need for further evaluation of ASA assessment training and routine use on the ground. These findings support the use of the ASA score as a statistically reliable tool in orthopaedic trauma.
Authors: J Nuttall; N Evaniew; P Thornley; A Griffin; B Deheshi; T O'Shea; J Wunder; P Ferguson; R L Randall; R Turcotte; P Schneider; P McKay; M Bhandari; M Ghert Journal: Bone Joint Res Date: 2016-08 Impact factor: 5.853
Authors: Willem-Jan Metsemakers; Mario Morgenstern; Eric Senneville; Olivier Borens; Geertje A M Govaert; Jolien Onsea; Melissa Depypere; R Geoff Richards; Andrej Trampuz; Michael H J Verhofstad; Stephen L Kates; Michael Raschke; Martin A McNally; William T Obremskey Journal: Arch Orthop Trauma Surg Date: 2019-10-29 Impact factor: 3.067
Authors: Seshadri C Mudumbai; Suzann Pershing; Thomas Bowe; Robin N Kamal; Erika D Sears; Andrea K Finlay; Dan Eisenberg; Mary T Hawn; Yingjie Weng; Amber W Trickey; Edward R Mariano; Alex H S Harris Journal: BMC Health Serv Res Date: 2019-11-21 Impact factor: 2.655