Daniel A Devcich1, Jennifer Weller2, Simon J Mitchell2, Scott McLaughlin3, Lauren Barker3, Jenny W Rudolph4, Daniel B Raemer4, Martin Zammert5, Sara J Singer6, Jane Torrie2, Chris Ma Frampton7, Alan F Merry2. 1. Department of Anaesthesiology, University of Auckland, Auckland, New Zealand. 2. Department of Anaesthesiology, University of Auckland, Auckland, New Zealand Department of Anaesthesia and Perioperative Medicine, Auckland City Hospital, Auckland, New Zealand. 3. School of Medicine, University of Auckland, Auckland, New Zealand. 4. Harvard Medical School, Center for Medical Simulation, Boston, Massachusetts, United States. 5. Harvard Medical School, Brigham and Women's Hospital, Boston, Massachusetts, United States. 6. Department of Health Policy and Management, Harvard T. H. Chan School of Public Health, Boston, Massachusetts, United States. 7. Department of Medicine, Christchurch School of Medicine and Health Sciences, University of Otago, Auckland, New Zealand.
Abstract
BACKGROUND: Realising the full potential of the WHO Surgical Safety Checklist (SSC) to reduce perioperative harm requires the constructive engagement of all operating room (OR) team members during its administration. To facilitate research on SSC implementation, a valid and reliable instrument is needed for measuring OR team behaviours during its administration. We developed a behaviourally anchored rating scale (BARS) for this purpose. METHODS: We used a modified Delphi process, involving 16 subject matter experts, to compile a BARS with behavioural domains applicable to all three phases of the SSC. We evaluated the instrument in 80 adult OR cases and 30 simulated cases using two medical student raters and seven expert raters, respectively. Intraclass correlation coefficients were calculated to assess inter-rater reliability. Internal consistency and instrument discrimination were explored. Sample size estimates for potential study designs using the instrument were calculated. RESULTS: The Delphi process resulted in a BARS instrument (the WHOBARS) with five behavioural domains. Intraclass correlation coefficients calculated from the OR cases exceeded 0.80 for 80% of the instrument's domains across the SSC phases. The WHOBARS showed high internal consistency across the three phases of the SSC and ability to discriminate among surgical cases in both clinical and simulated settings. Fewer than 20 cases per group would be required to show a difference of 1 point between groups in studies of the SSC, where α=0.05 and β=0.8. CONCLUSION: We have developed a generic instrument for comprehensively rating the administration of the SSC and informing initiatives to realise its full potential. We have provided data supporting its capacity for discrimination, internal consistency and inter-rater reliability. Further psychometric evaluation is warranted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/
BACKGROUND: Realising the full potential of the WHO Surgical Safety Checklist (SSC) to reduce perioperative harm requires the constructive engagement of all operating room (OR) team members during its administration. To facilitate research on SSC implementation, a valid and reliable instrument is needed for measuring OR team behaviours during its administration. We developed a behaviourally anchored rating scale (BARS) for this purpose. METHODS: We used a modified Delphi process, involving 16 subject matter experts, to compile a BARS with behavioural domains applicable to all three phases of the SSC. We evaluated the instrument in 80 adult OR cases and 30 simulated cases using two medical student raters and seven expert raters, respectively. Intraclass correlation coefficients were calculated to assess inter-rater reliability. Internal consistency and instrument discrimination were explored. Sample size estimates for potential study designs using the instrument were calculated. RESULTS: The Delphi process resulted in a BARS instrument (the WHOBARS) with five behavioural domains. Intraclass correlation coefficients calculated from the OR cases exceeded 0.80 for 80% of the instrument's domains across the SSC phases. The WHOBARS showed high internal consistency across the three phases of the SSC and ability to discriminate among surgical cases in both clinical and simulated settings. Fewer than 20 cases per group would be required to show a difference of 1 point between groups in studies of the SSC, where α=0.05 and β=0.8. CONCLUSION: We have developed a generic instrument for comprehensively rating the administration of the SSC and informing initiatives to realise its full potential. We have provided data supporting its capacity for discrimination, internal consistency and inter-rater reliability. Further psychometric evaluation is warranted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/
Authors: Annemarie Fridrich; Anita Imhof; Sven Staender; Mirko Brenni; David Schwappach Journal: Int J Qual Health Care Date: 2022-07-15 Impact factor: 2.257
Authors: Fabrizio Bracco; Gabriele de Tonetti; Michele Masini; Marcello Passarelli; Francesca Geretto; Danilo Celleno Journal: Int J Environ Res Public Health Date: 2018-03-03 Impact factor: 3.390
Authors: Jennifer M Weller; Tanisha Jowsey; Carmen Skilton; Derryn A Gargiulo; Oleg N Medvedev; Ian Civil; Jacqueline A Hannam; Simon J Mitchell; Jane Torrie; Alan F Merry Journal: BMJ Open Date: 2018-12-16 Impact factor: 2.692
Authors: Oleg N Medvedev; Alan F Merry; Carmen Skilton; Derryn A Gargiulo; Simon J Mitchell; Jennifer M Weller Journal: BMJ Open Date: 2019-01-09 Impact factor: 2.692
Authors: Michelle C White; Kirsten Randall; Vaonandianina A Ravelojaona; Hery H Andriamanjato; Vanessa Andean; James Callahan; Mark G Shrime; Stephanie Russ; Andrew J M Leather; Nick Sevdalis Journal: BMJ Glob Health Date: 2018-12-20
Authors: Jennifer Weller; Jennifer Anne Long; Peter Beaver; David Cumin; Chris Frampton; Alexander L Garden; Matthew Moore; Craig S Webster; Alan Merry Journal: BMJ Open Date: 2020-02-19 Impact factor: 2.692
Authors: Michelle C White; Leonid Daya; Fabo Kwemi Brice Karel; Graham White; Sonia Abid; Aoife Fitzgerald; G Alain Etoundi Mballa; Nick Sevdalis; Andrew J M Leather Journal: Anesth Analg Date: 2020-05 Impact factor: 5.108