BACKGROUND: The Scrub Practitioners' List of Intraoperative Non-Technical Skills (SPLINTS) system is a new tool for training and assessing scrub practitioner (nurse, technician) behaviours during surgical operations. OBJECTIVES: The aim of the study was to test the psychometric properties including inter-rater reliability of the prototype SPLINTS behavioural rating system. METHODS: Experienced scrub practitioners (n=34) attended a one-day session where they received background training in human factors and non-technical skills and were also trained to use the SPLINTS system. They then used SPLINTS to rate the scrub practitioners' non-technical skill performance in seven standardized simulated, surgical scenarios. RESULTS: Reliability, measured by within-group agreement (r(wg)) for the three skill categories and six out of nine elements, was acceptable (r(wg)>0.7). Participants were within one scale point of expert ratings in >90% of skill categories and elements, and could use SPLINTS to score performance with a reasonable level of accuracy. There was good internal consistency of the system: absolute mean difference was M<0.2 of a scale point for all three categories. Participants were surveyed and they indicated that the system was complete and usable as an assessment tool. CONCLUSION: The reliability of the SPLINTS system was deemed to be adequate for assessing scrub practitioners' non-technical skills in simulated, standardized, video scenarios. On the basis of these results, the system can now move on to usability testing in the real operating theatre.
BACKGROUND: The Scrub Practitioners' List of Intraoperative Non-Technical Skills (SPLINTS) system is a new tool for training and assessing scrub practitioner (nurse, technician) behaviours during surgical operations. OBJECTIVES: The aim of the study was to test the psychometric properties including inter-rater reliability of the prototype SPLINTS behavioural rating system. METHODS: Experienced scrub practitioners (n=34) attended a one-day session where they received background training in human factors and non-technical skills and were also trained to use the SPLINTS system. They then used SPLINTS to rate the scrub practitioners' non-technical skill performance in seven standardized simulated, surgical scenarios. RESULTS: Reliability, measured by within-group agreement (r(wg)) for the three skill categories and six out of nine elements, was acceptable (r(wg)>0.7). Participants were within one scale point of expert ratings in >90% of skill categories and elements, and could use SPLINTS to score performance with a reasonable level of accuracy. There was good internal consistency of the system: absolute mean difference was M<0.2 of a scale point for all three categories. Participants were surveyed and they indicated that the system was complete and usable as an assessment tool. CONCLUSION: The reliability of the SPLINTS system was deemed to be adequate for assessing scrub practitioners' non-technical skills in simulated, standardized, video scenarios. On the basis of these results, the system can now move on to usability testing in the real operating theatre.
Authors: Michael A Rosen; Aaron S Dietz; Ting Yang; Carey E Priebe; Peter J Pronovost Journal: J Am Med Inform Assoc Date: 2014-07-22 Impact factor: 4.497
Authors: Emma Claire Phillips; Samantha Eve Smith; Benjamin Clarke; Ailsa Lauren Hamilton; Joanne Kerins; Johanna Hofer; Victoria Ruth Tallentire Journal: BMJ Simul Technol Enhanc Learn Date: 2020-04-16
Authors: Eleanor R Robertson; Mohammed Hadi; Lauren J Morgan; Sharon P Pickering; Gary Collins; Steve New; Damian Griffin; Damien Griffin; Peter McCulloch; Ken C Catchpole Journal: PLoS One Date: 2014-03-04 Impact factor: 3.240