James J Jung1, Cornelia M Borkhoff2, Peter Jüni3, Teodor P Grantcharov4. 1. International Centre for Surgical Safety, Keenan Centre for Biomedical Science, St. Michael's Hospital, Toronto, Ontario, Canada; Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada. Electronic address: jungj@smh.ca. 2. Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada; Division of Paediatric Medicine and the Paediatric Outcomes Research Team (PORT), Hospital for Sick Children, Toronto, ON, Canada. 3. Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada; Applied Health Research Centre (AHRC), Li Ka Shing Knowledge Institute of St. Michael's Hospital, Department of Medicine and Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada. 4. International Centre for Surgical Safety, Keenan Centre for Biomedical Science, St. Michael's Hospital, Toronto, Ontario, Canada; Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada.
Abstract
BACKGROUND: To critically appraise the development and measurement properties, including sensibility, reliability, and validity of the Non-Technical Skills of Surgeons (NOTSS) system. DATA SOURCES: Articles that described development process of the NOTSS system were identified. Relevant primary studies that presented evidence of reliability and validity were identified through a comprehensive literature review. RESULTS: NOTSS was developed through robust item generation and reduction strategies. It was shown to have good content validity, acceptability, and feasibility. Inter-rater reliability increased with greater expertise and number of assessors. Studies demonstrated evidence of cross-sectional construct validity, in that the tool was able to differentiate known groups of varied non-technical skill levels. Evidence of longitudinal construct validity also existed to demonstrate that NOTSS detected changes in non-technical skills before and after targeted training. CONCLUSION: In populations and settings presented in our critical appraisal, NOTSS provided reliable and valid measurements of intraoperative non-technical skills of surgeons.
BACKGROUND: To critically appraise the development and measurement properties, including sensibility, reliability, and validity of the Non-Technical Skills of Surgeons (NOTSS) system. DATA SOURCES: Articles that described development process of the NOTSS system were identified. Relevant primary studies that presented evidence of reliability and validity were identified through a comprehensive literature review. RESULTS: NOTSS was developed through robust item generation and reduction strategies. It was shown to have good content validity, acceptability, and feasibility. Inter-rater reliability increased with greater expertise and number of assessors. Studies demonstrated evidence of cross-sectional construct validity, in that the tool was able to differentiate known groups of varied non-technical skill levels. Evidence of longitudinal construct validity also existed to demonstrate that NOTSS detected changes in non-technical skills before and after targeted training. CONCLUSION: In populations and settings presented in our critical appraisal, NOTSS provided reliable and valid measurements of intraoperative non-technical skills of surgeons.
Authors: Jaycelyn R Holland; Donald H Arnold; Holly R Hanson; Barbara J Solomon; Nicholas E Jones; Tucker W Anderson; Wu Gong; Christopher J Lindsell; Travis W Crook; Daisy A Ciener Journal: Med Educ Online Date: 2022-12