Sok Ying Liaw1, Albert Scherpbier, Piyanee Klainin-Yobas, Jan-Joost Rethans. 1. Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, Level 2, Clinical Research Centre, Block MD11, 10 Medical Drive, Singapore 117597, Singapore. nurliaw@nus.edu.sg
Abstract
AIM: This article is a report of a study which developed and tested the validity and reliability of the RAPIDS-Tool to measure student nurses' simulation performance in assessing, managing and reporting of clinical deterioration. BACKGROUND: The importance for nurses to recognize and respond to deteriorating patients has led educators to advocate for increasing use of simulation for developing this competency. However, there is a lack of evaluation tools to objectively evaluate nurses' simulation performance on clinical deterioration. METHOD: The study was conducted in three phases. Phase 1 began with development of items for the RAPIDS-Tool from the basis of a literature review and a panel of national experts' consensus. Phase 2 established the content validity of the RAPIDS-Tool by a panel of international experts and by undertaking a pilot test. Phase 3 involved testing the psychometric properties of the RAPIDS-Tool, on 30 video-recorded simulation performances, for construct validity, inter-rater reliability, and correlation between two scoring systems. RESULTS: The process of development and validation produced a 42-item RAPIDS-Tool. Significant differences (t=15.48, p<0.001) in performance scores among participants with different levels of training supported the construct validity. The RAPIDS-Tool demonstrated a high inter-rater reliability (ICC=0.99) among the three raters and a high correlation between the global rating and checklist scores (r=0.94, p<0.001). CONCLUSION: The RAPIDS-Tool provides a valid and reliable tool to evaluate nurses' simulation performances in clinical deterioration. This may prove useful for future studies that investigate outcomes of simulation training.
AIM: This article is a report of a study which developed and tested the validity and reliability of the RAPIDS-Tool to measure student nurses' simulation performance in assessing, managing and reporting of clinical deterioration. BACKGROUND: The importance for nurses to recognize and respond to deteriorating patients has led educators to advocate for increasing use of simulation for developing this competency. However, there is a lack of evaluation tools to objectively evaluate nurses' simulation performance on clinical deterioration. METHOD: The study was conducted in three phases. Phase 1 began with development of items for the RAPIDS-Tool from the basis of a literature review and a panel of national experts' consensus. Phase 2 established the content validity of the RAPIDS-Tool by a panel of international experts and by undertaking a pilot test. Phase 3 involved testing the psychometric properties of the RAPIDS-Tool, on 30 video-recorded simulation performances, for construct validity, inter-rater reliability, and correlation between two scoring systems. RESULTS: The process of development and validation produced a 42-item RAPIDS-Tool. Significant differences (t=15.48, p<0.001) in performance scores among participants with different levels of training supported the construct validity. The RAPIDS-Tool demonstrated a high inter-rater reliability (ICC=0.99) among the three raters and a high correlation between the global rating and checklist scores (r=0.94, p<0.001). CONCLUSION: The RAPIDS-Tool provides a valid and reliable tool to evaluate nurses' simulation performances in clinical deterioration. This may prove useful for future studies that investigate outcomes of simulation training.
Authors: Sok Ying Liaw; Lai Fun Wong; Sally Wai-Chi Chan; Jasmine Tze Yin Ho; Siti Zubaidah Mordiffi; Sophia Bee Leng Ang; Poh Sun Goh; Emily Neo Kim Ang Journal: J Med Internet Res Date: 2015-01-12 Impact factor: 5.428