Huiqin Yang1, Carl Thompson. 1. Centre for Reviews and Dissemination University of York, UK. hy505@york.ac.uk
Abstract
AIM: This paper is a report of a study of the relationship between nurses' clinical experience and calibration of their self-confidence and judgement accuracy for critical event risk assessment judgements. BACKGROUND: Miscalibration (i.e. under-confidence or over-confidence of confidence levels) has an important impact on the quality of nursing care. Despite this, little is known about how nurses' subjective confidence is calibrated with the accuracy of their judgments. METHODS: A sample of 103 nursing students and 34 experienced nurses were exposed to 25 risk assessment vignettes. For each vignette they made dichotomous judgements of whether the patient in each scenario was at risk of a critical event, and assigned confidence ratings (0-100) to their judgement calls. The clinical vignettes and judgement criteria were generated from real patient cases. The methodology of confidence calibration was used to calculate calibration measures and generate calibration curves. Data were collected between March 2007 and January 2008. FINDINGS: Experienced nurses were statistically significantly more confident than students but no more accurate. Whilst students tended towards under-confidence, experienced nurses were over-confident. Experienced nurses were no more calibrated than students. Experienced nurses were no better at discriminating between correct and incorrect judgements than students. These patterns were exacerbated when nurses and students were extremely over-confident or extremely under-confident. CONCLUSION: Nurses were systematically biased towards over/under-confidence in their critical event risk assessment judgements. In particular, experienced nurses were no better calibrated than their student counterparts; with student under-confidence countered by experienced nurses' greater susceptibility to over-confidence.
AIM: This paper is a report of a study of the relationship between nurses' clinical experience and calibration of their self-confidence and judgement accuracy for critical event risk assessment judgements. BACKGROUND: Miscalibration (i.e. under-confidence or over-confidence of confidence levels) has an important impact on the quality of nursing care. Despite this, little is known about how nurses' subjective confidence is calibrated with the accuracy of their judgments. METHODS: A sample of 103 nursing students and 34 experienced nurses were exposed to 25 risk assessment vignettes. For each vignette they made dichotomous judgements of whether the patient in each scenario was at risk of a critical event, and assigned confidence ratings (0-100) to their judgement calls. The clinical vignettes and judgement criteria were generated from real patient cases. The methodology of confidence calibration was used to calculate calibration measures and generate calibration curves. Data were collected between March 2007 and January 2008. FINDINGS: Experienced nurses were statistically significantly more confident than students but no more accurate. Whilst students tended towards under-confidence, experienced nurses were over-confident. Experienced nurses were no more calibrated than students. Experienced nurses were no better at discriminating between correct and incorrect judgements than students. These patterns were exacerbated when nurses and students were extremely over-confident or extremely under-confident. CONCLUSION: Nurses were systematically biased towards over/under-confidence in their critical event risk assessment judgements. In particular, experienced nurses were no better calibrated than their student counterparts; with student under-confidence countered by experienced nurses' greater susceptibility to over-confidence.
Authors: Amie C O'Donoghue; Vanessa Boudewyns; Kathryn J Aikin; Emily Geisen; Kevin R Betts; Brian G Southwell Journal: J Health Commun Date: 2015-07-15