HoNOS: is there any point in training clinicians?

This study examines the impact of training and clinical experience on the inter-rater reliability of the HoNOS. Following either standard or modified HoNOS training, two groups of registered mental health nurses (RMHNs) were tested for inter-rater reliability (IRR) using a standard case vignette. In addition, another group of nurses and two nonclinical comparison groups had their IRR tested using the same vignette but without receiving any HoNOS training. There was no significant difference between IRR scores post-training compared with the pre-training scores. This is the case whether the recommended or modified training programmes were used. In addition, there is no significant difference between nurses and the comparison group, characterized by nonclinical work experience in a mental health setting. All four groups achieved adequate IRR. Finally, the comparison group with no regular exposure to mental health patients but experience using rating scales are significantly less reliable than the other four groups. The results suggest two possible interpretations. The first is that the HoNOS scales are so well designed that only familiarity with psychiatric patients and no experience with rating scales is sufficient to achieve adequate IRR even without training. Alternatively, the use of written vignettes does not provide a valid measure of HoNOS IRR.