Inter-rater reliability in the Paediatric Observation Priority Score (POPS).

OBJECTIVE: The primary objective of this study was to determine the level of inter-rater reliability between nursing staff for the Paediatric Observation Priority Score (POPS).
DESIGN: Retrospective observational study.
SETTING: Single-centre paediatric emergency department. PARTICIPANTS: 12 participants from a convenience sample of 21 nursing staff.
INTERVENTIONS: Participants were shown video footage of three pre-recorded paediatric assessments and asked to record their own POPS for each child. The participants were blinded to the original, in-person POPS. Further data were gathered in the form of a questionnaire to determine the level of training and experience the candidate had using the POPS score prior to undertaking this study. MAIN OUTCOME MEASURES: Inter-rater reliability among participants scoring of the POPS.
RESULTS: Overall kappa value for case 1 was 0.74 (95% CI 0.605 to 0.865), case 2 was 1 (perfect agreement) and case 3 was 0.66 (95% CI 0.58 to 0.744).
CONCLUSION: This study suggests there is good inter-rater reliability between different nurses' use of POPS in assessing sick children in the emergency department. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.