Objective The primary objective of this study was to determine the level of inter-rater reliability between nursing staff for the Paediatric Observation Priority Score (POPS).
Design Retrospective observational studySetting Single centre paediatric emergency department Participants 12 participants from a convenience sample of 21 nursing staff.Interventions Participants were shown video footage of three pre-recorded paediatric assessments and asked to record their own POPS for each child. The participants were blinded to the original, in person POPS. Further data were gathered in the form of a questionnaire to determine the level of training and experience the candidate had using the POPS score prior to undertaking this study.
Main outcome measuresInter-rater reliability amongst participants scoring of the POPS.
ResultsOverall Kappa value for case 1 was 0.74 (95% confidence interval 0.605 to 0.865), case 2 was 1 (perfect agreement) and case 3 was 0.66 (95% confidence interval 0.58 to 0.744).
ConclusionThis study suggests there is good inter-rater reliability between different nurses use of POPS in assessing sick children in the Emergency Department.3