Marc H Gorelick1, Kenneth Yen. 1. Department of Pediatrics, Section of Emergency Medicine, Medical College of Wisconsin, and Children's Research Institute, P.O. Box 1997, Milwaukee, WI 53201, USA. mgorelic@mcw.edu
Abstract
BACKGROUND AND OBJECTIVE: To determine empirically chance agreement between different clinicians evaluating physical examination findings in children with acute abdominal pain. MATERIALS AND METHODS: Cross-sectional study of children age 3 to 18 years treated in a pediatric emergency department for acute abdominal pain. Three different examiners were provided the same historic information and asked to predict, independently and prior to examining the patient, the presence or absence of seven different clinical findings. Agreement between pairs of observers on these predicted findings was determined, and was defined as observed chance agreement. Actual examination findings were also recorded, and expected agreement due to chance was determined from the kappa statistic calculation. RESULTS: There were 68 pair of observations between two pediatric examiners, and 46 pair between pediatric and surgical examiners. Observed and expected chance agreement were very similar for six of the seven clinical findings. Agreement beyond chance for the actual exam findings was generally poor, with kappa less than 0.5 for all but one finding. CONCLUSIONS: Expected chance agreement, as calculated from the kappa statistic, is a reasonable reflection of empirically observed chance agreement between clinicians.
BACKGROUND AND OBJECTIVE: To determine empirically chance agreement between different clinicians evaluating physical examination findings in children with acute abdominal pain. MATERIALS AND METHODS: Cross-sectional study of children age 3 to 18 years treated in a pediatric emergency department for acute abdominal pain. Three different examiners were provided the same historic information and asked to predict, independently and prior to examining the patient, the presence or absence of seven different clinical findings. Agreement between pairs of observers on these predicted findings was determined, and was defined as observed chance agreement. Actual examination findings were also recorded, and expected agreement due to chance was determined from the kappa statistic calculation. RESULTS: There were 68 pair of observations between two pediatric examiners, and 46 pair between pediatric and surgical examiners. Observed and expected chance agreement were very similar for six of the seven clinical findings. Agreement beyond chance for the actual exam findings was generally poor, with kappa less than 0.5 for all but one finding. CONCLUSIONS: Expected chance agreement, as calculated from the kappa statistic, is a reasonable reflection of empirically observed chance agreement between clinicians.
Authors: Andrew M Fine; John S Brownstein; Lise E Nigrovic; Amir A Kimia; Karen L Olson; Amy D Thompson; Kenneth D Mandl Journal: Arch Pediatr Adolesc Med Date: 2011-01
Authors: Todd A Florin; Lilliam Ambroggio; Cole Brokamp; Mantosh S Rattan; Eric J Crotty; Andrea Kachelmeyer; Richard M Ruddy; Samir S Shah Journal: Pediatrics Date: 2017-09 Impact factor: 7.124
Authors: Andrew M Fine; Ben Y Reis; Lise E Nigrovic; Donald A Goldmann; Tracy N Laporte; Karen L Olson; Kenneth D Mandl Journal: J Am Med Inform Assoc Date: 2010 Jan-Feb Impact factor: 4.497