Kenneth A Michelson1, David N Williams2, Arianna H Dart1, Prashant Mahajan3, Emily L Aaronson4, Richard G Bachur1, Jonathan A Finkelstein5. 1. Division of Emergency Medicine, Boston Children's Hospital, Boston, MA, USA. 2. Division of Orthopedic Surgery, Boston Children's Hospital, Boston, MA, USA. 3. Departments of Emergency Medicine and Pediatrics, University of Michigan, Ann Arbor, MI, USA. 4. Department of Emergency Medicine, Massachusetts General Hospital, Boston, MA, USA. 5. Division of General Pediatrics, Boston Children's Hospital, Boston, MA, USA.
Abstract
OBJECTIVES: Using case review to determine whether a patient experienced a delayed diagnosis is challenging. Measurement would be more accurate if case reviewers had access to multi-expert consensus on grading the likelihood of delayed diagnosis. Our objective was to use expert consensus to create a guide for objectively grading the likelihood of delayed diagnosis of appendicitis, new-onset diabetic ketoacidosis (DKA), and sepsis. METHODS: Case vignettes were constructed for each condition. In each vignette, a patient has the condition and had a previous emergency department (ED) visit within 7 days. Condition-specific multi-specialty expert Delphi panels reviewed the case vignettes and graded the likelihood of a delayed diagnosis on a five-point scale. Delayed diagnosis was defined as the condition being present during the previous ED visit. Consensus was defined as ≥75% agreement. In each Delphi round, panelists were given the scores from the previous round and asked to rescore. A case scoring guide was created from the consensus scores. RESULTS: Eighteen expert panelists participated. Consensus was achieved within three Delphi rounds for all appendicitis and sepsis vignettes. We reached consensus on 23/30 (77%) DKA vignettes. A case review guide was created from the consensus scores. CONCLUSIONS: Multi-specialty expert reviewers can agree on the likelihood of a delayed diagnosis for cases of appendicitis and sepsis, and for most cases of DKA. We created a guide that can be used by researchers and quality improvement specialists to allow for objective case review to determine when delayed diagnoses have occurred for appendicitis, DKA, and sepsis.
OBJECTIVES: Using case review to determine whether a patient experienced a delayed diagnosis is challenging. Measurement would be more accurate if case reviewers had access to multi-expert consensus on grading the likelihood of delayed diagnosis. Our objective was to use expert consensus to create a guide for objectively grading the likelihood of delayed diagnosis of appendicitis, new-onset diabetic ketoacidosis (DKA), and sepsis. METHODS: Case vignettes were constructed for each condition. In each vignette, a patient has the condition and had a previous emergency department (ED) visit within 7 days. Condition-specific multi-specialty expert Delphi panels reviewed the case vignettes and graded the likelihood of a delayed diagnosis on a five-point scale. Delayed diagnosis was defined as the condition being present during the previous ED visit. Consensus was defined as ≥75% agreement. In each Delphi round, panelists were given the scores from the previous round and asked to rescore. A case scoring guide was created from the consensus scores. RESULTS: Eighteen expert panelists participated. Consensus was achieved within three Delphi rounds for all appendicitis and sepsis vignettes. We reached consensus on 23/30 (77%) DKA vignettes. A case review guide was created from the consensus scores. CONCLUSIONS: Multi-specialty expert reviewers can agree on the likelihood of a delayed diagnosis for cases of appendicitis and sepsis, and for most cases of DKA. We created a guide that can be used by researchers and quality improvement specialists to allow for objective case review to determine when delayed diagnoses have occurred for appendicitis, DKA, and sepsis.
Authors: Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde Journal: J Biomed Inform Date: 2008-09-30 Impact factor: 6.317
Authors: Kenneth A Michelson; Todd W Lyons; Richard G Bachur; Michael C Monuteaux; Jonathan A Finkelstein Journal: Pediatrics Date: 2018-04-12 Impact factor: 7.124
Authors: Christina L Cifra; Patrick Ten Eyck; Jeffrey D Dawson; Heather Schacht Reisinger; Hardeep Singh; Loreen A Herwaldt Journal: Pediatr Crit Care Med Date: 2020-05 Impact factor: 3.624
Authors: Faris Hussain; Alison Cooper; Andrew Carson-Stevens; Liam Donaldson; Peter Hibbert; Thomas Hughes; Adrian Edwards Journal: BMC Emerg Med Date: 2019-12-04
Authors: Kenneth A Michelson; Scott D Reeves; Joseph A Grubenhoff; Andrea T Cruz; Pradip P Chaudhari; Arianna H Dart; Jonathan A Finkelstein; Richard G Bachur Journal: JAMA Netw Open Date: 2021-08-02