S J Deakyne1, L Bajaj2, J Hoffman3, E Alessandrini4, D W Ballard5, R Norris6, L Tzimenatos7, M Swietlik8, E Tham2, R W Grundmeier9, N Kuppermann7, P S Dayan10. 1. Children's Hospital Colorado , Department of Research Informatics, Aurora, Colorado, United States. 2. University of Colorado , Department of Pediatrics, Section of Emergency Medicine, Aurora, Colorado, United States. 3. Nationwide Children's Hospital , Columbus, Ohio, United States. 4. Children's Hospital Medical Center , Cincinnati, Ohio, United States. 5. Kaiser Permanente, San Rafael Medical Center , San Rafael, California, United States. 6. Kaiser Permanente, Sacramento Medical Center , Sacramento, California, United States. 7. University of California Davis School of Medicine , Departments of Emergency Medicine and Pediatrics, Sacramento, California, United States. 8. Children's Hospital Colorado , Department of Clinical Application Services, Aurora, Colorado, United States. 9. Children's Hospital of Philadelphia and Perelman School of Medicine , Philadelphia, Pennsylvania, United States. 10. Columbia University College of Physicians and Surgeons , Department of Pediatrics, Division of Emergency Medicine, New York, New York, United States.
Abstract
BACKGROUND: Overuse of cranial computed tomography scans in children with blunt head trauma unnecessarily exposes them to radiation. The Pediatric Emergency Care Applied Research Network (PECARN) blunt head trauma prediction rules identify children who do not require a computed tomography scan. Electronic health record (EHR) based clinical decision support (CDS) may effectively implement these rules but must only be provided for appropriate patients in order to minimize excessive alerts. OBJECTIVES: To develop, implement and evaluate site-specific groupings of chief complaints (CC) that accurately identify children with head trauma, in order to activate data collection in an EHR. METHODS: As part of a 13 site clinical trial comparing cranial computed tomography use before and after implementation of CDS, four PECARN sites centrally developed and locally implemented CC groupings to trigger a clinical trial alert (CTA) to facilitate the completion of an emergency department head trauma data collection template. We tested and chose CC groupings to attain high sensitivity while maintaining at least moderate specificity. RESULTS: Due to variability in CCs available, identical groupings across sites were not possible. We noted substantial variability in the sensitivity and specificity of seemingly similar CC groupings between sites. The implemented CC groupings had sensitivities greater than 90% with specificities between 75-89%. During the trial, formal testing and provider feedback led to tailoring of the CC groupings at some sites. CONCLUSIONS: CC groupings can be successfully developed and implemented across multiple sites to accurately identify patients who should have a CTA triggered to facilitate EHR data collection. However, CC groupings will necessarily vary in order to attain high sensitivity and moderate-to-high specificity. In future trials, the balance between sensitivity and specificity should be considered based on the nature of the clinical condition, including prevalence and morbidity, in addition to the goals of the intervention being considered.
BACKGROUND: Overuse of cranial computed tomography scans in children with blunt head trauma unnecessarily exposes them to radiation. The Pediatric Emergency Care Applied Research Network (PECARN) blunt head trauma prediction rules identify children who do not require a computed tomography scan. Electronic health record (EHR) based clinical decision support (CDS) may effectively implement these rules but must only be provided for appropriate patients in order to minimize excessive alerts. OBJECTIVES: To develop, implement and evaluate site-specific groupings of chief complaints (CC) that accurately identify children with head trauma, in order to activate data collection in an EHR. METHODS: As part of a 13 site clinical trial comparing cranial computed tomography use before and after implementation of CDS, four PECARN sites centrally developed and locally implemented CC groupings to trigger a clinical trial alert (CTA) to facilitate the completion of an emergency department head trauma data collection template. We tested and chose CC groupings to attain high sensitivity while maintaining at least moderate specificity. RESULTS: Due to variability in CCs available, identical groupings across sites were not possible. We noted substantial variability in the sensitivity and specificity of seemingly similar CC groupings between sites. The implemented CC groupings had sensitivities greater than 90% with specificities between 75-89%. During the trial, formal testing and provider feedback led to tailoring of the CC groupings at some sites. CONCLUSIONS: CC groupings can be successfully developed and implemented across multiple sites to accurately identify patients who should have a CTA triggered to facilitate EHR data collection. However, CC groupings will necessarily vary in order to attain high sensitivity and moderate-to-high specificity. In future trials, the balance between sensitivity and specificity should be considered based on the nature of the clinical condition, including prevalence and morbidity, in addition to the goals of the intervention being considered.
Entities:
Keywords:
Head trauma; chief complaints; electronic health record; sensitivity and specificity
Authors: Nidhi R Shah; Andrew C Seger; Diane L Seger; Julie M Fiskio; Gilad J Kuperman; Barry Blumenfeld; Elaine G Recklet; David W Bates; Tejal K Gandhi Journal: J Am Med Inform Assoc Date: 2005-10-12 Impact factor: 4.497
Authors: Robyn Tamblyn; Allen Huang; Laurel Taylor; Yuko Kawasumi; Gillian Bartlett; Roland Grad; André Jacques; Martin Dawes; Michal Abrahamowicz; Robert Perreault; Nancy Winslade; Lise Poissant; Alain Pinsonneault Journal: J Am Med Inform Assoc Date: 2008-04-24 Impact factor: 4.497
Authors: Dean F Sittig; Adam Wright; Jerome A Osheroff; Blackford Middleton; Jonathan M Teich; Joan S Ash; Emily Campbell; David W Bates Journal: J Biomed Inform Date: 2007-09-21 Impact factor: 6.317
Authors: Eric Tham; Marguerite Swietlik; Sara Deakyne; Jeffrey M Hoffman; Robert W Grundmeier; Marilyn D Paterno; Beatriz H Rocha; Molly H Schaeffer; Deepika Pabbathi; Evaline Alessandrini; Dustin Ballard; Howard S Goldberg; Nathan Kuppermann; Peter S Dayan Journal: Appl Clin Inform Date: 2016-06-15 Impact factor: 2.342
Authors: Tamara P Miller; Yimei Li; Kelly D Getz; Jesse Dudley; Evanette Burrows; Jeffrey Pennington; Azada Ibrahimova; Brian T Fisher; Rochelle Bagatell; Alix E Seif; Robert Grundmeier; Richard Aplenc Journal: Br J Haematol Date: 2017-02-01 Impact factor: 6.998
Authors: Judy Shan; E Margaret Warton; Mary E Reed; David R Vinson; Nathan Kuppermann; Peter S Dayan; Stuart R Dalziel; Adina S Rauchwerger; Dustin W Ballard Journal: Perm J Date: 2021-11-22