Dereddi Raja Shekar Reddy1, Tarun D Singh2, Pramod K Guru3, Amra Sakusic4, Ognjen Gajic5, John C O'Horo6, Alejandro A Rabinstein7. 1. Department of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN; Department of Medicine, Multidisciplinary Epidemiology and Translational Research in Intensive Care, Emergency and Perioperative Medicine (METRIC), Mayo Clinic, Rochester, MN. Electronic address: drraja.reddy2005@gmail.com. 2. Department of Medicine, Multidisciplinary Epidemiology and Translational Research in Intensive Care, Emergency and Perioperative Medicine (METRIC), Mayo Clinic, Rochester, MN; Department of Neurology, Division of Critical Care Neurology, Mayo Clinic, Rochester, MN. Electronic address: tarundsingh6@gmail.com. 3. Department of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN; Department of Medicine, Multidisciplinary Epidemiology and Translational Research in Intensive Care, Emergency and Perioperative Medicine (METRIC), Mayo Clinic, Rochester, MN. Electronic address: guru.pramod@mayo.edu. 4. Department of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN. Electronic address: sakusic.amra@mayo.edu. 5. Department of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN; Department of Medicine, Multidisciplinary Epidemiology and Translational Research in Intensive Care, Emergency and Perioperative Medicine (METRIC), Mayo Clinic, Rochester, MN. Electronic address: gajic.ognjen@mayo.edu. 6. Department of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN; Department of Medicine, Multidisciplinary Epidemiology and Translational Research in Intensive Care, Emergency and Perioperative Medicine (METRIC), Mayo Clinic, Rochester, MN; Department of Medicine, Division of Infectious Diseases, Mayo Clinic, Rochester, MN. Electronic address: OHoro.John@mayo.edu. 7. Department of Medicine, Multidisciplinary Epidemiology and Translational Research in Intensive Care, Emergency and Perioperative Medicine (METRIC), Mayo Clinic, Rochester, MN; Department of Neurology, Division of Critical Care Neurology, Mayo Clinic, Rochester, MN. Electronic address: rabinstein.alejandro@mayo.edu.
Abstract
PURPOSE: Up to 80% of critically ill patients have acute neurologic dysfunction syndromes. We evaluated interrater reliability between the examination by the investigator and the charted assessment by the nurse because the accuracy and reliability of detailed data sets extracted from the electronic medical records represents a keystone for creating EMR-based definitions. MATERIALS AND METHODS: We conducted a prospective observational study of intensive care unit (ICU) patients to assess the reliability of charted Confusion Assessment Method for the ICU, Glasgow Coma Scale (GSC), Full Outline of Unresponsiveness, and Richmond Agitation Sedation Scale (RASS) scores, and a composite measure of ABF defined as new-onset coma or delirium. Trained investigator blinded to nursing assessments performed the neurologic evaluations that were compared with nursing documentation. RESULTS: A total of 202 observations were performed in 55 ICU patients. Excellent correlation was noted for GCS and Full Outline of Unresponsiveness scores on Bland-Altman plots (Pearson correlation 0.87 and 0.92, respectively). Correlation for Confusion Assessment Method for the ICU was also high (κ= 0.86; 95% confidence interval [CI], 0.70-1.01). Richmond Agitation Sedation Scale had good agreement when scores were dichotomized as oversedated (less than -2) vs not oversedated, with κ= 0.76 (95% CI, 0.54-0.98). Investigator assessment and nurse charting were highly concordant (κ= 0.84; 95% CI, 0.71-0.99). CONCLUSION: Neurologic assessments documented on the EMR are reliable.
PURPOSE: Up to 80% of critically illpatients have acute neurologic dysfunction syndromes. We evaluated interrater reliability between the examination by the investigator and the charted assessment by the nurse because the accuracy and reliability of detailed data sets extracted from the electronic medical records represents a keystone for creating EMR-based definitions. MATERIALS AND METHODS: We conducted a prospective observational study of intensive care unit (ICU) patients to assess the reliability of charted Confusion Assessment Method for the ICU, Glasgow Coma Scale (GSC), Full Outline of Unresponsiveness, and Richmond Agitation Sedation Scale (RASS) scores, and a composite measure of ABF defined as new-onset coma or delirium. Trained investigator blinded to nursing assessments performed the neurologic evaluations that were compared with nursing documentation. RESULTS: A total of 202 observations were performed in 55 ICU patients. Excellent correlation was noted for GCS and Full Outline of Unresponsiveness scores on Bland-Altman plots (Pearson correlation 0.87 and 0.92, respectively). Correlation for Confusion Assessment Method for the ICU was also high (κ= 0.86; 95% confidence interval [CI], 0.70-1.01). Richmond Agitation Sedation Scale had good agreement when scores were dichotomized as oversedated (less than -2) vs not oversedated, with κ= 0.76 (95% CI, 0.54-0.98). Investigator assessment and nurse charting were highly concordant (κ= 0.84; 95% CI, 0.71-0.99). CONCLUSION: Neurologic assessments documented on the EMR are reliable.
Authors: Timothy D Girard; James C Jackson; Pratik P Pandharipande; Brenda T Pun; Jennifer L Thompson; Ayumi K Shintani; Sharon M Gordon; Angelo E Canonico; Robert S Dittus; Gordon R Bernard; E Wesley Ely Journal: Crit Care Med Date: 2010-07 Impact factor: 7.598
Authors: Eduard E Vasilevskis; E Wesley Ely; Theodore Speroff; Brenda T Pun; Leanne Boehm; Robert S Dittus Journal: Chest Date: 2010-11 Impact factor: 9.410
Authors: Eelco F M Wijdicks; William R Bamlet; Boby V Maramattom; Edward M Manno; Robyn L McClelland Journal: Ann Neurol Date: 2005-10 Impact factor: 10.422
Authors: E Wesley Ely; Ayumi Shintani; Brenda Truman; Theodore Speroff; Sharon M Gordon; Frank E Harrell; Sharon K Inouye; Gordon R Bernard; Robert S Dittus Journal: JAMA Date: 2004-04-14 Impact factor: 56.272
Authors: Juliana Barr; Gilles L Fraser; Kathleen Puntillo; E Wesley Ely; Céline Gélinas; Joseph F Dasta; Judy E Davidson; John W Devlin; John P Kress; Aaron M Joffe; Douglas B Coursin; Daniel L Herr; Avery Tung; Bryce R H Robinson; Dorrie K Fontaine; Michael A Ramsay; Richard R Riker; Curtis N Sessler; Brenda Pun; Yoanna Skrobik; Roman Jaeschke Journal: Am J Health Syst Pharm Date: 2013-01-01 Impact factor: 2.637
Authors: Catherine Z Cheung; Shabbir M H Alibhai; Michael Robinson; George Tomlinson; Dean Chittock; John Drover; Yoanna Skrobik Journal: Intensive Care Med Date: 2007-12-18 Impact factor: 17.440
Authors: Jorge I F Salluh; Han Wang; Eric B Schneider; Neeraja Nagaraja; Gayane Yenokyan; Abdulla Damluji; Rodrigo B Serafim; Robert D Stevens Journal: BMJ Date: 2015-06-03
Authors: E W Ely; S Gautam; R Margolin; J Francis; L May; T Speroff; B Truman; R Dittus; R Bernard; S K Inouye Journal: Intensive Care Med Date: 2001-11-08 Impact factor: 17.440
Authors: Heidi Lindroth; Babar A Khan; Janet S Carpenter; Sujuan Gao; Anthony J Perkins; Sikandar H Khan; Sophia Wang; Richard N Jones; Malaz A Boustani Journal: Ann Am Thorac Soc Date: 2020-09
Authors: Mayur B Patel; Josef Bednarik; Patricia Lee; Yahya Shehabi; Jorge I Salluh; Arjen J Slooter; Kate E Klein; Yoanna Skrobik; Alessandro Morandi; Peter E Spronk; Andrew M Naidech; Brenda T Pun; Fernando A Bozza; Annachiara Marra; Sayona John; Pratik P Pandharipande; E Wesley Ely Journal: Crit Care Med Date: 2018-11 Impact factor: 7.598