Chathuri Daluwatte1, Jose Vicente2, Loriano Galeotti3, Lars Johannesen4, David G Strauss4, Christopher G Scully5. 1. Office of Science and Engineering Laboratories, CDRH, US FDA, Silver Spring, MD, USA. Electronic address: cldaluwatte@mail.missouri.edu. 2. Office of New Drugs, CDER, US FDA, Silver Spring, MD, USA. 3. Office of Device Evaluation, CDRH, US FDA, Silver Spring, MD, USA. 4. Office of Clinical Pharmacology, CDER, US FDA, Silver Spring, MD, USA. 5. Office of Science and Engineering Laboratories, CDRH, US FDA, Silver Spring, MD, USA.
Abstract
PURPOSE: Performance of ECG beat detectors is traditionally assessed on long intervals (e.g.: 30min), but only incorrect detections within a short interval (e.g.: 10s) may cause incorrect (i.e., missed+false) heart rate limit alarms (tachycardia and bradycardia). We propose a novel performance metric based on distribution of incorrect beat detection over a short interval and assess its relationship with incorrect heart rate limit alarm rates. BASIC PROCEDURES: Six ECG beat detectors were assessed using performance metrics over long interval (sensitivity and positive predictive value over 30min) and short interval (Area Under empirical cumulative distribution function (AUecdf) for short interval (i.e., 10s) sensitivity and positive predictive value) on two ECG databases. False heart rate limit and asystole alarm rates calculated using a third ECG database were then correlated (Spearman's rank correlation) with each calculated performance metric. MAIN FINDINGS: False alarm rates correlated with sensitivity calculated on long interval (i.e., 30min) (ρ=-0.8 and p<0.05) and AUecdf for sensitivity (ρ=0.9 and p<0.05) in all assessed ECG databases. Sensitivity over 30min grouped the two detectors with lowest false alarm rates while AUecdf for sensitivity provided further information to identify the two beat detectors with highest false alarm rates as well, which was inseparable with sensitivity over 30min. PRINCIPAL CONCLUSIONS: Short interval performance metrics can provide insights on the potential of a beat detector to generate incorrect heart rate limit alarms. Published by Elsevier Inc.
PURPOSE: Performance of ECG beat detectors is traditionally assessed on long intervals (e.g.: 30min), but only incorrect detections within a short interval (e.g.: 10s) may cause incorrect (i.e., missed+false) heart rate limit alarms (tachycardia and bradycardia). We propose a novel performance metric based on distribution of incorrect beat detection over a short interval and assess its relationship with incorrect heart rate limit alarm rates. BASIC PROCEDURES: Six ECG beat detectors were assessed using performance metrics over long interval (sensitivity and positive predictive value over 30min) and short interval (Area Under empirical cumulative distribution function (AUecdf) for short interval (i.e., 10s) sensitivity and positive predictive value) on two ECG databases. False heart rate limit and asystole alarm rates calculated using a third ECG database were then correlated (Spearman's rank correlation) with each calculated performance metric. MAIN FINDINGS: False alarm rates correlated with sensitivity calculated on long interval (i.e., 30min) (ρ=-0.8 and p<0.05) and AUecdf for sensitivity (ρ=0.9 and p<0.05) in all assessed ECG databases. Sensitivity over 30min grouped the two detectors with lowest false alarm rates while AUecdf for sensitivity provided further information to identify the two beat detectors with highest false alarm rates as well, which was inseparable with sensitivity over 30min. PRINCIPAL CONCLUSIONS: Short interval performance metrics can provide insights on the potential of a beat detector to generate incorrect heart rate limit alarms. Published by Elsevier Inc.
Authors: A L Goldberger; L A Amaral; L Glass; J M Hausdorff; P C Ivanov; R G Mark; J E Mietus; G B Moody; C K Peng; H E Stanley Journal: Circulation Date: 2000-06-13 Impact factor: 29.690
Authors: Deborah A Whalen; Patricia M Covelle; James C Piepenbrink; Karen L Villanova; Charlotte L Cuneo; Eric H Awtry Journal: J Cardiovasc Nurs Date: 2014 Sep-Oct Impact factor: 2.083
Authors: Christine Weirich Paine; Veena V Goel; Elizabeth Ely; Christopher D Stave; Shannon Stemler; Miriam Zander; Christopher P Bonafide Journal: J Hosp Med Date: 2015-12-14 Impact factor: 2.960
Authors: Barbara J Drew; Patricia Harris; Jessica K Zègre-Hemsey; Tina Mammone; Daniel Schindler; Rebeca Salas-Boni; Yong Bai; Adelita Tinoco; Quan Ding; Xiao Hu Journal: PLoS One Date: 2014-10-22 Impact factor: 3.240