Smartphone app for neonatal heart rate assessment: an observational study.

BACKGROUND: Heart rate (HR) assessment is crucial in neonatal resuscitation, but pulse oximetry (PO) and electrocardiography (ECG) are rarely accessible in low-resource to middle-resource settings. This study evaluated a free-of-charge smartphone application, NeoTap, which records HR with a screen-tapping method bypassing mental arithmetic calculations.
METHODS: This observational study was carried out during three time periods between May 2015 and January 2019 in Uganda in three phases. In phase 1, a metronome rate (n=180) was recorded by low-end users (midwives) using NeoTap. In phase 2, HR (n=69) in breathing neonates was recorded by high-end users (paediatricians) using NeoTap versus PO. In phase 3, HR (n=235) in non-breathing neonates was recorded by low-end users using NeoTap versus ECG.
RESULTS: In high-end users the mean difference was 3 beats per minute (bpm) higher with NeoTap versus PO (95% agreement limits -14 to 19 bpm), with acquisition time of 5 seconds. In low-end users, the mean difference was 6 bpm lower with NeoTap versus metronome (95% agreement limits -26 to 14 bpm) and 3 bpm higher with NeoTap versus ECG in non-breathing neonates (95% agreement limits -48 to 53 bpm), with acquisition time of 2.7 seconds. The agreement between NeoTap and ECG was good in the HR categories of 60-99 bpm and ≥100 bpm; HR <60 bpm had few measurements (kappa index 0.71, 95% CI 0.63 to 0.79).
CONCLUSION: HR could be accurately and rapidly assessed using a smartphone application in breathing neonates in a low-resource setting. Clinical assessment by low-end users was less accurate with wider CI but still adds clinically important information in non-breathing neonates. The authors suggest low-end users may benefit from auscultation-focused training. More research is needed to evaluate its feasibility in clinical use. © Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Heart rate is crucial in evaluating the status of neonates during resuscitation.

Previous simulation studies and an animal model have shown that a smartphone application, NeoTap, offers fast and accurate heart rate monitoring.

Clinical data on heart rate monitoring of neonates with a smartphone app are not yet available.

A smartphone application can improve speed and accuracy during heart rate assessment of neonates by auscultation in clinical setting.

NeoTap could be a low-cost alternative to expensive medical equipment in both low-resource and high-resource settings.

Introduction

Neonatal deaths stand at 47% of all deaths in children <5 years of age, equal to 2.5 million neonates dying in 2017, with about 1 million dying on the first day.1 2 Intrapartum-related events (birth asphyxia) stand at around 0.66 million deaths (uncertainty range of 0.42–1.05 million).3 Moreover, 2.6 million stillbirths occur every year, 50% after the onset of labour.4 Successful resuscitation could prevent many early neonatal deaths and decrease the morbidity of neonates surviving asphyxia.5

Heart rate (HR) is one of the most important clinical parameters in evaluating the status of a neonate, to guide neonatal resuscitation and to predict early neonatal mortality and morbidity.6–8 International guidelines state that resuscitation efforts should be guided by checking respiration and HR.7 9 Pulse oximetry (PO) is valuable in monitoring HR and measuring oxygen saturation,10 11 but HR is measured faster and more accurately through electrocardiography (ECG).7 9 Auscultation, recommended when PO and ECG are unavailable, is often inaccurate.12–16 Doppler is not recommended in current international guidelines.7 9 Resource-limited settings rarely have PO, ECG or Doppler.17 In 2017, a systematic review investigated the accuracy of seven new technologies for monitoring HRs of neonates and concluded that none could be recommended as suitable for widespread clinical use at this stage.18 The need to develop a low-cost, rapid and accurate alternative method for monitoring HR during neonatal resuscitation has been highlighted.18 19

NeoTap (NeoTap Life Support-NeoTapLS) is a free-of-charge smartphone app for HR recording (Google Play and App Store), developed by a non-profit organisation (Tap4Life, Stockholm, Sweden).20 21 It uses a screen-tapping method; the user auscultates the heart sounds and taps the beat on the screen a minimum of three times, and the app generates a number, bypassing mental arithmetic (figure 1). No probes are needed, and the interface is functional even when protected inside a latex glove. The app can also be used to estimate cord pulsations and fetal HR; an instructional video on ‘How to use NeoTapLS’ is available in online supplementary file 2 and the full version is available on YouTube. A significant proportion of health personnel in low-resource settings have their own smartphone, a number that is increasing.22 NeoTap has shown promising results from three simulation studies and an animal model.23–26

Figure 1

Tap to record the neonate’s heart rate by the NeoTap application. Heart rate <100 bpm (yellow) at 37 s: prepare for ventilation. Heart rate <60 bpm (red) at 2 min and 11 s: start chest compressions? Heart rate ≥100 bpm (green) at 3 min and 37 s: neonatal resuscitation is going well. bpm, beats per minute.

The aim of our study was to evaluate NeoTap by determining the speed and accuracy at which users could assess a rhythm by a metronome (low-end users, midwives well familiar with neonatal resuscitation but with no prior experience of the tapping method), HR in breathing neonates (high-end users, paediatricians well familiar with the tapping method), and HR in neonates in need of positive pressure ventilation (PPV), equal to neonates with insufficient or no breathing at birth (low-end users). The hypothesis was that NeoTap is as fast or faster than PO and ECG and accurate enough to guide neonatal resuscitations.

Methods

Study design

This prospective observational study was carried out during three time periods between May 2015 and January 2019. It is a substudy of the ‘Randomized Clinical Trial Assessing Laryngeal Mask Airway Versus Face-Mask Ventilation in Neonatal Resuscitation (LMA vs FMV)’ (ClinicalTrials.gov NCT02042118) and the ‘Neonatal Resuscitation with Supraglottic Airway Trial (NeoSupra)’ (ClinicalTrials.gov NCT03133572), conducted at the Department of Obstetrics and Gynaecology, Mulago National Referral Hospital, Uganda, which has around 25 000 deliveries per year.

Data collection

The study had three phases to evaluate NeoTap by testing low-end users’ ability to tap a metronome rhythm and high-end and low-end users’ ability to tap a correct HR in clinical practice, as well as assess the swiftness of the method in clinical use. Low-end users in the first and third phases were research midwives and exposed on a daily basis to neonatal resuscitation and trained according to Helping Babies Breathe, as part of the NeoSupra trial.27 High-end users were two paediatric specialists. The users simultaneously tapped the pace of the rhythm of the metronome, or the HR they auscultated over the heart of the neonate, on the smartphone screen with the NeoTap app running. NeoTap is designed to display the average rate of the last three taps, meaning a number was displayed after a minimum of three taps (figure 2). The metronome was used as the true value in phase 1, HR by PO (PalmSAT 2500, Nonin Medical, Plymouth, USA) as the true value in phase 2 (no other monitoring equipment was available at the time), and HR by ECG as the true value in phase 3. A convenience sample was chosen for each phase due to practical reasons and the exploratory nature of the study.

Figure 2

Low-end user using NeoTap to record heart rate (heart rate shown 147) and dry-electrode electrocardiography (heart rate shown 138). Picture used with written permission from the parents.

Phase 1: metronome rate by NeoTap (low-end users, a simulation)

In phase 1 we assessed the ability of low-end users to correctly record an audible metronome rhythm. Ten rates were randomly selected using a number generator set over the range of 20–150 beats per minute (bpm),28 and the rates (masked to the participants) were presented by the metronome for approximately 20 s. Low-end users recorded the rate with the NeoTap, after first being introduced to the app for 3–5 min, and wrote down the rate obtained on separate papers. The midwives included in the study were chosen irrespective of prior experience of smartphones. Informed consent was obtained from all participants.

Phase 2: HR by NeoTap versus PO (high-end users, healthy neonates)

In phase 2, we assessed the swiftness and ability of two high-end users to accurately record HR using NeoTap compared with PO in neonates not in need of PPV. PO was placed on the neonate on arrival on the resuscitation table by one high-end user and HR was assessed using NeoTap by the second high-end user as soon as HR was displayed by PO. Directly after HR was assessed using NeoTap, the second high-end user checked the HR on the PO (not masked to the participants) and noted both HRs on a paper. Acquisition time of NeoTap was noted (defined in seconds from start to end of tapping). Data were collected on-site when high-end users were available, and it was at this stage when it was unfeasible to involve low-end users since few were available. The first four paired HRs per neonate were collected. Informed consent was obtained from the parents on maternal admission and from the high-end users.

Phase 3: HR by NeoTap versus ECG (low-end users, neonates in need of PPV)

In phase 3, we assessed the swiftness and ability of low-end users to accurately record HR using NeoTap compared with ECG in neonates in need of PPV. ECG was placed on the neonate once feasible and HR was assessed using NeoTap when HR was displayed by ECG and compared with HR obtained by ECG at the same time (not masked to the participants). Low-end users were already introduced to NeoTap in phase 1 and did not receive additional training prior to phase 3. The acquisition time of NeoTap was noted as in phase 2. No high-end users were available at the study site, and it was therefore not possible to include them. All resuscitations were video-recorded using an HD 1080P Black Box AI-IP018 camera (Shenzhen Aishine Electronics, China). The first 49 HR data were supervised by the researchers and collected on-site by traditional ECG (Philips Intellivue X2, Amsterdam, The Netherlands), and the rest were unsupervised and collected from video review with dry-electrode ECG (NeoBeat, Laerdal Global Health, Stavanger, Norway). All paired HRs (HR by NeoTap at the same time as HR by ECG) until end of resuscitation were collected; no upper limit was set for numbers of assessments per neonate (figure 2). All neonates lacking simultaneous data (only one device, poor signal acquisition or poor camera angle) were excluded (n=270). Data on Apgar and weight were double-entered using Android devices running the Open Data Kit V.2.0 tool suite.29 Written and oral information was given to all parents on maternal admission, and deferred consent was obtained post-hoc in cases needing resuscitation.27

Patient and public involvement

It was not appropriate to involve patients or the public in the design, or conduct, or reporting or dissemination plans for the study.

Data analysis

The agreement in phase 1 was assessed using a Bland-Altman plot (including Pearson’s correlation coefficient between HR difference and HR values). The agreement in phase 2 and 3 was assessed using a Bland-Altman plot for repeated measures (including repeated measure correlation between HR difference and HR values), and in phase 3 using repeated measures version of kappa index on the following HR categories: <60, 60–99 and ≥100 bpm. The sensitivity and specificity of NeoTap in detecting bradycardia (HR <100 bpm) were also calculated. Acquisition times in phase 2 and 3 were summarised with median and IQR for descriptive purposes. Statistical analysis was performed using R V.3.5 (R Foundation for Statistical Computing, Vienna, Austria).30

Results

During the three phases we had no issues with the reliability of the app. The app is designed to use very low resources from the phone and is continuously updated. It never crashed and froze and no battery problems occurred. The quality of the videos in phase 3 was excellent, with only a few exclusions due to non-visible HR on NeoTap or ECG.

Phase 1: metronome rate by NeoTap (low-end users, a simulation)

One hundred and eighty recordings were assessed by 18 low-end users. There was a mean difference of −6 bpm with NeoTap versus metronome, with 95% agreement limits of −26 to 14 bpm (Bland-Altman plot) (figure 3). The difference was inversely correlated with the metronome rhythm (r=−0.50, p<0.0001), moving from an overestimation to an underestimation. NeoTap recordings ranged from 21 to 131 bpm, and the metronome was set at a range of 30–130 bpm. In total 77% differed by 10 or less from the true value and 95% differed by 20 or less.

Figure 3

Agreement between the metronome rhythm and the rate low-end users recorded using NeoTap: a simulation. Metronome rhythm is shown on the x-axis and the difference from recordings done by NeoTap on the y-axis (Bland-Altman plot) (data set in online supplementary file). bpm, beats per minute.

Phase 2: HR by NeoTap versus PO (high-end users, healthy neonates)

Sixty-nine HR recordings were assessed on 33 neonates as soon as HR by PO was available, which was at 120 s or more after birth (table 1). There was a mean difference of 3 bpm with NeoTap versus PO, with 95% agreement limits of −14 to 19 bpm (Bland-Altman plot) (figure 4). The difference was inversely correlated with HR (r=−0.43, p=0.009); it decreased, not towards a zero difference, but towards a negative difference. HR ranged from 132 to 214 bpm with NeoTap, and from 126 to 205 bpm with PO. The median acquisition time for the estimated HR was 5 s (IQR 5–5), ranging from 3 to 15 s. In total, 88% differed by 10 or less from the true value and 96% differed by 20 or less.

Table 1

Characteristics of neonates in phase 2 and 3 of the study

Characteristics	Phase 2	Phase 3
Number of neonates	33	98
Number of recordings	69	235
In need of PPV	No	Yes
Apgar 1 min	9 (IQR 9–9)	3 (IQR 2–4)
Apgar 5 min	9 (IQR 9–10)	5 (IQR 4–6)
Median weight (g)	3000 (IQR 2700–3390)	3100 (IQR 2750–3400)
Time of HR assessment after birth (s)	120–1800 (median 300, IQR 180–600)	~100–720*

*Exact data on time for measurements not possible to obtain through the method used in phase 3.

HR, heart rate; PPV, positive pressure ventilation.

Figure 4

Agreement between NeoTap and pulse oximetry among high-end users recording heart rate in healthy breathing neonates. Pulse oximetry recording is shown on the x-axis and the difference between the readings on the y-axis (Bland-Altman plot) (data set in online supplementary file). bpm, beats per minute.

Phase 3: HR by NeoTap versus ECG (low-end users, neonates in need of PPV)

Two hundred and thirty-five HR recordings were assessed by approximately 18 low-end users on 98 neonates (table 1). There was a mean difference of 3 bpm with NeoTap versus ECG, with 95% agreement limits of −48 to 53 bpm, a difference that did not correlate with HR (r=−0.06, p=0.51) (Bland-Altman plot) (figure 5). HR ranged from 46 to 294 bpm with NeoTap, and from 46 to 229 bpm with ECG. The median acquisition time for the estimated HR was 2.7 s (IQR 1.7–4.7), ranging from 0.8 to 13.9 s. When HR was evaluated using the categories <60, 60–99 and ≥100 bpm (table 2), the agreement between NeoTap and ECG was good (kappa index 0.71, 95% CI 0.63 to 0.79). The <60 bpm category included only three recordings, with NeoTap differing +3, –12 and −25 from ECG. The 60–99 bpm category included 27 recordings differing by a median of 7 (IQR 5–14) from the true value, and the >100 bpm category included 205 recordings differing by a median of 12 (IQR 5–24) from the true value. In total, 48% differed 10 or less from the true value and 73% differed by 20 or less. Overall, NeoTap showed very good sensitivity (0.87) and specificity (0.96) in detecting bradycardia (HR <100 bpm).

Figure 5

Agreement between NeoTap and ECG among low-end users recording heart rate in non-breathing neonates during neonatal resuscitation. ECG recordings are shown on the x-axis and the difference between the readings on the y-axis (Bland-Altman plot) (data set in online supplementary file). bpm, beats per minute; ECG, electrocardiography.

Table 2

Distribution in categories of correctly and incorrectly recorded heart rates among midwives assessing neonates in need of positive pressure ventilation compared with electrocardiography, phase 3

NeoTap	Electrocardiography
	<60 bpm	60–99 bpm	≥100 bpm
<60 bpm	1	1	0
60–99 bpm	2	22	8
≥100 bpm	0	4	197

Data expressed as number of evaluations in each category.

bpm, beats per minute.

The complete data set for all three phases is available in online supplementary file.

Discussion

This study presents new data on the feasibility of using a smartphone app for swift and accurate HR assessments in neonates, both those in need and not in need of PPV. NeoTap showed variable accuracy and precision in estimating rates and HRs, especially in low-end users in HR auscultation. Low-end users could quickly learn the tapping technique and both high-end and low-end users were quick in estimating HRs.

In low-resource settings, neonatal resuscitation is mainly carried out by health personnel with limited experience in both airway management and auscultation. Reliable monitoring equipment is rarely available.17 HR assessment is inaccurate due to imprecise auscultation and palpation or errors in mental arithmetic calculation.12–16 31 Auscultation is a three-step procedure: first is auscultating the heart, second is understanding what you hear (first and second heart sounds) and third is translating it by calculation to provide a number. A recent clinical study showed that HR auscultation by clinicians compared with PO and ECG was quick and reasonably accurate in neonates not in need of PPV. Still, studies during neonatal resuscitation with less experienced health personnel are lacking.32 Although imprecise, international guidelines recommend HR determination by physical examination if no PO and/or ECG are available.7 9

NeoTap over-rides the need for mental arithmetic calculations. In 2018, two simulation studies reported that HR could be accurately and rapidly assessed using NeoTap on a manikin.23 24 In 2019, another simulation study showed that NeoTap reduced the time to the first HR and the time to initiate heart compressions and to administer epinephrine compared with auscultation and mental computation.25 A porcine model showed that HR assessment with NeoTap had similar accuracy compared with auscultation with a digital stethoscope, ECG or carotid blood flow during asphyxia and faster acquisition time compared with the 6 s or 10 s method with a digital stethoscope.26 However, data on the clinically important group of HR <60 bpm are few and show contradictory results in the studies above as well as in the present study. A recent review on HR assessment stated that novel technologies including tap-based applications can support HR assessment, but that their clinical efficacy during neonatal resuscitation has yet to be investigated.33

The accuracy in this study was highest among low-end users recording a metronome rhythm and in high-end users recording HR compared with PO in neonates not in need of PPV. In phase 1 there was an inverse correlation between the bpm presented and the difference—participants overestimate low beats and underestimate high beats. We think this is because in low rates it is easy to tap too early and be too eager to tap the screen even when no sounds are presented, and in high rates it is hard to keep the high speed if you are not used to the tapping technic. In clinical use, this effect may be problematic in low HRs, but in high HRs it has minor clinical implications. Low-end users demonstrated the same mean difference in phase 3 as high-end users in phase 2, but with wider 95% agreement limits. Some recordings seemed to be twice the actual value. Health personnel, inexperienced in listening to hearts, may tap on both the first and second heart sounds, that is, tapping twice for each heart beat, a potential risk for errors in HR calculation even when auscultating without support from NeoTap. A qualitative study in our setting revealed that midwives did not assess HR by auscultation before the start of this study. Instead they palpated the cord or the chest.34 The midwives, however, accurately assessed the metronome rhythm. Auscultation-focused training and awareness of the first and second heart sounds could potentially improve clinical HR assessment with the tapping method. Clinical studies have shown that training is crucial and repeated training of health personnel affects the management of patients.35 36 It is likely that clinicians would have obtained better results due to prior experience in HR auscultation, and a training module for HR auscultation in resuscitation simulators could probably improve auscultation skills and performance of low-end users. Phase 3 shows few disagreements and narrow IQR ranges, and approximately three-fourths of HRs differed 20 or less from the true value in the 60–99 bpm and ≥100 bpm categories, pointing at a high probability of adhering to guidelines.

There is need for a low-cost, rapid and accurate alternative method for monitoring HR during neonatal resuscitation in low-resource to middle-resource settings. Rapid and accurate decision-making is crucial in neonatal resuscitation and PO is too slow to fulfil international resuscitation guidelines.7 9 37 ECG is fast and accurate but may be difficult to apply on the wet torso of the neonate, leading to delayed application.38 39 NeoTap or other apps for HR assessment are potentially faster than PO and ECG, offering an alternative way to fulfil international guidelines.24 25 However, the reported acquisition times in phase 3 were possibly due to a misunderstanding of the ‘tap at least three times for HR’ feature of the app. Users should be reminded to tap until they feel confident of tapping the same pace as the HR they hear, still a swift method potentially leading to higher accuracy.

There are limitations to this study. Low-end users were skilled in neonatal resuscitation and were trained in Helping Babies Breathe shortly before the study started. The participants were part of an ongoing trial providing a better environment for auscultation. Less experienced healthcare providers in rural areas may produce inferior results. The gold standard is different for each of the three phases due to practical reasons, for example lack of ECG at the study site during phase 2. PO has high sensitivity and specificity but may display a too low HR during the first minutes of life.40 PO in this study was used in neonates not in need of PPV at 120 s or more after birth, supporting the reliability of the PO data, and since NeoTap showed slightly higher HRs it points at NeoTap being accurate. The participants in phase 2 and 3 were not masked to the true value, introducing a potential bias, but the algorithm of NeoTap displays the average rate of the last three taps. This, combined with the very short acquisition times in both phases, de-emphasises this point. We had different users in the respective phases for practical reasons, making it harder to generalise the results. Most of the HR assessments in phase 3 were unsupervised, meaning timing of placement of ECG and first HR assessment was up to the user. Also, in phase 3, we could not identify the users since only the hands were caught on the videos; therefore, the number of users in this phase is an approximation. Lastly, we had few measurements of HR <100 bpm and especially <60 bpm, limiting the possibility of evaluating the importance of the results in clinical practice.

Conclusion

NeoTap provides a low-cost technology well adapted to the context of low-resource settings. It can be used in an inexpensive smartphone for swift and accurate HR registration. Clinical assessment by low-end users was less accurate and the authors suggest they may benefit from auscultation-focused training. Further studies are needed to demonstrate whether smartphone apps are useful in clinical practice.