| Literature DB >> 35461692 |
Marianna Mitratza1, Brianna Mae Goodale2, Aizhan Shagadatova3, Vladimir Kovacevic2, Janneke van de Wijgert4, Timo B Brakenhoff5, Richard Dobson6, Billy Franks5, Duco Veen7, Amos A Folarin8, Pieter Stolk4, Diederick E Grobbee9, Maureen Cronin2, George S Downward3.
Abstract
Containing the COVID-19 pandemic requires rapidly identifying infected individuals. Subtle changes in physiological parameters (such as heart rate, respiratory rate, and skin temperature), discernible by wearable devices, could act as early digital biomarkers of infections. Our primary objective was to assess the performance of statistical and algorithmic models using data from wearable devices to detect deviations compatible with a SARS-CoV-2 infection. We searched MEDLINE, Embase, Web of Science, the Cochrane Central Register of Controlled Trials (known as CENTRAL), International Clinical Trials Registry Platform, and ClinicalTrials.gov on July 27, 2021 for publications, preprints, and study protocols describing the use of wearable devices to identify a SARS-CoV-2 infection. Of 3196 records identified and screened, 12 articles and 12 study protocols were analysed. Most included articles had a moderate risk of bias, as per the National Institute of Health Quality Assessment Tool for Observational and Cross-Sectional Studies. The accuracy of algorithmic models to detect SARS-CoV-2 infection varied greatly (area under the curve 0·52-0·92). An algorithm's ability to detect presymptomatic infection varied greatly (from 20% to 88% of cases), from 14 days to 1 day before symptom onset. Increased heart rate was most frequently associated with SARS-CoV-2 infection, along with increased skin temperature and respiratory rate. All 12 protocols described prospective studies that had yet to be completed or to publish their results, including two randomised controlled trials. The evidence surrounding wearable devices in the early detection of SARS-CoV-2 infection is still in an early stage, with a limited overall number of studies identified. However, these studies show promise for the early detection of SARS-CoV-2 infection. Large prospective, and preferably controlled, studies recruiting and retaining larger and more diverse populations are needed to provide further evidence.Entities:
Mesh:
Year: 2022 PMID: 35461692 PMCID: PMC9020803 DOI: 10.1016/S2589-7500(22)00019-X
Source DB: PubMed Journal: Lancet Digit Health ISSN: 2589-7500
Eligible studies using wearable devices to detect changes in physiological parameters among COVID-19-positive individuals
| Bogu and Snyder (2021) | Observational and retrospective/Subset of Mishra et al's (2020) | Fitbit | 25/106 | NR | Self-reported COVID-19 diagnosis confirmed with a physician note | SO −6·94 to +5·12 | Long-term short-term memory networks-based autoencoder for anomaly detection (known as LAAD) | Changes in resting HR from baseline | NR | NR | Positive predictive value 0·91 (95% CI 0·854–0·967); sensitivity 0·36 (95% CI 0·232–0·487); F-beta (0·1) 0·79 (95% CI 0·693–0·888); abnormal HR lasted longer in the COVID-19-positive cohort; more COVID-19-positive cases had >1 day of abnormal HR |
| Cleary et al (2021) | First year medical interns, USA/Observational and retrospective | FitBit Inspire HR and the Apple Charge 3 Watch | 22/105 | NR | Self-reported SARS-CoV-2 test | NA | Binary classifier | Resting HR, sleep duration (min), and total step count | 105 (100%) | NA | Activity data: AUC 0·75 (95% CI 0·63–0·87); all sensor data: AUC 0·75 (0·62–0·89) |
| Hassantabar et al (2020) | Observational and cross-sectional/Health-care workers and patients of San Matteo hospital, Pavia, Italy | Empatica E4, pulse oximeter, and blood pressure monitor | 57/87 | NR | PCR test upon hospital arrival | ND | Deep neural networks | Galvanic skin response, SpO2, blood pressure, and questionnaire data (eg, on symptoms, presence of chronic lung diseases, and whether participants are immunocompromised) | 52 (60%; 18 healthy, 16 asymptomatic, and 18 symptomatic) | 17 (20%) in test set (6 healthy, 5 asymptomatic, and 6 symptomatic); 18 (20%) in the validation set (6 healthy, 6 asymptomatic, and 6 symptomatic) | F1 (ie, the harmonic mean of precision and sensitivity) 98·2%; true positive 98·1%; false positive 0·8%; false negative 0% for symptomatic individuals; sensitivity 97·52%; specificity 99·16% |
| Hirten et al (2021) | Observational and prospective/American health-care workers at Mount Sinai Health System, New York, NY, USA | Apple Watch Series 4 or 5 | 13/297 | 73 Asian (24·6%), 29 Black (9·8%), 43 other (14·5%), 108 White (36·4%), 44 Hispanic ethnicity (14·8%) | Self-reported nasal PCR test | ND | Mixed-effect cosinor model | HRV (SD of normal to normal R–R intervals) including mean MESOR, acrophase, and amplitude | NA | NA | Shorter mean SD of normal to normal R–R intervals amplitude in participants positive for COVID-19 |
| Lonini et al (2021) | Observational, cross-sectional/American healthy controls or COVID-19-positive patients recovering at home or in a hospital physical rehabilitation centre | Unnamed throat-worn patch | 15/29 | NR | Tested positive for COVID-19 | NR | Logistic regression with elastic net regularisation | HR, HRV (SD of R–R intervals), respiratory rate, cough frequency, and walk cadence | 29 (100%); randomly sampled one walk sequence and one cough sequence with replacement five times per individual, repeated 100 times to estimate CI | Validation set was leave-one-subject-out cross validation | AUC ≥0·92 (95% CI 0·92–0·96); pre-walk HR higher in COVID-19-positive cohort; pre-walk respiratory rate higher in COVID-19-positive cohort; pre-walk HRV lower for COVID-19-positive cohort; COVID-19-positive cohort walk slower |
| Miller et al (2020) | Observational and retrospective/Ambulatory, opt-in study of device users | WHOOP | 81/271 | NR | Self-reported SARS-CoV-2 test | ND | Gradient boosted classifier | 5 respiratory rate-derived features | 57 (70%); COVID-19-positive with symptoms between March 14 and April 14, 2020 | 24 in validation set one (30%); COVID-19-positive with symptoms between April 14–June 6, 2020; 190 participants negative for COVID-19 in validation set two | Sensitivity 36·5%, specificity 95·3%, positive predictive value 73·8%, negative predictive value 80·6% for the test set; identified 20% of individuals positive for COVID-19 before SO; identified 80% of individuals positive for COVID-19 by SO +3 days |
| Mishra et al (2020) | Observational, prospective, and retrospective/Ambulatory, opt-in study of device users | Fitbit (Ionic, Charge 4, and Charge 3) | 32/120 | 27 European (84·4%), 5 mixed or other (15·6%) | Self-reported COVID-19 (diagnosis confirmed with physician note) | SO −28 to SO +7 | Offline (HROS-AD, RHR-Diff) and online (CuSum) anomaly detection algorithms | The HROS-AD model included HR and step count as features; the RHR-Diff model included HR; the CuSum model included deviations in elevated residual resting HR | 32 (100% of participants positive for COVID-19) | 73 self-reported healthy participants in comparison set one; 15 participants not positive for COVID-19 in comparison set two | Median time to SO from elevated HR was 4 days, median HR increased by 7 beats per min following SO, step count decreased at onset of HR changes associated with COVID-19, sleep duration increased at onset of HR changes associated with COVID-19 when missing data was imputed, CuSum detected 63% of SARS-CoV-2 infections before SO in real-time |
| Natarajan et al (2020) | Observational and retrospective/Ambulatory, opt-in study of American and Canadian device users | Fitbit | 1257 | NR | Self-reported PCR test | SO −1 to SO +4 | Convolutional neural network | Body-mass index, age, sex, mean nocturnal respiratory rate, mean nocturnal HR during non-rapid eye movement sleep, HRV (RMSSD of nocturnal respiratory rate series), Shannon entropy of nocturnal respiratory rate series, and data from the day of examination and the 4 preceding days | 879 (random 70% split); 70:15:15 split performed five times, but cross-validation performed only once | 189 in test set (15%); 189 in cross- validation set (15%) | Sensitivity 25·9%; specificity 99·0%; AUC 0·77 (0·02); the 90% specificity model identified 40 (21%) of individuals positive for COVID-19 at SO −1; correctly identified 105 (56%) of individuals positive for COVID-19 at SO +4 |
| Nestor et al (2021) | Observational and retrospective (same data collection as used in Shapiro et al | Fitbit | 204/32 198 | NR | Self-reported SARS-CoV-2 test or medically diagnosed influenza | Day of symptomatic infection (SO to symptom end) | Model 1 (wearable only data) was (1a)gradient boosted classifier and (1b) gated recurrent unit-decay; model 2 (survey only data) was gated recurrent unit; model 3 was paired gradient boosted classifier and gated recurrent unit | Model 1 included 48 features based on HR, steps, and sleep data; model 2 included survey data (daily symptom history and demographic covariates); model 3 included 48 features and survey data | 11 269 (35%); 35:7·5:7·5:50 split performed five times | 16 099 (50%) in test set one (prospective); 2415 (7·5%) in test set two (retrospective, held-out set); 2415 (7·5%) in validation set (retrospective) | Model 3 sensitivity 0·65 (95% CI 0·19–0·87), specificity 0·69 (95% CI 0·41–0·97); model 3 detects 63·5% of COVID-19-positive cases at SO ( |
| Quer et al (2021) | Observational and prospective/Ambulatory, opt-in study of American smart device users | Device-agnostic | 54/333 | NR | Self-reported COVID-19 test result | NA | Binary classifier | Resting HR, age, sex, cough, fatigue, decreased taste or smell, sleep duration (min), and total step count | 333 (100%) | NA | AUC 0·80 (95% CI 0·73–0·86); sensitivity 0·72 (95% CI 0·59–0·83); specificity 0·73 (95% CI 0·68–0·78); positive predictive value 0·35 (95% CI 0·29–0·41); negative predictive value 0·93 (95% CI 0·90–0·96) |
| Shapiro et al (2021) | Observational and retrospective digital cohort/Ambulatory, opt-in study of device users | Fitbit | 41/1352 | No American Indian or Alaskan Native, 4 Asian or Pacific Islander (9·8%), 3 Black or African American (7·3%), 4 Hispanic or Latino (9·8%), 3 preferred not to answer (7·3%), 4 unavailable (9·8%), 23 White (56·1%) | Self-reported COVID-19 diagnosis by a health-care practitioner | SO −2 to SO +2 | Multilevel model | Resting HR, week of flu season, day of the week, average activity level in participant's physical state, and participant's baseline activity level | NA | NA | Increased HR in COVID-19-positive cohort; increased sleep persisted for longer in COVID-19-positive cohort; COVID-19-positive cohort took fewer steps |
| Smarr et al (2020) | Observational and retrospective/Global ambulatory, opt-in study of device users | Oura ring | 50/50 | 1 Asian (2%), 39 White (78%), 8 Hispanic or Latino (16%), 1 Middle Eastern (2%),1 European (2%), 1 Scandinavian (2%), 1 Jewish (2%), and 1 South Asian (2%), 2 unavailable (4%) | Self-reported COVID-19 diagnosis or test | SO to SO +7 | Wilcoxon rank-sum test; Kruskal-Wallis non-parametric comparison | Separate models for temperature, respiratory rate, HR, and HRV | NA | NA | Temperature increases around SO; respiratory rate increases after fever-based SO; HR increases after fever-based SO; HRV increases after fever-based SO |
AUC=area under the curve. CuSum=cumulative summary of deviations in elevated residual resting HR. HR=heart rate. HROS-AD=HR over steps anomaly detection. HRV=HR variability. MESOR=midline statistic of rhythm. NA=not applicable. ND=not determined. NR=not reported. RHR-Diff=resting HR difference. RMSSD=root mean square of successive differences in normal heartbeats. SO=symptom onset. SpO2=oxygen saturation.
SARS-CoV-2 infection detection timing relative to SO in days (eg, SO −1 indicates 1 day before SO) across all study models.
Preprint.
Proof-of-concept study.
Data are for the COVID-19-positive sub-cohort.
Indicates differs by analysis.
Summary of the wearable devices discussed by name in the included literature, their sensors, and principles of operation
| Apple Watch | Unspecified; Apple Watch Series 4 or 5 | Accelerometer, electrical heart sensor, | Apple | The EU granted European conformity (CE; also known as Conformité Européenne) marking in March, 2019, for ECG app and irregular HR notifications; US FDA approved ECG app for software as a medical device, temporary approval expanded to encompass remote monitoring of heart health during the COVID-19 pandemic | The Apple Watch provides wearers with a wrist-based notification system, transmitting messages and alerts from their smartphone in real-time; it can be worn during physical activity; its battery life ranges from 1·5–18 h; in addition to supporting third-party apps, the Apple Watch includes health-focused proprietary apps; newer models (eg, the Series 6) include blood oxygen and ECG apps, in addition to the widespread irregular heart rhythm alerts |
| E4 wristband | Unspecified | Accelerometer, electrodermal activity and galvanic skin response, event mark button, infrared thermopile, internal clock, and photoplethysmography | Empatica | The EU granted CE marking to the E4 wristband, in conjunction with the complementary Aura system, in March, 2021, as a class IIa medical device intended to detect and alert users to an early respiratory infection; approval not granted yet by FDA | Lacking a hardware display, the E4 wristband enables the user to record 32 h of continuous data between device charges; it collects data through multiple sensors and transmits them to a cloud platform, storing up to 60 h of data between transfers; the device allows researchers to record biometric data of participants who are wearing the device at home or in the lab and develop their own customised apps to access participant data in real-time |
| Fitbit smartwatches and trackers | Ionic; Charge 3 and Charge 4; Inspire 2 and Inspire HR; Sense; Versa 2 and Versa 3; unspecified | Accelerometer, altimeter, | Fitbit | Approval not granted yet by EU or FDA | All wrist-worn Fitbit devices rely on wearable sensors to track HR, step count, and sleep stage and quality; newer smartwatch versions (eg, Sense and Versa models) also track skin temperature, SpO2 concentrations, and document potential atrial fibrillation episodes; depending on the model, Fitbit displays provide real-time measurement updates related to the wearer's physical activity and smartphone activity; Fitbit devices can be used continuously and paired with a complementary mobile app, lasting up to 6 days between charges |
| Oura Ring | Unspecified | Accelerometer, negative temperature coefficient, photoplethysmography, and temperature | Oura | Approval not granted yet by EU or FDA | The Oura's finger-worn design emits a physical display; designed for constant wear and is water resistant, the Oura ring has a 5–7 day battery life; the company has created an accompanying mobile app for the Oura ring; users can track their sleep, activity, and so-called readiness scores on their phone; the sleep score reflects how long the user spends in deep, rapid eye movement, and light sleep, in addition to providing personalised tips for maximising rest; the activity score considers the user's daily steps, calories burned, and amount of time spent inactive; finally, the readiness score gives users a numeric estimate from 0 to 100 of how much their body has recovered from previous activity |
| WHOOP Strap | Unspecified | Accelerometer, capacitive touch, gyroscope, photoplethysmography, and thermometer | WHOOP | Approval not granted yet by EU or FDA | The wrist-worn WHOOP Strap collects physiological data continuously through multiple sensors; with no digital display on its hardware, the WHOOP strap's battery lasts 4–5 days; when synced with the complementary smartphone app, the WHOOP system quantifies the user's sleep quality, provides recommendations on how much physical exertion could be tolerated, and measures resting HR and HRV; the WHOOP app also enables users to log specific behaviours in a journal each day |
Only the named wearable devices, based on the relevant included literature, are described in the table; thus, the unnamed throat-worn patch (Lonini et al, 2021) is not presented here. ECG=electrocardiogram. FDA=Food and Drug Administration. HR=heart rate. HRV=heart rate variability. SpO2=oxygen saturation.
Model-dependent sensors.
Figure 1Comparison of the sensitivity and specificity of different machine learning models used for early SARS-CoV-2 detection
The size of the circle representing each study is proportional to its number of participants. The colour of the circle is proportional to the percentage of participants positive for SARS-CoV-2 in the study.
Figure 2An overview of the main physiological parameters analysed across different studies
The SARS-CoV-2 associated changes in physiological parameters are shown with upward triangles (indicating a value increase), downward triangles (indicating a value decrease), and circles (indicating parameters were analysed in the study but direction of change was not reported). Notably, Bogu and Snyder's algorithm found bidirectional heart rate abnormalities compared with baseline measurements. Similarly, Natarajan and colleagues report an overall increase in heart rate variability due to COVID-19, despite an initial decrease.