| Literature DB >> 36092018 |
Abinaya Gopalakrishnan1,2, Revathi Venkataraman1, Raj Gururajan2, Xujuan Zhou2, Rohan Genrich2.
Abstract
Mental health issues are a serious consequence of the COVID-19 pandemic, influencing about 700 million people worldwide. These physiological issues need to be consistently observed on the people through non-invasive devices such as smartphones, and fitness bands in order to remove the burden of having the conciseness of continuously being monitored. On the other hand, technological improvements have enhanced the abilities and roles of conventional mobile phones from simple communication to observations and improved accessibility in terms of size and price may reflect growing familiarity with the smartphone among a vast number of consumers. As a result of continuous monitoring, together with various embedded sensors in mobile phones, raw data can be converted into useful information about the actions and behaviors of the consumers. Thus, the aim of this comprehensive work concentrates on the literature work done so far in the prediction of mental health issues via passive monitoring data from smartphones. This study also explores the way users interact with such self-monitoring technologies and what challenges they might face. We searched several electronic databases (PubMed, IEEE Xplore, ACM Digital Libraries, Soups, APA PsycInfo, and Mendeley Data) for published studies that are relevant to focus on the topic and English language proficiency from January 2015 to December 2020. We identified 943 articles, of which 115 articles were eligible for this scoping review based on the predetermined inclusion and exclusion criteria carried out manually. These studies provided various works regarding smartphones for health monitoring such as Physical activity (26.0 percent; 30/115), Mental health analysis (27.8 percent; 32/115), Student specific monitoring (15.6 percent; 18/115) are the three analyses carried out predominantly. ©2022 Gopalakrishnan et al.Entities:
Keywords: Ambient sensors; Mental health; Mental health monitoring; Mobile phone; Passive sensing; Sensor; Smartphone
Year: 2022 PMID: 36092018 PMCID: PMC9455148 DOI: 10.7717/peerj-cs.1042
Source DB: PubMed Journal: PeerJ Comput Sci ISSN: 2376-5992
Figure 1Data flow diagram explaining how the publications for the review were chosen.
The number of documents resulted and chosen for review from various databases.
| Articles | PubMed | APA PsycInfo | IEEE explore | ACM | Scopus | Mendeley |
|---|---|---|---|---|---|---|
| Result of the search query | 105 | 76 | 186 | 206 | 244 | 126 |
| Taken for the survey | 30 | 9 | 28 | 20 | 16 | 12 |
The distribution of rejected papers as a result of the full-text review.
| Reason for exclusion | Publications excluded |
|---|---|
| Survey paper | 46 |
| collecting data with questionnaire | 39 |
| Activity monitoring | 12 |
| Language of articles not in English | 2 |
| Mental health monitoring with invasive methods | 29 |
Year-by-year breakdown of the number of unique papers returned.
| Year | Articles per year |
|---|---|
| 2020 | 19 |
| 2019 | 16 |
| 2018 | 20 |
| 2017 | 15 |
| 2016 | 25 |
| 2015 | 20 |
Summary of behavioral health outcomes from sensors, wearable, and remote monitoring intervention studies.
P- Participants/Study length, CA- Clinical assessment, H/w-Hardware, S/w-Software.
| Study | Period | Population | Method/Outcomes |
| H/w, S/w | Sensor |
|---|---|---|---|---|---|---|
|
| 262/4 weeks | College students | BioBase application was used for 4 weeks to reduce anxiety and promote well-being. | STAI, PHQ, WEMWBS | SP (iOS), Wristband (BioBeam), Biobase app | Accelerometer, actigraph |
|
| 160/4 weeks | college students | To detect the loniesss, keep an eye on social and sleeping habits. With an accuracy of 80.2%, it can detect loneliness and changes in loneliness levels, and with an accuracy of 88.4%, it can detect changes in loneliness levels. | UCLA | SP, Wristband, AWARE app (freeware data collection app) | Accelerometer, actigraph, Bluetooth, phone usage, GPS, microphone, SMS usage |
|
| 201//4 weeks | college students | Critical items detected using wearable sensors like temperature, barometer such as routine behavior, socializing for stress, depression with 78.3% accuracy for segregating stress level among students. | ASRM, IBS | SP, wristband (Afectiva), Motion Logger (AMI), Funf open-sensing framework | Accelorometer, actigraph, temperature sensor, GPS, light sensor, phone usage |
|
| 44/8 weeks | Healthy adults | Change over and abnormality in sleep, length of sleep are used to predict emotional wellbeing. | BDI, PHQ-9 | SP (Android), Funf opensending framework | Accelorometer, actigraph, Bluetooth |
|
| 121/5 weeks | Healthy adults | Participants reported a signifcant increase in the emotional support skill | COPE-NIV, PHQ, SWLS | SP (iPhone), Wireless cardiovascular belt, body worn wireless sensor | Accelorometer, Bluetooth, Camera, ECG, electrodermal sensor |
|
| 120/8 months | open | When comparing self-reported data from activity tracker applications to wearables for psychological anguish/moderate level of psychological distress, wearable devices had considerably longer daily activity duration than smartphone apps. | DASS-21 | SP | Accelorometer, actigraph |
|
| 25/2 weeks | Outpatient | The smartwatch recognises 75% of archetypal ASD motions after six sessions of use with an electronic photographic activity programme. | None identifed | SP (Android), Smart- watch | Accelorometer, actigraph |
|
| 30/6 weeks | Healthy adults | Stress detection and prediction using accelerometer data with 95% accuracy | None identifed | SP, Wireless Sensor Data Mining (WISDM), chest sensor, wrist sensor | Accelerometer, actigraph, Bluetooth, microphone, Wi-Fi |
|
| 16/10 days | Students | Examine the relationship between university students’ visits to religious sites and their social anxiety. | SIAS | SP | Accelerometer, GPS |
|
| 21/9-36 Weeks | Outpatient | Use random forest regression to correlate smartphone data with schizophrenia symptoms/Significant association between ground truth and anticipated mental health status scores | EMA (measuring sleep, calm, depression, hope, cognition, thoughts of harm, psychotic symptoms) | SP (Android), CrossCheck app, Funf open sensing framework, MobileEMA System | Accelerometer, app usage, GPS, light sensor, microphone, phone usage, SMS usage |
Summary of behavioral health outcomes from sensors, wearables, and remote monitoring intervention studies. P- Participants/Study length, CA- Clinical assessment, H/w-Hardware, S/w-Software.
| Study | Period | Population | Method/Outcomes | CA | H/w, S/w | Sensor |
|---|---|---|---|---|---|---|
|
| 5/8 weeks | Healthy adults | Feedback based motivational methods used to predict anxiety with virtual captions | IPQ, SUD | Head mounted VR, Zephyr HxM HR device, Memphis VR dialogue system | Accelerometer, ECG, microphone, Wi-fi |
|
| 47/10 weeks | Healthy adults | Predicts the correlation between location, length of sleep and stress levels from smartphone data. | PHQ-9, PSS, UCLA-LS | SP (Android), Wristband (JawBone Up), cell towers, wi-fi receiver | Accelerometer, actigraph, Bluetooth, GPS, light sensor, microphone |
|
| 537/3 months | Outpatient | Evaluate association of depression using Used generalized estimating equations (GEE) | SGDS-K | SP, Sensor FH62C14 | GPS |
|
| 12/12 weeks | Inpatient, depression and bipolar disorder | The correlation between daily intervals’ activity scores and mental state assessment scores was 0.6248, indicating that the mood state (manic, depressed) could be recognised. | BSDS, HDRS | Wristband activity tracker | Accelerometer, GPS, microphone, phone usage |
|
| 28/2 weeks | Outpatient | Predict depressive symptoms/Signifcant negative correlations between GPS features and depression; | PHQ-9 | SP (Android), Purple robot app | GPS, phone usage |
|
| 28/10 weeks | Outpatient | The mobility trace characteristics were linked to depressive mood in a model designed to predict changes in depression based on mobility patterns. | PHQ-8, HADS, GHQ | SP (Android), MoodTraces app | GPS |
|
| 10/12 weeks | Outpatient | With 97% precision and 97% recall, detect state shift in persons with bipolar disorder; recognise state with 76% accuracy. | ADL, HAMD, | SP (Android), tracking app | Accelerometer, GPS, microphone, phone usage |
|
| 37/2 weeks | Outpatient | A SVM predicts depression with 61% accuracy, and an RF classifier predicts depression with 59% accuracy. | PHQ-9 | SP, Mobile Sensing and Support (MOSS) app | Accelerometer, GPS, phone usage, SMS usage |
|
| 10/12 weeks | Outpatient | Ability to classify mood with confdence (85%) in the course of mood episodes | HAMD, YMRS | SP (Android), MONARCA app | Accelerometer, Bluetooth, GPS, microphone, phone usage, Wi-fi |
|
| 129/9 months | Outpatient | To compare differences in depressed and manic symptoms, researchers used an SP-based method with traditional treatment. | ASRSM, BDI | SP (Android), MONARCA II | Accelerometer, actigraph, GPS, phone usage, SMS usage |
Figure 2Source of health-related data from various sensors.
Figure 3The selected publications in research fields.
Figure 4Framework of health assessing system.
Clinical assessment scales.
| Acronyms | Description |
|---|---|
| ASRM | Atlman Self-Rating for Mania |
| SGABS | Shortened General Attitude and Belief Scale |
| GABS | General Attitude and Belief Scale |
| IBS | Irrational Belief Scale |
| HADS | Hospital Anxiety and Depression Scale |
| 28 –GHQ | General Health Questionnaire-28 |
| BDI | Beck Depression Inventory |
Passive monitoring sensors.
| Sensors | Analytics |
|---|---|
| Accelerometer | Covered distance, speed, static/inactive and time periods of movements |
| Actigraph | Physical progress, activity - rest cycles, circadian-rhythm cycles |
| Barometer | To measure the air density |
| Bluetooth | Identify adjacent Bluetooth enabled devices |
| Blood pressure monitor | Systolic and diastolic cycle of the blood, Eye gaze, light |
| Electro Cardio Gram (ECG) | Heart rate activity, heart rate variability |
| Electro Encephalon Gram (EEG) | Monitoring the brain activity |
| Global positioning system (GPS) | Location, duration of the movement, speed, proximity |
| Gyroscope | Gyroscope rotation of the device |
| Light sensor | Measures surrounding and device light |
| Magnetometer | Direction, field strength |
| Microphone | Speech communication |
| pH monitor | Stomach acid secretion intervals |
| Temperature sensor | Skin and ambient temperature |
| Wi-Fi | Location and signal strength of networks |
Source of the health-related data.
| Components of mobile device used for sensing | No of studies | Low level features | High level behavioral makers |
|---|---|---|---|
| GPS (Global Positioning System), Bluetooth, Wi-Fi | 43 | Movement intensity, Location | Hedonic activity, Stress, Social avoidance |
| Accelerometer | 32 | Activity type, Movement intensity | Psychomotor activity, Fatigue, concentration/Distractibility |
| Gyroscope | 8 | Movement intensity | Hedonic activity, Stress |
| Microphone | 6 | Paralinguistic information, Acoustic environment, Bedtime/Wakeup time | Depressed mood, Stress |
| Camera | 4 | Pictures | Social avoidance |
| SMS & calls | 13 | In phone social activity | Social avoidance, Depressed mood |
| Others (Ambient light, phone screen (On/Off) | 9 | Acoustic environment, Bedtime/Wakeup time | Depressed mood, Stress |
The selected publications mental health monitoring.
| Exploration area | Counts |
|---|---|
| Mental health | 32 |
| Physical activity | 30 |
| Student-specific monitoring systems | 18 |
| Conviviality | 11 |
| Sleep | 9 |
| Overall well-being | 8 |
| Ailment monitoring | 7 |
Figure 5The challenges in passive monitoring systems.