| Literature DB >> 35389502 |
Michael V Heinz1,2, George D Price1, Franklin Ruan1, Robert J Klein1, Matthew Nemesure1, Aliza Lopez1, Nicholas C Jacobson1,2.
Abstract
Importance: Selective serotonin reuptake inhibitors (SSRIs) are a common first-line treatment for some psychiatric disorders, including depression and anxiety; although they are generally well tolerated, SSRIs have known adverse effects, including movement problems, sleep disruption, and gastrointestinal problems (eg, nausea and upset stomach). No large-scale studies using naturalistic, longitudinal, objective data have validated physical activity findings, and actigraphy data are well suited to address this task.Entities:
Mesh:
Substances:
Year: 2022 PMID: 35389502 PMCID: PMC8990330 DOI: 10.1001/jamanetworkopen.2022.5403
Source DB: PubMed Journal: JAMA Netw Open ISSN: 2574-3805
Figure 1. Data Set and Smoothing
A, Schematic of the 7-day activity record for each participant across the control and selective serotonin reuptake inhibitor (SSRI) groups. The control group contains 6896 individuals, and the SSRI group contains 266 individuals. B, Schematic of the data smoothing pipeline. The left side of the diagram shows a sample of the smoothed activity superimposed on the movement data for 24 hours for 1 participant. After smoothing, there is less noise in the data, allowing for better visualization of trends. The blue line indicates no filter, and the orange line indicates smoothing.
Figure 2. Convolutional–Long Short-Term Memory (Conv-LSTM) Pipeline
A, The reshaping of the data can be visualized by representing each minute as a box, with the shading inversely associated with the magnitude of activity at that point. A daily activity log is constructed by creating a 60 × 24 matrix, where each row represents 60 minutes. B, The input to the model pipeline comprised a (7162 × 60 × 24 × 7) activity array. This was passed through 2 Conv-LSTM layers (C) and then to a dense layer (D), which outputs the final model prediction (E). F, Analysis was run with 9-item Patient Health Questionnaire (PHQ-9) scores by concatenating the PHQ-9 score to output from the Conv-LSTM layer. SSRI indicates selective serotonin reuptake inhibitor.
Figure 3. Shapley Additive Explanations (SHAP) Values for Actigraphy Modeling
A, Activity magnitude for participants in the selective serotonin reuptake inhibitor (SSRI) group over time. B, Activity for control participants. The curves (A and B) indicate the mean movement across the respective groups across weeks. These curves were plotted against colored SHAP values, where red regions correspond to high SHAP values and blue regions correspond to low SHAP values. High or red SHAP values suggest a positive association between movement and SSRI use, and low or blue SHAP values suggest a negative association between movement and SSRI use. Regions of relatively high or low SHAP values reveal time frames that were influential to the model’s prediction. C, Spearman correlation between participants’ raw actigraphy values and corresponding SHAP values for every minute in a day, smoothed with a 60-minute rolling window mean value.
Baseline Demographic Characteristics of Participants in the 2005-2006 National Health and Nutrition Examination Survey SSRI Cohort and the Non-SSRI Cohort
| Characteristic |
| ||
|---|---|---|---|
| SSRI (n = 266) |
| ||
| Age, y | |||
| <20 | 29 (10.9) | 2943 (42.7) | <.001 |
| 20-29 | 24 (9.0) | 851 (12.3) | |
| 30-39 | 25 (9.4) | 696 (10.1) | |
| 40-49 | 43 (16.2) | 685 (9.9) | |
| 50-59 | 56 (21.1) | 513 (7.4) | |
| 60-69 | 40 (15.0) | 561 (8.1) | |
| 70-84 | 45 (16.9) | 542 (7.9) | |
| ≥85 | 4 (1.5) | 105 (1.5) | |
| Mean (SD) age, y | 49.6 (20.2) | 33.1 (22.4) | |
| Sex | |||
| Female | 186 (69.9) | 3520 (51.0) | <.001 |
| Male | 80 (30.1) | 3376 (49.0) | |
| Race and ethnicity | |||
| Non-Hispanic | |||
| Black | 34 (12.8) | 1900 (27.6) | <.001 |
| White | 180 (67.7) | 2679 (38.8) | |
| Mexican American | 33 (12.4) | 1790 (26.0) | |
| Other Hispanic | 7 (2.6) | 203 (2.9) | |
| Other race (including multiractial) | 12 (4.5) | 324 (4.7) | |
| Clinical | |||
| Mean (SD) PHQ-9 total score | 4.26 (4.27) | 2.68 (2.82) | <.001 |
Abbreviations: PHQ-9, 9-item Patient Health Questionnaire; SSRI, selective serotonin reuptake inhibitor.
The χ2 test was performed for sex and race and ethnicity, and the t test was performed for mean PHQ-9 total score and mean age.
This category indicates racial categories not matching 1 of the predefined categories or multiracial.
Modeling Performance Metrics
| Model | AUC, mean (95% CI) | Cut point | Sensitivity | Specificity | PPV, % | NPV, % | BAC | PSI |
|---|---|---|---|---|---|---|---|---|
| Conv-LSTM model | ||||||||
| Held-out test set (activity only) | 0.66 (0.64-0.68) | 0.48 | 0.79 | 0.50 | 5.77 | 98.43 | 0.65 | 10.02 |
| Cross-validation sets (activity only) | 0.67 (0.64-0.71) | 0.49 | 0.68 | 0.60 | 6.90 | 98.10 | 0.64 | 10.03 |
| Conv-LSTM model with depression scores | ||||||||
| Held-out test set (PHQ-9 plus activity) | 0.66 (0.65-0.67) | 0.50 | 0.74 | 0.56 | 6.13 | 98.26 | 0.65 | 10.10 |
| Cross-validation sets (PHQ-9 plus activity) | 0.70 (0.65-0.75) | 0.50 | 0.73 | 0.60 | 7.10 | 98.35 | 0.66 | 10.20 |
| Wavelet LogReg model | ||||||||
| Held-out test set | 0.64 (0.64-0.64) | 0.08 | 0.72 | 0.56 | 5.95 | 98.15 | 0.64 | 3.40 |
| Cross-validation sets | 0.65 (0.60-0.71) | 0.06 | 0.72 | 0.54 | 6.05 | 98.22 | 0.63 | 3.41 |
Abbreviations: AUC, area under the receiver operating characteristic curve; BAC, balanced accuracy; Conv-LSTM, convolutional–long short-term memory; LogReg, logistic regression; NPV, negative predictive value; PHQ-9, 9-item Patient Health Questionnaire; PPV, positive predictive value; PSI, population stability index.
Given the small size of our selective serotonin reuptake inhibitor group, we present these metrics for each model (Conv-LSTM run with movement data alone, Conv-LSTM run with movement data and depression scores, and logistic regression operating on wavelet-derived features) to ensure comprehensive report of model performance. Sensitivity, specificity, PPV, NPV, BAC, and PSI are mean values across 10 cross-validation sets or across distinct model runs of held-out test set; AUC remains the primary outcome metric, which is discussed in the Results and Discussion sections.