| Literature DB >> 35990068 |
Lirong Zhang1, Hua Zheng2, Min Yi3, Ying Zhang4, Guoliang Cai5, Changqing Li2, Liang Zhao2.
Abstract
The aim of this study was to develop and validate a prediction model to evaluate the risk of poor sleep quality. We performed a cross-sectional study and enrolled 1,928 college students from five universities between September and November 2021. The quality of sleep was evaluated using the Chinese version of the Pittsburgh Sleep Quality Index (PSQI). Participants were divided into a training (n = 1,555) group and a validation (n = 373) group. The training group was used to establish the model, and the validation group was used to validate the predictive effectiveness of the model. The risk classification of all participants was performed based on the optimal threshold of the model. Of all enrolled participants, 45.07% (869/1,928) had poor sleep quality (PSQI score ≧ 6 points). Multivariate analysis showed that factors such as older age, a higher grade, previous smoking, drinking, midday rest, chronic disease, anxiety, and stress were significantly associated with a higher rate of poor sleep quality, while preference for vegetables was significantly associated with better sleep quality, and all these variables were included to develop the prediction model. The area under the curve (AUC) was 0.765 [95% confidence interval (CI): 0.742-0.789] in the training group and 0.715 (95% CI: 0.664-0.766) in the validation group. Corresponding discrimination slopes were 0.207 and 0.167, respectively, and Brier scores were 0.195 and 0.221, respectively. Calibration curves showed favorable matched consistency between the predicted and actual probability of poor sleep quality in both groups. Based on the optimal threshold, the actual probability of poor sleep quality was 29.03% (317/1,092) in the low-risk group and 66.03% (552/836) in the high-risk group (P < 0.001). A nomogram was presented to calculate the probability of poor sleep quality to promote the applicationof the model. The prediction model can be a helpful tool to stratify sleep quality, especially among university students. Some intervention measures or preventive strategies to quit smoking and drinking, eat more vegetables, avoid midday rest, treat chronic disease, and alleviate anxiety and stress may be considerably beneficial in improving sleep quality.Entities:
Keywords: Pittsburgh Sleep Quality Index; depression anxiety stress scales; prediction model; quality of sleep; university students
Year: 2022 PMID: 35990068 PMCID: PMC9385968 DOI: 10.3389/fpsyt.2022.927619
Source DB: PubMed Journal: Front Psychiatry ISSN: 1664-0640 Impact factor: 5.435
FIGURE 1Patient’s flowchart and study design. Based on inclusive and exclusive criteria, a total of 1,928 participants were enrolled and divided into a training group (n = 1,555) and a validation (n = 373) group.
Student’s demographics, living and sport habits, and mental health.
| Characteristics | Students ( |
| Gender | |
| Male | 44.87% (865/1,928) |
| Female | 55.13% (1,063/1,928) |
| Age [median (IQR), years] | 19.00 (19.00, 20.00) |
| Grade | |
| First year | 24.27% (468/1,928) |
| Second year | 47.10% (908/1,928) |
| Third year | 16.65% (321/1,928) |
| Fourth year | 11.15% (215/1,928) |
| Delayed graduation | 0.83% (16/1,928) |
| Marital status | |
| Single | 76.56% (1,476/1,928) |
| Dating | 22.61% (436/1,928) |
| Married | 0.83% (16/1,928) |
| Smoking | |
| No | 92.12% (1,776/1,928) |
| Abstain from smoking | 2.96% (57/1,928) |
| Yes | 4.93% (95/1,928) |
| Drinking | |
| No | 81.64% (1,574/1,928) |
| Abstain from drinking | 4.67% (90/1,928) |
| Yes | 13.69% (264/1,928) |
| Having a habit of midday rest | |
| Yes | 78.89% (1,521/1,928) |
| No | 21.11% (407/1,928) |
| Monthly expense (¥) | |
| <2,000 | 78.89% (1,521/1,928) |
| ≧2,000 and < 5,000 | 20.23% (390/1,928) |
| ≧5,000 and < 10,000 | 0.41% (8/1,928) |
| ≧10,000 | 0.47% (9/1,928) |
| Chronic disease | |
| Yes | 4.10% (79/1,928) |
| No | 95.90% (1,849/1,928) |
| Preference to low salt and fat food | |
| Yes | 30.60% (590/1,928) |
| No | 69.40% (1,338/1,928) |
| Preference to oil food | |
| Yes | 25.83% (498/1,928) |
| No | 74.17% (1,430/1,928) |
| Preference to barbecue | |
| Yes | 28.99% (559/1,928) |
| No | 71.01% (1,369/1,928) |
| Preference to red meat | |
| Yes | 66.65% (1,285/1,928) |
| No | 33.35% (643/1,928) |
| Preference to vegetable | |
| Yes | 49.17% (948/1,928) |
| No | 50.83% (980/1,928) |
| Preference to fruit | |
| Yes | 57.47% (1,108/1,928) |
| No | 42.53% (820/1,928) |
| Sedentary time (hours) | |
| <1 | 5.13% (99/1,928) |
| ≧1 and < 3 | 18.36% (354/1,928) |
| ≧3 and < 6 | 33.45% (645/1,928) |
| ≧6 | 43.05% (830/1,928) |
| Frequency of sports per week | |
| 0 | 21.27% (410/1,928) |
| 1−2 | 36.41% (702/1,928) |
| 3−4 | 21.06% (406/1,928) |
| ≧5 | 21.27% (410/1,928) |
| Sport type | |
| None | 21.27% (410/1,928) |
| Aerobic exercise | 44.29% (854/1,928) |
| A middle between aerobic and anaerobic exercise | 23.24% (448/1,928) |
| Anaerobic exercise | 11.20% (216/1,928) |
| COVID-19 sporadic outbreaks in local city | |
| Yes | 48.60% (937/1,928) |
| No | 51.40% (991/1,928) |
| DASS-21 depression score [median (IQR)] | 4.00 (0.00 10.00) |
| DASS-21 anxiety score [median (IQR)] | 4.00 (0.00 10.00) |
| DASS-21 stress score [median (IQR)] | 6.00 (0.00 12.00) |
| Quality of sleep | |
| Poor | 45.07% (869/1,928) |
| Good | 54.93% (1,059/1,928) |
IQR, Interquartile range; COVID-19, Corona virus disease 2019; DASS-21, Depression anxiety stress scales 21; PSQI, Pittsburgh sleep quality index.
aIndicates that poor sleep quality was defined as participants with a total PSQI score of six points or above.
Multivariate analysis of characteristics for predicting poor sleep quality among university students in the training group.
| Characteristics | Patients ( | OR | 95% CI | ||
| LL | UL | ||||
| (Intercept) | 0.015 | 0.003 | 0.090 | <0.001 | |
| Gender | |||||
| Male | 632 (40.64%) | Reference | |||
| Female | 923 (59.36%) | 1.301 | 0.988 | 1.711 | 0.061 |
| Age [median (IQR), years] | 19.00 (19.00, 20.00) | 1.129 | 1.035 | 1.231 | 0.006 |
| Grade | |||||
| First year | 351 (22.57%) | Reference | |||
| Second year | 750 (48.23%) | 1.205 | 0.883 | 1.644 | 0.239 |
| Third year | 271 (17.43%) | 1.612 | 1.066 | 2.439 | 0.024 |
| Fourth year | 170 (10.93%) | 1.236 | 0.730 | 2.094 | 0.431 |
| Delayed graduation | 13 (0.84%) | 0.828 | 0.158 | 4.347 | 0.824 |
| Marital status | |||||
| Single | 1,187 (76.33%) | Reference | |||
| Dating | 356 (22.89%) | 0.857 | 0.646 | 1.137 | 0.285 |
| Married | 12 (0.77%) | 0.095 | 0.008 | 1.160 | 0.065 |
| Smoking | |||||
| No | 1,422 (91.45%) | Reference | |||
| Abstain from smoking | 45 (2.89%) | 2.148 | 1.042 | 4.429 | 0.038 |
| Yes | 88 (5.66%) | 0.997 | 0.567 | 1.753 | 0.991 |
| Drinking | |||||
| No | 1,256 (80.77%) | Reference | |||
| Abstain from drinking | 76 (4.89%) | 1.433 | 0.820 | 2.505 | 0.206 |
| Yes | 223 (14.34%) | 1.562 | 1.085 | 2.250 | 0.017 |
| Having a habit of midday rest | |||||
| No | 340 (21.86%) | Reference | |||
| Yes | 1,215 (78.14%) | 1.443 | 1.080 | 1.928 | 0.013 |
| Monthly expense (¥) | |||||
| <2,000 | 1,177 (75.69%) | Reference | |||
| ≧2,000 and < 5,000 | 363 (23.34%) | 1.193 | 0.907 | 1.568 | 0.207 |
| ≧5,000 and < 10,000 | 8 (0.51%) | 0.929 | 0.134 | 6.436 | 0.941 |
| ≧10,000 | 7 (0.45%) | 1.020 | 0.120 | 8.634 | 0.986 |
| Chronic disease | |||||
| No | 1,487 (95.63%) | Reference | |||
| Yes | 68 (4.37%) | 1.983 | 1.118 | 3.518 | 0.019 |
| Preference to low salt and fat food | |||||
| No | 1,086 (69.84%) | Reference | |||
| Yes | 469 (30.16%) | 0.912 | 0.696 | 1.197 | 0.508 |
| Preference to oil food | |||||
| No | 1,153 (74.15%) | Reference | |||
| Yes | 402 (25.85%) | 0.846 | 0.641 | 1.116 | 0.237 |
| Preference to barbecue | |||||
| No | 1,112 (71.51%) | Reference | |||
| Yes | 443 (28.49%) | 1.258 | 0.960 | 1.650 | 0.097 |
| Preference to red meat | |||||
| No | 504 (32.41%) | Reference | |||
| Yes | 1,051 (67.59%) | 1.011 | 0.782 | 1.306 | 0.935 |
| Preference to vegetable | |||||
| No | 793 (51.00%) | Reference | |||
| Yes | 762 (49.00%) | 0.704 | 0.551 | 0.900 | 0.005 |
| Preference to fruit | |||||
| No | 636 (40.90%) | Reference | |||
| Yes | 919 (59.10%) | 1.199 | 0.929 | 1.546 | 0.163 |
| Sedentary time (hours) | |||||
| <1 | 81 (5.21%) | Reference | |||
| ≧1 and < 3 | 302 (19.42%) | 0.731 | 0.409 | 1.305 | 0.289 |
| ≧3 and < 6 | 527 (33.89%) | 0.747 | 0.428 | 1.305 | 0.305 |
| ≧6 | 645 (41.48%) | 0.831 | 0.476 | 1.449 | 0.514 |
| Frequency of sports per week | |||||
| 0 | 366 (23.54%) | Reference | |||
| 1−2 | 615 (39.55%) | 1.166 | 0.723 | 1.880 | 0.530 |
| 3−4 | 334 (21.48%) | 1.371 | 0.841 | 2.236 | 0.206 |
| ≧5 | 240 (15.43%) | 0.973 | 0.582 | 1.626 | 0.917 |
| Sport type | |||||
| None | 366 (23.54%) | Reference | |||
| Aerobic exercise | 655 (42.12%) | 0.991 | 0.659 | 1.491 | 0.967 |
| A middle between aerobic and anaerobic exercise | 355 (22.83%) | 1.153 | 0.755 | 1.761 | 0.511 |
| Anaerobic exercise | 179 (11.51%) | Not applicable | |||
| COVID-19 sporadic outbreaks in local city | |||||
| No | 646 (41.54%) | Reference | |||
| Yes | 909 (58.46%) | 0.910 | 0.713 | 1.161 | 0.447 |
| DASS depression score [median (IQR)] | 4.00 (0.00 10.00) | 1.018 | 0.989 | 1.049 | 0.223 |
| DASS anxiety score [median (IQR)] | 4.00 (0.00 10.00) | 1.064 | 1.024 | 1.104 | 0.001 |
| DASS stress score [median (IQR)] | 6.00 (0.00 12.00) | 1.071 | 1.038 | 1.104 | <0.001 |
OR, odds ratio; CI, confident interval; LL, lower limit; UL, upper limit; IQR, interquartile range; COVID-19, coronavirus disease 2019; DASS-21, Depression Anxiety Stress Scale 21.
FIGURE 2A nomogram to predict sleep quality among university students. The nomogram is comprised of nine features and three axes (score, total score, and risk probability axes). Each feature is able to obtain a score by referring to the score axis, the total score is the sum points of the nine features, and participant’s risk probability can be calculated by drawing a line downward from the total score axis to the risk probability axis. In the nomogram, quantitative features are depicted as density curves to visualize distribution, and qualitative features including age, anxiety, and stress are presented as boxes. The size of boxes indicates proportions in each feature.
FIGURE 3Evaluation of model’s discrimination. (A) Area under the curve (AUC) for the model in the training group. (B) AUC for the model in the validation group. (C) Discrimination slope for the model in the training group (0.207, P < 0.001). (D) Discrimination slope for the model in the validation group (0.167, P < 0.001). A discriminative plot is plotted with an actual event (yes vs. no) against a predicted probability of poor sleep quality. Discrimination slope is the mean difference of predicted probabilities between participants with actual poor sleep quality and those without it.
Predictive effectiveness of the model to predict risk probability of poor sleep quality among university students.
| Prediction measures | Training group | Validation group |
| Brier score | 0.195 | 0.221 |
| Brierscaled score | 0.208 | 0.115 |
| AUC (95% CI) | 0.765 (0.742–0.789) | 0.715 (0.664–0.766) |
| Discrimination slope | 0.207 | 0.167 |
| Accuracy | 0.703 | 0.657 |
| Threshold | 0.378 | 0.475 |
| Specificity | 0.673 | 0.768 |
| Sensitivity | 0.741 | 0.541 |
| NPV | 0.767 | 0.635 |
| PPV | 0.641 | 0.692 |
| Precision | 0.641 | 0.692 |
| Recall | 0.741 | 0.541 |
| Youden | 1.414 | 1.309 |
AUC, Are under the curve; CI, Confident interval; NPV, Negative predictive value; PPV, Positive predictive value.
FIGURE 4Evaluation of model’s calibration and clinical usefulness. (A) Calibration curve for the model in the training group. (B) Calibration curve for the model in the validation group. Calibration curve is plotted with predicted probability against observed probability. A dotted diagonal line in the curve indicates perfect consistency between the predicted and observed probability. (C) Decision curve analysis for the model in the training group. (D) Decision curve analysis for the model in the validation group. Decision curve is plotted with different thresholds against net benefit. Larger space between the red line and the two reference (a treat-for-all line and a treat-for-none line) lines indicates better clinical usefulness.
Risk classification based on the nomogram and corresponding predicted and actual probability of poor sleep quality among the entire cohort of university students.
| Groups | Patients ( | Probability of poor sleep quality | ||
| Predicted | Actual | |||
| Low-risk (<43%) | 1,092 | 27.09% | 29.03% (317/1,092) | <0.001 |
| High-risk (≧43%) | 836 | 66.05% | 66.03% (552/836) | |
aIndicates the P-value was calculated from the Chi-square test after a comparison between the low-risk and high-risk groups in the actual probability of poor sleep quality.