| Literature DB >> 32454873 |
Yejing Shen1,2, Mengyun Hu3, Qianglong Chen4, Yanyang Zhang1,5, Junying Liang6, Tingting Lu7, Qinqin Ma1,8, Ruijie Ma1,9.
Abstract
OBJECTIVE: The objective of this study was to compare the effectiveness of different combinations of interventions in patients with stroke at the convalescence stage based on the electronic health records (EHRs) by using the Markov decision process (MDP) theory and explore the feasibility of the Markov model in the real-world study (RWS).Entities:
Year: 2020 PMID: 32454873 PMCID: PMC7240799 DOI: 10.1155/2020/8961341
Source DB: PubMed Journal: Evid Based Complement Alternat Med ISSN: 1741-427X Impact factor: 2.629
Figure 1Schematic diagram of an MDP.
Figure 2The agent-environment interaction in an MDP.
General information of patients with stroke at the convalescence stage.
|
| Male | Female | |
|---|---|---|---|
| Age | |||
| 18–45 years | 51 (6.11) | 40 (7.98) | 11 (3.29) |
| 46–65 years | 251 (30.06) | 173 (34.53) | 78 (23.35) |
| ≥66 years | 533 (63.83) | 288 (57.49) | 245 (73.35) |
|
| |||
| Disease history | |||
| None | 76 (9.10) | 48 (9.58) | 28 (8.38) |
| Have one | 262 (31.38) | 165 (32.93) | 97 (29.04) |
| Have at least two | 497 (59.52) | 288 (57.49) | 209 (62.57) |
|
| |||
| Complication | |||
| None | 614 (73.53) | 372 (74.25) | 242 (72.46) |
| Have at least one | 221 (26.47) | 129 (25.75) | 92 (27.54) |
|
| |||
| Western medicine diagnosis | |||
| Ischaemic stroke | 637 (76.29) | 378 (75.45) | 259 (77.54) |
| Haemorrhagic stroke | 198 (23.71) | 123 (24.55) | 75 (22.46) |
|
| |||
| Syndrome differentiation of TCM | |||
| Wind-fired disturbance type | 13 (1.56) | 8 (1.60) | 5 (1.50) |
| Phlegm-blocking type | 498 (59.64) | 315 (62.87) | 183 (54.79) |
| Yin-deficiency type | 64 (7.66) | 37 (7.39) | 27 (8.08) |
| Qi deficiency and blood stasis type | 227 (27.19) | 123 (24.55) | 104 (31.14) |
| Phlegm-heat type | 33 (3.95) | 18 (3.59) | 15 (4.49) |
|
| |||
| Levels of neurological functional impairment | |||
| Level 1 (0–2) | 89 (10.66) | 59 (11.78) | 30 (8.98) |
| Level 2 (3–5) | 138 (16.53) | 85 (16.97) | 53 (15.87) |
| Level 3 (6–12) | 398 (47.66) | 233 (46.51) | 165 (49.40) |
| Level 4 (13–19) | 171 (20.48) | 104 (20.76) | 67 (20.06) |
| Level 5 (20–29) | 8 (0.96) | 4 (0.80) | 4 (1.20) |
| Incomplete data | 31 (3.71) | 16 (3.19) | 15 (4.49) |
Action data set.
| Code |
|
|
|
|---|---|---|---|
| 1 | 1 | 1 | 1 |
| 2 | 1 | 1 | 0 |
| 3 | 1 | 0 | 1 |
| 4 | 1 | 0 | 0 |
| 5 | 0 | 1 | 1 |
| 6 | 0 | 1 | 0 |
| 7 | 0 | 0 | 1 |
| 8 | 0 | 0 | 0 |
Quantity of patients and the main corresponding behavioural combinations in the real world.
| Patient's quantity | State | Corresponding behavioural combinations | |||||||
|---|---|---|---|---|---|---|---|---|---|
|
|
|
|
|
|
|
|
|
| |
| 34 | 3 | 2 | 0 | 1 | 2 | 3 | 0 | 0 | 0 |
| 0 | 0 | 1 | |||||||
| 1 | 1 | 1 | |||||||
| 0 | 1 | 1 | |||||||
| 1 | 0 | 1 | |||||||
| 1 | 1 | 0 | |||||||
|
| |||||||||
| 25 | 2 | 2 | 0 | 1 | 2 | 3 | 1 | 1 | 1 |
| 0 | 0 | 1 | |||||||
| 0 | 0 | 0 | |||||||
| 1 | 0 | 1 | |||||||
| 0 | 1 | 0 | |||||||
| 0 | 1 | 1 | |||||||
| 1 | 0 | 0 | |||||||
| 1 | 1 | 0 | |||||||
| … | … | … | … | … | … | … | … | … | |
Behavioural combinations between different states, corresponding rewards, and transition probabilities.
| Code | Pretreatment state | Action | Posttreatment state | Reward | Transition probabilities |
|---|---|---|---|---|---|
| 71 | 120223 | 111 | 120222 | 3 | 0.5151 |
| 111 | 120223 | 1 | 0.0303 | ||
| 001 | 120223 | 0 | 0.3333 | ||
| 101 | 120223 | 0 | 0.1212 |
Decision-making for patients with various ages, related diseases, and no complications. Decision-making for patients ≥66 years old without complications.
| Degree of neurological deficit | ≥66 years | 46–65 years | 18–45 years | |||
|---|---|---|---|---|---|---|
| Action | Frequency | Action | Frequency | Action | Frequency | |
| Mild | 000 | 4 | 000 | 1 | 001 | 3 |
| 001 | 8 | 010 | 2 | 100 | 2 | |
| 010 | 4 | 100 | 6 | 101 | 2 | |
| 110 | 1 | 110 | 1 | 111 | 2 | |
| 101 | 2 | 101 | 1 | |||
| 011 | 1 | 011 | 3 | |||
| 111 | 2 | 111 | 4 | |||
|
| ||||||
| Moderate to severe | 000 | 1 | 000 | 3 | 010 | 1 |
| 001 | 1 | 001 | 2 | 110 | 1 | |
| 010 | 2 | 100 | 3 | 101 | 2 | |
| 100 | 1 | 110 | 1 | 011 | 2 | |
| 101 | 8 | 101 | 2 | 111 | 5 | |
| 011 | 5 | 111 | 15 | |||
| 111 | 9 | |||||
Decision-making for patients ≥66 years old with no complications.
| Degree of neurological deficit | Without disease history | With disease history | ||
|---|---|---|---|---|
| Action | Frequency | Action | Frequency | |
| Mild | 000 | 1 | 000 | 4 |
| 001 | 1 | 001 | 8 | |
| 100 | 3 | 010 | 4 | |
| 110 | 1 | 110 | 1 | |
| 101 | 2 | |||
| 011 | 1 | |||
| 111 | 2 | |||
|
| ||||
| Moderate to severe | 100 | 1 | 000 | 1 |
| 101 | 1 | 001 | 1 | |
| 011 | 2 | 010 | 2 | |
| 111 | 3 | 100 | 1 | |
| 101 | 8 | |||
| 011 | 5 | |||
| 111 | 9 | |||
| 000 | 4 | |||
Decision-making for patients with phlegm-blocking type and qi deficiency and blood stasis type.
| Degree of neurological deficit | Phlegm-blocking type | Qi deficiency and blood stasis type | ||
|---|---|---|---|---|
| Action | Frequency | Action | Frequency | |
| Mild | 000 | 7 | 000 | 4 |
| 001 | 9 | 001 | 6 | |
| 010 | 3 | 010 | 2 | |
| 100 | 9 | 100 | 3 | |
| 101 | 5 | 110 | 4 | |
| 011 | 1 | 101 | 2 | |
| 111 | 10 | 011 | 4 | |
| 111 | 3 | |||
|
| ||||
| Moderate to severe | 000 | 5 | 000 | 6 |
| 001 | 5 | 001 | 2 | |
| 010 | 3 | 010 | 4 | |
| 110 | 2 | 100 | 3 | |
| 101 | 13 | 110 | 4 | |
| 011 | 5 | 101 | 5 | |
| 111 | 20 | 011 | 4 | |
| 111 | 15 | |||