| Literature DB >> 35628029 |
Norio Yamamoto1,2,3, Shintaro Sukegawa4, Takashi Watari5,6,7.
Abstract
No prediction models using use conventional logistic models and machine learning exist for medical litigation outcomes involving medical doctors. Using a logistic model and three machine learning models, such as decision tree, random forest, and light-gradient boosting machine (LightGBM), we evaluated the prediction ability for litigation outcomes among medical litigation in Japan. The prediction model with LightGBM had a good predictive ability, with an area under the curve of 0.894 (95% CI; 0.893-0.895) in all patients' data. When evaluating the feature importance using the SHApley Additive exPlanation (SHAP) value, the system error was the most significant predictive factor in all clinical settings for medical doctors' loss in lawsuits. The other predictive factors were diagnostic error in outpatient settings, facility size in inpatients, and procedures or surgery settings. Our prediction model is useful for estimating medical litigation outcomes.Entities:
Keywords: diagnostic error; litigation; machine learning; medical error; medical malpractice claims; prediction model; system error
Year: 2022 PMID: 35628029 PMCID: PMC9140545 DOI: 10.3390/healthcare10050892
Source DB: PubMed Journal: Healthcare (Basel) ISSN: 2227-9032
Figure 1Flowchart of participant selection for the analysis.
Patient demographics and characteristics of litigation against medical doctors in Japan (n = 1399).
| Demographics/Characteristics | Reason for Litigation | |||
|---|---|---|---|---|
| without Procedures or Surgery | Procedures or Surgery | |||
| Total | Outpatient | Inpatient | ||
| ( | ( | ( | ( | |
| Patient sex, male, | 736 (52.6) | 200 (53.4) | 237 (55.9) | 284 (48.7) |
| Patient age, median (IQR) | 33 (9–54) | 38 (20–54) | 27 (0–55) | 34 (6–52) |
| Adjusted total billing amount ($), median (IQR) | 460,149 (202,106–799,794) | 428,908 (194,291–716,004) | 485,750 (241,197–777,529) | 468,779 (191,367–877,166) |
| Subject of litigation, individual medical doctor, | 394 (28.2) | 137 (37.2) | 88 (20.8) | 162 (27.8) |
| Duration of claim (years), median (IQR) | 7 (5–10) | 6 (5–9) | 7 (5–11) | 7 (5–10) |
| Accepted claim, | 764 (54.6) | 196 (53.3) | 231 (54.5) | 327 (56.1) |
| Adjusted median indemnity ($), median (IQR) | 236,017 (56,784–504,513) | 157,069 (33,867–432,290) | 265,011 (72,347–532,206) | 220,008 (59,826–517,553) |
| Clinical outcome | ||||
| Deaths, | 785 (56.1) | 232 (63.0) | 261 (61.6) | 273 (46.8) |
| Sequelae, | 554 (39.6) | 113 (30.7) | 151 (35.6) | 286 (49.1) |
| Full recovery, | 60 (5.3) | 23 (6.3) | 12 (2.8) | 24 (4.1) |
IQR: interquartile range. Accepted: The medical doctor has lost the case. Note: The total billing amount and median indemnity were adjusted to their 2017 equivalents using the Japanese Consumer Price Index (shown in USD, 1$ = ¥115, 12 January 2022).
Clinical and litigation factors on litigation outcomes.
| Accepted ( | Rejected ( | |||
|---|---|---|---|---|
| Patient sex, male, | 395 (51.7) | 341 (53.7) | 0.485 | |
| Patient age, median (IQR) | 32 (11–53) | 34 (7.5–56) | 0.625 | |
| Initial diagnoses (Top 5 involved in malpractice claims), | ||||
| Malignant neoplasm ( | 60 (7.9) | 55 (8.7) | 0.625 | |
| Neonatal disease ( | 66 (8.6) | 44 (6.9) | 0.273 | |
| Trauma ( | 64 (8.4) | 45 (7.1) | 0.423 | |
| Procedure and postoperative complications ( | 42 (5.5) | 25 (3.9) | 0.208 | |
| Acute coronary syndrome ( | 37 (4.8) | 29 (4.6) | 0.899 | |
| Specialty, | ||||
| Surgical specialties | 439 (57.5) | 335 (52.8) | 0.084 | |
| Non-surgical specialties | 202 (26.4) | 202 (31.8) | 0.028 | |
| Place, | ||||
| Outpatient office | 145 (19.0) | 132 (20.8) | 0.419 | |
| Emergency room | 51 (6.7) | 40 (6.3) | 0.828 | |
| Ward | 231 (30.2) | 193 (30.4) | 0.953 | |
| Operation room | 327 (42.8) | 256 (40.3) | 0.355 | |
| Facility size, | ||||
| Clinic | 223 (29.2) | 137 (21.6) | 0.001 | |
| Small hospital (<200 beds) | 166 (21.7) | 110 (17.3) | 0.043 | |
| Medium hospital (200–399 beds) | 264 (34.6) | 243 (38.3) | 0.163 | |
| Large (>400 beds) or university hospital | 111 (14.5) | 145 (22.8) | <0.001 | |
| Time, | ||||
| Day time | 480 (62.8) | 379 (59.7) | 0.247 | |
| Night shift | 121 (15.8) | 83 (13.1) | 0.149 | |
| Error type, | ||||
| System error | 634 (83.0) | 127 (20.0) | <0.001 | |
| Diagnostic error | 377 (49.3) | 205 (32.3) | <0.001 | |
| Subject of litigation, | ||||
| Individual medical doctor | 238 (31.2) | 156 (24.6) | 0.007 | |
| Group or hospital | 548 (71.7) | 491 (77.3) | 0.02 | |
| Era * | 4/11/60/135/174/311/65/4 | 0/6/67/162/114/197/85/4 | NA | |
| Clinical outcome, | ||||
| Deaths | 411 (53.8) | 374 (58.9) | 0.058 | |
| Sequelae | 321 (42.0) | 233 (36.7) | 0.048 | |
| Full recovery | 32 (4.2) | 28 (4.4) | 0.895 | |
Accepted: Medical doctors lost the case. Rejected: Medical doctors won the case. IQR, interquartile range; NA, not available because of a zero event. * 10-year interval, 1940–1949, 1950–, 1960–, 1970–, 1980–, 1990–, 2000–, 2010–2017.
Machine learning and logistic model-based prediction models for litigation outcomes in all cases.
| LightGBM | Decision Tree | Random Forest | Logistic Model | ||||
|---|---|---|---|---|---|---|---|
| Accuracy | 0.839 | (0.838–0.841) | 0.825 | (0.823–0.826) | 0.832 | (0.831–0.834) | 0.826 (0.825–0.827) |
| Precision | 0.811 | (0.808–0.813) | 0.787 | (0.781–0.794) | 0.810 | (0.808–0.813) | 0.810 (0.809–0.811) |
| Recall | 0.924 | (0.819–0.928) | 0.935 | (0.920–0.950) | 0.907 | (0.901–0.913) | 0.893 (0.894–0.891) |
| F1 score | 0.863 | (0.864–0.862) | 0.853 | (0.850–0.856) | 0.855 | (0.853–0.857) | 0.849 (0.848–0.850) |
| AUC | 0.894 | (0.893–0.895) | 0.874 | (0.872–0.876) | 0.894 | (0.893–0.896) | 0.881 (0.881–0.882) |
The value is described as the predictive ability (95% CI). CI, confidence interval; AUC, area under the curve.
Figure 2Feature importance in lightGBM with SHAP (A,B). The top five features important in lightGBM were system error, diagnostic error, the reason for litigation diagnosis, facility size, era, and patient age, in descending order.
Impact of the top five predictive factors on medical doctor loss (accepted claims).
| Factors | Indemnity ($), Median (IQR) | Total Indemnity ($) | Proportion of All Total Indemnity in Each Group (%) | |
|---|---|---|---|---|
| All Cases ( | ||||
| System error | 634 (82.9) | 212,971 (53,651–450,478) | 201,959,117 | 82.5 |
| Diagnostic error | 377 (49.3) | 248,534 (59,279–507,662) | 133,875,865 | 54.6 |
| Reason for litigation: diagnosis | 186 (24.3) | 202,639 (67,344–482,423) | 60,084,309 | 24.5 |
| Facility size (medium hospital) | 264 (34.5) | 237,931 (67,344–482,423) | 86,910,186 | 35.5 |
| Patient age (age 0) | 134 (17.5) | 349,625 (126,867–727, 673) | 59,320,694 | 24.2 |
| Subgroups | ||||
| Outpatient ( | ||||
| System error | 108 (55.1) | 82,920 (28,562–346,612) | 26,098,691 | 46.6 |
| Diagnostic error | 150 (76.5) | 206,364 (39,476–463,340) | 49,727,644 | 88.9 |
| Patient age (age 0) | 10 (5.1) | 95,216 (27,170–804,262) | 4,101,603 | 7.3 |
| Era (1991–1999) | 85 (43.3) | 184,002 (31,533–499,561) | 28,974,661 | 51.8 |
| Treatment: other treatments | 55 (28.0) | 59,279 (31,676–271,776) | 12,369,668 | 22.1 |
| Inpatient ( | ||||
| System error | 209 (90.4) | 242,469 (73,847–492,951) | 70,966,535 | 91.0 |
| Facility size (medium hospital) | 100 (43.2) | 269,137 (89,484–513,205) | 32,763,778 | 42.0 |
| Era (1991–1999) | 89 (38.5) | 300,128 (57,342–531,114) | 31,572,902 | 40.4 |
| Diagnostic error | 109 (47.1) | 297,139 (103,474–565,210) | 42,819,638 | 54.9 |
| Sequence | 138 (59.7) | 237,485 (62,423–408,069) | 39,358,055 | 50.4 |
| Procedures or surgery ( | ||||
| System error | 309 (94.4) | 206,791 (68,185–478,915) | 102,194,174 | 94.4 |
| Facility size (medium hospital) | 113 (34.5) | 254,086 (108,194–643,171) | 25,272,862 | 23.3 |
| Patient age (age 0) | 60 (18.3) | 481,070 (278,112–833,305) | 32,018,881 | 29.6 |
| Diagnostic error | 112 (34.2) | 249,226 (76,811–486,514) | 40,354,005 | 37.3 |
| Era (1991–1999) | 134 (40.9) | 283,772 (77,425–620,218) | 52,708,845 | 48.7 |