Literature DB >> 31830138

Suicide among physicians and health-care workers: A systematic review and meta-analysis.

Frédéric Dutheil1,2, Claire Aubert3, Bruno Pereira4, Michael Dambrun5, Fares Moustafa6, Martial Mermillod7,8, Julien S Baker9, Marion Trousselard10, François-Xavier Lesage11, Valentin Navel12.   

Abstract

BACKGROUND: Medical-related professions are at high suicide risk. However, data are contradictory and comparisons were not made between gender, occupation and specialties, epochs of times. Thus, we conducted a systematic review and meta-analysis on suicide risk among health-care workers.
METHOD: The PubMed, Cochrane Library, Science Direct and Embase databases were searched without language restriction on April 2019, with the following keywords: suicide* AND (« health care worker* » OR physician* OR nurse*). When possible, we stratified results by gender, countries, time, and specialties. Estimates were pooled using random-effect meta-analysis. Differences by study-level characteristics were estimated using stratified meta-analysis and meta-regression. Suicides, suicidal attempts, and suicidal ideation were retrieved from national or local specific registers or case records. In addition, suicide attempts and suicidal ideation were also retrieved from questionnaires (paper or internet).
RESULTS: The overall SMR for suicide in physicians was 1.44 (95CI 1.16, 1.72) with an important heterogeneity (I2 = 93.9%, p<0.001). Female were at higher risk (SMR = 1.9; 95CI 1.49, 2.58; and ES = 0.67; 95CI 0.19, 1.14; p<0.001 compared to male). US physicians were at higher risk (ES = 1.34; 95CI 1.28, 1.55; p <0.001 vs Rest of the world). Suicide decreased over time, especially in Europe (ES = -0.18; 95CI -0.37, -0.01; p = 0.044). Some specialties might be at higher risk such as anesthesiologists, psychiatrists, general practitioners and general surgeons. There were 1.0% (95CI 1.0, 2.0; p<0.001) of suicide attempts and 17% (95CI 12, 21; p<0.001) of suicidal ideation in physicians. Insufficient data precluded meta-analysis on other health-care workers.
CONCLUSION: Physicians are an at-risk profession of suicide, with women particularly at risk. The rate of suicide in physicians decreased over time, especially in Europe. The high prevalence of physicians who committed suicide attempt as well as those with suicidal ideation should benefits for preventive strategies at the workplace. Finally, the lack of data on other health-care workers suggest to implement studies investigating those occupations.

Entities:  

Mesh:

Year:  2019        PMID: 31830138      PMCID: PMC6907772          DOI: 10.1371/journal.pone.0226361

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


Introduction

Suicide risk was increased in certain occupational groups, especially in medical-related professions [1]. Physicians, and other health-care workers such as nurses [2,3], were considered like high risk group of suicide in different countries [4,5,6], especially for women [6,7,8]. Indeed, despite considerably higher risk of suicides in men than women in the general population [9], female doctors have higher suicide rates than men [10], putatively because of their social family role [11], or a poor status integration within the profession [7]. Suicide rate in physicians was also not homogenous in all countries [12], and physicians’ satisfaction has been reported to change between different epochs of times [13]. Physicians working conditions varied substantially between countries and over contemporary times, these factors were never investigated in relationships with suicide in physicians. For example, there were tentative to regulate working time of physicians over the recent years, such as in Europe with its European Working Time Directive (EWTD) [14]. Some specialties have been suggested to be particularly at risk of suicides [15,16] with occupational factors individualized in different medical or surgical specialties: heavy workload and working hours involved in the job such as long shifts and unpredictable hours (with the sleep deprivation associated) [17], stress of the situations (life and death emergencies) [18], and easy access to a means of committing suicide [19]. To implement coordinated and synergistic preventive strategies, we need to identify physicians in mental health suffering [20], therefore statistical analyses on suicide attempts and suicidal ideation were necessary. However, robust statistics on health-care workers were desperately lacking for suicides, suicide attempts and suicidal ideation. The latest meta-analysis summarized physicians suicide risk before 2000s [6], we need for updated synthesis of literature. We hypothesized that 1) physicians are more at risk to commit suicide than the general population, 2) women physicians are more at risk to commit suicide than their male counterparts, 3) some countries would have higher rates of suicide in physicians, 4) with an improvement over time, 5) some medical or surgical specialties would be at higher risk of suicide, 6) physicians would also exhibit higher rates of suicide attempts and suicidal ideation, and 7) other health care workers would also be at risk of suicide. Thus, we aimed to conduct a systematic review of the literature and meta-analysis to provide evidence-based data for suicide risk among health-care workers, considering gender, geographic zone, epoch of time, medical and surgical specialties. Finally, we wanted to expand our study to suicide attempts and suicidal ideation.

Methods

Search strategy and study eligibility

We reviewed all studies involving suicides, suicide attempts or suicidal ideation in health-care workers. Students were excluded because of the difference in responsibilities in comparisons with health-care workers, and because of the existence of previous recent meta-analyses focusing specifically on health-care students [21,22,23,24]; we included interns because they were not included in the aforementioned meta-analyses on prevalence of suicides, suicide attempts or suicidal ideation, and because they could have similar responsibilities to senior practitioners. The PubMed, Cochrane Library, Science Direct and Embase databases were searched on April 2019, with the following keywords: suicide* AND (« health care worker* » OR physician* OR nurse*). The search was not limited by years or languages. To be included, articles had to be peer-reviewed and to describe original empirical data on suicides, suicide attempt or suicidal ideation in health-care workers. When data were available, we also collected data from a control group (such as general population) for comparisons purposes. In addition, reference lists of all publications meeting the inclusion criteria will be manually searched to identify any further studies not found through digital research. The search strategy was presented in Fig 1. Three authors (Claire Aubert, Valentin Navel and Frederic Dutheil) conducted all literature searches, and separately reviewed the abstracts and decided the suitability of the articles for inclusion. Two others authors (Bruno Pereira and Martial Mermillod) have been asked to review the articles when consensus on suitability was debated. Then all authors reviewed the eligible articles.
Fig 1

Search strategy.

Quality of assessment

Although not designed for quantifying the integrity of studies [25], the “STrengthening the Reporting of Observational studies in Epidemiology” (STROBE) criteria [26] and Newcastle-Ottawa Scale (NOS) were used to check the quality of articles [27]. The maximum score in STROBE criteria was 30 with assessment of 22 items, in NOS criteria was 9 with assessment of 8 items (one star for each item within the selection and exposure category and a maximum of two stars for comparability) (Figs 2 and 3).
Fig 2

Methodological quality of included articles using Newcastle–Ottawa Quality Assessment Scale.

Fig 3

Summary bias risk of included articles using the Newcastle–Ottawa Quality Assessment Scale model.

Statistical considerations

Statistical analysis was conducted using Comprehensive Meta-analysis software (version 2, Biostat Corporation) [28,29,30] and Stata software (version 13, StataCorp, College Station, US) [28,29,31]. Main characteristics were summarized for each study sample and reported as mean (standard-deviation) and number (%) for continuous and categorical variables respectively. Statistical heterogeneity between results was assessed by examining forest plots, confidence intervals (CI) and using formal tests for homogeneity based on I2 statistic, which is the most common metric for measuring the magnitude of heterogeneity between studies and is easily interpretable. I2 values range between 0% and 100% and are typically considered low for <25%, moderate for 25–50%, and high for > 50%. Random effect meta-analysis (DerSimonian and Liard approach) were conducted when data could be pooled [32]. P values < 0.05 were considered statistically significant. We conducted: 1) meta-analyses on the Standardized Mortality Ratio (SMR) for suicides i.e. the ratio between the observed and expected number of death among physicians, stratified by sex (Fig 4; and Fig 5 for metaregressions), geographic zones (Fig 6), epochs of time, and by categories of specialties (main groups of specialities (Fig 7 and S1 Fig), surgical specialties (Fig 8 and S2 Fig), then medical specialities (Fig 9 and S3 Fig), 2) meta-analyses on the prevalence of health-care workers died by suicide among all health-care workers death (Fig 10), 3) meta-analyses on the prevalence of health-care workers died by suicide among all the deaths by suicide in the general population (S4 Fig), 4) meta-analyses on suicide attempts (S5 Fig) and suicidal ideation (Fig 11). Effect-size was estimated for quantitative endpoints as number of physicians having done suicide attempt and number of physicians with suicidal ideation. A scale for ES has been suggested with 0.8 reflecting a large effect, 0.5 a moderate effect, and 0.2 a small effect [33]. When possible (sufficient sample size), meta-regressions were proposed to study relation between prevalence and epidemiological relevant parameters determined according to the literature: sex, geographic zone, epoch of time (for studies with a follow-up over several consecutive years, we based our statistics on the mean year of epoch of time). Results were expressed as regression coefficient and 95% CI.
Fig 4

Meta-analysis of standardized mortality rate for suicides among physicians by gender.

Fig 5

Meta-regression of standardized mortality rate for suicides among physicians.

Fig 6

Meta-analysis of standardized mortality rate for suicides by geographic zones.

Fig 7

Meta-analysis of percentages of suicide in physicians by group of specialties.

Fig 8

Meta-analysis of percentages of suicide in physicians by category of surgical specialties.

Fig 9

Meta-analysis of percentages of suicide in physicians by category of medical specialties.

Fig 10

Meta-analysis of prevalence of physicians died by suicide among all deaths in physicians.

Fig 11

Meta-analysis of prevalence of physicians with suicidal ideation among all the physicians.

Results

An initial search produced a possible 37050 articles (Fig 1). Removal of duplicates and use of the selection criteria reduced the search to 61 articles [1,2,5,7,8,15,16,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87]. In those 61 articles, 55 articles were on physicians [1,5,7,8,15,16,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,82,83,84,85], four on dental surgeons [55,56,62,70], four on nurses [2,79,80,86], and two on other health-care workers [70,87]. Among those 55 on physicians, 47 reported data on deaths by suicide [1,5,7,8,15,16,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,82,83], five on suicide attempts [47,73,75,77,85], and seven on suicidal ideation [74,75,76,77,78,84,85]. In those 47 articles on deaths by suicide among physicians, 25 described SMR for suicide [7,8,41,46,52,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,82], eight reported percentages of suicide by specialty [15,16,40,43,45,47,51,83], 12 reported the number of physicians died by suicide among all deaths in physicians [16,39,41,42,44,46,48,49,50,51,52,53], and nine reported the number of physicians died by suicide among all the deaths by suicide in the general population [1,5,15,34,35,36,37,38,82]. As there are few exploitable studies about dental surgeons, nurses and other health-care workers, we won’t treat them in that meta-analysis. More details on study characteristics (Table 1), quality of articles (Figs 2 and 3), method of sampling for markers analysis, inclusion and exclusion criteria, characteristics of participants, outcomes and aims of the studies, and study designs of included articles are described in S1 Appendix.
Table 1

Characteristics of included studies.

CI, Confidence Interval; n, Number; SMR, Standardized Mortality Ratio; USA, United States of America.

Time PeriodTotalSuicides
StudyCountryContinentPhysicians–n (%)Death–n (%)Mortality–SMR (95CI)Attempts—nThoughts—nSpecialities
MenWomenMenWomenMenWomenMenWomenMenWomen
Aasland 2001NorwayEurope1960–199373 (89)9 (11)No specified
Aasland 2011NorwayEurope1960–2000No specified
Arnetz 1987SwedenEurope1961–197032 (76)10 (24)1,2 (0.85, 1.69)5,7 (1.68, 10.7)No specified
Austin 2013AustraliaAustralia, New-Zealand and Pacific1997–20116 (66)3 (34)Anaesthesiologists, psychiatrists, general practitioners, general surgeons
Bamayr 1986GermanyEurope1963–197867 (71)27 (29)1,58 (1.07, 2.34)2,96 (1.44, 6.09)No specified
Brooks 2017USANorth America2003–20141188 (72)544 (28)3832No specified
Carpenter 1997Great BritainEurope1962–197956 (87)8 (13)0,96 (0.72, 1.25)2,15 (0.93, 4.23)No specified
Craig 1968USANorth America1965–196721117No specified
Davidson 2018USANorth America2005–20152,29 (1.66, 3.08)2,29 (1.66, 3.08)No specified
Dean 1969South AfricaAfrica1960–196622 (96)1 (4)1,26 (0.74, 2.13)No specified
Desole 1969USANorth America1965–1968General practitioners, general surgeons, internal medicine, psychiatrists, obstetricians, anaesthesiologists, pathology, paediatrics, radiology, internships
Everson 1975USANorth America1966–1970No specified
Frank 1999USANorth America1993–199404501 (100)61No specified
Frank 2000USANorth America1984–1995379 (91)37 (9)1,7 (1.53, 1.88)2,38 (1.69, 3.28)No specified
Fridner 2009Sweden and ItalyEurope2005–20050385 (100)122No specified
Gagne 2011QuebecNorth America1992–200929 (80)7 (20)General practitioners, radiology, psychiatrists
Gold 2013USANorth America2003–2008No specified
Gunnarsdottir 1995IcelandEurope1920–1979No specified
Hawton 2001Great BritainEurope1991–199542 (74)15 (26)0,67 (0.47, 0.87)2,02 (1.00, 3.04)No specified
Hawton 2002England and WalesEurope1994–1997No specified
Hawton 2011DanishEurope1981–2006131 (80)32 (20)No specified
Hem 2000NorwayEurope1993–1999722 (72)282 (28)796143No specified
Hem 2005NorwayEurope1960–199098 (88)13 (22)No specified
Hemenway 1993USANorth America1976–1988No specified
Herner 1993SwedenEurope1989–199117 (68)8 (32)1.1 (0.8, 1.52)2,32 (1.12, 4.81)No specified
Hikiji 2014JapanAsia1996–201068 (79)19 (21)Internal medicine, dermatologists, paediatrics, psychiatrists, general surgeons, orthopaedists, ophthalmology, plastic surgeons, ENT, obstetricians, radiology, anaesthesiologists
Hubbard 1922USANorth America1921No specified
Innos 2002EstoniaEurope1983–19986 (54)5 (46)0,58 (0.21, 1.27)0,62 (0.20, 1.45)No specified
Jones 1977USANorth America1967–1975115General practitioners, anaesthesiologists, internal medicine, obstetricians, psychiatrists, general surgeons, internships
Juel 1999DanishEurope1973–1992168 (86)26 (14)1.64 (1.40, 1.91)1.68 (1.10, 2.46)No specified
Lew 1976USANorth America1954–1976No specified
Linde 1981USANorth America1930–1946274 (100)0100No specified
Lindeman 1997FinlandEurope1986–1993No specified
Lindeman 2007FinlandEurope1987–19882 (28)5 (72)No specified
Lindfors 2009FinlandEurope2004–2008175 (53)153 (47)No specified
Lindhardt 1963DenmarkEurope1935–19591.53 (1.06, 2.20)No specified
Loas 2018BelgiumEurope2015–2018223 (40)334 (60)594291No specified
No Author 1986USANorth America1980–1981No specified
Nordentoft 1988NetherlandsEurope1970–198059 (85)10 (15)2.46 (1.02, 3.42)3.33 (0.42, 26.3)No specified
Olkinuora 1990FinlandEurope1986–19891582 (59)1062 (41)106340269No specified
Palhares-Alves 2015BrazilSouth America2000–200938 (76)12 (24)No specified
Petersen 2008USANorth America1984–1992181 (89)22 (11)0.8 (0.53, 1.20)2.39 (1.52, 3.77)No specified
Pitts 1979USANorth America1967–1972751493.57 (1.23, 10.4)No specified
Rafnsson 1998IslandEurope1955–19957 (100)1.01 (0.40, 2.04)No specified
Revicki 1985USANorth America1978–1982131.16 (0.80, 1.70)No specified
Rich 1979USANorth America1967–1972179795441.03 (0.74, 1.45)No specified
Rich 1980USANorth America1967–1972544 (92)49 (8)General practitioners, internal medicine, general surgeons, psychiatrists, obstetricians, paediatrics, radiology, anaesthesiologists, pathology, ophthalmology, orthopaedists
Rimpela 1987FinlandEurope1971–1980171.28 (1.01, 1.65)No specified
Rose 1973USANorth America1959–196148 (98)1 (2)2.03 (1.29, 3.19)No specified
Roy 1985USANorth America1981–1974No specified
Samkoff 1995USANorth America1980–1988General practitioners, internal medicine, general surgeons, radiology, paediatrics
Schlicht 1990AustraliaAustralia, New-Zealand and Pacific1950–19861279 (88)174 (12)1031.13 (0.54, 2.07)5.01 (1.01, 14.7)No specified
Shang 2011TaiwanAustralia, New-Zealand and Pacific1990–2006No specified
Shang 2012TaiwanAsia1990–2006No specified
Simon 1968USANorth America1947–1967No specified
Stefansson 1991SwedenEurope1971–1985113 (82)25 (19)1.82 (1.19, 2.80)5.02 (1.67, 15.0)No specified
Torre 2005USANorth America1948–1998183 (91)18 (11)20 (90)2 (10)1.82 (1.11, 2.82)4.95 (0.56, 17.9)No specified
Ullmann 1991USANorth America1910–1981461.48 (0.97, 2.27)No specified
Wang 2017ChinaAsia2004–20176 (33)8 (44)Dermatologists, emergency, internal medicine, obstetricians, paediatrics, cardiology, neurology, urology, ophthalmology, anaesthesiologists

Characteristics of included studies.

CI, Confidence Interval; n, Number; SMR, Standardized Mortality Ratio; USA, United States of America.

Meta-analysis of the standardized mortality rate for suicides among physicians

We included 25 studies. The overall SMR was 1.44 (95CI 1.16, 1.72) with an important heterogeneity (I2 = 93.9%). Among the 25 included studies, 17 studies reported both male and female physicians [7,8,41,46,52,54,55,56,57,58,59,61,62,68,70,71,82], six reported only male physicians [60,64,65,66,67,72], and one only reported female physicians [63]. We found a significantly higher risk of suicide among male physicians than in the general population (SMR = 1.24; 95CI 1.05, 1.43; P < 0.001; I2 = 79.1%) and for suicide among female physicians than in the general population (SMR = 1.94; 95CI 1.49, 2.58; P < 0.041; I2 = 42.5%) (Fig 4). Meta-regressions demonstrated that women physicians had a higher risk than their counterpart men to commit suicide (0.67; 95CI 0.19, 1.14; P = 0.007) (Fig 5). We further demonstrated that the risk of suicide was not homogeneous over all the countries. SMR was 1.27 (95CI 1.05, 1.49; P < 0.001; I2 = 71.3%) in Europe, 1.63 (95CI 1.29, 1.96; P < 0.001; I2 = 74.1%) in North America, 0.79 (95CI 0.03, 1.62; P = 0.002; I2 = 79.5%) in Australia, New-Zeeland and Pacific and 1.26 (95CI 0.56, 1.96) in Africa (Fig 6). Meta-regressions demonstrated a higher risk of suicide in North America than in Australia, New-Zeeland and Pacific (0.92; 95CI 0.22, 1.63; P = 0.013) and especially higher in USA vs the rest of the world (1.34; 95CI 1.28, 1.55; P < 0.001) (Fig 5). Finally, we demonstrated an overall time effect (-0.15; 95CI -0.29, -0.01; P = 0.032) which signify that the risk decreased over time. This relationship is significant in Europe (-0.18; 95CI -0.37, -0.01; P = 0.044) but not in USA (-0.11; 95CI -0.37, 0.15; P = 0.370) or in Australia, New-Zeeland and Pacific (-0.48; 95CI -8.09, 7.12; P = 0.570). For Africa, there were insufficient observations (Fig 5).

Meta-analysis of percentage of suicide in physicians by group of specialties

We included eight studies [15,16,40,43,45,47,51,83]. The percentage of suicide in general practitioners was 32% (95CI 21, 43; P < 0.001; I2 = 93.1%), in internal medicine was 16% (95CI 9, 23; P < 0.001; I2 = 88.6%), in psychiatrists was 11% (95CI 9, 14; P = 0.30; I2 = 17.5%), in other medical specialties was 3% (95CI 3, 4; P = 0.02; I2 = 40.7%), in surgeons was 4% (95CI 2, 5; P < 0.001; I2 = 62.8%) and in internships was 2% (95CI 1, 4) (Fig 7). Meta-regressions demonstrated a higher risk of suicide in general practitioners than internal medicine (0.12; 95CI 0.05, 0.19; P = 0.001), than psychiatrists (0.17; 95CI 0.09, 0.24; P < 0.001), than other medical specialties (0.24; 95CI 0.18, 0.30; P < 0.001), than surgeons (0.25; 95CI 0.19, 0.30; P < 0.001) and then internships (0.24; 95CI 0.15, 0.34; P < 0.001). Moreover, a higher risk of suicide in internal medicine than in other medical specialties (0.12; 95CI 0.08, 0.17; P < 0.001), than surgeons (0.13; 95CI 0.08, 0.18; P < 0.001), and than internships (0.13; 95CI 0.03, 0.22; P = 0.008). Finally, we demonstrated a higher risk of suicide in psychiatrists than other medical specialties (0.07; 95CI 0.02, 0.13; P = 0.009) and than surgeons (0.08; 95CI 0.02, 0.13; P = 0.005) (S1 Fig).

Meta-analysis of percentages of suicide in physicians by category of surgical specialties

We included six studies [15,16,43,47,51,83]. The percentage of suicide in general surgeons was 6% i.e. (95CI 4, 9; I2 = 64.5%, P = 0.04), in obstetricians was 4% (95CI 2, 5; I2 = 0, P = 0.81), in orthopaedists was 2% (95CI 1, 4), in ears, nose and throat was 3% (95CI 0, 3) and in plastic surgeons was 1% (95CI 0, 6) (Fig 8). Meta-regressions demonstrated a higher risk of suicide in general surgeons than obstetricians (0.03; 95CI 0.01, 0.05; P = 0.035), than orthopedists (0.04; 95CI 0.01, 0.07; P = 0.006), than ophthalmologists (0.04; 95CI 0.02, 0.07; P = 0.006) and than plastic surgeons (0.05; 95CI 0.01, 0.09; P = 0.010) (S2 Fig).

Meta-analysis of percentages of suicide in physicians by category of medical specialties

Eight studies were included [15,16,40,43,45,47,51,83]. The percentage of suicide in internal medicine was 16% (95CI 9, 23; I2 = 88.6%, P < 0.001), in psychiatrists was 11% (95CI 9, 14; I2 = 17.5%, P = 0.30), in anaesthesiologists was 4% (95CI 2, 6; I2 = 43.6%, P = 0.11), in radiologists was 3% (95CI 2, 5; I2 = 66.0%, P = 0.02), in paediatricians was 4% (95CI 3, 6; I2 = 46.4%, P = 0.11), in pathologists was 2% (95CI 1, 3), in dermatologists was 5% (95CI 1, 9), in cardiologists was 6% (95CI 1, 26), in neurologists was 6% (95CI 1, 26) and in emergency physicians was 6% (95CI 1, 26) (Fig 9). Meta-regressions demonstrated a higher risk of suicide in internal medicine than anesthesiologists (0.12; 95CI 0.06, 0.18; P = 0.001) than radiologists (0.13; 95CI 0.07, 0.19; P < 0.001), than pediatricians (0.12; 95CI 0.06, 0.18; P = 0.001) than pathologists (0.14; 95CI 0.07, 0.21; P < 0.001) and than dermatologists (0.12; 95CI 0.03, 0.21; P = 0.13). Moreover, the risk of suicide was higher in psychiatrists than anesthesiologists (0.07; 95CI 0.01, 0.13; P = 0.038), than radiologists (0.08; 95CI 0.02, 0.14; P = 0.014), than pediatricians (0.07; 95CI 0.01, 0.13; P = 0.038) and than pathologists (0.09; 95CI 0.02, 0.17; P = 0.014) (S3 Fig).

Meta-analysis of prevalence of physicians dead by suicide among all deaths in physicians

We included 12 studies [16,39,41,42,44,46,48,49,50,51,52,53], and we demonstrated a prevalence of 4% (95CI 3, 5) with an important heterogeneity (I2 = 88.7%) (Fig 10). Meta-regression on geographic zones did not retrieves any significant result. Moreover, insufficient data did not permit other meta-regression.

Meta-analysis of the prevalence of deaths by suicide in physicians among all deaths by suicide in the general population

We included nine studies [1,5,15,34,35,36,37,38,82], and we demonstrated a prevalence of 1% (95CI 1, 1) with an important heterogeneity (I2 = 98.0%) (S4 Fig). Insufficient data did not permit meta-regression.

Meta-analysis of the number of physicians having done suicide attempt among all the physicians

We included five studies [47,57,75,77,85]. The overall effect size was 0.01 (95CI 0.01, 0.02; p < 0.01) with an important heterogeneity (I2 = 82.6%) (S5 Fig). Insufficient data did not permit meta-regression.

Meta-analysis of the number of physicians with suicidal ideation among all the physicians

We included seven studies [74,75,76,77,78,84,85]. The overall effect size was 0.17 (95CI 0.12, 0.21; p < 0.001) with an important heterogeneity (I2 = 98.8%) (Fig 11). Insufficient data did not permit meta-regression.

Other health care workers

As there are few exploitable studies about dental surgeons, nurses and other health-care workers, we didn’t treat them in that meta-analysis.

Discussion

Physicians were an at-risk profession (1.44, 95CI 1.16, 1.72), particularly women-physician (0.67, 95CI 0.19, 1.14; p = 0.007). Some countries had a high risk of suicide (USA vs Rest of the world: 1.34, 95CI 1.28, 1.55; p < 0.001) and rate of suicide in physicians decreased over time, especially in Europe (-0.18, 95CI -0.37, -0.01; p = 0.044). Some specialties were higher risk such as anesthesiologists, psychiatrists, general practitioners and general surgeons. The prevalence of physicians having done suicide attempt among all the physicians were significant (0.01, 95CI 0.01, 0.02; p < 0.001) as the prevalence of physicians with suicidal ideation among all the physicians (0.17, 95CI 0.12, 0.21; p < 0.001). Finally, there were not enough exploitable data about dental surgeons, nurses and other health-care workers which are however some at-risk professions.

An at-risk profession

The high risk of suicide in physicians might be explained by several putative factors such as psychosocial working environment [18], or specific personality traits of physicians. Psychosocial work environment has been shown in the literature as an important risk factor, doctors being confronted to conflicts with colleagues, lack of cohesive teamwork and social support, leading them individually [88]. Physicians must also routinely face with breaking bad news [89], and are in frequent contact with illness, anxiety, suffering and death. Perfectionism, compulsive attention to detail, exaggerated sense of duty, excessive sense of responsibility, desire to please everyone are appreciates qualities in workplace [90,91] but increased stress and depression [92] and imprison physicians in vicious circle without seek help. They also prevent themselves to ask for help because of the culture of medical education [90,91]. In particular, we demonstrated that women physicians were particularly exposed to suicide, which might be explained by the additional strain imposed on them because of their social roles [11]. In most countries, women still have more at-home responsibilities (education of children, nursing, household care, etc) than men. Combining a full-time job as a physician and those at-home responsibilities might be particularly difficult to manage [11]. Although income gender-inequalities have not been reported in physicians[93,94], some authors suggested that the medical field was mainly dominated by the male gender and reported a poor status integration of women physicians within the profession [7]. It has been shown that female physicians/internships react by imposing themselves an additional pressure to demonstrate their male counterparts that they are as strong, self-sufficient and worthy as them [95].

Depending on countries

We showed that the risk of suicide was not homogeneous between countries, in line with inequality of job satisfaction among physicians in many countries [96,97]. Indeed, some countries such as Switzerland and Canada reported a high level of job satisfaction for physicians (>75%) [98,99]. In the United States, most obstetrician gynecologists only rated their job satisfaction as moderate [100]. Physician job satisfaction is essential for ensuring the quality and sustainability of health care provision [101,102]. Moreover, career dissatisfaction was associated with burnout and prolonged fatigue among physicians [103]. In most countries, physicians’ work conditions underwent frequent mutations, with multiple healthcare reforms initiatives promoting by local governments. Reforms are a necessary compromise between best outcomes on deliveries of care, health economics, and quality of work environment [104,105].

With a time effect

There are few data on the evolution of the rate of suicide over time and we were the first to demonstrate that, in some countries such as in Europe the suicide rate among physicians decreased significantly with time but not in the USA. During the past decade, a confluence of forces has changed the practice of medicine in unprecedented ways. Indeed, physicians have seen their autonomy reduced by increased administrative tasks and time pressure [106,107,108]. In USA, a survey showed that physicians’ satisfaction declined over the last 10 years, with less time spent per patient and for private life [13]. US physicians might also be particularly stress [109] because of medical errors that are the third leading cause of death in US [110,111] in a context of economic pressure and relationships with pharmaceutic companies [112,113], religious beliefs [114], access care difficulties for some patients [115], and legal procedure intended against physicians [116] leading them to practice a more defensive medicine [117] misleading patients in overdiagnosis [118]. The World Health Organization global strategy on human resources for health (workforce 2030) promoted the personal and professional rights of health-care workers, including safe and decent working environments [119]. Particularly in Europe, working hours of physicians decreased significantly over the last decades following official instructions such as the European Working Time Directive (EWTD) [14], which may have contributed to a decreased risk of suicides.

Some specialties are more at-risk

We showed some the most at-risk specialties were anaesthesiologists, psychiatrists, general practitioners and general surgeons. The high risk of suicides in anaesthesiologists [16,41,48,76] could be explained by an easy access to potentially lethal drugs, a high prevalence of burnout [120], a high workload with fear of harming patients and organizational burden with poor autonomy, and conflicts with colleagues [121]. For psychiatrists, the high risk of suicides has been linked by stressful and traumatic experiences such as, paradoxically, dealing with suicides of patient [16]. Next to those medical specialties, the general practitioners were an historical at-risk occupation, with moral loneliness, job interfering with family life, constant interruptions both at home and at work, increasing administrative constraints, and high levels of patients' expectations, leading to a low job satisfaction and poor mental health [122,123]. Finally, specialties with life-and-death emergencies, like surgery, are particularly stressful [124,125,126,127]. For example, it has been shown that intra-operative death increased morbidity in patients operated by the same surgeon in the subsequent 48 hours, with a more pronounced whether the death occurring during emergency surgery [128].

Suicide attempts and suicidal ideation

Suicide could be regarded as a lengthy process. Little is known about causes and transitions between suicidal ideation / attempted suicide and suicide, as well as about the factors that precipitate or protect against these transitions [129]. Because physicians might be more aware of these characteristics than the general population [75], having suicidal thoughts should be taken particularly seriously in this profession. Suicidal ideation are considered a sensitive and specific indicator of suicide risk [130,131]. Preventive strategies may include improved management of psychiatric disorders, the recognition and treatment of depression and substances abuse [65], but also measures to reduce occupational stress, and restriction of access to means of suicide when doctors are depressed [4,132]. Medical school curriculum should also include programs to increase students’ self-confidence, to express their emotional needs, and to teach that anyone may be suicidal–regardless of his status [133]. The preventive approach may consist of screening, assessment, referral and education, and to destigmatize help-seeking at-risk medical students/physicians [134].

Suicides in other health-care workers

We highlighted the lack of studies providing data on deaths by suicide and on suicidal risks in nurses and in other health-care workers. However, nurses remained at high-risk of suicide with various stressful factors comparable to those previously described for physicians, such as patients cares, team’s conflicts, heavy workload, lack of autonomy, and work-family conflicts [135,136]. As for physicians, some occupational settings were described as particularly stressful, such as working in emergency departments [137], with a high prevalence of shift work [138], exposure to aggressive and violent behavior from patients [139] and from situation relating to trauma, alcohol and intoxications [140]. Our study demonstrated the lack of data on other health-care workers such as pharmacists, dental surgeons, midwives, caregivers and hospital maids. We believe that such data are needed.

Limitations

Our study has however some limitations. Meta-analyses inherit the limitations of the individual studies of which they are composed: varying quality of studies and multiple variations in study protocols and evaluation. We highlighted that general practitioners were prone to suicide. However, comparisons between specialties may suffer from a major bias such as different number of physicians within each specialty (not the same denominator in statistical analyses—there are more suicides among general practitioners because there are more general practitioners than other individual specialties). All included studies on death by suicide in physicians were retrospective and based on health registers, and thus few studies reported details on occupation such as seniority or characteristics of practice, precluding further analyses necessary for effective preventive strategies. The studies on suicide attempts and suicidal ideation that were based on self-report questionnaire [73,74,75,77] may lack of standardized interviews or specifics criteria for diagnoses psychiatric disorders [125,[141]. Most cross-sectional studies included in our meta-analyses described a bias of self-report such as skipping questions and incomplete information, nondisclosure, and uncertainty regarding timing of questionnaire. Percentage of respondents within those studies may seem low, from 45% [74] to 76% [77], however the response rate was higher than usual [142,143,144,145,146]. The language used in countries with two official languages may also have influenced responses [74]. Only one study questioned physicians on their antidepressant treatment [121], and only one study questioned about a psychiatric disorder [74]. More data is needed regarding physician’s health. Finally, none of the studies included specified whether some physicians were retired or not.

Conclusion

Preventive strategies on the risk of suicides in physicians are strongly needed. Physicians are an at-risk profession of suicide, with a global SMR of 1.44 (95CI 1.16, 1.72), and an important heterogeneity between studies. Women were particularly at risk compared to male physicians. In addition, some countries were with a higher risk of suicide such as USA. Interestingly, the rate of suicide in physicians decreased over time, especially in Europe, suggesting improvements of working conditions of physicians. Some specialties might be at higher risk such as anesthesiologists, psychiatrists, general practitioners and general surgeons. The high prevalence of physicians who committed suicide attempts as well as those with suicidal ideation should benefits for preventive strategies at the workplace. Public health policies must aim at improving social work environment and contribute to screening, assessment, referral, and destigmatization of suicides in physicians. Finally, the lack of data on other health-care workers suggest implementing studies investigating those occupations who might also be at risk of suicide.

Details on study characteristics, quality of articles (Figs 2 and 3), method of sampling for markers analysis, inclusion and exclusion criteria, characteristics of participants, outcomes and aims of the studies, and study designs of included articles.

(DOCX) Click here for additional data file.

PRISMA checklist.

(DOCX) Click here for additional data file.

Meta-regression of percentages of suicide in physicians by group of specialties.

(TIF) Click here for additional data file.

Meta-regression of percentages of suicide in physicians by category of surgical specialties.

(TIF) Click here for additional data file.

Meta-regression of percentages of suicide in physicians by category of medical specialties.

(TIF) Click here for additional data file.

Meta-analysis of prevalence of physicians died by suicide among all the deaths by suicide in the general population.

(TIF) Click here for additional data file.

Meta-analysis of prevalence of physicians having done suicide attempt among all the physicians.

(TIF) Click here for additional data file.

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present. 23 Aug 2019 PONE-D-19-21600 Suicide among physicians and health-care workers A systematic review and meta-analysis PLOS ONE Dear Dr. Navel, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please address all concerns raised by our reviewer. English editing should be done as pointed out. Moreover, further detailed information and clearer descriptions, especially on methodology, must be required in order to convince our readers on why the authors approach was relevant and valid scientifically. We would appreciate receiving your revised manuscript by Oct 07 2019 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript: A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'. A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'. An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Takeru Abe, Ph.D Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf Additional Editor Comments (if provided): [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank you for the opportunity to review the manuscript, “Suicide among physicians and health-care workers: A systematic review and meta-analysis.” This manuscript conducts an updated meta-analytic review of suicide risk among healthcare works. The authors tackle a topic of need, as demonstrated by the high rates of suicide among healthcare workers, and physicians more specifically. While I believe this manuscript may be of value to the broader literature, there are several spots where more information or discussion would greatly enhance the potential impact. These points, in addition to a few more minor points, are outlined below. - I appreciate the author’s erring toward brevity in setting up the rational for the current study. However, given the number of, and content of, the study hypotheses, there is a need for more background information. It is not clear why the authors are hypothesizing many of the points that they are. For example, why do they think that females would have greater risk of death by suicide? The general literature demonstrates that men are more likely to die by suicide. Similarly, why do they think that rates by profession will improve overtime? - Additional information on the inclusion /exclusion criteria and how this impacted study selection is needed. Did studies need to be peer-reviewed, present empirical data, etc. ? Why were studies on medical students excluded but those including interns included? - Further, it is unclearly why studies needed to include information on both healthcare workers and the general population for inclusion criteria (pg. 5, sentence 4) when not all analyses required this. It would also be helpful to include how many studies were not included per exclusion criteria listed in Figure 1. - The authors detail 4 different meta-analyses in the statistical considerations questions, but present information on 8 different models. Greater detail of the models in the statistical considerations section would be useful. For example, further explanation of how some of the models are different would be important to include (i.e., meta-analysis of percentage of suicide in physicians by group of specialties vs. that by category of medical specialty). This might be a point of discussion to further delineate in the introduction. - How many studies were conducted in the US? Currently the figures just note North America, but analyses also target the US. - Given the significance of gender analyses, it would be useful to have N’s by gender for studies versus just percentage (since we don’t know the overall N for studies). - Greater information on how the different time periods were handled in analyses would be useful (i.e., some time periods included 30+ years where others were shorter, some were partially overlapping, etc.). - In the discussion it would be useful if authors discussed in more depth the gender finding. This seems to be a major finding of the paper but it only receives 1-2 lines in the discussion. - Similarly, the discussion could be enhanced overall by increasing the depth of discussion of findings. For example, when discussing findings related to the US authors discuss career dissatisfaction but don’t really discuss why this might be different in the US. - Greater discussion of the implications of these findings in the Conclusion section is needed. What do these findings mean? How should be people use this information? - Generally the Figures were very hard to read, sometimes did not fit on the page, and did not include enough information to stand alone (e..g, Figure 3). - I would suggest that the authors have someone native to English copy-edit the manuscript, simply to examine verb disagreements, etc. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. 2 Oct 2019 Dear Editor, My coauthors and I welcomed the review of our Manuscript PONE-D-19-21600 entitled “Suicide among physicians and health-care workers A systematic review and meta-analysis”. We have addressed the comments of the reviewers in a revised manuscript and enclose a point-by-point response. Editor Comments None [REPLY] Thank you for letting us know that all questions were already included into reviewers’ comments. Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf [REPLY] Thank you for your comment. The manuscript now follows Journal Requirements. Reviewers' Comments Thank you for the opportunity to review the manuscript, “Suicide among physicians and health-care workers: A systematic review and meta-analysis.” This manuscript conducts an updated meta-analytic review of suicide risk among healthcare works. The authors tackle a topic of need, as demonstrated by the high rates of suicide among healthcare workers, and physicians more specifically. While I believe this manuscript may be of value to the broader literature, there are several spots where more information or discussion would greatly enhance the potential impact. These points, in addition to a few more minor points, are outlined below. [REPLY] Thank you for you positive comment. We have addressed a point-by-point response below. - I appreciate the author’s erring toward brevity in setting up the rational for the current study. [REPLY] Thank you for you positive comment. However, given the number of, and content of, the study hypotheses, there is a need for more background information. It is not clear why the authors are hypothesizing many of the points that they are. For example, why do they think that females would have greater risk of death by suicide? The general literature demonstrates that men are more likely to die by suicide. [REPLY] Thank you for your relevant comment. The introduction now reads: “Suicide risk was increased in certain occupational groups, especially in medical-related professions [1]. Physicians, and other health-care workers such as nurses [2,3], were considered like high risk group of suicide in different countries [4,5,6], especially for women [6,7,8]. Indeed, despite considerably higher risk of suicides in men than women in the general population [9], female doctors have higher suicide rates than men [10], putatively because of their social family role [95], or a poor status integration within the profession [7].” We also added more details in the discussion. Similarly, why do they think that rates by profession will improve overtime? [REPLY] Thank you for your relevant comment. The introduction now reads: “Physicians working conditions varied substantially between countries and over contemporary times, these factors were never investigated in relationships with suicide in physicians. For example, recent years saw tentative to regulate working time of physicians, such as in Europe with its European Working Time Directive (EWTD) [Reference].” Reference: Temple, J. (2014). Resident duty hours around the globe: where are we now? BMC Medical Education, 14(1), S8. doi:10.1186/1472-6920-14-S1-S8 - Additional information on the inclusion /exclusion criteria and how this impacted study selection is needed. Did studies need to be peer-reviewed, present empirical data, etc. ? [REPLY] The methods section now reads: “To be included, articles had to be peer-reviewed and to describe original empirical data on suicides, suicide attempt or suicidal ideation in health-care workers.” Why were studies on medical students excluded but those including interns included? [REPLY] The methods section now reads: “Students were excluded because of the difference in responsibilities in comparisons with health-care workers, and because of the existence of previous recent meta-analyses focusing specifically on health-care students [References].” References: Puthran, R., Zhang, M. W., Tam, W. W., & Ho, R. C. (2016). Prevalence of depression amongst medical students: a meta-analysis. Medical Education, 50(4), 456-468. doi:10.1111/medu.12962 Rotenstein, L. S., Ramos, M. A., Torre, M., Segal, J. B., Peluso, M. J., Guille, C., . . . Mata, D. A. (2016). Prevalence of Depression, Depressive Symptoms, and Suicidal Ideation Among Medical Students: A Systematic Review and Meta-Analysis. JAMA, 316(21), 2214-2236. doi:10.1001/jama.2016.17324 Witt, K., Boland, A., Lamblin, M., McGorry, P. D., Veness, B., Cipriani, A., . . . Robinson, J. (2019). Effectiveness of universal programmes for the prevention of suicidal ideation, behaviour and mental ill health in medical students: a systematic review and meta-analysis. Evid Based Ment Health, 22(2), 84-90. doi:10.1136/ebmental-2019-300082 Zeng, W., Chen, R., Wang, X., Zhang, Q., & Deng, W. (2019). Prevalence of mental health problems among medical students in China: A meta-analysis. Medicine, 98(18), e15337. doi:10.1097/md.0000000000015337 - Further, it is unclearly why studies needed to include information on both healthcare workers and the general population for inclusion criteria (pg. 5, sentence 4) when not all analyses required this. [REPLY] Thank you for your relevant comment. We totally agree with you and deleted “in the general population”. The methods section now reads: “To be included, articles had to be peer-reviewed and to describe original empirical data on suicides, suicide attempt or suicidal ideation in health-care workers. It would also be helpful to include how many studies were not included per exclusion criteria listed in Figure 1. [REPLY] Thank you for your relevant comment. Figure 1 now includes the number of studies not included per exclusion criteria. - The authors detail 4 different meta-analyses in the statistical considerations questions, but present information on 8 different models. Greater detail of the models in the statistical considerations section would be useful. For example, further explanation of how some of the models are different would be important to include (i.e., meta-analysis of percentage of suicide in physicians by group of specialties vs. that by category of medical specialty). This might be a point of discussion to further delineate in the introduction. [REPLY] Thank you for your relevant comment. In fact, we computed four types of meta-analyses: 1) on SMR, 2) on prevalence of suicides among all health-care workers death, 3) on prevalence of suicides among all the death by suicides in the general population, and 4) on suicide attempts and suicidal ideation); but each type might be composed of several meta-analysis in subgroups, such as SMR by sex, SMR by geographic zones, SMR by epochs of time, and SMR by categories of specialties. To facilitate understanding for readers, we have chosen to add the Figures in parenthesis and to give more details. The methods section now reads: “We conducted: 1) meta-analyses on the Standardized Mortality Ratio (SMR) for suicides i.e. the ratio between the observed and expected number of death among physicians, stratified by sex (Fig 4; and Fig 5 for metaregressions), geographic zones (Fig 6), epochs of time, and by categories of specialties (main groups of specialities (Fig 7 and S1 Fig), surgical specialties (Fig 8 and S2 Fig), then medical specialities (Fig 9 and S3 Fig), 2) meta-analyses on the prevalence of health-care workers died by suicide among all health-care workers death (Fig 10), 3) meta-analyses on the prevalence of health-care workers died by suicide among all the deaths by suicide in the general population (S4 Fig), 4) meta-analyses on suicide attempts (S5 Fig) and suicidal ideation (Fig 11).” We added the following sentence in the introduction to emphasize our further objective to compare between specialties: “Some specialties have been suggested to be particularly at risk of suicides [15,16] with occupational factors individualized in different medical or surgical specialties: heavy workload and working hours involved in the job such as long shifts and unpredictable hours (with the sleep deprivation associated) [17], stress of the situations (life and death emergencies) [18], and easy access to a means of committing suicide [19].” - How many studies were conducted in the US? Currently the figures just note North America, but analyses also target the US. [REPLY] Thank you for your relevant comment. We added a new Table 1 that gives details on studies including country. - Given the significance of gender analyses, it would be useful to have N’s by gender for studies versus just percentage (since we don’t know the overall N for studies). [REPLY] Thank you for your relevant comment. We added a new Table 1 that gives details on N’s by gender for studies versus just percentage. - Greater information on how the different time periods were handled in analyses would be useful (i.e., some time periods included 30+ years where others were shorter, some were partially overlapping, etc.). [REPLY] Thank you for your relevant comment. The statistics section now reads: “When possible (sufficient sample size), meta-regressions were proposed to study relation between prevalence and epidemiological relevant parameters determined according to the literature: sex, geographic zone, epoch of time (for studies with a follow-up over several consecutive years, we based our statistics on the mean year of epoch of time).” - In the discussion it would be useful if authors discussed in more depth the gender finding. This seems to be a major finding of the paper but it only receives 1-2 lines in the discussion. [REPLY] Thank you for your relevant comment. We added the following sentences in the discussion: “In particular, we demonstrated that women physicians were particularly exposed to suicide, which might be explained by the additional strain imposed on them because of their social roles [95]. In most countries, women still have more at-home responsibilities (education of children, nursing, household care, etc) than men. Combining a full-time job as a physician and those at-home responsibilities might be particularly difficult to manage [95]. Although income gender-inequalities have not been reported in physicians [97,98], some authors suggested that the medical field was mainly dominated by the male gender and reported a poor status integration of women physicians within the profession [7]. It has been shown that female physicians/internships react by imposing themselves an additional pressure to demonstrate their male counterparts that they are as strong, self-sufficient and worthy as them [99].”. References: 97. Smith SJ (1990) Income, Housing Wealth and Gender Inequality. Urban Studies 27: 67-88. 98. Finch N (2014) Why are women more likely than men to extend paid work? The impact of work-family life history. Eur J Ageing 11: 31-39. 99. Pospos S, Tal I, Iglewicz A, Newton IG, Tai-Seale M, Downs N, et al. (2019) Gender differences among medical students, house staff, and faculty physicians at high risk for suicide: A HEAR report. Depress Anxiety. - Similarly, the discussion could be enhanced overall by increasing the depth of discussion of findings. For example, when discussing findings related to the US authors discuss career dissatisfaction but don’t really discuss why this might be different in the US. [REPLY] Thank you for your relevant comment. The discussion now reads: “There are few data on the evolution of the rate of suicide over time and we were the first to demonstrate that, in some countries such as in Europe the suicide rate among physicians decreased significantly with time but not in the USA. During the past decade, a confluence of forces has changed the practice of medicine in unprecedented ways. Indeed, physicians have seen their autonomy reduced by increased administrative tasks and time pressure [110,111,112]. In USA, a survey showed that physicians’ satisfaction declined over the last 10 years, with less time spent per patient and for private life [13]. US physicians might also be particularly stress [113] because of medical errors that are the third leading cause of death in US [114,115] in a context of economic pressure and relationships with pharmaceutic companies [116,117], religious beliefs [118], access care difficulties for some patients [119], and legal procedure intended against physicians [120] leading them to practice a more defensive medicine [121] misleading patients in overdiagnosis [122]. The World Health Organization global strategy on human resources for health (workforce 2030) promoted the personal and professional rights of health-care workers, including safe and decent working environments [123]. Particularly in Europe, working hours of physicians decreased significantly over the last decades following official instructions such as the European Working Time Directive (EWTD) [14], which may have contributed to a decreased risk of suicides.” References: 113. Leape LL (1994) Error in medicine. Jama 272: 1851-1857. 114. Makary MA, Daniel M (2016) Medical error-the third leading cause of death in the US. Bmj 353: i2139. 115. Anderson JG, Abrahamson K (2017) Your Health Care May Kill You: Medical Errors. Stud Health Technol Inform 234: 13-17. 116. Mitchell AP, Winn AN, Lund JL, Dusetzina SB (2019) Evaluating the Strength of the Association Between Industry Payments and Prescribing Practices in Oncology. Oncologist 24: 632-639. 117. Wazana A (2000) Physicians and the pharmaceutical industry: is a gift ever just a gift? Jama 283: 373-380. 118. Korup AK, Sondergaard J, Lucchetti G, Ramakrishnan P, Baumann K, Lee E, et al. (2019) Religious values of physicians affect their clinical practice: A meta-analysis of individual participant data from 7 countries. Medicine (Baltimore) 98: e17265. 119. Dickman SL, Himmelstein DU, Woolhandler S (2017) Inequality and the health-care system in the USA. Lancet 389: 1431-1441. 120. Berlin L (2017) Medical errors, malpractice, and defensive medicine: an ill-fated triad. Diagnosis (Berl) 4: 133-139. 121. Studdert DM, Mello MM, Sage WM, DesRoches CM, Peugh J, Zapert K, et al. (2005) Defensive medicine among high-risk specialist physicians in a volatile malpractice environment. Jama 293: 2609-2617. 122. Chiolero A, Paccaud F, Aujesky D, Santschi V, Rodondi N (2015) How to prevent overdiagnosis. Swiss Med Wkly 145: w14060. - Greater discussion of the implications of these findings in the Conclusion section is needed. What do these findings mean? How should be people use this information? [REPLY] Thank you for your relevant comment. We added implications of these findings in the Conclusion. The conclusion now reads: “Preventive strategies on the risk of suicides in physicians are strongly needed. Physicians are an at-risk profession of suicide, with a global SMR of 1.44 (95CI 1.16, 1.72), and an important heterogeneity between studies. Women were particularly at risk compared to male physicians. In addition, some countries were with a higher risk of suicide such as USA. Interestingly, the rate of suicide in physicians decreased over time, especially in Europe, suggesting improvements of working conditions of physicians. Some specialties might be at higher risk such as anesthesiologists, psychiatrists, general practitioners and general surgeons. The high prevalence of physicians who committed suicide attempts as well as those with suicidal ideation should benefits for preventive strategies at the workplace. Public health policies must aim at improving social work environment and contribute to screening, assessment, referral, and destigmatization of suicides in physicians. Finally, the lack of data on other health-care workers suggest implementing studies investigating those occupations who might also be at risk of suicide.”. - Generally the Figures were very hard to read, sometimes did not fit on the page, and did not include enough information to stand alone (e.g., Figure 3). [REPLY] Thank you for your relevant comment. We agree that there was a need to provide further details on each included articles. In order to keep Figures as simple as possible, we added a new Table 1 with details (including gender and country) for each study. Figure 3 is common in meta-analysis as a summary of risks of bias (e.g. doi: 10.1016/j.jtos.2019.06.004 impact factor 9.1, doi: 10.1001/jama.2018.20578 impact factor 51), in order to give more confidence on results of our meta-analysis. However, Figure 3 can be proposed as a supplementary material on request. - I would suggest that the authors have someone native to English copy-edit the manuscript, simply to examine verb disagreements, etc. [REPLY] We wish to thank Richard May, native English, for providing assistance in improving the manuscript. We hope our work will be considered favorably and look forward to hearing from you. Sincerely yours, Submitted filename: Response to Reviewers.docx Click here for additional data file. 4 Nov 2019 PONE-D-19-21600R1 Suicide among physicians and health-care workers: A systematic review and meta-analysis PLOS ONE Dear Dr. Navel, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. There would be a few points to be clarified. Please address all comments by our reviewer. We would appreciate receiving your revised manuscript by Dec 19 2019 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript: A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'. A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'. An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Takeru Abe, Ph.D Academic Editor PLOS ONE [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank you for the opportunity to review the revised manuscript, “Suicide among physicians and health-care workers: A systematic review and meta-analysis.” I thank the authors for their thoughtful and thorough response to reviewers. I believe the manuscript is much improved. Only two minor points remain. - The authors added the sentence “For example, recent years saw tentative to regulate working time of physicians, such as in Europe with its European Working Time Directive (EWTD).” I believe there may be a word missing following tentative. - Thank you for the added explanation regarding the exclusion of students. However, what about the relevance to interns (some fields consider interns as students, while others do not)? Are they expected to have responsibilities that do not reflect traditional students? Were they included in the previous meta-analysis? - Thank you for clarifying the inclusion criteria regarding information on healthcare workers vs. the general population in the methods section. However, did this influence the studies included? That is, were studies that did not information on the general population excluded from the review? If so, this would suggest it may be necessary to re-review the excluded studies. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. 13 Nov 2019 Dear Editor, My coauthors and I welcomed the review of our Manuscript PONE-D-19-21600 entitled “Suicide among physicians and health-care workers A systematic review and meta-analysis”. We have addressed the comments of the reviewers in a revised manuscript and enclose a point-by-point response. Review Comments to the Author Thank you for the opportunity to review the revised manuscript, “Suicide among physicians and health-care workers: A systematic review and meta-analysis.” I thank the authors for their thoughtful and thorough response to reviewers. I believe the manuscript is much improved. Only two minor points remain. [REPLY] Thank you for your positive comment. - The authors added the sentence “For example, recent years saw tentative to regulate working time of physicians, such as in Europe with its European Working Time Directive (EWTD).” I believe there may be a word missing following tentative. [REPLY] Thank you for your comment. The sentence now reads: “For example, there were tentative to regulate working time of physicians over the recent years, such as in Europe with its European Working Time Directive (EWTD).” - Thank you for the added explanation regarding the exclusion of students. However, what about the relevance to interns (some fields consider interns as students, while others do not)? Are they expected to have responsibilities that do not reflect traditional students? Were they included in the previous meta-analysis? [REPLY] Thank you for your comment. We included internship students in our meta-analysis because previous meta-analyses did not include interns (medical students included were year 1 to 5 or 6 in all meta-analyses on prevalence of suicids or suicidal ideations – Puthran et al. 2016 Rotenstein et al. 2016 and Zeng et al. 2019) and because they could have similar responsibilities to senior practitioners. We added the following sentence within the Methods section: “Students were excluded because of the difference in responsibilities in comparisons with health-care workers, and because of the existence of previous recent meta-analyses focusing specifically on health-care students [21,22,23,24]; we included interns because they were not included in the aforementioned meta-analyses on prevalence of suicides, suicide attempts or suicidal ideation, and because they could have similar responsibilities to senior practitioners.” - Thank you for clarifying the inclusion criteria regarding information on healthcare workers vs. the general population in the methods section. However, did this influence the studies included? That is, were studies that did not information on the general population excluded from the review? If so, this would suggest it may be necessary to re-review the excluded studies. [REPLY] Thank you for your comment. It did not influence the studies included as data in the general population were not mandatory (it was needed only for some meta-analysis for between groups comparison: health care workers versus general population). We added the following sentence within the Methods section: “When data were available, we also collected data from a control group (such as general population) for comparisons purposes.” Submitted filename: 2019-11-12_PlosOne_ResponseToReviewers.docx Click here for additional data file. 26 Nov 2019 Suicide among physicians and health-care workers: A systematic review and meta-analysis PONE-D-19-21600R2 Dear Dr. Navel, We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements. Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication. Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. With kind regards, Takeru Abe, Ph.D Academic Editor PLOS ONE Additional Editor Comments (optional): Just for clarification to you and our reviewer, I just noted below. In your response to reviewer's comments, you described: [REPLY] Thank you for your comment. The sentence now reads: “For example, there were tentative to regulate working time of physicians over the recent years, such as in Europe with its European Working Time Directive (EWTD).” However, the sentence in the manuscript reads below: For example, there were attempts in recent years to regulate physicians’ working time, e.g. the European Working Time Directive (EWTD) in Europe. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No 3 Dec 2019 PONE-D-19-21600R2 Suicide among physicians and health-care workers: A systematic review and meta-analysis Dear Dr. Navel: I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. For any other questions or concerns, please email plosone@plos.org. Thank you for submitting your work to PLOS ONE. With kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Takeru Abe Academic Editor PLOS ONE
  138 in total

1.  Mortality among medical students and young physicians.

Authors:  R B Everson; J F Fraumeni
Journal:  J Med Educ       Date:  1975-08

2.  Doctor discontent.

Authors:  J P Kassirer
Journal:  N Engl J Med       Date:  1998-11-19       Impact factor: 91.245

3.  Medical error-the third leading cause of death in the US.

Authors:  Martin A Makary; Michael Daniel
Journal:  BMJ       Date:  2016-05-03

Review 4.  Creatine Supplementation and Upper Limb Strength Performance: A Systematic Review and Meta-Analysis.

Authors:  Charlotte Lanhers; Bruno Pereira; Geraldine Naughton; Marion Trousselard; François-Xavier Lesage; Frédéric Dutheil
Journal:  Sports Med       Date:  2017-01       Impact factor: 11.136

5.  Meta-analysis in clinical trials.

Authors:  R DerSimonian; N Laird
Journal:  Control Clin Trials       Date:  1986-09

6.  Suicide and role strain among physicians.

Authors:  D E DeSole; P Singer; S Aronson
Journal:  Int J Soc Psychiatry       Date:  1969

7.  Suicide by physicians.

Authors:  A G Craig; F N Pitts
Journal:  Dis Nerv Syst       Date:  1968-11

8.  Mortality experience among anesthesiologists, 1954-1976.

Authors:  E A Lew
Journal:  Anesthesiology       Date:  1979-09       Impact factor: 7.892

9.  Are health workers motivated by income? Job motivation of Cambodian primary health workers implementing performance-based financing.

Authors:  Keovathanak Khim
Journal:  Glob Health Action       Date:  2016-06-17       Impact factor: 2.640

10.  Relationships between anhedonia, suicidal ideation and suicide attempts in a large sample of physicians.

Authors:  Gwenolé Loas; Guillaume Lefebvre; Marianne Rotsaert; Yvon Englert
Journal:  PLoS One       Date:  2018-03-27       Impact factor: 3.240

View more
  60 in total

1.  Deaths of Despair Among Healthcare Workers, Massachusetts, 2011 to 2015.

Authors:  Sahith Kaki; Devan Hawkins
Journal:  J Occup Environ Med       Date:  2021-06-01       Impact factor: 2.162

2.  Your Best Life: Preventing Physician Suicide.

Authors:  William B Hogan; Alan H Daniels
Journal:  Clin Orthop Relat Res       Date:  2021-10-01       Impact factor: 4.755

3.  Assessing the psychological impact of COVID-19 on intensive care workers: A single-centre cross-sectional UK-based study.

Authors:  Natasha Dykes; Oliver Johnson; Peter Bamford
Journal:  J Intensive Care Soc       Date:  2021-01-05

4.  Association of US Nurse and Physician Occupation With Risk of Suicide.

Authors:  Matthew A Davis; Benjamin A Y Cher; Christopher R Friese; Julie P W Bynum
Journal:  JAMA Psychiatry       Date:  2021-04-14       Impact factor: 21.596

5.  Suicide ideation in Canada during the COVID-19 pandemic.

Authors:  Li Liu; Colin A Capaldi; Raelyne L Dopko
Journal:  Health Promot Chronic Dis Prev Can       Date:  2021-09-27       Impact factor: 3.240

6.  Impact of the COVID-19 Pandemic on the Mental Health of Healthcare Workers.

Authors:  Andreas Chatzittofis; Maria Karanikola; Kyriaki Michailidou; Anastasia Constantinidou
Journal:  Int J Environ Res Public Health       Date:  2021-02-03       Impact factor: 3.390

7.  Coronavirus Disease 2019 (COVID-19) and Psychiatric Sequelae in South Africa: Anxiety and Beyond.

Authors:  Ugasvaree Subramaney; Andrew Wooyoung Kim; Indhrin Chetty; Shren Chetty; Preethi Jayrajh; Mallorie Govender; Pralene Maharaj; EungSok Pak
Journal:  Wits J Clin Med       Date:  2020-07

8.  Physician Suicide Prevention and the Ethics and Role of a Healing Community: an American College of Physicians Policy Paper.

Authors:  Matthew DeCamp; Mark Levine
Journal:  J Gen Intern Med       Date:  2021-06-02       Impact factor: 5.128

9.  Burnout and its correlates in Saudi family medicine residents: An observational study from Aseer, Saudi Arabia.

Authors:  Malak Aziz Al-Ghamdi; Shamsun Nahar; Aesha Farheen Siddiqui; Safar Abadi Al-Saleem
Journal:  J Family Med Prim Care       Date:  2021-05-31

10.  DHEA as a Biomarker of Stress: A Systematic Review and Meta-Analysis.

Authors:  Frédéric Dutheil; Sarah de Saint Vincent; Bruno Pereira; Jeannot Schmidt; Farès Moustafa; Morteza Charkhabi; Jean-Baptiste Bouillon-Minois; Maëlys Clinchamps
Journal:  Front Psychiatry       Date:  2021-07-06       Impact factor: 4.157

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.