Literature DB >> 30990814

Violence risk and mental disorders (VIORMED-2): A prospective multicenter study in Italy.

Stefano Barlati1,2, Alberto Stefana1, Francesco Bartoli3, Giorgio Bianconi4, Viola Bulgari5, Valentina Candini5, Giuseppe Carrà3, Cesare Cavalera5,6, Massimo Clerici3,7, Marta Cricelli8, Maria Teresa Ferla8, Clarissa Ferrari9, Laura Iozzino5, Ambra Macis9, Antonio Vita1,2, Giovanni de Girolamo5.   

Abstract

BACKGROUND: The management of mentally ill offenders in the community is one of the great challenges imposed on community psychiatry. AIM: The aim of this study was to analyze the association between sociodemographic, clinical, and psychosocial factors and violent behavior in a sample of outpatients with severe mental disorders.
METHOD: This was a prospective cohort study with a baseline cross-sectional design used to provide a detailed analysis of patients' profiles, followed by a longitudinal design to measure aggressive and violent behavior during a 1-year follow-up. Patients with severe mental disorders, with or without a history of violence, were enrolled in four Italian Departments of Mental Health and underwent a comprehensive multidimensional assessment.
RESULTS: The sample included 247 outpatients, for a total of 126 cases and 121 controls. Compared to controls, patients with a history of violence had a greater frequency of lifetime domestic violence, a greater lifetime propensity to misuse substances, and a higher number of compulsory admissions. The forthnightly monitoring during the 1-year follow-up did show statistically significant differences in aggressive and violent behavior rates between the two groups. Verbal aggression was significantly associated with aggression against objects and physical aggression. Moreover, outpatients with an history of violence showed statistically significant higher MOAS scores compared to both residential patients with an history of violence, assessed in the first wave of this project, and all controls.
CONCLUSIONS: Patients with a history of violence had specific characteristics and showed a greater occurrence of additional community violence during a 1-year observation period. Our results may assist clinicians in implementing standardized methods of patient assessment and violence monitoring in outpatient mental health services and may prompt improved collaboration between different community services.

Entities:  

Mesh:

Year:  2019        PMID: 30990814      PMCID: PMC6467378          DOI: 10.1371/journal.pone.0214924

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


Introduction

Several studies have investigated the association between severe mental disorders (SMDs) and violence, many of which focused on psychiatric patients admitted to or discharged from acute inpatient facilities, [1] Residential Facilities (RFs) [2], or Forensic Mental Hospitals (FMHs) [3]; other studies have assessed the risk of violence among outpatients in treatment at mental health services [4,5]. All these studies have identified several variables that may increase the risk of violence, including male gender, a diagnosis of schizophrenia, substance use disorders, and a lifetime history of violence [6]. However, only a few studies prospectively assessed the frequency of aggressive and violent behavior among patients in different treatment settings, such as outpatient care and RFs: the latter in many countries have replaced mental hospitals for long-term care [7,8]. In Italy, very few retrospective studies have been conducted to investigate the clinical and sociodemographic profiles of patients at risk for violence or to assess the frequency and severity of aggressive and violent behavior among psychiatric outpatients [9-11]; none of these studies that have been conducted used standardized multidimensional evaluation tools. This represents a serious problem, especially when considering the current structure and provision of mental healthcare in Italy [12,13], which includes the recent closure of all FMHs [14], with the consequent increase in the number of mentally ill offenders who are in outpatient treatment at ordinary Departments of Mental Health (DMHs). In this study, we aimed to investigate the prevalence of aggressive and violent behavior in a large sample of outpatients with SMDs and their associated factors. First, we examined the sociodemographic, clinical, and treatment-related characteristics of psychiatric outpatients with SMDs with a history of violence (i.e., cases), compared to controls. Second, we measured aggressive or violent behavior exhibited by outpatients during a 1-year period, using a standardized tool, and analyzed a variety of risk and protective factors. An additional aim was to compare the frequency of aggressive and violent behavior (over a 1-year period) among (a) residential patients (VIORMED-1 Study) assessed in wave 1 of this project [15], (b) outpatients (VIORMED-2 Study), both with a history of violence, and (c) residential and outpatients without any history of violence.

Method

Design overview and participants

The Violence Risk and Mental Disorder (VIORMED-2) is a prospective cohort study, with a baseline cross-sectional comparative design, followed by a 1-year follow-up observation period. Outpatient recruitment was carried out at four DMHs in Lombardy (Northern Italy). In each of the four DMHs, there are four community mental health centers that provide outpatient care; the participating sites have a catchment area with an average population of 351,400 (±32,366.70) (see S1 Table). The average number of outpatients receiving care is 4,206 (±360.13). Recruitment started in the second half of 2015 and study participants were then consecutively recruited during six months. Inclusion criteria were a primary psychiatric diagnosis and age between 18 and 65 years. Exclusion criteria included a diagnosis of organic mental disorder, mental retardation, dementia, or sensory deficits. Cases were recruited first. The selection of these patients was based solely on a comprehensive and detailed documentation (as reported in clinical records) about a history of violent behavior(s). Violent patients had to meet any of the following criteria: (i) to have been admitted at least once to a FMH for any violent acts against people and then discharged; and/or (ii) to have a documented lifetime history of violent acts against people in the last 10 years (as reported in the official clinical records), which caused physical harm to the victim, or having committed armed robbery, pyromania, or sexual violence; these behaviors led to legal prosecution or to arrest. The control group included patients who did not meet any of these three conditions during their lifetime. All participants provided written informed consent before entering the study. Before signing consent, the treating clinician with the local research assistant provided the potential participant with detailed information about the observational nature of the study, of the study aims and methods. The participant information sheets and consent/assent forms made explicit the voluntary nature of subjects’ involvement and the possibility to withdraw from the study at any time. There were 6 patients who had a legal representative: 3 ‘cases’ and 1 control in Garbagnate; 1 control in Legnano and 1 case in Brescia. In these six cases the informed consent was initially sought from the legal representative, and then from the patient. Even if the legal representative gave consent but the patient refused, that person was not included in the study. Patients were assessed with several standardized instruments within 14 days of recruitment. The purpose of the observation follow-up period, which started once patients had completed baseline assessment, was to measure and quantify patients’ aggressive and violent behavior. Ethical approval was granted by the ethical committee of the coordinating center (IRCCS Saint John of God, Fatebenefratelli; n° 64/2014) and by ethical committees of all other recruiting centers.

Measures and assessments

A specific patient schedule was developed to collect information on selected sociodemographic characteristics, clinical and treatment-related factors, and the history of violence (to be completed for cases only). The Structured Clinical Interview for DSM-IV Axis I (SCID-I) [16] and Axis II (SCID-II) [17] were administered to confirm clinical diagnoses. The global concordance was evaluated by Cohen’s K index, and it was K = 0.93 for Axis I and K = 0.65 for Axis II; the latter value (which, according to Landis and Koch, should be considered substantial) [18] is in the range of Cohen’s k value found in Italy by Maffei et al. [19] in a sample of 231 consecutively admitted in- and outpatients assessed with the SCID-II. Symptom severity and psychosocial functioning were assessed using the Brief Psychiatric Rating Scale-Expanded (BPRS-E) [20], and the Specific Levels of Functioning scale (SLOF) [21]. Aggressiveness, impulsiveness, and hostility were evaluated through a set of self-reported measures, notably (a) the Brown-Goodwin Lifetime History of Aggression (BGLHA) [22], an 11-item questionnaire assessing lifetime aggressive behavior across two stages of life (adolescence and adulthood) by directly asking how many times the aggressive behavior occurred for each item; (b) the Buss-Durkee Hostility Inventory (BDHI) [23], a 75-item questionnaire containing eight subscales (e.g, direct and indirect aggression, irritability, negativism, resentment, suspiciousness, verbal aggression and guilt) and producing an index of inhibition of aggression (a higher score indicating more hostility); and (c) the Barratt Impulsiveness Scale (BIS-11) [24], a 30-item 4-point Likert scale questionnaire that investigates personality and behavioral impulsiveness, with scores ranging from 30 to 120 (a higher score indicating more impulsiveness). The State-Trait Anger Expression Inventory 2 (STAXI-2) [25], which includes 57 items grouped into six scales (state and trait anger, anger directed inside and outside, control and expression of anger) plus an anger expression index and an overall measure of total anger expression (a higher score indicates more anger) evaluated on a 4-point Likert scale, was employed to provide specific measures of anger. Aggressive and violent behavior exhibited by patients during the 1-year follow-up were rated every fifteen days with the Modified Overt Aggression Scale (MOAS) [26], for a total of 24 MOAS evaluations for each patient. All MOAS evaluators (treating clinicians and other mental health staff, and family relatives) were very familiar with the patients and had daily, or very frequent, contact with them. The MOAS includes four aggression subdomains: verbal, against objects, against self, and physical-interpersonal. A score from 0 to 4 is assigned: 0 indicating no aggressive behavior and higher scores showing increasing severity. The score in each category is multiplied by a factor assigned to that category, which is 1 for verbal aggression, 2 for aggression against objects, 3 for aggression against self, and 4 for aggression against other people. The total weighted score for each evaluation ranges from 0 (no aggression) to 40 (maximum grade of aggression); since there were 24 ratings during a 1-year period, the individual MOAS total score for that time period ranged from 0 to 960. We will subsequently refer to the weighted MOAS total score (our primary outcome) simply as the MOAS score. Treatment compliance was rated with the Medication Adherence Rating Scale (MARS), a 10-item self-report questionnaire validated in patients with psychosis [27].

Statistical analyses

To compare categorical data, a χ2 test or the exact Fisher’s test, whenever appropriate (n<5 in any cell), were used. For quantitative data, ANOVA or a nonparametric Mann Whitney test were used. The normality assumption was verified by visual inspection of the variable distribution through QQ-plots and box plots in addition to Shapiro-Wilk and Kolmogorov-Smirnov tests. For the BPRS-E, an exploratory factor analysis was used to identify the main scale domains. Factor extraction was performed by varimax rotation, and the number of factors was determined through Kaiser’s criterion (i.e., eigenvalue ≥1) and through visual inspection of the screen plot. Factor loadings with the highest value (among extracted factors) were considered to contribute sufficiently to the overall variability accounted for in each factor. Monitoring of aggressive and violent behavior was carried out by analyzing MOAS scores across all 24 evaluations, and their trends were estimated with the smoothing-splines method [28]. Given the non-Gaussian distribution of the MOAS scores (skewed and zero-inflated distribution), generalized estimating equation models (GEE) with tweedie distribution and log-link function were used to analyze MOAS repeated measurements. Finally, the analyses of predictive factors for violence were performed by adopting generalized linear models (GLMs) with tweedie distribution and log-link function (MOAS score—total and subscales—used as the dependent variable and all other measurements as independent ones). Model goodness of fit was evaluated by Akaike information criterion (AIC: the lower value indicates a better model). The beta coefficients are reported as exponential reparameterization of the standardized ones for easier interpretation. All tests were two-tailed with statistical significance set at p = 0.05. All data were coded and analyzed using the Statistical Package for Social Science (SPSS, version 21 for Windows Chicago, Illinois 69606, USA), and R: A language and environment for statistical computing (R Core Team, 2015), R Foundation for statistical Computing, Vienna, Austria.

Results

Sample

To estimate the minimum sample size based on significant change (baseline-follow-up) differences in the MOAS Total Score between violent and control groups we relied on two studies (Margari et al. [26] and Mauri et al. [29]), indicating that it was necessary to enroll 232 patients (116 cases and 116 controls). However, our main aim was to recruit a larger sample to prevent possible dropouts, so that at the end of the recruitment period (6 months) we enrolled 15 more patients (10 cases and 5 controls). Among the 274 patients who were asked to join the study, 27 (9.8%) refused; therefore, the total study sample included 247 outpatients with a primary diagnosis of SMDs: 126 of them had a lifetime history of violence (i.e., cases) and 121 had no such history (i.e., controls). The two groups did not differ in age, gender, nationality, marital status, or occupation. Compared to the controls, the cases had a lower educational level (X2 = 4.3, p = 0.038), spent more time doing nothing (more than 3 hours per day; X2 = 7.9, p = 0.005), and had received less social support during the past year (X2 = 4.0, p = 0.046). Regarding a lifetime history of violence, the proportion of participants who had witnessed or were involved in at least one episode of domestic violence was higher among cases (X2 = 20.2, p < 0.001). The sociodemographic information is presented in Table 1.
Table 1

Socio-demographic characteristics of patients with an history of violence and controls.

Violent groupControlsTest*p-value
N = 126%N = 121%
Gender
    Male10381.79074.41.960.161
    Female2318.33125.6
Nationality
    Italian12196.011998.31.200.240
    Others54.021.7
Age
    18–352015.92520.82.800.247
    36–507055.65445.0
    51+3628.64134.2
Marital status
    Married or cohabiting5140.54738.80.070.793
    Single7559.57461.2
Education
    Low level8265.16352.14.310.038
    Medium-high level4434.95847.9
Occupation
    Employed5241.66050.41.910.167
    Unemployed7358.45949.6
Economic independence
    Yes5444.35547.00.180.670
    No6855.76253.0
Social support in the last year
    Present8672.39483.23.970.046
    Not present3327.71916.8
Time spent doing nothing
    Less than 3 h per day4637.46655.57.940.005
    More than 3 h per day7762.65344.5
Episodes of violence in family
    Yes4034.2119.620.21<0.001
    No7765.810390.4

* Chi-squared test or Exact Fisher’s test (when n <5 in at least one cell).

* Chi-squared test or Exact Fisher’s test (when n <5 in at least one cell). The most frequent primary diagnoses included schizophrenia spectrum disorders (up to 41.3%) and personality disorders (up to 28.1%). The mean duration of illness was 17.7 years (SD = 10.5) for the violent group and 16.0 years (SD = 10.0) for the control group (F = 1.8, p = 0.186). The mean age of patients at their first contact with mental health services was 28.6 years (SD = 10.4) for the violent group and 29.8 years (SD = 11.5) for the control group (F = 0.7, p = 0.396). Cases had a higher number of past compulsory admissions to psychiatric hospital wards (X2 = 19.8, p < 0.001) and were less able to collaborate with treating clinicians during the previous year (X2 = 5.1, p = 0.023). With regard to lifetime substance use disorders, higher comorbid rates were found among cases compared to controls (X2 = 8.3, p = 0.004), while there were no between-group differences in alcohol misuse (X2 = 2.1, p = 0.145). The groups did not differ even in recent substance use disorders over the previous 12 months as reported by treating clinicians. No statistical differences were observed regarding medication (present/absent) or the presence/absence of symptoms during the previous 2 years. Clinical and treatment-related characteristics are reported in Table 2.
Table 2

Baseline clinical characteristics of patients with an history of violence and controls.

Violent group(N = 126)Controls(N = 121)Test*p-value
MeanSDMeanSD
Illness duration (Years)17.7310.5215.999.981.760.186
Age of first contact with DMHs (Years)28.6310.3629.8111.480.720.396
N%N%Test*p-value
Primary diagnosis by the treating clinician
    Schizophrenia5241.35243.034.200.331
    Personality disorder4737.33428.1
    Bipolar disorder1310.31411.6
    Anxiety/Mood disorders1411.12117.4
Current comorbidity with substance use disorders
    Alcohol97.343.32.440.295
    Other substances1310.51714.0
    None10282.310082.6
Lifetime alcohol use disorders
    Yes3931.02722.72.120.145
    No or occasional8769.09277.3
Lifetime substance use disorders
    At least one4737.92521.08.310.004
    None7762.19479.0
Alcohol use disorder in the last 12 months
    Yes3830.23024.80.890.345
    No8869.89175.2
Misuse of at least one substance in the last 12 months
    Yes1915.2129.91.560.212
    No10684.810990.1
Lifetime compulsory admissions
    None6654.18872.719.81<0.001
    1–34032.83327.3
    ≥41613.100.0
Access rate to outpatient community services
    1 time per month8970.67259.53.370.066
    Less than 1 time per month3729.44940.5
Capability of collaboration in the last year
    Collaborating10689.111596.65.130.023
    Non-collaborating1310.943.4
Psychopharmacological treatment
    Yes11592.011595.00.940.334
    No108.065.0
Psychopathological symptoms (last 2 years)
    Absent7867.88067.80.000.996
    Persistent3732.23832.2

DMHs = Departments of Mental Health

* ANOVA for continuous variables; Chi-square test or Fisher’s exact test (n<5 in at least one cell) for categorical variables.

DMHs = Departments of Mental Health * ANOVA for continuous variables; Chi-square test or Fisher’s exact test (n<5 in at least one cell) for categorical variables.

History of violence

Cases committed a large number of violent offenses, including physical aggression (87.2%), stalking (3.2%), sexual violence (2.4%), armed robbery (1.6%), murder (1.6%), attempted murder (0.8%), and other violent acts (3.2%). In more than one-fourth of cases, violent behavior was committed in the presence of psychotic symptoms, and in 20.5% of the instances the offenders were under the influence of alcohol. The history of violence was more frequently due to an episode of impulsive violence (92.4%). Victims of violence were more frequently the patients’ parents or partners (respectively 28.0% and 24.6%), followed by clinical staff (6.8%), patients’ friends (6.8%), other relatives (6.8%), other patients (2.5%), or others (24.6%). The large majority of patients (88.8%) recognized their acts as violent, while the remaining 11.2% denied the violent nature of the offenses. Almost one-fourth (23.4%) of the violent patients were arrested for the violent offenses; 72.8% of patients already had a diagnosis of SMD at the time of their violent offense, and 67.5% were under care at the local DMH. Cases obtained higher scores on the BGLHA (mean score: 40.4, SD = 12.4 for cases vs. 33.6, SD = 9.7 for controls; p < 0.001) (Table 3).
Table 3

Baseline assessment: clinician-administered assessment tools and self-reports.

Violent group (N = 126)Controls (N = 121)Test*p-value
MeanSDMeanSD
BPRS-E
    Affect-Anxiety11.174.1110.704.19–0.730.463
    Activation11.674.759.553.09–3.81<0.001
    Negative Symptoms5.483.155.262.72–0.570.572
    Psychotic Symptoms12.385.4710.883.50–1.160.247
    Total score41.0111.7536.858.89–2.430.015
SLOF
    Physical functioning24.131.4424.251.340.830.406
    Self-care33.243.1433.373.120.440.663
    Interpersonal relationships23.905.9424.935.631.460.143
    Social acceptability/adjustment23.694.0326.962.706.81<0.001
    Activities48.517.3949.806.021.030.303
    Work skills21.516.5723.166.111.910.056
BGLHA
    Total score40.3812.4433.599.68–3.91<0.001
BIS-11
    Attentional impulsiveness15.404.3214.513.80–1.470.142
    Motor impulsiveness22.644.8621.374.55–1.850.064
    Non-planning impulsiveness27.215.3826.425.38–1.210.228
    Total score64.8111.5662.1010.41–1.620.105
BDHI
    Assault4.582.614.432.450.170.683
    Indirect aggression4.622.254.561.730.050.822
    Irritability4.112.604.002.290.090.759
    Negativism2.631.572.311.542.020.157
    Resentment3.901.983.892.350.000.976
    Suspicion4.132.384.282.620.150.702
    Verbal aggression6.612.826.252.490.820.367
    Guilt4.882.334.362.332.260.135
    Total score35.5814.5834.6212.570.190.665
STAXI-2
    State anger33.44200.2331.4717.68–0.290.770
    Feeling angry24.4823.7925.6723.39–0.100.919
    Feel like expressing anger verbally24.5824.4624.4221.88–0.230.818
    Feel like expressing anger physically23.3223.4423.7322.26–0.040.969
    Trait anger32.9719.4229.0716.02–1.290.197
    Angry temperament25.4223.8223.8721.12–1.430.153
    Angry reaction25.3823.3423.1419.14–0.720.474
    Anger expression-out30.1420.9926.1716.41–1.740.083
    Anger expression-in30.9319.9631.7719.140.150.878
    Anger control-out27.9113.6133.0015.372.720.006
    Anger control-in31.2015.4735.0516.632.060.040
    Anger expression index46.4516.8339.9115.15–2.840.005

BDHI = Buss-Durkee Hostility Inventory; BGLHA = Brown-Goodwin Lifetime History of Aggression; BIS-11 = Barratt Impulsiveness Scale; BPRS-E = Brief Psychiatric Rating Scale; SLOF = Specific Levels Of Functioning; STAXI-2 = Scale State-Trait Anger Expression Inventory 2.

* Mann-Whitney test for BPRS-E, SLOF, BGLHA, BIS, STAXI-2; ANOVA for BDHI.

BDHI = Buss-Durkee Hostility Inventory; BGLHA = Brown-Goodwin Lifetime History of Aggression; BIS-11 = Barratt Impulsiveness Scale; BPRS-E = Brief Psychiatric Rating Scale; SLOF = Specific Levels Of Functioning; STAXI-2 = Scale State-Trait Anger Expression Inventory 2. * Mann-Whitney test for BPRS-E, SLOF, BGLHA, BIS, STAXI-2; ANOVA for BDHI.

Psychopathology

The exploratory factor analysis of the BPRS-E suggested a four-factor structure named affect-anxiety, activation, negative symptoms and psychotic symptoms (S2 Table). This BPRS-E structure was similar to the previously published [30]. Cases showed higher symptom severity than controls (Table 3). We found a statistically significant difference in the BPRS-E total score between the two groups (mean score: 41.0, SD = 11.7 for cases vs. 36.9, SD = 8.9 for controls; p = 0.015) and different scores in the BPRS-E activation subdomain (mean score: 11.7, SD = 4.8 for cases vs. 9.6, SD = 3.1 for controls; p < 0.001).

Psychosocial functioning and treatment compliance

Although cases had lower scores on all SLOF domains, a statistically significant difference was found for the social acceptability subscale (mean score: 23.7, SD = 4.0 for the violent group vs. 27.0, SD = 2.7 for controls; p < 0.001) (Table 3). With regard to treatment compliance, patients with an history of violence had a significantly lower MARS average score (6.87, SD = 2.31) compared to controls (7.51, SD = 1.73) (t-test = -2.06, p = 0.041).

Impulsiveness and anger

We did not find any differences between groups in the BDHI and BIS-11 scores. A statistically significant difference was found on two STAXI-2 subscales and for the Anger Expression Index: (i) anger control-out (mean score: 27.9, SD = 13.6 for the violent group vs. 33.0, SD = 15.4 for the control group; p = 0.006); (ii) anger control-in (mean score: 31.2, SD = 15.5 for the violent group vs. 35.1, SD = 16.6 for the control group; p = 0.040); (iii) Anger Expression Index (mean score: 46.5, SD = 16.8 for the violent group vs. 39.9, SD = 15.2 for the control group; p = 0.005). The mean total scores (including subscale scores) for the BDHI, BIS-11, and STAXI-2 in both groups are shown in Table 3.

Aggressive and violent behavior during the 1-Year follow-up

Fifteen patients (11 cases and 4 controls) had more than two missing MOAS and so were not considered in these analyses. Patients with up to two missing MOAS evaluations were computed by the moving average estimation method. Compared to controls, cases displayed statistically greater scores on the MOAS total score (mean = 25.7, SD = 36.3 for the violent group and mean = 8.4, SD = 17.4 for controls; U = -4.7, p < 0.001). The MOAS subratings were also higher for the violent group when compared to controls. This was true for MOAS verbal aggression (mean = 10.2, SD = 12.1 vs. mean = 4.8, SD = 8.5; U = -4.1, p < 0.001), MOAS aggression against objects (mean = 4.7, SD = 8.4 vs. mean = 1.7, SD = 5.6; U = -3.9, p < 0.001), MOAS physical aggression (mean = 7.4, SD = 17.0 vs. mean = 1.0, SD = 5.0; U = -5.1, p < 0.001), and MOAS self-aggression (mean = 3.3, SD = 10.8 vs. mean = 0.8, SD = 3.9; U = -1.8, p = 0.067). Since the specific interest of this study was aggressive and violent behavior, we focused only on the first three subscales. Cases showed a quickly decreasing trend on MOAS scores, while controls had an almost stable trend (see Fig 1). Moreover, trends were statistically different between cases and controls for MOAS total scores. For the verbal and physical aggression scores and MOAS aggression against objects, cases showed a different trend (confidence bands do not overlap) only up to the thirteenth observation.
Fig 1

Longitudinal evaluation of MOAS Total and subscales scores during follow-up in cases and controls.

Trend estimated through Smoothing Spline functions with corresponding 95% confidence bands.

Longitudinal evaluation of MOAS Total and subscales scores during follow-up in cases and controls.

Trend estimated through Smoothing Spline functions with corresponding 95% confidence bands. A longitudinal evaluation of the MOAS subscales was performed through generalized estimating equation (GEE) with an interaction effect between time (from 1 to 24 evaluations) and group, and showed significantly different trajectories for aggression against objects (p = 0.002) and physical aggression (p = 0.006), but not for verbal aggression (p = 0.191) (see S3 Table). Further analyses for gender-specific differences in the frequency of aggressive and violent behavior, measured by the total MOAS, showed no significant differences between males and females (see S1 Fig).

Predictors of aggressive and violent behavior

With regard to the relationship between the three subscales, verbal aggression was a significant predictor of aggression against objects (p < 0.001) and of interpersonal violence (p < 0.001), while aggression against objects was a significant predictor (p < 0.001) of interpersonal violence. Generalized Linear Models with MOAS total score as a dependent variable and clinical and socio-demographic features, group and their interaction as independent variables were applied to detect which MOAS predictors had different effect in the two study groups. In order to quantify these differentiated (between the two groups) effects (evaluated by beta coefficients) we computed GLMs for the two groups separately.Results showed that the negativism score of the BDHI was the best (in terms of AIC) predictor of violent behavior (p = 0.039, AIC = 1195.3). A lower MOAS total score was predicted by higher levels of negativism (which in this instrument evaluates oppositive and conflictual behaviors) among cases (βcases = 0.81). Other predictors of the MOAS total score included the SLOF social acceptability score (p < 0.001, AIC = 1521.0), with higher total MOAS scores predicted by lower levels of social acceptability among both cases and controls (but with different strength between groups: βcases = 0.92, βcontrols = 0.75). Both MOAS verbal aggression and MOAS aggression against objects were inversely associated with the SLOF social acceptability score (respectively, p = 0.002, AIC = 1272.0, βcases = 0.91, βcontrols = 0.77; and p = 0.012, AIC = 700.5, βcases = 0.89, βcontrols = 0.71). MOAS physical aggression was predicted by BDHI total score (p = 0.036, AIC = 325.7), with higher strength in controls with respect to cases (βcases = 0.98, βcontrols = 1.11). An inverse association was found between MOAS physical aggression and SLOF social acceptability (p = 0.012, AIC = 556.5), in controls only (βcontrols = 0.69). Table 4 shows all risk and protective factors for violent behavior (recorded during the follow-up period) with a significant different effect between the two study groups.
Table 4

Predictors of aggressive and violent behavior: generalized linear models (GLMs) with interaction effect between variables and groups (all sample), and corresponding GLMs for the two groups.

All sampleCase patients groupControl group
p-valueAICβcasesβcontrols
Total MOAS
BDHI Negativism0.0391195.30.81**1.08
SLOF Social acceptability/adjustment<0.0011521.00.92**0.75**
BPRS-E Total Score0.0191547.31.011.06**
Lifetime misuse of substances (No vs Yes)<0.0011554.50.910.18**
Time spent doing nothing0.0081570.10.51**1.43
BPRS-E Activation0.0011575.51.05**1.23**
Age0.0141576.70.98**0.94**
Primary diagnosis0.0231578.4##
Familiarity with psychiatric illness (Yes vs No)0.0631583.81.60**0.81
Comorbidity with alcohol/substances misuse0.0281588.9##
Illness duration0.0051592.31.000.95**
Misuse of alcohol in the last 12 months (No vs Yes)0.0031593.31.040.33**
MOAS verbal aggression
SLOF Social acceptability/adjustment0.0021272.00.91**0.77**
BPRS-E Total Score0.0181295.61.011.06**
Lifetime misuse of substances (No vs Yes)<0.0011307.10.890.25**
BPRS-E Activation0.0081321.51.06**1.19**
Age0.0111329.50.990.95**
Misuse of alcohol in the last 12 months (No vs Yes)0.0031332.90.950.31**
Comorbidity with alcohol/substances misuse0.0381334.3$$
BPRS-E Psychotic Symptoms0.0461334.81.001.09**
Illness duration0.0231339.11.000.96**
MOAS aggression against objects
SLOF Social acceptability/adjustment0.012700.50.89**0.71**
Lifetime misuse of substances (No vs Yes)0.001707.41.400.16**
Illness duration0.047720.30.990.92**
Time spent doing nothing0.023721.10.593.00*
Misuse of alcohol in the last 12 months (No vs Yes)0.056722.80.900.24**
MOAS self-aggression
BDHI Indirect Aggression0.025246,50.981.99**
STAXI Feel like expressing anger physically0.036339,71.03**0.97
STAXI Feeling angry0.035340,31.03**0.97
STAXI Feel like expressing anger verbally0.048340,61.03**0.97
STAXI Anger control-in0.045340,91.04**0.97
Familiarity with psychiatric illness (Yes vs No)0.005360,34.67**0.12**
Occupation (Yes vs No)0.014361,35.96**0.34
MOAS physical aggression
BDHI Total Score0.036325.70.981.11*
STAXI Anger Expression Index0.046510.01.001.06**
Lifetime misuse of substances (No vs Yes)0.001549.10.910.03**
Age of first contact with DMHs0.001553.30.970.71**
SLOF Social acceptability/adjustment0.012556.50.990.69**
Misuse of alcohol in the last 12 months (No vs Yes)0.039563.80.530.06**
BPRS-E Activation0.017566.21.051.40**
Primary diagnosis0.024568.0££
Time spent doing nothing0.051568.20.31**2.02
Illness duration0.029570.31.030.92*

BDHI = Buss-Durkee Hostility Inventory; BPRS-E = Brief Psychiatric Rating Scale; MOAS = Modified Overt Aggression Scale; SLOF = Specific Levels of Functioning; STAXI-2 = Scale State-Trait Anger Expression Inventory 2.

p value: significance of the interaction term; AIC: Akaike Information Criterion of the GLM; βcases βcontrols: estimates of the variable effect in the two groups separately.

* Tendency towards significance (p≤0.1) of the beta coefficient

** Significance (p<0.05) of the β coefficient.

# Among cases, patients with a personality disorder are more violent than other diagnostic groups (p<0.048); among controls, patients with personality disorders are more violent than patients with schizophrenia (p<0.001). Among cases, there are no significant differences between patients with and without comorbidity of alcohol/substance abuse. Among controls, patients with a comorbidity of alcohol/substance abuse are more violent than patients who do not use alcohol and substances.

$ Among cases, there are no significant differences in verbal aggression between patients with and without comorbidity of alcohol/substance abuse. Among controls, patients with a comorbidity of alcohol/substance abuse are more verbally violent than patients who do not use alcohol and substances.

£ Among cases, there are no significant differences among different diagnostic groups; among controls, patients with personality disorders are more violent than patients with schizophrenia (p<0.047).

BDHI = Buss-Durkee Hostility Inventory; BPRS-E = Brief Psychiatric Rating Scale; MOAS = Modified Overt Aggression Scale; SLOF = Specific Levels of Functioning; STAXI-2 = Scale State-Trait Anger Expression Inventory 2. p value: significance of the interaction term; AIC: Akaike Information Criterion of the GLM; βcases βcontrols: estimates of the variable effect in the two groups separately. * Tendency towards significance (p≤0.1) of the beta coefficient ** Significance (p<0.05) of the β coefficient. # Among cases, patients with a personality disorder are more violent than other diagnostic groups (p<0.048); among controls, patients with personality disorders are more violent than patients with schizophrenia (p<0.001). Among cases, there are no significant differences between patients with and without comorbidity of alcohol/substance abuse. Among controls, patients with a comorbidity of alcohol/substance abuse are more violent than patients who do not use alcohol and substances. $ Among cases, there are no significant differences in verbal aggression between patients with and without comorbidity of alcohol/substance abuse. Among controls, patients with a comorbidity of alcohol/substance abuse are more verbally violent than patients who do not use alcohol and substances. £ Among cases, there are no significant differences among different diagnostic groups; among controls, patients with personality disorders are more violent than patients with schizophrenia (p<0.047). Additionally, univariate GLMs (without considering the group distinction between cases and controls) were performed to analyze factors associated with the MOAS scores. The best predictor of new aggressive and violent behavior(s) was the BDHI suspicion score (p = 0.030, AIC = 1156.1, β = 1.14), followed by the BGLHA total score (p = 0.002, AIC = 1208.9, β = 1.05). Furthermore, we found different factors associated with the MOAS domains. MOAS verbal aggression was predicted by the BDHI suspicion score (p = 0.038, AIC = 991.5, β = 1.11), whereas MOAS aggression against objects was predicted by the STAXI Anger Expression Index and STAXI trait anger (respectively, p = 0.014, AIC = 665.9, β = 1.03; and p = 0.038, AIC = 676.0, β = 1.02). Only the BGLHA total score predicted MOAS physical aggression (p = 0.018, AIC = 443.7, β = 1.10). The full list of the factors associated with the MOAS scores is shown in S4 Table.

Violence and hospital admission

During the 1-year follow-up, 23 patients (16 with an history of violence, 7 controls) were hospitalized in general hospital psychiatric wards. We compared the last MOAS score prior to hospitalization with the previous four scores (two months) and with the MOAS score immediately after discharge. As shown in Supporting Information S2 Fig, there were no statistically significant differences between the MOAS scores at these different timepoints, suggesting that in our cases, hospital admission was not due to an increase in aggressive and violent behavior (S2 Fig).

Patients with an history of violence in different treatment settings

In the first wave of this project [15], we evaluated 139 patients living in RFs, 82 violent and 57 control subjects. We did not find any statistically significant differences in aggressive behavior rates between the two groups during the 1-year follow-up. Our conclusion was that patients with a history of violence in RFs, where treatment and clinical supervision are available, do not show higher rates of aggression and violence compared to patients with no lifetime history of violence. Therefore, we decided to compare the two samples (residential and outpatients) from waves 1 and 2 to establish whether staying in a RF for patients with a history of violence has a protective effect from the risk of violent behavior. To do this, we merged the two control samples (patients with and without a history of violence), while we kept the two case samples (outpatients and residential patients) with a history of violence separated. The results of this analysis are shown in Fig 2.
Fig 2

Longitudinal evaluation of MOAS Total score during the 1-year follow-up in three different clinical groups.

Trend estimated through Smoothing Spline functions with corresponding 95% confidence bands.

Longitudinal evaluation of MOAS Total score during the 1-year follow-up in three different clinical groups.

Trend estimated through Smoothing Spline functions with corresponding 95% confidence bands. Compared to both controls and residential cases, outpatient cases displayed statistically greater scores on the MOAS total score when compared to both controls and residential cases (mean = 25.7 SD = 36.3 for outpatient cases, mean = 11.4 SD = 18.0 for residential cases and mean = 8.1 SD = 17.1 for all controls; K = 32.7, p<0.001).

Discussion

A recent Italian law (81/2014) enacted a significant reorganization of the forensic system, with the closure of the six FMHs, the opening of new small-scale high-security units, and a consequent transfer of many patients with SMD who had offended, or are at risk of offending, to ordinary DMHs (including RFs managed by these services). This change has prompted a deeper investigation into the risk of aggressive and violent behavior among patients in treatment at DMHs. To our knowledge, this is the first Italian study, and one of very few internationally, to use a large set of standardized multidimensional evaluation tools and to prospectively examine the frequency and severity of aggressive and violent behavior in outpatients with SMDs. Previous studies examining the link between SMDs and violence have produced mixed findings [1,31]. Several factors have been suggested to explain this heterogeneity, such as different study designs, assessment tools, type of outcome(s), settings of care, and the specific national mental health policies and programmes, making it difficult to make comparisons and interpret results [6,32-34]. Our study demonstrates that outpatients with SMDs who have an history of serious violence are more likely to show higher levels (in terms of frequency and severity) of aggressive and violent behavior as compared to patients who do not have such a history, and this raises important clinical problems in terms of prevention and management.

Are outpatients with a history of violence more likely to commit violent acts?

Our findings show that outpatients with a lifetime history of violence under care in Italian DMHs had more frequent and more severe episodes of aggression and violence compared to controls. This is in line with Italian retrospective studies on outpatients conducted after the reform of Law 81/2014 [9,10]. On the other hand, this finding is at odds with the results of the first wave of the VIORMED project, in which 82 patients living in RFs with an history of violence were compared to 57 patients with no such history. In these settings, with 24-hour cover, the difference in the frequency of aggressive and violent behavior between patients with and without a history of violence was negligibile [15]. Living in a controlled environment, with compliance granted and no possibility of substance use disorders, may have a preventive effect on aggressive and violent behavior, while life in the community, where treatment compliance is not warranted and there is a greater risk of substance use disorders, has a potential detrimental effect on the risk of recurrence. Indeed, this finding was confirmed when comparing the MOAS total scores among outpatient cases, residential cases, and all controls: while residential cases, living in a controlled environment, did not show higher scores compared to all controls, from both settings, outpatient cases displayed the highest rates of aggressive and violent behavior. To our knowledge, this is the first time ever that a study with the same prospective design compared patients with an history of violence treated in different setting, and shows a marked difference in behavioral patterns associated with different regimes of care (with higher or lower protection).

What predicts violence?

We identified several predictive and protective factors for community violence. Social acceptability was a predictor of nonaggressive behavior, indicating that better social acceptability is associated with lower MOAS scores among both cases and controls. With specific regard to physically aggressive behavior, higher levels of anger expression did predict aggressive behavior, while hostility was predictive only among controls. Other predictors of aggressive and violent behavior that we found in our study (i.e., lifetime substance use disorders, early age at the first contact with DMHs, longer illness duration) are in line with findings from previous studies on Italian cohorts [9]. Finally, patients who showed higher levels of verbal aggression were more likely to commit physical aggression against objects or against other people, and patients who showed higher levels of aggression against objects were more likely to commit aggression against other people. This sequence seems to compose a ‘continuum’ in the occurrence of aggressive and violent behavior and offers important elements for prevention: if a patient shows increasing levels of verbal aggression, or of aggression against objects, this may indicate the need for appropriate interventions to prevent an escalation to more severe forms of violence against other people.

Clinical differences between patients with or without violence history

Unlike previous studies on outpatient cohorts [31], we did not find any differences in many functional areas between outpatients with or without a lifetime history of physical interpersonal violence. Furthermore, at variance with some studies [35], but not other studies [9] done in outpatient samples, our cases had more severe psychopathological symptoms, as rated with the BPRS-E, compared to controls. Possible explanations for these divergent results may be related to the use of different assessment tools and to the different time elapsed from the index violent behavior. On the other hand, there is consensus in the literature concerning the association between a lifetime history of violence, a history of domestic violence, a lifetime use of substances, and a history of compulsory admissions [6]. With regard to impulsiveness, unlike previous findings [36,37], we found no differences between the two groups when rated by the BIS. Although there were differences in BGHA scores, the BDHI scores among cases were similar to those found in a study conducted among male prisoners [38]. Findings on angry feelings showed that compared to controls, cases had lower anger-control, with less ability to calm or cool down. This is in line with previous findings showing a negative association between the STAXI-2 anger control subscale and aggression [39].

How to manage violent patients in the community

This study provides useful indications for planners and clinicians who have the relevant task of planning and managing services which currently have also to care for mentally ill offenders in Italy. While patients with a history of interpersonal violence are effectively managed in RFs [15], where treatment and clinical supervision are granted, our study shows that outpatients living in the community still pose a higher risk of reiteration of aggressive and violent behavior as compared to patients with no history of violence. It is doubtful whether current mental health services in Italy are well equipped to cope with these relevant clinical needs: despite the approval of the new law reorganizing the care for mentally ill offenders, no plans for specific training programmes of mental health workers have been developed, and residency programmes for psychiatrists in training are equally insufficient to meet these training needs; as a consequence many services are inadequately equipped to well manage difficult clinical situations raised by patients with serious histories of violence, as recognized by several authors; the relationships with judicial institutions and forensic services are equally problematic [40-42]. At the same time an active collaboration between mental health services and addiction services (which is of paramount relevance given the importance of substance use disorders as a primary risk factor for aggressive and violent behavior) is often missing, and new strategies of collaborative work involving different treatment agencies have to be developed. It will be necessary to set up appropriate monitoring systems to well understand the main unmet needs of this difficult-to-treat clinical population and identify the clinical skills which mental health workers have to learn to well manage these patients.

Acute hospitalizations and violent behavior

During the 1-year follow-up, 23 patients (16 with an history of violence, 7 controls) were hospitalized in general hospital psychiatric wards: based on MOAS scores in the periods prior to hospitalization and after discharge, we did not find any association between hospital admission and reports of increased violent behavior. In a large survey of almost 3,000 acute patients admitted to Italian general hospital psychiatric wards, violence against people was among factors contributing to admission for a substantial proportion of hospitalized patients: this occurred in 19.3% of patients with a diagnosis of schizophrenia, 13.5% of patients with bipolar disorders, and 19.3 for patients with personality disorders or substance use disorders [43]. Given the small number of patients acutely admitted in our study, it is difficult to generalize our results, and specific investigations about the role of aggressive and violent behavior in triggering hospital admissions are warranted.

Limitations

This study has a number of limitations. First, the duration of the observation period limited to one year may have reduced the possibility to detect new aggressive and violent episodes and, hence, to identify long-term predictors of such behavior. Second, the MOAS assessment was based on that reported by the patients’ treating clinicians, case managers, or family members and not based on a direct 24-hour observation. Thus, our results might have underestimated the occurrence of aggressive and violent behavior among outpatients, in particular because MOAS was not used to evaluate each individual aggressive episode. In any event, the limited period of observation for each MOAS rating (two weeks) makes it unlikely that relevant episodes of aggression or violence remained undetected.

Conclusions

Our data show that outpatients with a history of violence are more aggressive than patients with no lifetime violent behavior. The management of mentally ill offenders in the community is one of the great challenges imposed on community psychiatry. Indeed, more intensive care, as found in RFs, where treatment is granted and prevention of significant substance use disorders is avoided, is associated with a substantial decrease in the frequency and severity of aggressive and violent behavior even among people with a history of violence. Violence by the mentally ill has a profound detrimental effect on public opinion, is associated with stigma and discrimination, and places a great burden on family members, who are often the victims of such violence. Risk assessment plays a key role in the prevention and/or decrease of violent behavior [44,45]. This process is preliminary and linked to an accurate diagnosis, which defines the target population [46], and it has to be integrated with local base information [33]. Better prediction also means better prevention by developing more appropriate treatments tailored to the psychopathological dimensions associated with violence (e.g., impulsivity, hostility). If community psychiatry can prevent the violence associated with mental disorders, the full integration of patients and their families will be much easier.

Characteristics and activity data of 4 participating departments of mental health.

(DOCX) Click here for additional data file.

BPRS-E exploratory factor analysis.

(DOCX) Click here for additional data file.

Longitudinal evaluation of MOAS total score and subscales through generalized estimating equation (GEE) with interaction effect between time (from 1 to 24) and group.

(DOCX) Click here for additional data file.

Generalized linear models without interaction effect between variables and group: predictors of any aggressive behavior (regardless of the two groups).

(DOCX) Click here for additional data file.

Longitudinal evaluation of MOAS Total score for males and females during the 1-year follow-up.

Trend estimated through Smoothing Spline functions with corresponding 95% confidence bands. (TIF) Click here for additional data file.

MOAS Total score in the two months prior to acute hospital admission and after discharge.

Longitudinal evaluation of MOAS Total score (n = 23 outpatients). (TIF) Click here for additional data file.

Dataset.

(XLSX) Click here for additional data file.
  35 in total

1.  FACTOR ANALYSIS OF SOME PSYCHOMETRIC MEASURES OF IMPULSIVENESS AND ANXIETY.

Authors:  E S BARRATT
Journal:  Psychol Rep       Date:  1965-04

2.  Aggression and psychopharmacological treatments in major psychosis and personality disorders during hospitalisation.

Authors:  M C Mauri; C Rovera; S Paletta; I F De Gaspari; M Maffini; A C Altamura
Journal:  Prog Neuropsychopharmacol Biol Psychiatry       Date:  2011-05-17       Impact factor: 5.067

3.  Validation study of the Medication Adherence Rating Scale. Results from the FACE-SZ national dataset.

Authors:  Guillaume Fond; Laurent Boyer; Mohamed Boucekine; Latif A Aden; Franck Schürhoff; Arnaud Tessier; Meja Andrianarisoa; Fabrice Berna; Lore Brunel; Delphine Capdevielle; Isabelle Chereau; Jasmina Mallet; Hélène Denizot; Jean Michel Dorey; Caroline Dubertret; Julien Dubreucq; Catherine Faget; Franck Gabayet; Romain Rey; Raphaelle Richieri; Christine Passerieux; Aurélie Schandrin; Mathieu Urbach; Pierre Vidailhet; Pierre Michel Llorca; David Misdrahi
Journal:  Schizophr Res       Date:  2016-10-24       Impact factor: 4.939

4.  A national study of violent behavior in persons with schizophrenia.

Authors:  Jeffrey W Swanson; Marvin S Swartz; Richard A Van Dorn; Eric B Elbogen; H Ryan Wagner; Robert A Rosenheck; T Scott Stroup; Joseph P McEvoy; Jeffrey A Lieberman
Journal:  Arch Gen Psychiatry       Date:  2006-05

5.  Prevalence and risk factors for violent behavior in young people presenting with first-episode psychosis in Hong Kong: A 3-year follow-up study.

Authors:  Wing Chung Chang; Sherina Suet In Chan; Christy Lai Ming Hui; Sherry Kit Wa Chan; Edwin Ho Ming Lee; Eric Yu Hai Chen
Journal:  Aust N Z J Psychiatry       Date:  2015-08-28       Impact factor: 5.744

6.  Violence and mental disorders. A retrospective study of people in charge of a community mental health center.

Authors:  Federica Pinna; Massimo Tusconi; Claudio Dessì; Giuseppe Pittaluga; Andrea Fiorillo; Bernardo Carpiniello
Journal:  Int J Law Psychiatry       Date:  2016-05-11

7.  Monitoring and predicting the risk of violence in residential facilities. No difference between patients with history or with no history of violence.

Authors:  Giovanni de Girolamo; Chiara Buizza; Davide Sisti; Clarissa Ferrari; Viola Bulgari; Laura Iozzino; Maria Elena Boero; Giuseppe Cristiano; Alessandra De Francesco; Gian Marco Giobbio; Paolo Maggi; Giuseppe Rossi; Beatrice Segalini; Valentina Candini
Journal:  J Psychiatr Res       Date:  2016-05-24       Impact factor: 4.791

8.  Violence and mental illness.

Authors:  Marie E Rueve; Randon S Welton
Journal:  Psychiatry (Edgmont)       Date:  2008-05

Review 9.  Rates of violence in patients classified as high risk by structured risk assessment instruments.

Authors:  Jay P Singh; Seena Fazel; Ralitza Gueorguieva; Alec Buchanan
Journal:  Br J Psychiatry       Date:  2014-03       Impact factor: 9.319

10.  Routine Outcome Monitoring and Clinical Decision-Making in Forensic Psychiatry Based on the Instrument for Forensic Treatment Evaluation.

Authors:  Frida C A van der Veeken; Jacques Lucieer; Stefan Bogaerts
Journal:  PLoS One       Date:  2016-08-12       Impact factor: 3.240

View more
  5 in total

1.  Staff Perception of Respect for Human Rights of Users and Organizational Well-being: A Study in Four Different Countries of the Mediterranean Area.

Authors:  Yosra Zgueb; Antonio Preti; Alessandra Perra; Sofian El-Astal; Cesar Ivan Aviles Gonzalez; Martina Piras; Giorgia Testa; Iskren Kirolov; Giorgio Tamburini; Uta Ouali; Goce Kalcev; Ferdinando Romano; Viviane Kovess; Mauro Giovanni Carta
Journal:  Clin Pract Epidemiol Ment Health       Date:  2020-07-30

2.  Prescribing Patterns of Psychotropic Drugs and Risk of Violent Behavior: A Prospective, Multicenter Study in Italy.

Authors:  E di Giacomo; A Stefana; V Candini; G Bianconi; L Canal; M Clerici; G Conte; M T Ferla; L Iozzino; G Sbravati; G Tura; R Micciolo; G de Girolamo
Journal:  Int J Neuropsychopharmacol       Date:  2020-05-27       Impact factor: 5.176

Review 3.  Aggressive Behavior and Psychiatric Inpatients: a Narrative Review of the Literature with a Focus on the European Experience.

Authors:  Rosangela Caruso; Fabio Antenora; Michelle Riba; Martino Belvederi Murri; Bruno Biancosino; Luigi Zerbinati; Luigi Grassi
Journal:  Curr Psychiatry Rep       Date:  2021-04-07       Impact factor: 5.285

Review 4.  Positive and negative syndrome scale in forensic patients with schizophrenia spectrum disorders: a systematic review and meta-analysis.

Authors:  Chiara Buizza; Cosmo Strozza; Giulio Sbravati; Giovanni de Girolamo; Clarissa Ferrari; Laura Iozzino; Ambra Macis; Harry G Kennedy; Valentina Candini
Journal:  Ann Gen Psychiatry       Date:  2022-09-10       Impact factor: 3.301

5.  Aggressive behavior and metacognitive functions: a longitudinal study on patients with mental disorders.

Authors:  Valentina Candini; Marta Ghisi; Giorgio Bianconi; Viola Bulgari; Antonino Carcione; Cesare Cavalera; Giovanni Conte; Marta Cricelli; Maria Teresa Ferla; Clarissa Ferrari; Laura Iozzino; Ambra Macis; Giuseppe Nicolò; Alberto Stefana; Giovanni de Girolamo
Journal:  Ann Gen Psychiatry       Date:  2020-06-03       Impact factor: 3.455

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.