Ramit Sawhney1, Harshit Joshi2, Saumya Gandhi3, Di Jin4, Rajiv Ratn Shah1. 1. MIDAS, IIIT Delhi, New Delhi, India. 2. Cluster Innovation Centre, University of Delhi, New Delhi, India. 3. Computer Science, Visvesvaraya National Institute of Technology, Nagpur, India. 4. Computer Science and Artificial Intelligence Lab, Massachussetts Institute of Technology, Cambridge, Massachussetts USA.
Abstract
OBJECTIVE: The prevalence of social media for sharing personal thoughts makes it a viable platform for the assessment of suicide risk. However, deep learning models are not able to capture the diverse nature of linguistic choices and temporal patterns that can be exhibited by a suicidal user on social media and end up overfitting on specific cues that are not generally applicable. We propose Adversarial Suicide assessment Hierarchical Attention (ASHA), a hierarchical attention model that employs adversarial learning for improving the generalization ability of the model. MATERIAL AND METHODS: We assess the suicide risk of a social media user across 5 levels of increasing severity of risk. ASHA leverages a transformer-based architecture to learn the semantic nature of social media posts and a temporal attention-based long short-term memory architecture for the sequential modeling of a user's historical posts. We dynamically generate adversarial examples by adding perturbations to actual examples that can simulate the stochasticity in historical posts, thereby making the model robust. RESULTS: Through extensive experiments, we establish the face-value of ASHA and show that it significantly outperforms existing baselines, with the F1 score of 64%. This is a 2% and a 4% increase over the ContextBERT and ContextCNN baselines, respectively. Finally, we discuss the practical applicability and ethical aspects of our work pertaining to ASHA, as a human-in-the-loop framework. DISCUSSION AND CONCLUSIONS: Adversarial samples can be helpful in capturing the diverse nature of suicidal ideation. Through ASHA, we hope to form a component in a larger human-in-the-loop infrastructure for suicide risk assessment on social media.
OBJECTIVE: The prevalence of social media for sharing personal thoughts makes it a viable platform for the assessment of suicide risk. However, deep learning models are not able to capture the diverse nature of linguistic choices and temporal patterns that can be exhibited by a suicidal user on social media and end up overfitting on specific cues that are not generally applicable. We propose Adversarial Suicide assessment Hierarchical Attention (ASHA), a hierarchical attention model that employs adversarial learning for improving the generalization ability of the model. MATERIAL AND METHODS: We assess the suicide risk of a social media user across 5 levels of increasing severity of risk. ASHA leverages a transformer-based architecture to learn the semantic nature of social media posts and a temporal attention-based long short-term memory architecture for the sequential modeling of a user's historical posts. We dynamically generate adversarial examples by adding perturbations to actual examples that can simulate the stochasticity in historical posts, thereby making the model robust. RESULTS: Through extensive experiments, we establish the face-value of ASHA and show that it significantly outperforms existing baselines, with the F1 score of 64%. This is a 2% and a 4% increase over the ContextBERT and ContextCNN baselines, respectively. Finally, we discuss the practical applicability and ethical aspects of our work pertaining to ASHA, as a human-in-the-loop framework. DISCUSSION AND CONCLUSIONS: Adversarial samples can be helpful in capturing the diverse nature of suicidal ideation. Through ASHA, we hope to form a component in a larger human-in-the-loop infrastructure for suicide risk assessment on social media.
Authors: John P Pestian; Michael Sorter; Brian Connolly; Kevin Bretonnel Cohen; Cheryl McCullumsmith; Jeffry T Gee; Louis-Philippe Morency; Stefan Scherer; Lesley Rohlfs Journal: Suicide Life Threat Behav Date: 2016-11-03
Authors: Keith Hawton; Katrina G Witt; Tatiana L Taylor Salisbury; Ella Arensman; David Gunnell; Philip Hazell; Ellen Townsend; Kees van Heeringen Journal: Lancet Psychiatry Date: 2016-07-13 Impact factor: 27.083
Authors: Daun Shin; Kyungdo Kim; Seung-Bo Lee; Changwoo Lee; Ye Seul Bae; Won Ik Cho; Min Ji Kim; C Hyung Keun Park; Eui Kyu Chie; Nam Soo Kim; Yong Min Ahn Journal: Front Psychiatry Date: 2022-05-24 Impact factor: 5.435