Viktoria Manukyan1, Brigitte N Durieux2, Cailin J Gramling3, Laurence A Clarfeld4, Donna M Rizzo4, Margaret J Eppstein5, Robert Gramling6. 1. 1 Department of Family Medicine and Computer Science, University of Vermont , Burlington, Vermont. 2. 2 Department of Romance Languages and Linguistics, University of Vermont , Burlington, Vermont. 3. 3 Department of Philosophy, University of Vermont , Burlington, Vermont. 4. 4 Department of Engineering, University of Vermont , Burlington, Vermont. 5. 5 Department of Computer Science, and University of Vermont , Burlington, Vermont. 6. 6 Department of Family Medicine/Palliative Medicine, University of Vermont , Burlington, Vermont.
Abstract
OBJECTIVE: Automating conversation analysis in the natural clinical setting is essential to scale serious illness communication research to samples that are large enough for traditional epidemiological studies. Our objective is to automate the identification of pauses in conversations because these are important linguistic targets for evaluating dynamics of speaker involvement and turn-taking, listening and human connection, or distraction and disengagement. DESIGN: We used 354 audio recordings of serious illness conversations from the multisite Palliative Care Communication Research Initiative cohort study. SETTING/ SUBJECTS: Hospitalized people with advanced cancer seen by the palliative care team. MEASUREMENTS: We developed a Random Forest machine learning (ML) algorithm to detect Conversational Pauses of two seconds or longer. We triple-coded 261 minutes of audio with human coders to establish a gold standard for evaluating ML performance characteristics. RESULTS: ML automatically identified Conversational Pauses with a sensitivity of 90.5 and a specificity of 94.5. CONCLUSIONS: ML is a valid method for automatically identifying Conversational Pauses in the natural acoustic setting of inpatient serious illness conversations.
OBJECTIVE: Automating conversation analysis in the natural clinical setting is essential to scale serious illness communication research to samples that are large enough for traditional epidemiological studies. Our objective is to automate the identification of pauses in conversations because these are important linguistic targets for evaluating dynamics of speaker involvement and turn-taking, listening and human connection, or distraction and disengagement. DESIGN: We used 354 audio recordings of serious illness conversations from the multisite Palliative Care Communication Research Initiative cohort study. SETTING/ SUBJECTS: Hospitalized people with advanced cancer seen by the palliative care team. MEASUREMENTS: We developed a Random Forest machine learning (ML) algorithm to detect Conversational Pauses of two seconds or longer. We triple-coded 261 minutes of audio with human coders to establish a gold standard for evaluating ML performance characteristics. RESULTS: ML automatically identified Conversational Pauses with a sensitivity of 90.5 and a specificity of 94.5. CONCLUSIONS: ML is a valid method for automatically identifying Conversational Pauses in the natural acoustic setting of inpatient serious illness conversations.
Authors: Eline van den Broek-Altenburg; Robert Gramling; Kelly Gothard; Maarten Kroesen; Caspar Chorus Journal: BMC Palliat Care Date: 2021-01-25 Impact factor: 3.234