Yvonne Versluijs1,2, Meredith G Moore1, David Ring1, Prakash Jayakumar1. 1. Department of Surgery and Perioperative Care, Dell Medical School, the University of Texas at Austin, Austin, TX, USA. 2. Department of Trauma Surgery, Leiden University Medical Center, Leiden, the Netherlands.
Abstract
BACKGROUND: Mental health has a notable and perhaps underappreciated relationship with symptom intensity related to musculoskeletal pathophysiology. Tools for increasing awareness of mental health opportunities may help musculoskeletal specialists identify and address psychological distress and unhealthy misconceptions with greater confidence. One such type of technology-software that identifies emotions by analyzing facial expressions-could be developed as a clinician-awareness tool. A first step in this endeavor is to conduct a pilot study to assess the ability to measure patient mental health through specialist facial expressions. QUESTIONS/PURPOSES: (1) Does quantification of clinician emotion using facial recognition software correlate with patient psychological distress and unhealthy misconceptions? (2) Is there a correlation between clinician facial expressions of emotions and a validated measure of the quality of the patient-clinician relationship? METHODS: In a cross-sectional pilot study, between April 2019 and July 2019, we made video recordings of the clinician's face during 34 initial musculoskeletal specialist outpatient evaluations. There were 16 men and 18 women, all fluent and literate in English, with a mean age of 43 ± 15 years. Enrollment was performed according to available personnel, equipment, and room availability. We did not track declines, but there were only a few. Video recordings were analyzed using facial-emotional recognition software, measuring the proportion of time spent by clinicians expressing measured emotions during a consultation. After the visit, patients completed a demographic questionnaire and measures of health anxiety (the Short Health Anxiety Inventory), fear of painful movement (the Tampa Scale for Kinesiophobia), catastrophic or worst-case thinking about pain (the Pain Catastrophizing Scale), symptoms of depression (the Patient Health Questionnaire), and the patient's perception of the quality of their relationship with the clinician (Patient-Doctor Relationship Questionnaire). RESULTS: Clinician facial expressions consistent with happiness were associated with less patient health anxiety (r = -0.59; p < 0.001) and less catastrophic thinking (r = -0.37; p = 0.03). Lower levels of clinician expressions consistent with sadness were associated with less health anxiety (r = 0.36; p = 0.04), fewer symptoms of generalized anxiety (r = 0.36; p = 0.03), and less catastrophic thinking (r = 0.33; p = 0.05). Less time expressing anger was associated with greater health anxiety (r = -0.37; p = 0.03), greater symptoms of anxiety (r = -0.46; p < 0.01), more catastrophic thinking (r = -0.38; p = 0.03), and greater symptoms of depression (r = -0.42; p = 0.01). More time expressing surprise was associated with less health anxiety (r = -0.44; p < 0.01) and symptoms of depression (r = -0.52; p < 0.01). More time expressing fear was associated with less kinesiophobia (r = -0.35; p = 0.04). More time expressing disgust was associated with less catastrophic thinking (r = -0.37; p = 0.03) and less health anxiety (GAD-2; r = -0.42; p = 0.02) and symptoms of depression (r = -0.44; p < 0.01). There was no association between a clinicians' facial expression of emotions and patient experience with patient-clinician interactions. CONCLUSION: The ability to measure a patient's mindset on the clinician's face confirms that clinicians are registering the psychological aspects of illness, whether they are consciously aware of them or not. Future research involving larger cohorts of patients, mapping clinician-patient interactions during consultation, and more sophisticated capture of nonverbal and verbal cues, including a broader range of emotional expressions, may help translate this innovation from the research setting to clinical practice. CLINICAL RELEVANCE: Tools for measuring emotion through facial recognition could be used to train clinicians to become aware of the psychological aspects of health and to coach clinicians on effective communication strategies both for gentle reorientation of common misconceptions as well as for appropriate and timely diagnosis and treatment of psychological distress.
BACKGROUND: Mental health has a notable and perhaps underappreciated relationship with symptom intensity related to musculoskeletal pathophysiology. Tools for increasing awareness of mental health opportunities may help musculoskeletal specialists identify and address psychological distress and unhealthy misconceptions with greater confidence. One such type of technology-software that identifies emotions by analyzing facial expressions-could be developed as a clinician-awareness tool. A first step in this endeavor is to conduct a pilot study to assess the ability to measure patient mental health through specialist facial expressions. QUESTIONS/PURPOSES: (1) Does quantification of clinician emotion using facial recognition software correlate with patient psychological distress and unhealthy misconceptions? (2) Is there a correlation between clinician facial expressions of emotions and a validated measure of the quality of the patient-clinician relationship? METHODS: In a cross-sectional pilot study, between April 2019 and July 2019, we made video recordings of the clinician's face during 34 initial musculoskeletal specialist outpatient evaluations. There were 16 men and 18 women, all fluent and literate in English, with a mean age of 43 ± 15 years. Enrollment was performed according to available personnel, equipment, and room availability. We did not track declines, but there were only a few. Video recordings were analyzed using facial-emotional recognition software, measuring the proportion of time spent by clinicians expressing measured emotions during a consultation. After the visit, patients completed a demographic questionnaire and measures of health anxiety (the Short Health Anxiety Inventory), fear of painful movement (the Tampa Scale for Kinesiophobia), catastrophic or worst-case thinking about pain (the Pain Catastrophizing Scale), symptoms of depression (the Patient Health Questionnaire), and the patient's perception of the quality of their relationship with the clinician (Patient-Doctor Relationship Questionnaire). RESULTS: Clinician facial expressions consistent with happiness were associated with less patient health anxiety (r = -0.59; p < 0.001) and less catastrophic thinking (r = -0.37; p = 0.03). Lower levels of clinician expressions consistent with sadness were associated with less health anxiety (r = 0.36; p = 0.04), fewer symptoms of generalized anxiety (r = 0.36; p = 0.03), and less catastrophic thinking (r = 0.33; p = 0.05). Less time expressing anger was associated with greater health anxiety (r = -0.37; p = 0.03), greater symptoms of anxiety (r = -0.46; p < 0.01), more catastrophic thinking (r = -0.38; p = 0.03), and greater symptoms of depression (r = -0.42; p = 0.01). More time expressing surprise was associated with less health anxiety (r = -0.44; p < 0.01) and symptoms of depression (r = -0.52; p < 0.01). More time expressing fear was associated with less kinesiophobia (r = -0.35; p = 0.04). More time expressing disgust was associated with less catastrophic thinking (r = -0.37; p = 0.03) and less health anxiety (GAD-2; r = -0.42; p = 0.02) and symptoms of depression (r = -0.44; p < 0.01). There was no association between a clinicians' facial expression of emotions and patient experience with patient-clinician interactions. CONCLUSION: The ability to measure a patient's mindset on the clinician's face confirms that clinicians are registering the psychological aspects of illness, whether they are consciously aware of them or not. Future research involving larger cohorts of patients, mapping clinician-patient interactions during consultation, and more sophisticated capture of nonverbal and verbal cues, including a broader range of emotional expressions, may help translate this innovation from the research setting to clinical practice. CLINICAL RELEVANCE: Tools for measuring emotion through facial recognition could be used to train clinicians to become aware of the psychological aspects of health and to coach clinicians on effective communication strategies both for gentle reorientation of common misconceptions as well as for appropriate and timely diagnosis and treatment of psychological distress.
Authors: Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde Journal: J Biomed Inform Date: 2008-09-30 Impact factor: 6.317
Authors: Christina M Van der Feltz-Cornelis; Patricia Van Oppen; Harm W J Van Marwijk; Edwin De Beurs; Richard Van Dyck Journal: Gen Hosp Psychiatry Date: 2004 Mar-Apr Impact factor: 3.238