Chandril Chandan Ghosh1, Duncan McVicar2, Gavin Davidson2, Ciaran Shannon3. 1. Queen's University Belfast, University Rd, Belfast, BT7 1NN, UK. C.Ghosh@qub.ac.uk. 2. Queen's University Belfast, University Rd, Belfast, BT7 1NN, UK. 3. IMPACT Research Centre, Northern Health and Social Care Trust, 60 Steeple Road, Antrim, BT41 2 RJ, UK.
Abstract
BACKGROUND: The diagnostic system is fundamental to any health discipline, including mental health, as it defines mental illness and helps inform possible treatment and prognosis. Thus, the procedure to estimate the reliability of such a system is of utmost importance. The current ways of measuring the reliability of the diagnostic system have limitations. In this study, we propose an alternative approach for verifying and measuring the reliability of the existing system. METHODS: We perform Jaccard's similarity index analysis between first person accounts of patients with the same disorder (in this case Major Depressive Disorder) and between those who received a diagnosis of a different disorder (in this case Bulimia Nervosa) to demonstrate that narratives, when suitably processed, are a rich source of data for this purpose. We then analyse 228 narratives of lived experiences from patients with mental disorders, using Python code script, to demonstrate that patients with the same diagnosis have very different illness experiences. RESULTS: The results demonstrate that narratives are a statistically viable data resource which can distinguish between patients who receive different diagnostic labels. However, the similarity coefficients between 99.98% of narrative pairs, including for those with similar diagnoses, are low (< 0.3), indicating diagnostic Heterogeneity. CONCLUSIONS: The current study proposes an alternative approach to measuring diagnostic Heterogeneity of the categorical taxonomic systems (e.g. the Diagnostic and Statistical Manual, DSM). In doing so, we demonstrate the high Heterogeneity and limited reliability of the existing system using patients' written narratives of their illness experiences as the only data source. Potential applications of these outputs are discussed in the context of healthcare management and mental health research.
BACKGROUND: The diagnostic system is fundamental to any health discipline, including mental health, as it defines mental illness and helps inform possible treatment and prognosis. Thus, the procedure to estimate the reliability of such a system is of utmost importance. The current ways of measuring the reliability of the diagnostic system have limitations. In this study, we propose an alternative approach for verifying and measuring the reliability of the existing system. METHODS: We perform Jaccard's similarity index analysis between first person accounts of patients with the same disorder (in this case Major Depressive Disorder) and between those who received a diagnosis of a different disorder (in this case Bulimia Nervosa) to demonstrate that narratives, when suitably processed, are a rich source of data for this purpose. We then analyse 228 narratives of lived experiences from patients with mental disorders, using Python code script, to demonstrate that patients with the same diagnosis have very different illness experiences. RESULTS: The results demonstrate that narratives are a statistically viable data resource which can distinguish between patients who receive different diagnostic labels. However, the similarity coefficients between 99.98% of narrative pairs, including for those with similar diagnoses, are low (< 0.3), indicating diagnostic Heterogeneity. CONCLUSIONS: The current study proposes an alternative approach to measuring diagnostic Heterogeneity of the categorical taxonomic systems (e.g. the Diagnostic and Statistical Manual, DSM). In doing so, we demonstrate the high Heterogeneity and limited reliability of the existing system using patients' written narratives of their illness experiences as the only data source. Potential applications of these outputs are discussed in the context of healthcare management and mental health research.
Authors: Roman Kotov; Robert F Krueger; David Watson; Thomas M Achenbach; Robert R Althoff; R Michael Bagby; Timothy A Brown; William T Carpenter; Avshalom Caspi; Lee Anna Clark; Nicholas R Eaton; Miriam K Forbes; Kelsie T Forbush; David Goldberg; Deborah Hasin; Steven E Hyman; Masha Y Ivanova; Donald R Lynam; Kristian Markon; Joshua D Miller; Terrie E Moffitt; Leslie C Morey; Stephanie N Mullins-Sweatt; Johan Ormel; Christopher J Patrick; Darrel A Regier; Leslie Rescorla; Camilo J Ruggero; Douglas B Samuel; Martin Sellbom; Leonard J Simms; Andrew E Skodol; Tim Slade; Susan C South; Jennifer L Tackett; Irwin D Waldman; Monika A Waszczuk; Thomas A Widiger; Aidan G C Wright; Mark Zimmerman Journal: J Abnorm Psychol Date: 2017-03-23