PURPOSE: Registers derived from administrative datasets are valuable tools in psychosis research, but diagnostic accuracy can be problematic. We sought to compare the relative performance of four methods for assigning a single diagnosis from longitudinal administrative clinical records when compared with reference diagnoses. METHODS: Diagnoses recorded in inpatient and community mental health records were compared to research diagnoses of psychotic disorders obtained from semi-structured clinical interviews for 289 persons. Diagnoses were derived from administrative datasets using four algorithms; 'At least one' diagnosis, 'Last' or most recent diagnosis, 'Modal' or most frequently occurring diagnosis, and 'Hierarchy' in which a diagnostic hierarchy was applied. Agreements between algorithm-based and reference diagnoses for overall presence/absence of psychosis and for specific diagnoses of schizophrenia, schizoaffective disorder, and affective psychosis were examined using estimated prevalence rates, overall agreement, ROC analysis, and kappa statistics. RESULTS: For the presence/absence of psychosis, the most sensitive and least specific algorithm ('At least one' diagnosis) performed best. For schizophrenia, 'Modal' and 'Last' diagnoses had greatest agreement with reference diagnosis. For affective psychosis, 'Hierarchy' diagnosis performed best. Agreement between clinical and reference diagnoses was no better than chance for diagnoses of schizoaffective disorder. Overall agreement between administrative and reference diagnoses was modest, but may have been limited by the use of participants who had been screened for likely psychosis prior to assessment. CONCLUSION: The choice of algorithm for extracting a psychosis diagnosis from administrative datasets may have a substantial impact on the accuracy of the diagnoses derived. An 'Any diagnosis' algorithm provides a sensitive measure for the presence of any psychosis, while 'Last diagnosis' is more accurate for specific diagnosis of schizophrenia and a hierarchical diagnosis is more accurate for affective psychosis.
PURPOSE: Registers derived from administrative datasets are valuable tools in psychosis research, but diagnostic accuracy can be problematic. We sought to compare the relative performance of four methods for assigning a single diagnosis from longitudinal administrative clinical records when compared with reference diagnoses. METHODS: Diagnoses recorded in inpatient and community mental health records were compared to research diagnoses of psychotic disorders obtained from semi-structured clinical interviews for 289 persons. Diagnoses were derived from administrative datasets using four algorithms; 'At least one' diagnosis, 'Last' or most recent diagnosis, 'Modal' or most frequently occurring diagnosis, and 'Hierarchy' in which a diagnostic hierarchy was applied. Agreements between algorithm-based and reference diagnoses for overall presence/absence of psychosis and for specific diagnoses of schizophrenia, schizoaffective disorder, and affective psychosis were examined using estimated prevalence rates, overall agreement, ROC analysis, and kappa statistics. RESULTS: For the presence/absence of psychosis, the most sensitive and least specific algorithm ('At least one' diagnosis) performed best. For schizophrenia, 'Modal' and 'Last' diagnoses had greatest agreement with reference diagnosis. For affective psychosis, 'Hierarchy' diagnosis performed best. Agreement between clinical and reference diagnoses was no better than chance for diagnoses of schizoaffective disorder. Overall agreement between administrative and reference diagnoses was modest, but may have been limited by the use of participants who had been screened for likely psychosis prior to assessment. CONCLUSION: The choice of algorithm for extracting a psychosis diagnosis from administrative datasets may have a substantial impact on the accuracy of the diagnoses derived. An 'Any diagnosis' algorithm provides a sensitive measure for the presence of any psychosis, while 'Last diagnosis' is more accurate for specific diagnosis of schizophrenia and a hierarchical diagnosis is more accurate for affective psychosis.
Authors: D J Castle; A Jablensky; J J McGrath; V Carr; V Morgan; A Waterreus; G Valuri; H Stain; P McGuffin; A Farmer Journal: Psychol Med Date: 2005-09-29 Impact factor: 7.723
Authors: Paul Lichtenstein; Camilla Björk; Christina M Hultman; Edward Scolnick; Pamela Sklar; Patrick F Sullivan Journal: Psychol Med Date: 2006-07-25 Impact factor: 7.723
Authors: T Taiminen; K Ranta; H Karlsson; H Lauerma; K M Leinonen; E Wallenius; A Kaljonen; R K Salokangas Journal: Nord J Psychiatry Date: 2001 Impact factor: 2.202
Authors: Vera A Morgan; Anna Waterreus; Assen Jablensky; Andrew Mackinnon; John J McGrath; Vaughan Carr; Robert Bush; David Castle; Martin Cohen; Carol Harvey; Cherrie Galletly; Helen J Stain; Amanda L Neil; Patrick McGorry; Barbara Hocking; Sonal Shah; Suzy Saw Journal: Aust N Z J Psychiatry Date: 2012-06-13 Impact factor: 5.744
Authors: W Löffler; H Häfner; B Fätkenheuer; K Maurer; A Riecher-Rössler; J Lützhøft; S Skadhede; P Munk-Jørgensen; E Strömgren Journal: Acta Psychiatr Scand Date: 1994-09 Impact factor: 6.392
Authors: Nita Sodhi-Berry; Matthew Knuiman; Janine Alan; Vera A Morgan; David B Preen Journal: Soc Psychiatry Psychiatr Epidemiol Date: 2015-01-22 Impact factor: 4.328
Authors: S L Matheson; M Kariuki; M J Green; K Dean; F Harris; S Tzoumakis; M Tarren-Sweeney; S Brinkman; M Chilvers; T Sprague; V J Carr; K R Laurens Journal: Epidemiol Psychiatr Sci Date: 2016-08-04 Impact factor: 6.892
Authors: Katrina Alice Southworth Davis; Oliver Bashford; Amelia Jewell; Hitesh Shetty; Robert J Stewart; Cathie L M Sudlow; Matthew Hugo Hotopf Journal: PLoS One Date: 2018-03-26 Impact factor: 3.240