Venkata V Dalai1, Sana Khalid2, Dinesh Gottipati1, Thomas Kannampallil2, Vineeth John3, Brett Blatter4, Vimla L Patel2, Trevor Cohen5. 1. National Center for Cognitive Informatics and Decision Making in Healthcare School of Biomedical Informatics University of Texas Health Science Center, 7000 Fannin St, Houston, 77030 TX, USA. 2. Center for Cognitive Studies in Medicine and Public Health The New York Academy of Medicine, 1216 5th Avenue, New York, 10029 NY, USA. 3. Psychiatry and Behavioral Sciences University of Texas Medical School at Houston University of Texas Health Science Center, 6341 Fannin St, Houston, 77030 TX, USA. 4. Psychiatric Emergency Services New York Presbyterian Hospital, 622 West 168th St, New York, 10032 NY, USA. 5. National Center for Cognitive Informatics and Decision Making in Healthcare School of Biomedical Informatics University of Texas Health Science Center, 7000 Fannin St, Houston, 77030 TX, USA. Electronic address: trevor.cohen@uth.tmc.edu.
Abstract
OBJECTIVE: Clinicians' attention is a precious resource, which in the current healthcare practice is consumed by the cognitive demands arising from complex patient conditions, information overload, time pressure, and the need to aggregate and synthesize information from disparate sources. The ability to organize information in ways that facilitate the generation of effective diagnostic solutions is a distinguishing characteristic of expert physicians, suggesting that automated systems that organize clinical information in a similar manner may augment physicians' decision-making capabilities. In this paper, we describe the design and evaluation of a theoretically driven cognitive support system (CSS) that assists psychiatrists in their interpretation of clinical cases. The system highlights, and provides the means to navigate to, text that is organized in accordance with a set of diagnostically and therapeutically meaningful higher-level concepts. METHODS AND MATERIALS: To evaluate the interface, 16 psychiatry residents interpreted two clinical case scenarios, with and without the CSS. Think-aloud protocols captured during their interpretation of the cases were transcribed and analyzed qualitatively. In addition, the frequency and relative position of content related to key higher-level concepts in a verbal summary of the case were evaluated. In addition the transcripts from both groups were compared to an expert derived reference standard using latent semantic analysis (LSA). RESULTS: Qualitative analysis showed that users of the system better attended to specific clinically important aspects of both cases when these were highlighted by the system, and revealed ways in which the system mediates hypotheses generation and evaluation. Analysis of the summary data showed differences in emphasis with and without the system. The LSA analysis suggested users of the system were more "expert-like" in their emphasis, and that cognitive support was more effective in the more complex case. CONCLUSIONS: Cognitive support impacts upon clinical comprehension. This appears to be largely helpful, but may also lead to neglect of information (such as the psychosocial history) that the system does not highlight. The results have implications for the design of CSSs for clinical narratives including the role of information organization and textual embellishments for more efficient clinical case presentation and comprehension.
OBJECTIVE: Clinicians' attention is a precious resource, which in the current healthcare practice is consumed by the cognitive demands arising from complex patient conditions, information overload, time pressure, and the need to aggregate and synthesize information from disparate sources. The ability to organize information in ways that facilitate the generation of effective diagnostic solutions is a distinguishing characteristic of expert physicians, suggesting that automated systems that organize clinical information in a similar manner may augment physicians' decision-making capabilities. In this paper, we describe the design and evaluation of a theoretically driven cognitive support system (CSS) that assists psychiatrists in their interpretation of clinical cases. The system highlights, and provides the means to navigate to, text that is organized in accordance with a set of diagnostically and therapeutically meaningful higher-level concepts. METHODS AND MATERIALS: To evaluate the interface, 16 psychiatry residents interpreted two clinical case scenarios, with and without the CSS. Think-aloud protocols captured during their interpretation of the cases were transcribed and analyzed qualitatively. In addition, the frequency and relative position of content related to key higher-level concepts in a verbal summary of the case were evaluated. In addition the transcripts from both groups were compared to an expert derived reference standard using latent semantic analysis (LSA). RESULTS: Qualitative analysis showed that users of the system better attended to specific clinically important aspects of both cases when these were highlighted by the system, and revealed ways in which the system mediates hypotheses generation and evaluation. Analysis of the summary data showed differences in emphasis with and without the system. The LSA analysis suggested users of the system were more "expert-like" in their emphasis, and that cognitive support was more effective in the more complex case. CONCLUSIONS: Cognitive support impacts upon clinical comprehension. This appears to be largely helpful, but may also lead to neglect of information (such as the psychosocial history) that the system does not highlight. The results have implications for the design of CSSs for clinical narratives including the role of information organization and textual embellishments for more efficient clinical case presentation and comprehension.
Authors: Thomas G Kannampallil; Amy Franklin; Rashmi Mishra; Khalid F Almoosa; Trevor Cohen; Vimla L Patel Journal: Artif Intell Med Date: 2012-11-26 Impact factor: 5.326