Jannik Schaaf1, Martin Sedlmayr2, Brita Sedlmayr2, Hans-Ulrich Prokosch3, Holger Storf4. 1. Medical Informatics Group (MIG), University Hospital Frankfurt, Frankfurt, Germany. jannik.schaaf@kgu.de. 2. Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technical University of Dresden, Dresden, Germany. 3. Department of Medical Informatics, Biometrics and Epidemiology, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany. 4. Medical Informatics Group (MIG), University Hospital Frankfurt, Frankfurt, Germany.
Abstract
BACKGROUND: Rare Diseases (RDs) are difficult to diagnose. Clinical Decision Support Systems (CDSS) could support the diagnosis for RDs. The Medical Informatics in Research and Medicine (MIRACUM) consortium developed a CDSS for RDs based on distributed clinical data from eight German university hospitals. To support the diagnosis for difficult patient cases, the CDSS uses data from the different hospitals to perform a patient similarity analysis to obtain an indication of a diagnosis. To optimize our CDSS, we conducted a qualitative study to investigate usability and functionality of our designed CDSS. METHODS: We performed a Thinking Aloud Test (TA-Test) with RDs experts working in Rare Diseases Centers (RDCs) at MIRACUM locations which are specialized in diagnosis and treatment of RDs. An instruction sheet with tasks was prepared that the participants should perform with the CDSS during the study. The TA-Test was recorded on audio and video, whereas the resulting transcripts were analysed with a qualitative content analysis, as a ruled-guided fixed procedure to analyse text-based data. Furthermore, a questionnaire was handed out at the end of the study including the System Usability Scale (SUS). RESULTS: A total of eight experts from eight MIRACUM locations with an established RDC were included in the study. Results indicate that more detailed information about patients, such as descriptive attributes or findings, can help the system perform better. The system was rated positively in terms of functionality, such as functions that enable the user to obtain an overview of similar patients or medical history of a patient. However, there is a lack of transparency in the results of the CDSS patient similarity analysis. The study participants often stated that the system should present the user with an overview of exact symptoms, diagnosis, and other characteristics that define two patients as similar. In the usability section, the CDSS received a score of 73.21 points, which is ranked as good usability. CONCLUSIONS: This qualitative study investigated the usability and functionality of a CDSS of RDs. Despite positive feedback about functionality of system, the CDSS still requires some revisions and improvement in transparency of the patient similarity analysis.
BACKGROUND: Rare Diseases (RDs) are difficult to diagnose. Clinical Decision Support Systems (CDSS) could support the diagnosis for RDs. The Medical Informatics in Research and Medicine (MIRACUM) consortium developed a CDSS for RDs based on distributed clinical data from eight German university hospitals. To support the diagnosis for difficult patient cases, the CDSS uses data from the different hospitals to perform a patient similarity analysis to obtain an indication of a diagnosis. To optimize our CDSS, we conducted a qualitative study to investigate usability and functionality of our designed CDSS. METHODS: We performed a Thinking Aloud Test (TA-Test) with RDs experts working in Rare Diseases Centers (RDCs) at MIRACUM locations which are specialized in diagnosis and treatment of RDs. An instruction sheet with tasks was prepared that the participants should perform with the CDSS during the study. The TA-Test was recorded on audio and video, whereas the resulting transcripts were analysed with a qualitative content analysis, as a ruled-guided fixed procedure to analyse text-based data. Furthermore, a questionnaire was handed out at the end of the study including the System Usability Scale (SUS). RESULTS: A total of eight experts from eight MIRACUM locations with an established RDC were included in the study. Results indicate that more detailed information about patients, such as descriptive attributes or findings, can help the system perform better. The system was rated positively in terms of functionality, such as functions that enable the user to obtain an overview of similar patients or medical history of a patient. However, there is a lack of transparency in the results of the CDSS patient similarity analysis. The study participants often stated that the system should present the user with an overview of exact symptoms, diagnosis, and other characteristics that define two patients as similar. In the usability section, the CDSS received a score of 73.21 points, which is ranked as good usability. CONCLUSIONS: This qualitative study investigated the usability and functionality of a CDSS of RDs. Despite positive feedback about functionality of system, the CDSS still requires some revisions and improvement in transparency of the patient similarity analysis.
Entities:
Keywords:
Clinical decision support systems; Computer-assisted diagnosis; Rare diseases; Usability
Authors: Enrique Stanziola; María Quispe Uznayo; Juan Marcos Ortiz; Mariana Simón; Carlos Otero; Fernando Campos; Daniel Luna Journal: Stud Health Technol Inform Date: 2015
Authors: Holger Storf; Jannik Schaaf; Dennis Kadioglu; Jens Göbel; Thomas O F Wagner; Frank Ückert Journal: Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz Date: 2017-05 Impact factor: 1.513
Authors: Jannik Schaaf; Martin Boeker; Thomas Ganslandt; Christian Haverkamp; Tim Hermann; Dennis Kadioglu; Hans-Ulrich Prokosch; Thomas O F Wagner; Michael von Wagner; Johanna Schaefer; Martin Sedlmayr; Holger Storf Journal: Stud Health Technol Inform Date: 2019-08-21
Authors: Domenica Taruscio; Giovanna Floridia; Marco Salvatore; Stephen C Groft; William A Gahl Journal: Adv Exp Med Biol Date: 2017 Impact factor: 2.622
Authors: N Griffon; M Schuers; F Dhombres; T Merabti; G Kerdelhué; L Rollin; S J Darmoni Journal: BMC Med Inform Decis Mak Date: 2016-08-02 Impact factor: 2.796
Authors: Reed T Sutton; David Pincock; Daniel C Baumgart; Daniel C Sadowski; Richard N Fedorak; Karen I Kroeker Journal: NPJ Digit Med Date: 2020-02-06
Authors: Sven Kernebeck; Chantal Jux; Theresa Sophie Busse; Dorothee Meyer; Larissa Alice Dreier; Daniel Zenz; Boris Zernikow; Jan Peter Ehlers Journal: Children (Basel) Date: 2022-01-06
Authors: Sven Kernebeck; Theresa Sophie Busse; Chantal Jux; Larissa Alice Dreier; Dorothee Meyer; Daniel Zenz; Boris Zernikow; Jan Peter Ehlers Journal: Int J Environ Res Public Health Date: 2022-03-18 Impact factor: 3.390