Nicolas Griffon1, Gaétan Kerdelhué2, Saliha Hamek3, Sylvain Hassler3, César Boog3, Jean-Baptiste Lamy4, Catherine Duclos4, Alain Venot4, Stéfan J Darmoni1. 1. CISMeF, Rouen University Hospital, Cour Leschevin, Rouen, Cedex, France INSERM, U1142, LIMICS, Paris, France Sorbonne Universités, UPMC Univ Paris 06, UMR_S 1142, LIMICS, Paris, France Université Paris 13, Sorbonne Paris Cité, LIMICS, (UMR_S 1142), Villetaneuse, France. 2. CISMeF, Rouen University Hospital, Cour Leschevin, Rouen, Cedex, France. 3. INSERM CIC IT Lille / EVALAB, CHU Lille, Université Lille Nord de France, UDSL EA 2694, Lille, France. 4. INSERM, U1142, LIMICS, Paris, France Sorbonne Universités, UPMC Univ Paris 06, UMR_S 1142, LIMICS, Paris, France Université Paris 13, Sorbonne Paris Cité, LIMICS, (UMR_S 1142), Villetaneuse, France.
Abstract
BACKGROUND AND OBJECTIVE: Doc'CISMeF (DC) is a semantic search engine used to find resources in CISMeF-BP, a quality controlled health gateway, which gathers guidelines available on the internet in French. Visualization of Concepts in Medicine (VCM) is an iconic language that may ease information retrieval tasks. This study aimed to describe the creation and evaluation of an interface integrating VCM in DC in order to make this search engine much easier to use. METHODS: Focus groups were organized to suggest ways to enhance information retrieval tasks using VCM in DC. A VCM interface was created and improved using the ergonomic evaluation approach. 20 physicians were recruited to compare the VCM interface with the non-VCM one. Each evaluator answered two different clinical scenarios in each interface. The ability and time taken to select a relevant resource were recorded and compared. A usability analysis was performed using the System Usability Scale (SUS). RESULTS: The VCM interface contains a filter based on icons, and icons describing each resource according to focus group recommendations. Some ergonomic issues were resolved before evaluation. Use of VCM significantly increased the success of information retrieval tasks (OR=11; 95% CI 1.4 to 507). Nonetheless, it took significantly more time to find a relevant resource with VCM interface (101 vs 65 s; p=0.02). SUS revealed 'good' usability with an average score of 74/100. CONCLUSIONS: VCM was successfully implemented in DC as an option. It increased the success rate of information retrieval tasks, despite requiring slightly more time, and was well accepted by end-users. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
BACKGROUND AND OBJECTIVE: Doc'CISMeF (DC) is a semantic search engine used to find resources in CISMeF-BP, a quality controlled health gateway, which gathers guidelines available on the internet in French. Visualization of Concepts in Medicine (VCM) is an iconic language that may ease information retrieval tasks. This study aimed to describe the creation and evaluation of an interface integrating VCM in DC in order to make this search engine much easier to use. METHODS: Focus groups were organized to suggest ways to enhance information retrieval tasks using VCM in DC. A VCM interface was created and improved using the ergonomic evaluation approach. 20 physicians were recruited to compare the VCM interface with the non-VCM one. Each evaluator answered two different clinical scenarios in each interface. The ability and time taken to select a relevant resource were recorded and compared. A usability analysis was performed using the System Usability Scale (SUS). RESULTS: The VCM interface contains a filter based on icons, and icons describing each resource according to focus group recommendations. Some ergonomic issues were resolved before evaluation. Use of VCM significantly increased the success of information retrieval tasks (OR=11; 95% CI 1.4 to 507). Nonetheless, it took significantly more time to find a relevant resource with VCM interface (101 vs 65 s; p=0.02). SUS revealed 'good' usability with an average score of 74/100. CONCLUSIONS: VCM was successfully implemented in DC as an option. It increased the success rate of information retrieval tasks, despite requiring slightly more time, and was well accepted by end-users. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Authors: S J Darmoni; B Thirion; J P Leroy; M Douyère; B Lacoste; C Godard; I Rigolle; M Brisou; S Videau; E Goupy; J Piot; M Quéré; S Ouazir; H Abdulrab Journal: Stud Health Technol Inform Date: 2001