Fateme Rangraz Jeddi1, Ehsan Nabovati2, Reyhane Bigham3, Reza Khajouei4. 1. Health Information Management Research Center, Kashan University of Medical Sciences, Kashan, Iran; Department of Health Information Management & Technology, School of Allied Health Professions, Kashan University of Medical Sciences, Kashan, Iran. 2. Health Information Management Research Center, Kashan University of Medical Sciences, Kashan, Iran; Department of Health Information Management & Technology, School of Allied Health Professions, Kashan University of Medical Sciences, Kashan, Iran. Electronic address: Nabovati@kaums.ac.ir. 3. Department of Health Information Management & Technology, School of Allied Health Professions, Kashan University of Medical Sciences, Kashan, Iran; Student research committee, Kashan University of Medical Sciences, Kashan, Iran. 4. Medical Informatics Research Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran.
Abstract
OBJECTIVE: One of the most important methods for evaluating information systems is usability evaluation. Usability is a context-dependent qualitative feature that is measured by multiple quality components that can be related to users' characteristics. This study was conducted to evaluate the usability of a comprehensive national health information system (SIB; an abbreviation for the Persian equivalent of 'integrated health system') from the perspective of different users and to determine the relationship between quality components and users' characteristics. METHOD: The study population were users of the national health information system (n = 309) at health centers and health homes affiliated to Kashan University of Medical Sciences, Kashan, Iran. Data were collected using Software Usability Measurement Inventory (SUMI) questionnaire which measures users' experiences of software interface in five quality components (i.e. affect, efficiency, helpfulness, control, and learnability) and provides a global usability score. SUMI scores were analyzed according to an extensive reference database (SUMISCO). The relationships between quality components and users' characteristics were investigated by one-way analysis of variance (ANOVA), independent t-test, and Pearson's correlation coefficient. RESULTS: A total of 250 users completed the questionnaire (response rate = 81%). The mean scores of all quality components were significantly lower than the mean of SUMISCO. Learnability score had significant relationships with the user's position, education level, and field of education (P < 0.001). Physicians scored significantly lower than other users in efficiency, helpfulness and global usability (P < 0.05). Users' practice experience and age had significant linear inverse relationships with efficiency, helpfulness, and learnability (P < 0.05). CONCLUSIONS: The national health information system which is used by a large number of users across a developing country have low usability. Given the significant relationships between the users' characteristics of such systems and quality components, it is essential to consider the characteristics and needs of various user groups during the processes of system analysis and design.
OBJECTIVE: One of the most important methods for evaluating information systems is usability evaluation. Usability is a context-dependent qualitative feature that is measured by multiple quality components that can be related to users' characteristics. This study was conducted to evaluate the usability of a comprehensive national health information system (SIB; an abbreviation for the Persian equivalent of 'integrated health system') from the perspective of different users and to determine the relationship between quality components and users' characteristics. METHOD: The study population were users of the national health information system (n = 309) at health centers and health homes affiliated to Kashan University of Medical Sciences, Kashan, Iran. Data were collected using Software Usability Measurement Inventory (SUMI) questionnaire which measures users' experiences of software interface in five quality components (i.e. affect, efficiency, helpfulness, control, and learnability) and provides a global usability score. SUMI scores were analyzed according to an extensive reference database (SUMISCO). The relationships between quality components and users' characteristics were investigated by one-way analysis of variance (ANOVA), independent t-test, and Pearson's correlation coefficient. RESULTS: A total of 250 users completed the questionnaire (response rate = 81%). The mean scores of all quality components were significantly lower than the mean of SUMISCO. Learnability score had significant relationships with the user's position, education level, and field of education (P < 0.001). Physicians scored significantly lower than other users in efficiency, helpfulness and global usability (P < 0.05). Users' practice experience and age had significant linear inverse relationships with efficiency, helpfulness, and learnability (P < 0.05). CONCLUSIONS: The national health information system which is used by a large number of users across a developing country have low usability. Given the significant relationships between the users' characteristics of such systems and quality components, it is essential to consider the characteristics and needs of various user groups during the processes of system analysis and design.