Carlos Zaror1,2, Gerardo Espinoza-Espinoza2,3, Claudia Atala-Acevedo2, Patricia Muñoz-Millán1,2, Yunhan Li4, Ken Clarke4, Juan Onetto5, Jaime Díaz1, Kerrod Hallet6, David Manton7, Rodrigo Mariño7. 1. Department of Pediatric Dentistry and Orthodontics, Faculty of Dentistry, Universidad de La Frontera, Temuco, Chile. 2. Center for Research in Epidemiology, Economics and Oral Public Health (CIEESPO), Faculty of Dentistry, Universidad de La Frontera, Temuco, Chile. 3. Department of Public Health, Faculty of Medicine, Universidad de La Frontera, Temuco, Chile. 4. Networked Society Institute, University of Melbourne, Parkville, Victoria, Australia. 5. Faculty of Dentistry, University of Valparaiso, Valparaiso, Chile. 6. Royal Children's Hospital Melbourne, Melbourne, Victoria, Australia. 7. Melbourne Dental School, The University of Melbourne, Parkville, Victoria, Australia.
Abstract
BACKGROUND/AIM: Traumatic dental injuries (TDI) are a public health problem, given their prevalence and consequences. However, their epidemiology is uncertain due to a general lack of quality data capture. The aim of this study was to evaluate the validity and usability of a mobile phone-based application for community-based surveillance of traumatic dental injuries. MATERIALS AND METHODS: A mobile phone-based application, Dental Trauma Tracker (DTT), was developed. This system involves a mobile application for general users to report TDIs and a Web application for researchers to generate epidemiological data. The DTT evaluation used mixed methods and was conducted in three phases: (a) validation of a trauma identification system using preselected TDI images; (b) design evaluation by experts; and (c) usability evaluation measured by the reporting of three fictitious TDI cases and using the System Usability Scale (SUS). RESULTS: In the first phase, 182 participants participated. Most images showed over 95% accuracy, indicating that they adequately represented the type of dentoalveolar trauma being evaluated (κ = 0.75). The design evaluation identified nine usability problems-four of them with a "High priority" to be fixed, four with "Low priority," and one "No fix necessary." A total of 29 volunteers participated in the usability evaluation. The mean time for users to complete all of the reports was 7.8 ± 3.0 minutes. Mean SUS score was 67.4 ± 21.9 (Range: 0-100; worst to best). The global agreement between cases registered with the gold standard was also "Substantial" (κ = 0.71). CONCLUSIONS: This preliminary evaluation confirmed the App's usability, using a sample of potential users, as well as reporting on the results of an expert panel review of the DTT. These are the minimum requirements necessary before further expansion and widespread implementation occurs to confirm these results.
BACKGROUND/AIM: Traumatic dental injuries (TDI) are a public health problem, given their prevalence and consequences. However, their epidemiology is uncertain due to a general lack of quality data capture. The aim of this study was to evaluate the validity and usability of a mobile phone-based application for community-based surveillance of traumatic dental injuries. MATERIALS AND METHODS: A mobile phone-based application, Dental Trauma Tracker (DTT), was developed. This system involves a mobile application for general users to report TDIs and a Web application for researchers to generate epidemiological data. The DTT evaluation used mixed methods and was conducted in three phases: (a) validation of a trauma identification system using preselected TDI images; (b) design evaluation by experts; and (c) usability evaluation measured by the reporting of three fictitious TDI cases and using the System Usability Scale (SUS). RESULTS: In the first phase, 182 participants participated. Most images showed over 95% accuracy, indicating that they adequately represented the type of dentoalveolar trauma being evaluated (κ = 0.75). The design evaluation identified nine usability problems-four of them with a "High priority" to be fixed, four with "Low priority," and one "No fix necessary." A total of 29 volunteers participated in the usability evaluation. The mean time for users to complete all of the reports was 7.8 ± 3.0 minutes. Mean SUS score was 67.4 ± 21.9 (Range: 0-100; worst to best). The global agreement between cases registered with the gold standard was also "Substantial" (κ = 0.71). CONCLUSIONS: This preliminary evaluation confirmed the App's usability, using a sample of potential users, as well as reporting on the results of an expert panel review of the DTT. These are the minimum requirements necessary before further expansion and widespread implementation occurs to confirm these results.