Kristin N Dew1, Anne M Turner2, Yong K Choi3, Alyssa Bosold4, Katrin Kirchhoff5. 1. University of Washington, Dept. of Human Centered Design & Engineering, Northwest Center for Public Health Practice, 1107 NE 45th Street, Suite 400, Seattle, WA 98105, USA. Electronic address: kndew@uw.edu. 2. University of Washington, Dept. of Health Services and Dept. Biomedical Informatics and Medical Education, Northwest Center for Public Health Practice, 1107 NE 45th Street, Suite 400, Seattle, WA 98105, USA. Electronic address: amturner@uw.edu. 3. University of Washington, Dept. of Biomedical Informatics and Medical Education, Seattle, WA, USA. 4. University of Washington, Dept. of Health Services, Seattle, WA, USA. 5. University of Washington, Dept. of Electrical Engineering, Seattle, WA, USA.
Abstract
OBJECTIVES: To (1) characterize how machine translation (MT) is being developed to overcome language barriers in health settings; and (2) based on evaluations presented in the literature, determine which MT approaches show evidence of promise and what steps need to be taken to encourage adoption of MT technologies in health settings. MATERIALS & METHODS: We performed a systematic literature search covering 2006-2016 in major health, engineering, and computer science databases. After removing duplicates, two levels of screening identified 27 articles for full text review and analysis. Our review and qualitative analysis covered application setting, target users, underlying technology, whether MT was used in isolation or in combination with human editing, languages tested, evaluation methods, findings, and identified gaps. RESULTS: Of 27 studies, a majority focused on MT systems for use in clinical settings (n = 18), and eight of these involved speech-based MT systems for facilitating patient-provider communications. Text-based MT systems (n = 19) aimed at generating a range of multilingual health materials. Almost a third of all studies (n = 8) pointed to MT's potential as a starting point before human input. Studies employed a variety of human and automatic MT evaluation methods. In comparison studies, statistical machine translation (SMT) systems were more accurate than rule-based systems when large corpora were available. For a variety of systems, performance was best for translations of simple, less technical sentences and from English to Western European languages. Only one system has been fully deployed. CONCLUSIONS: MT is currently being developed primarily through pilot studies to improve multilingual communication in health settings and to increase access to health resources for a variety of languages. However, continued concerns about accuracy limit the deployment of MT systems in these settings. The variety of piloted systems and the lack of shared evaluation criteria will likely continue to impede adoption in health settings, where excellent accuracy and a strong evidence base are critical. Greater translation accuracy and use of standard evaluation criteria would encourage deployment of MT into health settings. For now, the literature points to using MT in health communication as an initial step to be followed by human correction.
OBJECTIVES: To (1) characterize how machine translation (MT) is being developed to overcome language barriers in health settings; and (2) based on evaluations presented in the literature, determine which MT approaches show evidence of promise and what steps need to be taken to encourage adoption of MT technologies in health settings. MATERIALS & METHODS: We performed a systematic literature search covering 2006-2016 in major health, engineering, and computer science databases. After removing duplicates, two levels of screening identified 27 articles for full text review and analysis. Our review and qualitative analysis covered application setting, target users, underlying technology, whether MT was used in isolation or in combination with human editing, languages tested, evaluation methods, findings, and identified gaps. RESULTS: Of 27 studies, a majority focused on MT systems for use in clinical settings (n = 18), and eight of these involved speech-based MT systems for facilitating patient-provider communications. Text-based MT systems (n = 19) aimed at generating a range of multilingual health materials. Almost a third of all studies (n = 8) pointed to MT's potential as a starting point before human input. Studies employed a variety of human and automatic MT evaluation methods. In comparison studies, statistical machine translation (SMT) systems were more accurate than rule-based systems when large corpora were available. For a variety of systems, performance was best for translations of simple, less technical sentences and from English to Western European languages. Only one system has been fully deployed. CONCLUSIONS: MT is currently being developed primarily through pilot studies to improve multilingual communication in health settings and to increase access to health resources for a variety of languages. However, continued concerns about accuracy limit the deployment of MT systems in these settings. The variety of piloted systems and the lack of shared evaluation criteria will likely continue to impede adoption in health settings, where excellent accuracy and a strong evidence base are critical. Greater translation accuracy and use of standard evaluation criteria would encourage deployment of MT into health settings. For now, the literature points to using MT in health communication as an initial step to be followed by human correction.
Authors: Anne M Turner; Yong K Choi; Kristin Dew; Ming-Tse Tsai; Alyssa L Bosold; Shuyang Wu; Donahue Smith; Hendrika Meischke Journal: JMIR Public Health Surveill Date: 2019-01-28