Sehrish Bari1, Joseph Incorvia1, Katherine R Iverson1,2, Abebe Bekele3, Kaya Garringer1, Olivia Ahearn1, Laura Drown1, Amanu Aragaw Emiru4, Daniel Burssa5, Samson Workineh6, Ephrem Daniel Sheferaw6, John G Meara1,7, Andualem Beyene8. 1. Program in Global Surgery and Social Change, Harvard Medical School , Boston, MA, USA. 2. University of California, Davis Medical Center , Sacramento, CA, USA. 3. University of Global Health Equity, School of Medicine , Kigali, Rwanda. 4. College of Medicine and Health Sciences, School of Public Health, Department of Reproductive Health and Population Studies, Bahir Dar University , Bahir Dar, Ethiopia. 5. Ethiopian Federal Ministry of Health, State Minister's Office , Addis Ababa, Ethiopia. 6. Jhpiego , Addis Ababa, Ethiopia. 7. Department of Plastic and Oral Surgery, Boston Children's Hospital , Boston, MA, USA. 8. Department of Surgery, Addis Ababa University School of Medicine , Addis Ababa, Ethiopia.
Abstract
Background: One key challenge in improving surgical care in resource-limited settings is the lack of high-quality and informative data. In Ethiopia, the Safe Surgery 2020 (SS2020) project developed surgical key performance indicators (KPIs) to evaluate surgical care within the country. New data collection methods were developed and piloted in 10 SS2020 intervention hospitals in the Amhara and Tigray regions of Ethiopia. Objective: To assess the feasibility of collecting and reporting new surgical indicators and measure the impact of a surgical Data Quality Intervention (DQI) in rural Ethiopian hospitals. Methods: An 8-week DQI was implemented to roll-out new data collection tools in SS2020 hospitals. The Kirkpatrick Method, a widely used mixed-method evaluation framework for training programs, was used to assess the impact of the DQI. Feedback surveys and focus groups at various timepoints evaluated the impact of the intervention on surgical data quality, the feasibility of a new data collection system, and the potential for national scale-up. Results: Results of the evaluation are largely positive and promising. DQI participants reported knowledge gain, behavior change, and improved surgical data quality, as well as greater teamwork, communication, leadership, and accountability among surgical staff. Barriers remained in collection of high-quality data, such as lack of adequate human resources and electronic data reporting infrastructure. Conclusions: Study results are largely positive and make evident that surgical data capture is feasible in low-resource settings and warrants more investment in global surgery efforts. This type of training and mentorship model can be successful in changing individual behavior and institutional culture regarding surgical data collection and reporting. Use of the Kirkpatrick Framework for evaluation of a surgical DQI is an innovative contribution to literature and can be easily adapted and expanded for use within global surgery.
Background: One key challenge in improving surgical care in resource-limited settings is the lack of high-quality and informative data. In Ethiopia, the Safe Surgery 2020 (SS2020) project developed surgical key performance indicators (KPIs) to evaluate surgical care within the country. New data collection methods were developed and piloted in 10 SS2020 intervention hospitals in the Amhara and Tigray regions of Ethiopia. Objective: To assess the feasibility of collecting and reporting new surgical indicators and measure the impact of a surgical Data Quality Intervention (DQI) in rural Ethiopian hospitals. Methods: An 8-week DQI was implemented to roll-out new data collection tools in SS2020 hospitals. The Kirkpatrick Method, a widely used mixed-method evaluation framework for training programs, was used to assess the impact of the DQI. Feedback surveys and focus groups at various timepoints evaluated the impact of the intervention on surgical data quality, the feasibility of a new data collection system, and the potential for national scale-up. Results: Results of the evaluation are largely positive and promising. DQI participants reported knowledge gain, behavior change, and improved surgical data quality, as well as greater teamwork, communication, leadership, and accountability among surgical staff. Barriers remained in collection of high-quality data, such as lack of adequate human resources and electronic data reporting infrastructure. Conclusions: Study results are largely positive and make evident that surgical data capture is feasible in low-resource settings and warrants more investment in global surgery efforts. This type of training and mentorship model can be successful in changing individual behavior and institutional culture regarding surgical data collection and reporting. Use of the Kirkpatrick Framework for evaluation of a surgical DQI is an innovative contribution to literature and can be easily adapted and expanded for use within global surgery.
Entities:
Keywords:
Ethiopia; Global surgery; Kirkpatrick evaluation; monitoring and evaluation in safe surgery; safe surgery
Authors: Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde Journal: J Biomed Inform Date: 2008-09-30 Impact factor: 6.317
Authors: John G Meara; Andrew J M Leather; Lars Hagander; Blake C Alkire; Nivaldo Alonso; Emmanuel A Ameh; Stephen W Bickler; Lesong Conteh; Anna J Dare; Justine Davies; Eunice Dérivois Mérisier; Shenaaz El-Halabi; Paul E Farmer; Atul Gawande; Rowan Gillies; Sarah L M Greenberg; Caris E Grimes; Russell L Gruen; Edna Adan Ismail; Thaim Buya Kamara; Chris Lavy; Ganbold Lundeg; Nyengo C Mkandawire; Nakul P Raykar; Johanna N Riesel; Edgar Rodas; John Rose; Nobhojit Roy; Mark G Shrime; Richard Sullivan; Stéphane Verguet; David Watters; Thomas G Weiser; Iain H Wilson; Gavin Yamey; Winnie Yip Journal: Lancet Date: 2015-04-26 Impact factor: 79.321
Authors: Sarah Gimbel; Moses Mwanza; Marie Paul Nisingizwe; Cathy Michel; Lisa Hirschhorn Journal: BMC Health Serv Res Date: 2017-12-21 Impact factor: 2.655
Authors: Kristin L Close; Linden S Baxter; Vaonandianina A Ravelojaona; Hasiniaina N Rakotoarison; Emily Bruno; Alison Herbert; Vanessa Andean; James Callahan; Hery H Andriamanjato; Michelle C White Journal: BMJ Glob Health Date: 2017-09-29
Authors: Bradley H Wagenaar; Lisa R Hirschhorn; Catherine Henley; Artur Gremu; Ntazana Sindano; Roma Chilengi Journal: BMC Health Serv Res Date: 2017-12-21 Impact factor: 2.655
Authors: Michelle C White; Kirsten Randall; Vaonandianina A Ravelojaona; Hery H Andriamanjato; Vanessa Andean; James Callahan; Mark G Shrime; Stephanie Russ; Andrew J M Leather; Nick Sevdalis Journal: BMJ Glob Health Date: 2018-12-20