Robert Davies1, Elly Vaughan2, Graham Fraser3, Robert Cook2, Massimo Ciotti3, Jonathan E Suk3. 1. 1Public Health Directorate,St Helens and Knowsley Teaching Hospitals NHS Trust,West Midlands,England. 2. 2Bazian Ltd,An Economist Intelligence Unit Business,London,England. 3. 3Country Preparedness Section,European Centre for Disease Prevention and Control,Stockholm,Sweden.
Abstract
OBJECTIVE: This literature review aimed to identify the range of methods used in after action reviews (AARs) of public health emergencies and to develop appraisal tools to compare methodological reporting and validity standards. METHODS: A review of biomedical and gray literature identified key approaches from AAR methodological research, real-world AARs, and AAR reporting templates. We developed a 50-item tool to systematically document AAR methodological reporting and a linked 11-item summary tool to document validity. Both tools were used sequentially to appraise the literature included in this study. RESULTS: This review included 24 highly diverse papers, reflecting the lack of a standardized approach. We observed significant divergence between the standards described in AAR and qualitative research literature, and real-world AAR practice. The lack of reporting of basic methods to ensure validity increases doubt about the methodological basis of an individual AAR and the validity of its conclusions. CONCLUSIONS: The main limitations in current AAR methodology and reporting standards may be addressed through our 11 validity-enhancing recommendations. A minimum reporting standard for AARs could help ensure that findings are valid and clear for others to learn from. A registry of AARs, based on a common reporting structure, may further facilitate shared learning. (Disaster Med Public Health Preparedness. 2019;13:618-625).
OBJECTIVE: This literature review aimed to identify the range of methods used in after action reviews (AARs) of public health emergencies and to develop appraisal tools to compare methodological reporting and validity standards. METHODS: A review of biomedical and gray literature identified key approaches from AAR methodological research, real-world AARs, and AAR reporting templates. We developed a 50-item tool to systematically document AAR methodological reporting and a linked 11-item summary tool to document validity. Both tools were used sequentially to appraise the literature included in this study. RESULTS: This review included 24 highly diverse papers, reflecting the lack of a standardized approach. We observed significant divergence between the standards described in AAR and qualitative research literature, and real-world AAR practice. The lack of reporting of basic methods to ensure validity increases doubt about the methodological basis of an individual AAR and the validity of its conclusions. CONCLUSIONS: The main limitations in current AAR methodology and reporting standards may be addressed through our 11 validity-enhancing recommendations. A minimum reporting standard for AARs could help ensure that findings are valid and clear for others to learn from. A registry of AARs, based on a common reporting structure, may further facilitate shared learning. (Disaster Med Public Health Preparedness. 2019;13:618-625).
Keywords:
after action reviews; emergency preparedness; epidemics; outbreaks; public health
Authors: Michael A Stoto; Christopher Nelson; Rachael Piltch-Loeb; Landry Ndriko Mayigane; Frederik Copper; Stella Chungong Journal: Global Health Date: 2019-10-10 Impact factor: 4.185