Matthias Kaiser1, Andrew Tzer-Yeu Chen2, Peter Gluckman3. 1. The Centre for the Study of the Sciences and the Humanities (SVT), University of Bergen, Bergen, Norway. matthias.kaiser@uib.no. 2. Koi Tū: The Centre for Informed Futures, The University of Auckland, Auckland, New Zealand. andrew.chen@auckland.ac.nz. 3. Koi Tū: The Centre for Informed Futures, The University of Auckland, Auckland, New Zealand. pd.gluckman@auckland.ac.nz.
Abstract
BACKGROUND: This paper critically discusses the use and merits of global indices, in particular, the Global Health Security Index (GHSI; Cameron et al. https://www.ghsindex.org/#l-section--map ) in times of an imminent crisis, such as the current pandemic. This index ranked 195 countries according to their expected preparedness in the case of a pandemic or other biological threat. The coronavirus disease 2019 (Covid-19) pandemic provides the background to compare each country's predicted performance from the GHSI with the actual performance. In general, there is an inverted relation between predicted versus actual performance, i.e. the predicted top performers are among those that are the worst hit. Obviously, this reflects poorly on the potential policy uses of this index in imminent crisis management. METHODS: The paper analyses the GHSI and identifies why it may have struggled to predict actual pandemic preparedness as evidenced by the Covid-19 pandemic. The paper also uses two different data sets, one from the Worldmeter on the spread of the Covid-19 pandemics, and the other from the International Network for Government Science Advice (INGSA) Evidence-to-Policy Tracker, to draw comparisons between the actual introduction of pandemic response policies and the corresponding death rate in 29 selected countries. RESULTS: This paper analyses the reasons for the poor match between prediction and reality in the index, and mentions six general observations applying to global indices in this respect. These observations are based on methodological and conceptual analyses. The level of abstraction in these global indices builds uncertainties upon uncertainties and hides implicit value assumptions, which potentially removes them from the policy needs on the ground. CONCLUSIONS: From the analysis, the question is raised if the policy community might have better tools for decision-making in a pandemic. On the basis of data from the INGSA Evidence-to-Policy Tracker, and with backing in studies from social psychology and philosophy of science, some simple heuristics are suggested, which may be more useful than a global index.
BACKGROUND: This paper critically discusses the use and merits of global indices, in particular, the Global Health Security Index (GHSI; Cameron et al. https://www.ghsindex.org/#l-section--map ) in times of an imminent crisis, such as the current pandemic. This index ranked 195 countries according to their expected preparedness in the case of a pandemic or other biological threat. The coronavirus disease 2019 (Covid-19) pandemic provides the background to compare each country's predicted performance from the GHSI with the actual performance. In general, there is an inverted relation between predicted versus actual performance, i.e. the predicted top performers are among those that are the worst hit. Obviously, this reflects poorly on the potential policy uses of this index in imminent crisis management. METHODS: The paper analyses the GHSI and identifies why it may have struggled to predict actual pandemic preparedness as evidenced by the Covid-19 pandemic. The paper also uses two different data sets, one from the Worldmeter on the spread of the Covid-19 pandemics, and the other from the International Network for Government Science Advice (INGSA) Evidence-to-Policy Tracker, to draw comparisons between the actual introduction of pandemic response policies and the corresponding death rate in 29 selected countries. RESULTS: This paper analyses the reasons for the poor match between prediction and reality in the index, and mentions six general observations applying to global indices in this respect. These observations are based on methodological and conceptual analyses. The level of abstraction in these global indices builds uncertainties upon uncertainties and hides implicit value assumptions, which potentially removes them from the policy needs on the ground. CONCLUSIONS: From the analysis, the question is raised if the policy community might have better tools for decision-making in a pandemic. On the basis of data from the INGSA Evidence-to-Policy Tracker, and with backing in studies from social psychology and philosophy of science, some simple heuristics are suggested, which may be more useful than a global index.
Authors: Andrea Saltelli; Gabriele Bammer; Isabelle Bruno; Erica Charters; Monica Di Fiore; Emmanuel Didier; Wendy Nelson Espeland; John Kay; Samuele Lo Piano; Deborah Mayo; Roger Pielke; Tommaso Portaluri; Theodore M Porter; Arnald Puy; Ismael Rafols; Jerome R Ravetz; Erik Reinert; Daniel Sarewitz; Philip B Stark; Andrew Stirling; Jeroen van der Sluijs; Paolo Vineis Journal: Nature Date: 2020-06 Impact factor: 49.962
Authors: Enoch J Abbey; Banda A A Khalifa; Modupe O Oduwole; Samuel K Ayeh; Richard D Nudotor; Emmanuella L Salia; Oluwatobi Lasisi; Seth Bennett; Hasiya E Yusuf; Allison L Agwu; Petros C Karakousis Journal: PLoS One Date: 2020-10-07 Impact factor: 3.240
Authors: Bach Xuan Tran; Long Hoang Nguyen; Linh Phuong Doan; Tham Thi Nguyen; Giang Thu Vu; Hoa Thi Do; Huong Thi Le; Carl A Latkin; Cyrus S H Ho; Roger C M Ho Journal: PLoS One Date: 2022-09-23 Impact factor: 3.752