BACKGROUND: The World Health Organization (WHO) Tool for Situational Analysis to Assess Emergency and Essential Surgical Care (hereafter called the WHO Tool) has been used in more than 25 countries and is the largest effort to assess surgical care in the world. However, it has not yet been independently validated. Test-retest reliability is one way to validate the degree to which tests instruments are free from random error. The aim of the present field study was to determine the test-retest reliability of the WHO Tool. METHODS: The WHO Tool was mailed to 10 district hospitals in Ghana. Written instructions were provided along with a letter from the Ghana Health Services requesting the hospital administrator to complete the survey tool. After ensuring delivery and completion of the forms, the study team readministered the WHO Tool at the time of an on-site visit less than 1 month later. The results of the two tests were compared to calculate kappa statistics for each of the 152 questions in the WHO Tool. The kappa statistic is a statistical measure of the degree of agreement above what would be expected based on chance alone. RESULTS: Ten hospitals were surveyed twice over a short interval (i.e., less than 1 month). Weighted and unweighted kappa statistics were calculated for 152 questions. The median unweighted kappa for the entire survey was 0.43 (interquartile range 0-0.84). The infrastructure section (24 questions) had a median kappa of 0.81; the human resources section (13 questions) had a median kappa of 0.77; the surgical procedures section (67 questions) had a median kappa of 0.00; and the emergency surgical equipment section (48 questions) had a median kappa of 0.81. CONCLUSIONS: Hospital capacity survey questions related to infrastructure characteristics had high reliability. However, questions related to process of care had poor reliability and may benefit from supplemental data gathered by direct observation. Limitations to the study include the small sample size: 10 district hospitals in a single country. Consistent and high correlations calculated from the field testing within the present analysis suggest that the WHO Tool for Situational Analysis is a reliable tool where it measures structure and setting, but it should be revised for measuring process of care.
BACKGROUND: The World Health Organization (WHO) Tool for Situational Analysis to Assess Emergency and Essential Surgical Care (hereafter called the WHO Tool) has been used in more than 25 countries and is the largest effort to assess surgical care in the world. However, it has not yet been independently validated. Test-retest reliability is one way to validate the degree to which tests instruments are free from random error. The aim of the present field study was to determine the test-retest reliability of the WHO Tool. METHODS: The WHO Tool was mailed to 10 district hospitals in Ghana. Written instructions were provided along with a letter from the Ghana Health Services requesting the hospital administrator to complete the survey tool. After ensuring delivery and completion of the forms, the study team readministered the WHO Tool at the time of an on-site visit less than 1 month later. The results of the two tests were compared to calculate kappa statistics for each of the 152 questions in the WHO Tool. The kappa statistic is a statistical measure of the degree of agreement above what would be expected based on chance alone. RESULTS: Ten hospitals were surveyed twice over a short interval (i.e., less than 1 month). Weighted and unweighted kappa statistics were calculated for 152 questions. The median unweighted kappa for the entire survey was 0.43 (interquartile range 0-0.84). The infrastructure section (24 questions) had a median kappa of 0.81; the human resources section (13 questions) had a median kappa of 0.77; the surgical procedures section (67 questions) had a median kappa of 0.00; and the emergency surgical equipment section (48 questions) had a median kappa of 0.81. CONCLUSIONS: Hospital capacity survey questions related to infrastructure characteristics had high reliability. However, questions related to process of care had poor reliability and may benefit from supplemental data gathered by direct observation. Limitations to the study include the small sample size: 10 district hospitals in a single country. Consistent and high correlations calculated from the field testing within the present analysis suggest that the WHO Tool for Situational Analysis is a reliable tool where it measures structure and setting, but it should be revised for measuring process of care.
Authors: Thomas G Weiser; Scott E Regenbogen; Katherine D Thompson; Alex B Haynes; Stuart R Lipsitz; William R Berry; Atul A Gawande Journal: Lancet Date: 2008-06-24 Impact factor: 79.321
Authors: Reinou S Groen; Thaim B Kamara; Richmond Dixon-Cole; Steven Kwon; T Peter Kingham; Adam L Kushner Journal: World J Surg Date: 2012-08 Impact factor: 3.352
Authors: Robin T Petroze; Winta Mehtsun; Albert Nzayisenga; Georges Ntakiyiruta; Robert G Sawyer; J F Calland; J Forrest Calland Journal: World J Surg Date: 2012-09 Impact factor: 3.352
Authors: Marguerite Hoyler; Samuel R G Finlayson; Craig D McClain; John G Meara; Lars Hagander Journal: World J Surg Date: 2014-02 Impact factor: 3.352
Authors: Sandro Contini; Asadullah Taqdeer; Meena Cherian; Ahmad Shah Shokohmand; Richard Gosselin; Peter Graaff; Luc Noel Journal: World J Surg Date: 2010-03 Impact factor: 3.352
Authors: Adam Iddriss; Nestor Shivute; Stephen Bickler; Ramou Cole-Ceesay; Bakary Jargo; Fizan Abdullah; Meena Cherian Journal: Bull World Health Organ Date: 2011-05-06 Impact factor: 9.408
Authors: Christopher D Hughes; Craig D McClain; Lars Hagander; Jean Hamiltong Pierre; Reinou S Groen; Adam L Kushner; John G Meara Journal: World J Surg Date: 2013-07 Impact factor: 3.352
Authors: David A Spiegel; Fizan Abdullah; Raymond R Price; Richard A Gosselin; Stephen W Bickler Journal: World J Surg Date: 2013-07 Impact factor: 3.352