OBJECTIVE: Hand hygiene surveillance programs that rely on direct observations of healthcare worker activity may be limited by the Hawthorne effect. In addition, comparing compliance rates from period to period requires adequately sized samples of observations. We aimed to statistically determine whether the Hawthorne effect is stable over an observation period and statistically derive sample sizes of observations necessary to compare compliance rates. DESIGN: Prospective multicenter cohort study. SETTING: Five intensive care units and 6 medical/surgical wards in 3 geographically distinct acute care hospitals. METHODS: Trained observers monitored hand hygiene compliance during routine care in fixed 1-hour periods, using a standardized collection tool. We estimated the impact of the Hawthorne effect using empirical fluctuation processes and F tests for structural change. Standard sample-size calculation methods were used to estimate how many hand hygiene opportunities are required to accurately measure hand hygiene across various levels of baseline and target compliance. RESULTS: Exit hand hygiene compliance increased after 14 minutes of observation (from 56.2% to 60.5%; P < .001) and increased further after 50 minutes (from 60.5% to 66.0%; P < .001). Entry compliance increased after 38 minutes (from 40.4% to 43.4%; P = .005). Between 79 and 723 opportunities are required during each period, depending on baseline compliance rates (range, 35%-90%) and targeted improvement (5% or 10%). CONCLUSIONS: Limiting direct observation periods to approximately 15 minutes to minimize the Hawthorne effect and determining required number of hand hygiene opportunities observed per period on the basis of statistical power calculations would be expected to improve the validity of hand hygiene surveillance programs.
OBJECTIVE: Hand hygiene surveillance programs that rely on direct observations of healthcare worker activity may be limited by the Hawthorne effect. In addition, comparing compliance rates from period to period requires adequately sized samples of observations. We aimed to statistically determine whether the Hawthorne effect is stable over an observation period and statistically derive sample sizes of observations necessary to compare compliance rates. DESIGN: Prospective multicenter cohort study. SETTING: Five intensive care units and 6 medical/surgical wards in 3 geographically distinct acute care hospitals. METHODS: Trained observers monitored hand hygiene compliance during routine care in fixed 1-hour periods, using a standardized collection tool. We estimated the impact of the Hawthorne effect using empirical fluctuation processes and F tests for structural change. Standard sample-size calculation methods were used to estimate how many hand hygiene opportunities are required to accurately measure hand hygiene across various levels of baseline and target compliance. RESULTS: Exit hand hygiene compliance increased after 14 minutes of observation (from 56.2% to 60.5%; P < .001) and increased further after 50 minutes (from 60.5% to 66.0%; P < .001). Entry compliance increased after 38 minutes (from 40.4% to 43.4%; P = .005). Between 79 and 723 opportunities are required during each period, depending on baseline compliance rates (range, 35%-90%) and targeted improvement (5% or 10%). CONCLUSIONS: Limiting direct observation periods to approximately 15 minutes to minimize the Hawthorne effect and determining required number of hand hygiene opportunities observed per period on the basis of statistical power calculations would be expected to improve the validity of hand hygiene surveillance programs.
Authors: Alissa Werzen; Kerri A Thom; Gwen L Robinson; Shanshan Li; Clare Rock; Loreen A Herwaldt; Daniel J Diekema; Heather S Reisinger; Eli N Perencevich Journal: Am J Infect Control Date: 2018-10-10 Impact factor: 2.918
Authors: Mark W Vander Weg; Eli N Perencevich; Amy M J O'Shea; Michael P Jones; Mary S Vaughan Sarrazin; Carrie L Franciscus; Cassie Cunningham Goedken; Gio J Baracco; Suzanne F Bradley; Jose Cadena; Graeme N Forrest; Kalpana Gupta; Daniel J Morgan; Michael A Rubin; Joseph Thurn; Marvin J Bittner; Heather Schacht Reisinger Journal: JAMA Netw Open Date: 2019-10-02
Authors: Daniel J Livorsi; Cassie Cunningham Goedken; Michael Sauder; Mark W Vander Weg; Eli N Perencevich; Heather Schacht Reisinger Journal: JAMA Netw Open Date: 2018-10-05