Mackenzie A Hamilton1,2, Andrew Calzavara1, Scott D Emerson1, Mohamed Djebli1,2, Maria E Sundaram1, Adrienne K Chan2,3,4, Rafal Kustra2, Stefan D Baral5, Sharmistha Mishra3,6,7,8, Jeffrey C Kwong1,2,9,10,11,12. 1. ICES, Toronto, Ontario, Canada. 2. Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada. 3. Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada. 4. Division of Infectious Diseases, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada. 5. Department of Epidemiology, John Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America. 6. Department of Medicine, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada. 7. Institute of Medical Sciences, University of Toronto, Toronto, Ontario, Canada. 8. MAP Centre for Urban Health Solutions, St. Michael's Hospital, Li Ka Shing Knowledge Institute, Toronto, Ontario, Canada. 9. Public Health Ontario, Toronto, Ontario, Canada. 10. Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada. 11. University Health Network, Toronto, Ontario, Canada. 12. Centre for Vaccine Preventable Diseases, University of Toronto, Toronto, Ontario, Canada.
Abstract
OBJECTIVE: Routinely collected health administrative data can be used to efficiently assess disease burden in large populations, but it is important to evaluate the validity of these data. The objective of this study was to develop and validate International Classification of Disease 10th revision (ICD -10) algorithms that identify laboratory-confirmed influenza or laboratory-confirmed respiratory syncytial virus (RSV) hospitalizations using population-based health administrative data from Ontario, Canada. STUDY DESIGN AND SETTING: Influenza and RSV laboratory data from the 2014-15, 2015-16, 2016-17 and 2017-18 respiratory virus seasons were obtained from the Ontario Laboratories Information System (OLIS) and were linked to hospital discharge abstract data to generate influenza and RSV reference cohorts. These reference cohorts were used to assess the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of the ICD-10 algorithms. To minimize misclassification in future studies, we prioritized specificity and PPV in selecting top-performing algorithms. RESULTS: 83,638 and 61,117 hospitalized patients were included in the influenza and RSV reference cohorts, respectively. The best influenza algorithm had a sensitivity of 73% (95% CI 72% to 74%), specificity of 99% (95% CI 99% to 99%), PPV of 94% (95% CI 94% to 95%), and NPV of 94% (95% CI 94% to 95%). The best RSV algorithm had a sensitivity of 69% (95% CI 68% to 70%), specificity of 99% (95% CI 99% to 99%), PPV of 91% (95% CI 90% to 91%) and NPV of 97% (95% CI 97% to 97%). CONCLUSION: We identified two highly specific algorithms that best ascertain patients hospitalized with influenza or RSV. These algorithms may be applied to hospitalized patients if data on laboratory tests are not available, and will thereby improve the power of future epidemiologic studies of influenza, RSV, and potentially other severe acute respiratory infections.
OBJECTIVE: Routinely collected health administrative data can be used to efficiently assess disease burden in large populations, but it is important to evaluate the validity of these data. The objective of this study was to develop and validate International Classification of Disease 10th revision (ICD -10) algorithms that identify laboratory-confirmed influenza or laboratory-confirmed respiratory syncytial virus (RSV) hospitalizations using population-based health administrative data from Ontario, Canada. STUDY DESIGN AND SETTING:Influenza and RSV laboratory data from the 2014-15, 2015-16, 2016-17 and 2017-18 respiratory virus seasons were obtained from the Ontario Laboratories Information System (OLIS) and were linked to hospital discharge abstract data to generate influenza and RSV reference cohorts. These reference cohorts were used to assess the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of the ICD-10 algorithms. To minimize misclassification in future studies, we prioritized specificity and PPV in selecting top-performing algorithms. RESULTS: 83,638 and 61,117 hospitalized patients were included in the influenza and RSV reference cohorts, respectively. The best influenza algorithm had a sensitivity of 73% (95% CI 72% to 74%), specificity of 99% (95% CI 99% to 99%), PPV of 94% (95% CI 94% to 95%), and NPV of 94% (95% CI 94% to 95%). The best RSV algorithm had a sensitivity of 69% (95% CI 68% to 70%), specificity of 99% (95% CI 99% to 99%), PPV of 91% (95% CI 90% to 91%) and NPV of 97% (95% CI 97% to 97%). CONCLUSION: We identified two highly specific algorithms that best ascertain patients hospitalized with influenza or RSV. These algorithms may be applied to hospitalized patients if data on laboratory tests are not available, and will thereby improve the power of future epidemiologic studies of influenza, RSV, and potentially other severe acute respiratory infections.
Authors: Jeffrey C Kwong; Sarah A Buchan; Hannah Chung; Michael A Campitelli; Kevin L Schwartz; Natasha S Crowcroft; Michael L Jackson; Timothy Karnauchow; Kevin Katz; Allison J McGeer; J Dayre McNally; David C Richardson; Susan E Richardson; Laura C Rosella; Andrew Simor; Marek Smieja; George Zahariadis; Aaron Campigotto; Jonathan B Gubbay Journal: Vaccine Date: 2019-06-17 Impact factor: 3.641
Authors: Kristen A Feemster; Kateri H Leckerman; Maria Middleton; Danielle M Zerr; Alexis M Elward; Jason G Newland; Lindsey Asti; Rebecca M Guth; Rangaraj Selvarangan; Susan E Coffin Journal: J Pediatric Infect Dis Soc Date: 2012-07-02 Impact factor: 3.164
Authors: Ron Keren; Anna Wheeler; Susan E Coffin; Theoklis Zaoutis; Richard Hodinka; Kateri Heydon Journal: Emerg Infect Dis Date: 2006-10 Impact factor: 6.883
Authors: Nicola Marsden-Haug; Virginia B Foster; Philip L Gould; Eugene Elbert; Hailiang Wang; Julie A Pavlin Journal: Emerg Infect Dis Date: 2007-02 Impact factor: 6.883
Authors: Andrea Pisesky; Eric I Benchimol; Coralie A Wong; Charles Hui; Megan Crowe; Marc-Andre Belair; Supichaya Pojsupap; Tim Karnauchow; Katie O'Hearn; Abdool S Yasseen; James D McNally Journal: PLoS One Date: 2016-03-09 Impact factor: 3.240
Authors: Amol A Verma; Tejasvi Hora; Hae Young Jung; Michael Fralick; Sarah L Malecki; Lauren Lapointe-Shaw; Adina Weinerman; Terence Tang; Janice L Kwan; Jessica J Liu; Shail Rawal; Timothy C Y Chan; Angela M Cheung; Laura C Rosella; Marzyeh Ghassemi; Margaret Herridge; Muhammad Mamdani; Fahad Razak Journal: CMAJ Date: 2021-02-10 Impact factor: 8.262
Authors: Joshua Nealon; Daniel Modin; Rebecca E Ghosh; Deborah Rudin; Gunnar Gislason; Helen P Booth; Jens Ulrik Stæhr Jensen; Rachael Williams; Hilary Shepherd; Eleanor Yelland; Helene Bricout; Sandra S Chaves; Tor Biering-Sørensen Journal: NPJ Vaccines Date: 2022-02-23 Impact factor: 7.344
Authors: Brittney M Snyder; Megan F Patterson; Tebeb Gebretsadik; Pingsheng Wu; Tan Ding; Rees L Lee; Kathryn M Edwards; Lindsay A Somerville; Thomas J Braciale; Justin R Ortiz; Tina V Hartert Journal: Influenza Other Respir Viruses Date: 2022-01-04 Impact factor: 4.380
Authors: Mackenzie A Hamilton; Ying Liu; Andrew Calzavara; Maria E Sundaram; Mohamed Djebli; Dariya Darvin; Stefan Baral; Rafal Kustra; Jeffrey C Kwong; Sharmistha Mishra Journal: Influenza Other Respir Viruses Date: 2022-05-24 Impact factor: 5.606
Authors: Joshua Nealon; Nieves Derqui; Caroline de Courville; Tor Biering-Sørensen; Benjamin J Cowling; Harish Nair; Sandra S Chaves Journal: Open Forum Infect Dis Date: 2022-07-21 Impact factor: 4.423
Authors: F Martinón-Torres; M Carmo; L Platero; G Drago; J L López-Belmonte; M Bangert; J Díez-Domingo; M Garcés-Sánchez Journal: BMC Infect Dis Date: 2022-09-29 Impact factor: 3.667
Authors: Amol A Verma; Tejasvi Hora; Hae Young Jung; Michael Fralick; Sarah L Malecki; Lauren Lapointe-Shaw; Adina Weinerman; Terence Tang; Janice L Kwan; Jessica J Liu; Shail Rawal; Timothy C Y Chan; Angela M Cheung; Laura C Rosella; Marzyeh Ghassemi; Margaret Herridge; Muhammad Mamdani; Fahad Razak Journal: CMAJ Date: 2021-06-07 Impact factor: 8.262
Authors: Joan Puig-Barberà; Sonia Tamames-Gómez; Pedro Plans-Rubio; José María Eiros-Bouza Journal: Int J Environ Res Public Health Date: 2022-01-12 Impact factor: 3.390