Anna M Bramley1, Sandra S Chaves1, Fatimah S Dawood1, Saumil Doshi1, Arthur Reingold2, Lisa Miller3, Kimberly Yousey-Hindes4, Monica M Farley5, Patricia Ryan6, Ruth Lynfield7, Joan Baumbach8, Shelley Zansky9, Nancy Bennett10, Ann Thomas11, William Schaffner12, Lyn Finelli1, Seema Jain1. 1. Centers for Disease Control and Prevention, National Center for Immunization and Respiratory Diseases, Influenza Division, Atlanta, GA. 2. California Emerging Infections Program, Oakland, CA. 3. Colorado Department of Public Health and Environment, Denver, CO. 4. Connecticut Emerging Infections Program, Yale School of Public Health, New Haven, CT. 5. Emory University School of Medicine and Veterans Affairs Medical Center, Atlanta, GA. 6. Maryland Department of Health and Mental Hygiene, Baltimore, MD. 7. Minnesota Department of Health, St. Paul, MN. 8. New Mexico Department of Health, Santa Fe, NM. 9. New York State Department of Health, Emerging Infections Program, Albany, NY. 10. University of Rochester School of Medicine and Dentistry, Center for Community Health and Department of Medicine, Rochester, NY. 11. Oregon Public Health Division, Portland, OR. 12. Vanderbilt University School of Medicine, Nashville, TN.
Abstract
OBJECTIVE: Transcripts from admission chest radiographs could aid in identification of pneumonia cases for public health surveillance. We assessed the reliability of radiographic data abstraction and performance of radiographic key terms to identify pneumonia in patients hospitalized with laboratory-confirmed influenza virus infection. METHODS: We used data on patients hospitalized with laboratory-confirmed influenza virus infection from October 2008 through December 2009 from 10 geographically diverse U.S. study sites participating in the Influenza Hospitalization Surveillance Network (FluSurv-NET). Radiographic key terms (i.e., bronchopneumonia, consolidation, infiltrate, airspace density, and pleural effusion) were abstracted from final impressions of chest radiograph reports. We assessed the reliability of radiographic data abstraction by examining the percent agreement and Cohen's k statistic between clinicians and surveillance staff members. Using a composite reference standard for presence or absence of pneumonia based on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes and discharge summary data, we calculated sensitivity, specificity, positive predictive value (PPV), and percent agreement for individual and combined radiographic key terms. RESULTS: For each radiographic key term, the percent agreement between clinicians and surveillance staff members ranged from 89.4% to 98.6% and Cohen's k ranged from 0.46 (moderate) to 0.84 (almost perfect). The combination of bronchopneumonia or consolidation or infiltrate or airspace density terms had sensitivity of 66.5%, specificity of 89.2%, PPV of 80.4%, and percent agreement of 80.1%. Adding pleural effusion did not result in significant changes in sensitivity, specificity, PPV, or percent agreement. CONCLUSION: Radiographic key terms abstracted by surveillance staff members from final impressions of chest radiograph reports had moderate to almost perfect reliability and could be used to identify pneumonia among patients hospitalized with laboratory-confirmed influenza virus infection. This method can inform pneumonia surveillance and aid in public health response.
OBJECTIVE: Transcripts from admission chest radiographs could aid in identification of pneumonia cases for public health surveillance. We assessed the reliability of radiographic data abstraction and performance of radiographic key terms to identify pneumonia in patients hospitalized with laboratory-confirmed influenza virus infection. METHODS: We used data on patients hospitalized with laboratory-confirmed influenza virus infection from October 2008 through December 2009 from 10 geographically diverse U.S. study sites participating in the Influenza Hospitalization Surveillance Network (FluSurv-NET). Radiographic key terms (i.e., bronchopneumonia, consolidation, infiltrate, airspace density, and pleural effusion) were abstracted from final impressions of chest radiograph reports. We assessed the reliability of radiographic data abstraction by examining the percent agreement and Cohen's k statistic between clinicians and surveillance staff members. Using a composite reference standard for presence or absence of pneumonia based on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes and discharge summary data, we calculated sensitivity, specificity, positive predictive value (PPV), and percent agreement for individual and combined radiographic key terms. RESULTS: For each radiographic key term, the percent agreement between clinicians and surveillance staff members ranged from 89.4% to 98.6% and Cohen's k ranged from 0.46 (moderate) to 0.84 (almost perfect). The combination of bronchopneumonia or consolidation or infiltrate or airspace density terms had sensitivity of 66.5%, specificity of 89.2%, PPV of 80.4%, and percent agreement of 80.1%. Adding pleural effusion did not result in significant changes in sensitivity, specificity, PPV, or percent agreement. CONCLUSION: Radiographic key terms abstracted by surveillance staff members from final impressions of chest radiograph reports had moderate to almost perfect reliability and could be used to identify pneumonia among patients hospitalized with laboratory-confirmed influenza virus infection. This method can inform pneumonia surveillance and aid in public health response.
Authors: Lionel A Mandell; Richard G Wunderink; Antonio Anzueto; John G Bartlett; G Douglas Campbell; Nathan C Dean; Scott F Dowell; Thomas M File; Daniel M Musher; Michael S Niederman; Antonio Torres; Cynthia G Whitney Journal: Clin Infect Dis Date: 2007-03-01 Impact factor: 9.079
Authors: David M Hansell; Alexander A Bankier; Heber MacMahon; Theresa C McLoud; Nestor L Müller; Jacques Remy Journal: Radiology Date: 2008-01-14 Impact factor: 11.105
Authors: Fatimah S Dawood; Sandra S Chaves; Alejandro Pérez; Arthur Reingold; James Meek; Monica M Farley; Patricia Ryan; Ruth Lynfield; Craig Morin; Joan Baumbach; Nancy M Bennett; Shelley Zansky; Ann Thomas; Mary Lou Lindegren; William Schaffner; Lyn Finelli Journal: J Infect Dis Date: 2013-08-28 Impact factor: 5.226
Authors: Kimberly J O'Malley; Karon F Cook; Matt D Price; Kimberly Raiford Wildes; John F Hurdle; Carol M Ashton Journal: Health Serv Res Date: 2005-10 Impact factor: 3.402
Authors: Ewoudt M W van de Garde; Jan Jelrik Oosterheert; Marc Bonten; Robert C Kaplan; Hubert G M Leufkens Journal: J Clin Epidemiol Date: 2007-02-23 Impact factor: 6.437
Authors: Christopher A Czaja; Lisa Miller; Nisha Alden; Heidi L Wald; Charisse Nitura Cummings; Melissa A Rolfes; Evan J Anderson; Nancy M Bennett; Laurie M Billing; Shua J Chai; Seth Eckel; Robert Mansmann; Melissa McMahon; Maya L Monroe; Alison Muse; Ilene Risk; William Schaffner; Ann R Thomas; Kimberly Yousey-Hindes; Shikha Garg; Rachel K Herlihy Journal: Open Forum Infect Dis Date: 2019-07-01 Impact factor: 3.835
Authors: Shekhar Ghamande; Courtney Shaver; Kempapura Murthy; Chandni Raiyani; Heath D White; Tasnim Lat; Alejandro C Arroliga; Dayna Wyatt; H Keipp Talbot; Emily T Martin; Arnold S Monto; Richard K Zimmerman; Donald B Middleton; Fernanda P Silveira; Jill M Ferdinands; Manish M Patel; Manjusha Gaglani Journal: Clin Infect Dis Date: 2022-04-28 Impact factor: 20.999