Jason L Salemi1,2, Rachel E Rutkowski2, Jean Paul Tanner2, Jennifer L Matas1, Russell S Kirby2. 1. 1 Department of Family and Community Medicine, Baylor College of Medicine, Houston, TX, USA. 2. 2 Birth Defects Surveillance Program, Department of Community and Family Health, College of Public Health, University of South Florida, Tampa, FL, USA.
Abstract
OBJECTIVES: We identified algorithms to improve the accuracy of passive surveillance programs for birth defects that rely on administrative diagnosis codes for case ascertainment and in situations where case confirmation via medical record review is not possible or is resource prohibitive. METHODS: We linked data from the 2009-2011 Florida Birth Defects Registry, a statewide, multisource, passive surveillance program, to an enhanced surveillance database with selected cases confirmed through medical record review. For each of 13 birth defects, we calculated the positive predictive value (PPV) to compare the accuracy of 4 algorithms that varied case definitions based on the number of diagnoses, medical encounters, and data sources in which the birth defect was identified. We also assessed the degree to which accuracy-improving algorithms would affect the Florida Birth Defects Registry's completeness of ascertainment. RESULTS: The PPV generated by using the original Florida Birth Defects Registry case definition (ie, suspected cases confirmed by medical record review) was 94.2%. More restrictive case definition algorithms increased the PPV to between 97.5% (identified by 1 or more codes/encounters in 1 data source) and 99.2% (identified in >1 data source). Although PPVs varied by birth defect, alternative algorithms increased accuracy for all birth defects; however, alternative algorithms also resulted in failing to ascertain 58.3% to 81.9% of cases. CONCLUSIONS: We found that surveillance programs that rely on unverified diagnosis codes can use algorithms to dramatically increase the accuracy of case finding, without having to review medical records. This can be important for etiologic studies. However, the use of increasingly restrictive case definition algorithms led to a decrease in completeness and the disproportionate exclusion of less severe cases, which could limit the widespread use of these approaches.
OBJECTIVES: We identified algorithms to improve the accuracy of passive surveillance programs for birth defects that rely on administrative diagnosis codes for case ascertainment and in situations where case confirmation via medical record review is not possible or is resource prohibitive. METHODS: We linked data from the 2009-2011 Florida Birth Defects Registry, a statewide, multisource, passive surveillance program, to an enhanced surveillance database with selected cases confirmed through medical record review. For each of 13 birth defects, we calculated the positive predictive value (PPV) to compare the accuracy of 4 algorithms that varied case definitions based on the number of diagnoses, medical encounters, and data sources in which the birth defect was identified. We also assessed the degree to which accuracy-improving algorithms would affect the Florida Birth Defects Registry's completeness of ascertainment. RESULTS: The PPV generated by using the original Florida Birth Defects Registry case definition (ie, suspected cases confirmed by medical record review) was 94.2%. More restrictive case definition algorithms increased the PPV to between 97.5% (identified by 1 or more codes/encounters in 1 data source) and 99.2% (identified in >1 data source). Although PPVs varied by birth defect, alternative algorithms increased accuracy for all birth defects; however, alternative algorithms also resulted in failing to ascertain 58.3% to 81.9% of cases. CONCLUSIONS: We found that surveillance programs that rely on unverified diagnosis codes can use algorithms to dramatically increase the accuracy of case finding, without having to review medical records. This can be important for etiologic studies. However, the use of increasingly restrictive case definition algorithms led to a decrease in completeness and the disproportionate exclusion of less severe cases, which could limit the widespread use of these approaches.
Authors: Eric M Delmelle; Cynthia H Cassell; Coline Dony; Elizabeth Radcliff; Jean Paul Tanner; Csaba Siffel; Russell S Kirby Journal: Birth Defects Res A Clin Mol Teratol Date: 2013-09-02
Authors: Suzanne R Block; Sharon M Watkins; Jason L Salemi; Rachel Rutkowski; Jean Paul Tanner; Jane A Correia; Russell S Kirby Journal: Paediatr Perinat Epidemiol Date: 2013-10-10 Impact factor: 3.980
Authors: Jennifer C Hirsch; Glenn Copeland; Janet E Donohue; Russell S Kirby; Violanda Grigorescu; James G Gurney Journal: J Pediatr Date: 2011-02-24 Impact factor: 4.406
Authors: James E Kucik; Cynthia H Cassell; Clinton J Alverson; Pamela Donohue; Jean Paul Tanner; Cynthia S Minkovitz; Jane Correia; Thomas Burke; Russell S Kirby Journal: Am J Public Health Date: 2014-07-17 Impact factor: 9.308
Authors: Jason L Salemi; Jean Paul Tanner; Suzanne B Anjohrin; Rachel E Rutkowski; Jane A Correia; Sharon M Watkins; Russell S Kirby Journal: J Registry Manag Date: 2015
Authors: Jason L Salemi; Marie Pierre; Jean Paul Tanner; Jennifer L Kornosky; Kimberlea W Hauser; Russell S Kirby; Jane D Carver Journal: Birth Defects Res A Clin Mol Teratol Date: 2009-11
Authors: Christine E Cronk; Marsha E Malloy; Andrew N Pelech; Richard E Miller; Sally A Meyer; Melissa Cowell; D Gail McCarver Journal: Birth Defects Res A Clin Mol Teratol Date: 2003-09
Authors: Elizabeth Radcliff; Cynthia H Cassell; Jean Paul Tanner; Russell S Kirby; Sharon Watkins; Jane Correia; Cora Peterson; Scott D Grosse Journal: Birth Defects Res A Clin Mol Teratol Date: 2012-11-01
Authors: Yonabeth Nava de Escalante; Aanu Abayomi; Anders Erickson; Xibiao Ye; Rosemary Armour; Laura Arbour; Sylvie Langlois; Bonnie Henry Journal: Can J Public Health Date: 2022-02-11