Elliott K Main1, Anisha Abreo2, Jennifer McNulty3, William Gilbert4, Colleen McNally5, Debra Poeltler5, Katarina Lanner-Cusin6, Douglas Fenton7, Theresa Gipps8, Kathryn Melsop2, Naomi Greene9, Jeffrey B Gould2, Sarah Kilpatrick9. 1. California Maternal Quality Care Collaborative, Stanford University, Palo Alto, CA. Electronic address: main@cmqcc.org. 2. California Maternal Quality Care Collaborative, Stanford University, Palo Alto, CA. 3. Long Beach Memorial Miller Children's and Women's Hospital, Long Beach, CA. 4. Sutter Medical Center, Sacramento, CA. 5. Sharp Mary Birch Hospital for Women & Newborns, San Diego, CA. 6. Alta Bates Summit Medical Center, Oakland, CA. 7. Scripps Healthcare, Scripps Memorial Hospital Encinitas, CA. 8. Community Regional Medical Center, Fresno, CA. 9. Cedars-Sinai Medical Center, Los Angeles, CA.
Abstract
BACKGROUND: Both maternal mortality rate and severe maternal morbidity rate have risen significantly in the United Sates. Recently, the Centers for Disease Control and Prevention introduced International Classification of Diseases, 9th revision, criteria for defining severe maternal morbidity with the use of administrative data sources; however, those criteria have not been validated with the use of chart reviews. OBJECTIVE: The primary aim of the current study was to validate the Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, criteria for the identification of severe maternal morbidity. This analysis initially required the development of a reproducible set of clinical conditions that were judged to be consistent with severe maternal morbidity to be used as the clinical gold standard for validation. Alternative criteria for severe maternal morbidity were also examined. STUDY DESIGN: The 67,468 deliveries that occurred during a 12-month period from 16 participating California hospitals were screened initially for severe maternal morbidity with the presence of any of 4 criteria: (1) Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, diagnosis and procedure codes; (2) prolonged postpartum length of stay (>3 standard deviations beyond the mean length of stay for the California population); (3) any maternal intensive care unit admissions (with the use of hospital billing sources); and (4) the administration of any blood product (with the use of transfusion service data). Complete medical records for all screen-positive cases were examined to determine whether they satisfied the criteria for the clinical gold standard (determined by 4 rounds of a modified Delphi technique). Descriptive and statistical analyses that included area under the receiver operating characteristic curve and C-statistic were performed. RESULTS: The Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, criteria had a reasonably high sensitivity of 0.77 and a positive predictive value of 0.44 with a C-statistic of 0.87. The most important source of false-positive cases were mothers whose only criterion was 1-2 units of blood products. The Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, criteria screen rate ranged from 0.51-2.45% among hospitals. True positive severe maternal morbidity ranged from 0.05-1.13%. When hospitals were grouped by their neonatal intensive care unit level of care, severe maternal morbidity rates were statistically lower at facilities with lower level neonatal intensive care units (P < .0001). CONCLUSION: The Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, criteria can serve as a reasonable administrative metric for measuring severe maternal morbidity at population levels. Caution should be used with the use of these criteria for individual hospitals, because case-mix effects appear to be strong.
BACKGROUND: Both maternal mortality rate and severe maternal morbidity rate have risen significantly in the United Sates. Recently, the Centers for Disease Control and Prevention introduced International Classification of Diseases, 9th revision, criteria for defining severe maternal morbidity with the use of administrative data sources; however, those criteria have not been validated with the use of chart reviews. OBJECTIVE: The primary aim of the current study was to validate the Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, criteria for the identification of severe maternal morbidity. This analysis initially required the development of a reproducible set of clinical conditions that were judged to be consistent with severe maternal morbidity to be used as the clinical gold standard for validation. Alternative criteria for severe maternal morbidity were also examined. STUDY DESIGN: The 67,468 deliveries that occurred during a 12-month period from 16 participating California hospitals were screened initially for severe maternal morbidity with the presence of any of 4 criteria: (1) Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, diagnosis and procedure codes; (2) prolonged postpartum length of stay (>3 standard deviations beyond the mean length of stay for the California population); (3) any maternal intensive care unit admissions (with the use of hospital billing sources); and (4) the administration of any blood product (with the use of transfusion service data). Complete medical records for all screen-positive cases were examined to determine whether they satisfied the criteria for the clinical gold standard (determined by 4 rounds of a modified Delphi technique). Descriptive and statistical analyses that included area under the receiver operating characteristic curve and C-statistic were performed. RESULTS: The Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, criteria had a reasonably high sensitivity of 0.77 and a positive predictive value of 0.44 with a C-statistic of 0.87. The most important source of false-positive cases were mothers whose only criterion was 1-2 units of blood products. The Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, criteria screen rate ranged from 0.51-2.45% among hospitals. True positive severe maternal morbidity ranged from 0.05-1.13%. When hospitals were grouped by their neonatal intensive care unit level of care, severe maternal morbidity rates were statistically lower at facilities with lower level neonatal intensive care units (P < .0001). CONCLUSION: The Centers for Disease Control and Prevention International Classification of Diseases, 9th revision, criteria can serve as a reasonable administrative metric for measuring severe maternal morbidity at population levels. Caution should be used with the use of these criteria for individual hospitals, because case-mix effects appear to be strong.
Authors: Renata E Howland; Meghan Angley; Sang Hee Won; Wendy Wilcox; Hannah Searing; Sze Yan Liu; Emily White Johansson Journal: Matern Child Health J Date: 2019-03
Authors: Stephanie A Leonard; Elliott K Main; Karen A Scott; Jochen Profit; Suzan L Carmichael Journal: Ann Epidemiol Date: 2019-02-28 Impact factor: 3.797
Authors: Marian Jarlenski; Elizabeth E Krans; Qingwen Chen; Scott D Rothenberger; Abigail Cartus; Kara Zivin; Lisa M Bodnar Journal: Drug Alcohol Depend Date: 2020-08-20 Impact factor: 4.492
Authors: Kyle E Freese; Katherine P Himes; Jennifer A Hutcheon; Sara M Parisi; Maria M Brooks; Kathleen McTigue; Lisa M Bodnar Journal: Ann Epidemiol Date: 2020-06-26 Impact factor: 3.797
Authors: Elizabeth J Conrey; Susan E Manning; Cynthia Shellhaas; Nicholas J Somerville; Sarah L Stone; Hafsatou Diop; Kristin Rankin; Dave Goodman Journal: Matern Child Health J Date: 2019-08