Anna M Modest1,2,3, Lauren A Wise3, Matthew P Fox3,4, Jennifer Weuve3, Alan S Penzias1,5, Michele R Hacker1,2,6. 1. Department of Obstetrics and Gynecology, Beth Israel Deaconess Medical Center, 30 Brookline Avenue, Boston, MA, USA. 2. Department of Obstetrics, Gynecology, and Reproductive Biology, Harvard Medical School, 25 Shattuck Street, Boston, MA, USA. 3. Department of Epidemiology, Boston University School of Public Health, 715 Albany Street, Boston, MA, USA. 4. Department of Global Health, Boston University School of Public Health, 715 Albany Street, Boston, MA, USA. 5. Boston IVF, 130 Second Avenue, Waltham, MA, USA. 6. Department of Epidemiology, Harvard T. H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA.
Abstract
STUDY QUESTION: Does inverse probability weighting (IPW) provide a more valid estimate of the cumulative incidence of live birth after multiple cycles of IVF? SUMMARY ANSWER: IPW can provide a more accurate estimate of treatment success for counseling and decision-making regarding IVF. WHAT IS KNOWN ALREADY: Different approaches have been used to define and calculate IVF success; however, many of these approaches have limitations and potentially violate statistical assumptions. IPW can address potential selection bias that arises when people do not continue IVF treatment after a failed cycle. STUDY DESIGN, SIZE, DURATION: Data were derived from a cohort study of women undergoing their first fresh embryo transfer IVF cycle at our institution between 1 January 1995 and 31 December 2014. All autologous cycles (fresh and frozen) were included, up to six total cycles. PARTICIPANTS/MATERIALS, SETTING, METHODS: We identified 20 015 women who underwent 47 079 IVF cycles and had 10 031 live births during the study period. The cumulative incidence of live birth was calculated using three approaches. First, we used a standard Kaplan-Meier approach, 'the optimistic approach', censoring women when they dropped out of treatment. Second, we used a 'conservative' Kaplan-Meier approach that assumed women who dropped out of treatment did not achieve a live birth. Finally, we used IPW to calculate the probability of remaining in treatment, while accounting for differences in treatment drop out. IPW up-weights the data of those remaining under observation who resembled the women who dropped out of treatment, thereby decreasing the potential selection bias resulting from loss to follow-up. The IPW was incorporated into a Kaplan-Meier approach. MAIN RESULTS AND THE ROLE OF CHANCE: The cumulative incidence of live birth was 72.1% (95% CI: 71.0-73.1%) for the optimistic approach, 50.1% (49.4-50.8%) for the conservative approach and 66.8% (65.5-68.1%) for the IPW approach. Among women < 38 years of age, the cumulative incidence of live birth calculated by the IPW was slightly higher than that calculated by the optimistic approach. For women 41-42 years of age, the IPW cumulative incidence of live birth was slightly lower. The IPW was similar to the optimistic approach for the other age groups. The conservative estimate was lowest for all age groups. LIMITATIONS, REASONS FOR CAUTION: Only clinical data recorded by the providers during an IVF cycle were used to generate weights for IPW. Covariates included: age, gravidity and year at the start of the cycle; primary infertility diagnosis; procedure type (i.e. whether a fresh or frozen embryo was transferred); number of mature oocytes retrieved; number of embryos transferred; cycle cancellation; pregnancy loss in the cycle; and insurance status. We were unable to determine exact reasons for treatment drop out (e.g. cessation of IVF treatment, transfer to another institution or spontaneous pregnancy). Our IPW model was moderately predictive based on the c-statistic from the calculation of the denominator of the weight; however, residual selection bias may remain due to the limited range of covariate data. WIDER IMPLICATIONS OF THE FINDINGS: IPW can be used in a variety of settings to address selection bias introduced by differential loss to follow up or treatment drop out. STUDY FUNDING/COMPETING INTEREST(S): AMM was supported by National Institutes of Health (NIH) T32 HD052458-Boston University Reproductive, Perinatal and Pediatric Epidemiology Training Program. The authors report no conflicts of interest. TRIAL REGISTRATION NUMBER: N/A.
STUDY QUESTION: Does inverse probability weighting (IPW) provide a more valid estimate of the cumulative incidence of live birth after multiple cycles of IVF? SUMMARY ANSWER: IPW can provide a more accurate estimate of treatment success for counseling and decision-making regarding IVF. WHAT IS KNOWN ALREADY: Different approaches have been used to define and calculate IVF success; however, many of these approaches have limitations and potentially violate statistical assumptions. IPW can address potential selection bias that arises when people do not continue IVF treatment after a failed cycle. STUDY DESIGN, SIZE, DURATION: Data were derived from a cohort study of women undergoing their first fresh embryo transfer IVF cycle at our institution between 1 January 1995 and 31 December 2014. All autologous cycles (fresh and frozen) were included, up to six total cycles. PARTICIPANTS/MATERIALS, SETTING, METHODS: We identified 20 015 women who underwent 47 079 IVF cycles and had 10 031 live births during the study period. The cumulative incidence of live birth was calculated using three approaches. First, we used a standard Kaplan-Meier approach, 'the optimistic approach', censoring women when they dropped out of treatment. Second, we used a 'conservative' Kaplan-Meier approach that assumed women who dropped out of treatment did not achieve a live birth. Finally, we used IPW to calculate the probability of remaining in treatment, while accounting for differences in treatment drop out. IPW up-weights the data of those remaining under observation who resembled the women who dropped out of treatment, thereby decreasing the potential selection bias resulting from loss to follow-up. The IPW was incorporated into a Kaplan-Meier approach. MAIN RESULTS AND THE ROLE OF CHANCE: The cumulative incidence of live birth was 72.1% (95% CI: 71.0-73.1%) for the optimistic approach, 50.1% (49.4-50.8%) for the conservative approach and 66.8% (65.5-68.1%) for the IPW approach. Among women < 38 years of age, the cumulative incidence of live birth calculated by the IPW was slightly higher than that calculated by the optimistic approach. For women 41-42 years of age, the IPW cumulative incidence of live birth was slightly lower. The IPW was similar to the optimistic approach for the other age groups. The conservative estimate was lowest for all age groups. LIMITATIONS, REASONS FOR CAUTION: Only clinical data recorded by the providers during an IVF cycle were used to generate weights for IPW. Covariates included: age, gravidity and year at the start of the cycle; primary infertility diagnosis; procedure type (i.e. whether a fresh or frozen embryo was transferred); number of mature oocytes retrieved; number of embryos transferred; cycle cancellation; pregnancy loss in the cycle; and insurance status. We were unable to determine exact reasons for treatment drop out (e.g. cessation of IVF treatment, transfer to another institution or spontaneous pregnancy). Our IPW model was moderately predictive based on the c-statistic from the calculation of the denominator of the weight; however, residual selection bias may remain due to the limited range of covariate data. WIDER IMPLICATIONS OF THE FINDINGS: IPW can be used in a variety of settings to address selection bias introduced by differential loss to follow up or treatment drop out. STUDY FUNDING/COMPETING INTEREST(S): AMM was supported by National Institutes of Health (NIH) T32 HD052458-Boston University Reproductive, Perinatal and Pediatric Epidemiology Training Program. The authors report no conflicts of interest. TRIAL REGISTRATION NUMBER: N/A.
Authors: Alexandra J Bensdorp; Raissa Tjon-Kon-Fat; Harold Verhoeve; Carolien Koks; Peter Hompes; Annemieke Hoek; Jan Peter de Bruin; Ben Cohlen; Diederik Hoozemans; Frank Broekmans; Peter van Bomme; Jesper Smeenk; Ben W J Mol; Fulco van der Veen; Madelon van Wely Journal: Eur J Obstet Gynecol Reprod Biol Date: 2016-08-10 Impact factor: 2.435
Authors: Lauren E Cain; Michael S Saag; Maya Petersen; Margaret T May; Suzanne M Ingle; Roger Logan; James M Robins; Sophie Abgrall; Bryan E Shepherd; Steven G Deeks; M John Gill; Giota Touloumi; Georgia Vourli; François Dabis; Marie-Anne Vandenhende; Peter Reiss; Ard van Sighem; Hasina Samji; Robert S Hogg; Jan Rybniker; Caroline A Sabin; Sophie Jose; Julia Del Amo; Santiago Moreno; Benigno Rodríguez; Alessandro Cozzi-Lepri; Stephen L Boswell; Christoph Stephan; Santiago Pérez-Hoyos; Inma Jarrin; Jodie L Guest; Antonella D'Arminio Monforte; Andrea Antinori; Richard Moore; Colin Nj Campbell; Jordi Casabona; Laurence Meyer; Rémonie Seng; Andrew N Phillips; Heiner C Bucher; Matthias Egger; Michael J Mugavero; Richard Haubrich; Elvin H Geng; Ashley Olson; Joseph J Eron; Sonia Napravnik; Mari M Kitahata; Stephen E Van Rompaey; Ramón Teira; Amy C Justice; Janet P Tate; Dominique Costagliola; Jonathan Ac Sterne; Miguel A Hernán Journal: Int J Epidemiol Date: 2016-12-01 Impact factor: 9.685
Authors: Jennifer Yland; Carmen Messerlian; Lidia Mínguez-Alarcón; Jennifer B Ford; Russ Hauser; Paige L Williams Journal: Hum Reprod Date: 2019-03-01 Impact factor: 6.918
Authors: Laura E Dodge; Leslie V Farland; Katharine F B Correia; Stacey A Missmer; Emily A Seidler; Jack Wilkinson; Anna M Modest; Michele R Hacker Journal: Hum Reprod Date: 2020-07-01 Impact factor: 6.918
Authors: Juan J Tarín; Eva Pascual; Santiago Pérez-Hoyos; Raúl Gómez; Miguel A García-Pérez; Antonio Cano Journal: J Assist Reprod Genet Date: 2019-12-05 Impact factor: 3.412
Authors: Juan J Tarín; Eva Pascual; Miguel A García-Pérez; Raúl Gómez; Juan J Hidalgo-Mora; Antonio Cano Journal: J Assist Reprod Genet Date: 2019-12-03 Impact factor: 3.412
Authors: Alexandra C Purdue-Smithe; Keewan Kim; Carrie Nobles; Enrique F Schisterman; Karen C Schliep; Neil J Perkins; Lindsey A Sjaarda; Joshua R Freeman; Sonia L Robinson; Jeannie G Radoc; James L Mills; Robert M Silver; Aijun Ye; Sunni L Mumford Journal: Nat Commun Date: 2021-05-13 Impact factor: 14.919
Authors: Joseph B Stanford; Tracey Parnell; Kristi Kantor; Matthew R Reeder; Shahpar Najmabadi; Karen Johnson; Iris Musso; Hanna Hartman; Elizabeth Tham; Ira Winter; Krzysztof Galczynski; Anne Carus; Amy Sherlock; Jean Golden Tevald; Maciej Barczentewicz; Barbara Meier; Paul Carpentier; Karen Poehailos; Robert Chasuk; Peter Danis; Lewis Lipscomb Journal: Hum Reprod Open Date: 2022-08-09