Charles L Bormann1, Prudhvi Thirumalaraju2, Manoj Kumar Kanakasabapathy2, Hemanth Kandula2, Irene Souter3, Irene Dimitriadis1, Raghav Gupta2, Rohan Pooniwala2, Hadi Shafiee4. 1. Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts; Department of Medicine, Harvard Medical School, Boston, Massachusetts. 2. Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts. 3. Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts. 4. Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts; Department of Medicine, Harvard Medical School, Boston, Massachusetts. Electronic address: hshafiee@bwh.harvard.edu.
Abstract
OBJECTIVE: To evaluate the consistency and objectivity of deep neural networks in embryo scoring and making disposition decisions for biopsy and cryopreservation in comparison to grading by highly trained embryologists. DESIGN: Prospective double-blind study using retrospective data. SETTING: U.S.-based large academic fertility center. PATIENTS: Not applicable. INTERVENTION(S): Embryo images (748 recorded at 70 hours postinsemination [hpi]) and 742 at 113 hpi) were used to evaluate embryologists and neural networks in embryo grading. The performance of 10 embryologists and a neural network were also evaluated in disposition decision making using 56 embryos. MAIN OUTCOME MEASURES: Coefficients of variation (%CV) and measures of consistencies were compared. RESULTS: Embryologists exhibited a high degree of variability (%CV averages: 82.84% for 70 hpi and 44.98% for 113 hpi) in grading embryo. When selecting blastocysts for biopsy or cryopreservation, embryologists had an average consistency of 52.14% and 57.68%, respectively. The neural network outperformed the embryologists in selecting blastocysts for biopsy and cryopreservation with a consistency of 83.92%. Cronbach's α analysis revealed an α coefficient of 0.60 for the embryologists and 1.00 for the network. CONCLUSIONS: The results of our study show a high degree of interembryologist and intraembryologist variability in scoring embryos, likely due to the subjective nature of traditional morphology grading. This may ultimately lead to less precise disposition decisions and discarding of viable embryos. The application of a deep neural network, as shown in our study, can introduce improved reliability and high consistency during the process of embryo selection and disposition, potentially improving outcomes in an embryology laboratory.
OBJECTIVE: To evaluate the consistency and objectivity of deep neural networks in embryo scoring and making disposition decisions for biopsy and cryopreservation in comparison to grading by highly trained embryologists. DESIGN: Prospective double-blind study using retrospective data. SETTING: U.S.-based large academic fertility center. PATIENTS: Not applicable. INTERVENTION(S): Embryo images (748 recorded at 70 hours postinsemination [hpi]) and 742 at 113 hpi) were used to evaluate embryologists and neural networks in embryo grading. The performance of 10 embryologists and a neural network were also evaluated in disposition decision making using 56 embryos. MAIN OUTCOME MEASURES: Coefficients of variation (%CV) and measures of consistencies were compared. RESULTS: Embryologists exhibited a high degree of variability (%CV averages: 82.84% for 70 hpi and 44.98% for 113 hpi) in grading embryo. When selecting blastocysts for biopsy or cryopreservation, embryologists had an average consistency of 52.14% and 57.68%, respectively. The neural network outperformed the embryologists in selecting blastocysts for biopsy and cryopreservation with a consistency of 83.92%. Cronbach's α analysis revealed an α coefficient of 0.60 for the embryologists and 1.00 for the network. CONCLUSIONS: The results of our study show a high degree of interembryologist and intraembryologist variability in scoring embryos, likely due to the subjective nature of traditional morphology grading. This may ultimately lead to less precise disposition decisions and discarding of viable embryos. The application of a deep neural network, as shown in our study, can introduce improved reliability and high consistency during the process of embryo selection and disposition, potentially improving outcomes in an embryology laboratory.
Authors: V W Fitz; M K Kanakasabapathy; P Thirumalaraju; H Kandula; L B Ramirez; L Boehnlein; J E Swain; C L Curchoe; K James; I Dimitriadis; I Souter; C L Bormann; H Shafiee Journal: J Assist Reprod Genet Date: 2021-09-17 Impact factor: 3.357
Authors: Manoj Kumar Kanakasabapathy; Prudhvi Thirumalaraju; Hemanth Kandula; Fenil Doshi; Anjali Devi Sivakumar; Deeksha Kartik; Raghav Gupta; Rohan Pooniwala; John A Branda; Athe M Tsibris; Daniel R Kuritzkes; John C Petrozza; Charles L Bormann; Hadi Shafiee Journal: Nat Biomed Eng Date: 2021-06-10 Impact factor: 25.671