Tae Keun Yoo1, Joon Yul Choi2, Hong Kyu Kim3. 1. Department of Ophthalmology, Aerospace Medical Center, Republic of Korea Air Force, Cheongju, South Korea. Electronic address: eyetaekeunyoo@gmail.com. 2. Epilepsy Center, Neurological Institute, Cleveland Clinic, Cleveland, OH, USA. Electronic address: jychoi717@gmail.com. 3. Department of Ophthalmology, Dankook University Hospital, Dankook University College of Medicine, Cheonan, South Korea.
Abstract
PURPOSE: Orbital decompression for thyroid-associated ophthalmopathy (TAO) is an ophthalmic plastic surgery technique to prevent optic neuropathy and reduce exophthalmos. Because the postoperative appearance can significantly change, sometimes it is difficult to make decisions regarding decompression surgery. Herein, we present a deep learning technique to synthesize the realistic postoperative appearance for orbital decompression surgery. METHODS: This data-driven approach is based on a conditional generative adversarial network (GAN) to transform preoperative facial input images into predicted postoperative images. The conditional GAN model was trained on 109 pairs of matched pre- and postoperative facial images through data augmentation. RESULTS: When the conditional variable was changed, the synthesized facial image was transferred from a preoperative image to a postoperative image. The predicted postoperative images were similar to the ground truth postoperative images. We also found that GAN-based synthesized images can improve the deep learning classification performance between the pre- and postoperative status using a small training dataset. However, a relatively low quality of synthesized images was noted after a readout by clinicians. CONCLUSIONS: Using this framework, we synthesized TAO facial images that can be queried using conditioning on the orbital decompression status. The synthesized postoperative images may be helpful for patients in determining the impact of decompression surgery. However, the quality of the generated image should be further improved. The proposed deep learning technique based on a GAN can rapidly synthesize such realistic images of the postoperative appearance, suggesting that a GAN can function as a decision support tool for plastic and cosmetic surgery techniques.
PURPOSE: Orbital decompression for thyroid-associated ophthalmopathy (TAO) is an ophthalmic plastic surgery technique to prevent optic neuropathy and reduce exophthalmos. Because the postoperative appearance can significantly change, sometimes it is difficult to make decisions regarding decompression surgery. Herein, we present a deep learning technique to synthesize the realistic postoperative appearance for orbital decompression surgery. METHODS: This data-driven approach is based on a conditional generative adversarial network (GAN) to transform preoperative facial input images into predicted postoperative images. The conditional GAN model was trained on 109 pairs of matched pre- and postoperative facial images through data augmentation. RESULTS: When the conditional variable was changed, the synthesized facial image was transferred from a preoperative image to a postoperative image. The predicted postoperative images were similar to the ground truth postoperative images. We also found that GAN-based synthesized images can improve the deep learning classification performance between the pre- and postoperative status using a small training dataset. However, a relatively low quality of synthesized images was noted after a readout by clinicians. CONCLUSIONS: Using this framework, we synthesized TAO facial images that can be queried using conditioning on the orbital decompression status. The synthesized postoperative images may be helpful for patients in determining the impact of decompression surgery. However, the quality of the generated image should be further improved. The proposed deep learning technique based on a GAN can rapidly synthesize such realistic images of the postoperative appearance, suggesting that a GAN can function as a decision support tool for plastic and cosmetic surgery techniques.