Literature DB >> 33552840

A survey on generative adversarial networks for imbalance problems in computer vision tasks.

Vignesh Sampath1,2, Iñaki Maurtua1, Juan José Aguilar Martín2, Aitor Gutierrez1.   

Abstract

Any computer vision application development starts off by acquiring images and data, then preprocessing and pattern recognition steps to perform a task. When the acquired images are highly imbalanced and not adequate, the desired task may not be achievable. Unfortunately, the occurrence of imbalance problems in acquired image datasets in certain complex real-world problems such as anomaly detection, emotion recognition, medical image analysis, fraud detection, metallic surface defect detection, disaster prediction, etc., are inevitable. The performance of computer vision algorithms can significantly deteriorate when the training dataset is imbalanced. In recent years, Generative Adversarial Neural Networks (GANs) have gained immense attention by researchers across a variety of application domains due to their capability to model complex real-world image data. It is particularly important that GANs can not only be used to generate synthetic images, but also its fascinating adversarial learning idea showed good potential in restoring balance in imbalanced datasets. In this paper, we examine the most recent developments of GANs based techniques for addressing imbalance problems in image data. The real-world challenges and implementations of synthetic image generation based on GANs are extensively covered in this survey. Our survey first introduces various imbalance problems in computer vision tasks and its existing solutions, and then examines key concepts such as deep generative image models and GANs. After that, we propose a taxonomy to summarize GANs based techniques for addressing imbalance problems in computer vision tasks into three major categories: 1. Image level imbalances in classification, 2. object level imbalances in object detection and 3. pixel level imbalances in segmentation tasks. We elaborate the imbalance problems of each group, and provide GANs based solutions in each group. Readers will understand how GANs based techniques can handle the problem of imbalances and boost performance of the computer vision algorithms.
© The Author(s) 2021.

Entities:  

Keywords:  Classification; Deep generative model; Deep learning; Generative adversarial neural networks; Imbalanced data; Object detection; Segmentation

Year:  2021        PMID: 33552840      PMCID: PMC7845583          DOI: 10.1186/s40537-021-00414-0

Source DB:  PubMed          Journal:  J Big Data        ISSN: 2196-1115


  26 in total

1.  Pedestrian detection: an evaluation of the state of the art.

Authors:  Piotr Dollár; Christian Wojek; Bernt Schiele; Pietro Perona
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2012-04       Impact factor: 6.226

2.  Long short-term memory.

Authors:  S Hochreiter; J Schmidhuber
Journal:  Neural Comput       Date:  1997-11-15       Impact factor: 2.026

3.  AttGAN: Facial Attribute Editing by Only Changing What You Want.

Authors:  Zhenliang He; Wangmeng Zuo; Meina Kan; Shiguang Shan; Xilin Chen
Journal:  IEEE Trans Image Process       Date:  2019-05-20       Impact factor: 10.856

4.  Focal Loss for Dense Object Detection.

Authors:  Tsung-Yi Lin; Priya Goyal; Ross Girshick; Kaiming He; Piotr Dollar
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2018-07-23       Impact factor: 6.226

5.  Multi-Task Convolutional Neural Network for Pose-Invariant Face Recognition.

Authors: 
Journal:  IEEE Trans Image Process       Date:  2018-02       Impact factor: 10.856

6.  Generative adversarial networks with decoder-encoder output noises.

Authors:  Guoqiang Zhong; Wei Gao; Yongbin Liu; Youzhao Yang; Da-Han Wang; Kaizhu Huang
Journal:  Neural Netw       Date:  2020-04-09

7.  Skin Lesion Classification Using GAN based Data Augmentation.

Authors:  Haroon Rashid; M Asjid Tanveer; Hassan Aqeel Khan
Journal:  Conf Proc IEEE Eng Med Biol Soc       Date:  2019-07

8.  On the localness modeling for the self-attention based end-to-end speech synthesis.

Authors:  Shan Yang; Heng Lu; Shiyin Kang; Liumeng Xue; Jinba Xiao; Dan Su; Lei Xie; Dong Yu
Journal:  Neural Netw       Date:  2020-02-11

9.  Mask R-CNN.

Authors:  Kaiming He; Georgia Gkioxari; Piotr Dollar; Ross Girshick
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2018-06-05       Impact factor: 6.226

10.  DeepFruits: A Fruit Detection System Using Deep Neural Networks.

Authors:  Inkyu Sa; Zongyuan Ge; Feras Dayoub; Ben Upcroft; Tristan Perez; Chris McCool
Journal:  Sensors (Basel)       Date:  2016-08-03       Impact factor: 3.576

View more
  3 in total

1.  A Tutorial on Generative Adversarial Networks with Application to Classification of Imbalanced Data.

Authors:  Yuxiao Huang; Kara G Fields; Yan Ma
Journal:  Stat Anal Data Min       Date:  2021-12-31       Impact factor: 1.247

2.  Continuous Sign Language Recognition through a Context-Aware Generative Adversarial Network.

Authors:  Ilias Papastratis; Kosmas Dimitropoulos; Petros Daras
Journal:  Sensors (Basel)       Date:  2021-04-01       Impact factor: 3.576

3.  Multi-Class Skin Problem Classification Using Deep Generative Adversarial Network (DGAN).

Authors:  Maleika Heenaye-Mamode Khan; Nuzhah Gooda Sahib-Kaudeer; Motean Dayalen; Faadil Mahomedaly; Ganesh R Sinha; Kapil Kumar Nagwanshi; Amelia Taylor
Journal:  Comput Intell Neurosci       Date:  2022-03-23
  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.