Literature DB >> 24808934

Convergence analysis of fully complex backpropagation algorithm based on Wirtinger calculus.

Huisheng Zhang1, Xiaodong Liu2, Dongpo Xu3, Ying Zhang4.   

Abstract

This paper considers the fully complex backpropagation algorithm (FCBPA) for training the fully complex-valued neural networks. We prove both the weak convergence and strong convergence of FCBPA under mild conditions. The decreasing monotonicity of the error functions during the training process is also obtained. The derivation and analysis of the algorithm are under the framework of Wirtinger calculus, which greatly reduces the description complexity. The theoretical results are substantiated by a simulation example.

Entities:  

Keywords:  Complex-valued neural networks; Convergence; Fully complex backpropagation algorithm; Wirtinger calculus

Year:  2014        PMID: 24808934      PMCID: PMC4012068          DOI: 10.1007/s11571-013-9276-7

Source DB:  PubMed          Journal:  Cogn Neurodyn        ISSN: 1871-4080            Impact factor:   5.082


  8 in total

1.  An Extension of the Back-Propagation Algorithm to Complex Numbers.

Authors:  Tohru Nitta
Journal:  Neural Netw       Date:  1997-11

2.  Approximation by fully complex multilayer perceptrons.

Authors:  Taehwan Kim; Tülay Adali
Journal:  Neural Comput       Date:  2003-07       Impact factor: 2.026

3.  A Kalman filtering approach to the representation of kinematic quantities by the hippocampal-entorhinal complex.

Authors:  Graham Wordsworth Osborn
Journal:  Cogn Neurodyn       Date:  2010-06-08       Impact factor: 5.082

4.  Convergence analysis of three classes of split-complex gradient algorithms for complex-valued recurrent neural networks.

Authors:  Dongpo Xu; Huisheng Zhang; Lijun Liu
Journal:  Neural Comput       Date:  2010-10       Impact factor: 2.026

5.  Boundedness and convergence of online gradient method with penalty for feedforward neural networks.

Authors:  Huisheng Zhang; Wei Wu; Fei Liu; Mingchen Yao
Journal:  IEEE Trans Neural Netw       Date:  2009-05-08

6.  Local minima in hierarchical structures of complex-valued neural networks.

Authors:  Tohru Nitta
Journal:  Neural Netw       Date:  2013-02-18

7.  A computational neural model of orientation detection based on multiple guesses: comparison of geometrical and algebraic models.

Authors:  Hui Wei; Yuan Ren; Zi Yan Wang
Journal:  Cogn Neurodyn       Date:  2012-12-25       Impact factor: 5.082

8.  Deterministic convergence of an online gradient method for BP neural networks.

Authors:  Wei Wu; Guorui Feng; Zhengxue Li; Yuesheng Xu
Journal:  IEEE Trans Neural Netw       Date:  2005-05
  8 in total
  2 in total

1.  Deterministic convergence of chaos injection-based gradient method for training feedforward neural networks.

Authors:  Huisheng Zhang; Ying Zhang; Dongpo Xu; Xiaodong Liu
Journal:  Cogn Neurodyn       Date:  2015-01-01       Impact factor: 5.082

2.  Event-based exponential synchronization of complex networks.

Authors:  Bo Zhou; Xiaofeng Liao; Tingwen Huang
Journal:  Cogn Neurodyn       Date:  2016-06-06       Impact factor: 5.082

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.