An Intensive and Comprehensive Overview of JAYA Algorithm, its Versions and Applications.

In this review paper, JAYA algorithm, which is a recent population-based algorithm is intensively overviewed. The JAYA algorithm combines the survival of the fittest principle from evolutionary algorithms as well as the global optimal solution attractions of Swarm Intelligence methods. Initially, the optimization model and convergence characteristics of JAYA algorithm are carefully analyzed. Thereafter, the proposed versions of JAYA algorithm have been surveyed such as modified, binary, hybridized, parallel, chaotic, multi-objective and others. The various applications tackled using relevant versions of JAYA algorithm are also discussed and summarized based on several problem domains. Furthermore, the open sources code of JAYA algorithm are identified to provide enrich resources for JAYA research communities. The critical analysis of JAYA algorithm reveals its advantages and limitations in dealing with optimization problems. Finally, the paper ends up with conclusion and possible future enhancements suggested to improve the performance of JAYA algorithm. The reader of this overview will determine the best domains and applications used by JAYA algorithm and can justify their JAYA-related contributions. © CIMNE, Barcelona, Spain 2021.

Introduction

In the Artificial Intelligence, the search for the optimal solution in the search space is one of the common issues in almost all sub-fields such as machine learning, deep learning, knowledge representation, reasoning, and perception. The traditional search techniques depend on the heuristic concepts which are problem-dependent trying to search for approximate solutions often with less focus on the quality [1]. Recently, Metaheuristic-based algorithms attract the attentions of artificial intelligence research communities due to its impressive capability in manipulating the search space of optimization problems [2]. A Metaheuristic-based algorithm is a general optimization framework that can be adapted for many optimization problems. It has an iterative evolution strategy that utilizes learning mechanisms exploiting accumulative knowledge as well as exploring problem search space. It is usually controlled by specific parameters used to find good enough approximation solution for optimization problem in hand [3].

Metaheuristic-based algorithms are conventionally categorized in several ways [4]: Nature-inspired vs. non-nature inspired, population-based vs. single point search, dynamic vs. static objective function, single vs. various neighborhood structures, and memory usage vs. memory-less. Recently, the research community combined these algorithms in categories based on the natural inspirations of the Metaheuristic algorithm such as evolutionary algorithms (EAs), Local Search (LSA), Swarm intelligence , physical-based , chemical-based, and human-based algorithms [5, 6].

The traditional evolutionary algorithm is genetic algorithm (GA) which was proposed in 1970 by Holland and his students to emulate the biological concepts of survival-of-the-fittest [7] . The initial population is evolved using recombination, mutation, and natural selection. Other EAs includes: Genetic Algorithm (GA) [7], Differential evolution (DE) [8], Evolutionary programming (EP) [9], Evolution strategies (ES) [10], Genetic Programming (GP) [11], Probability-based incremental learning (PBIL) [12], and Biogeography-Based Optimizer (BBO) [13].

The metaheuristic local search-based algorithms are initiated with a single solution. Iteratively, that solution is adjusted following a specific trajectory in the search space by moving to the neighbouring solution until a local optima is achieved. These algorithms are very strong in exploitation. The most popular local search algorithms are -Hill Climbing [14], Simulated Annealing[15], Tabu Search [16], Iterated Local Search [17], Variable Neighborhood Search [18], and Greedy Randomized Adaptive Search Procedure (GRASP) [19].

The Swarm Intelligence (SI) are the third category of metaheuristic-based algorithms. This type of algorithms is stemmed by the idea of how the Swarm of animals survive, collaborate, communicate in their social behavior and follow the swarm leader. The earliest SI are Particle swarm optimization (PSO) [20] and Ant colony optimization (ACO) [21]. The reminder of SI includes Artifical bee colony (ABC) [22], Firefly algorithm (FA) [23], Bat algorithm (BA) [24], Flower pollination algorithm (FPA) [25], Grey wolf optimizer (GWO) [26], Krill herd algorithm (KHA) [27], Moth-flame optimization algorithm (MFO) [28], and JAYA algorithm [29].

The physical-based category of metaheuristic algorithms emulate the physical phenomena happening in the universe. Examples of physical-based metaheuristic are Central force optimization (CFO) [30], Gravitational search algorithm (GSA) [31], big bang–big crunch (BBBC) [32], electromagnetic field optimization (EFO) [33], water evaporation optimization (WEO) [34], Multi-verse optimizer (MVO) [35], and thermal exchange optimization (TEO) [36]. The chemical-based metaheuristic category is inspired by the chemical process.These include Artificial chemical process (ACP) [37], chemical reaction optimization (CRO) [38], artificial chemical reaction optimization (ACRO) [39], gases Brownian motion optimization (GBMO) [40], and chemotherapy science algorithm (CSA) [41]. Human-based metaheuristic algorithms simulate the intelligent behaviour in solving the problems. The most famous Harmony Search Algorithm (HSA) [42], Coronavirus herd immunity optimizer (CHIO) [43], firework algorithm (FWA) [44], teaching–learning-based algorithm (TLBA) [45], and football game-inspired algorithm (FGIA) [46] Fig. 1.

Fig. 1

The categories of Metaheuristic-based algorithms

A recent metaheuristic-based algorithm called JAYA algorithm combines the features of EA in terms of survivability for the fittest principle as well as SI in which the Swarm normally follow the leader during the search for optimal solution. JAYA algorithm is proposed by Rao [29] in 2016 and gained a considerable interest from a wide variety of research communities due to its impressive characteristics: It is simple in concepts and easy-to-use. It has no derivative information in the initial search. It is a parameter-less algorithm. It is adaptable, flexible, and sound-and-complete. Therefore, JAYA algorithm has been tremendously utilized for a plethora of optimization problems in different domains such as Optimal Power Flow [47, 48], parameters extraction of solar cells [49], knapsack problems [50], virtual machine placement [51], job shop scheduling [52, 53], permutation flow-shop scheduling problem [54], reliability–redundancy allocation problems [55], team formation problem [56], truss structures [57], facial emotion recognition [58], feature selection [59], Plate-fin heat exchanger [60], estimating Li-ion battery model parameters [61], etc.

Due to the complexity nature of some optimization problems and their rugged features in their search space, several researchers have modified the JAYA algorithm to improve their convergence behaviours. Some other researchers hybridize JAYA Algorithm with other powerful components borrowed from other optimization algorithms. Therefore, several variants of JAYA algorithm have been proposed such as binary JAYA [62]. self-adaptive JAYA algorithm [63, 64], elitism-based JAYA [65], elitism-based self-adaptive multi-population JAYA algorithm [66, 67], chaotic JAYA algorithm [64, 68], Neural network JAYA algorithm [69, 70], hybridization with evolutionary algorithms [71, 72], hybridization with swarm intelligence algorithms [73-76], hybridization with physical-based algorithms [55], and hybridization with other components [77, 78].

In this review paper, an intensive but not exhaustive overview of the JAYA algorithms from different sides is provided: initially, the theoretical background are discussed and analyzed. The modified, hybridized and adapted versions of JAYA algorithm are then overviewed. The applications tackled by JAYA algorithms are summarized based on several categories. The reader of this overview will determine the domains and applications that used JAYA algorithm and how to justify their JAYA-related contributions. Furthermore, the open sources code of JAYA algorithm are identified to provide enrich resources for JAYA research communities. Accordingly, this paper will provide critiques and critical analyses about the main pros and cons of JAYA algorithm. Finally, the conclusion of the existing JAYA algorithm contributions and the possible future directions to improve the performance and the applicability of using JAYA algorithm is provided.

The rest parts of this overview paper is arranged as follows: The timeline and the growth of the JAYA algorithm developments are skimmed in Sect.2. The theoretical aspects of JAYA algorithm are provided in Sect.3. The latest developments in terms of adaptation, modifications, hybridization of JAYA algorithm variants are given in Sect. 4. The JAYA algorithm has been widely adapted for various real-world optimization applications which are extensively summarized in Sect. 5.The open source software prepared for JAYA algorithm is illustrated in Sect.6. Critical analysis about the convergence behaviour of JAYA algorithm is provided in Sect. 7. Finally, the overview paper is concluded and some future points are highlighted in Sect. 8.

The Growth of JAYA Glgorithm in the Literature

The growth and progression of JAYA algorithm is presented in this section with different perspectives. The JAYA algorithm is initially established in 2016. Since that time, the interest of the JAYA algorithm has rapidly increased. It has been published in well reputed journals, conferences, book chapters with high-prestige publishers such as ScienceDirect, Springer-Link, IEEEExplorer, IET Digital Library. IGI, Inderscience, MDPI, Hindawi, Taylor & Francis, Wiley, and many others as shown in Fig. 2.

Fig. 2

The number of JAYA algorithm publications per publisher extracted from Google Scholar at 17-8-2020

The growth of the JAYA algorithm is also analyzed based on the topic against the number of publications per topic. Apparently, the highest number of publications is published in the Engineering topics which is equal to 338. The computer science topic has also gained tremendous publications with a number equal to 292. In the mathematics topics, JAYA-based algorithms are used 122 times to solve mathematical problems. Other topics used JAYA-based algorithms with large extension as shown in Fig. 3.

Fig. 3

The number of JAYA-based publications published by each subject (Source Scopus: 17-8-2020)

Also in this JAYA overview paper, the top 15 authors who published a number of documents using JAYA-based algorithms are given in Fig. 4. As can be noticed, the founder of JAYA algorithm has the most interest in solving optimization problems with 30 JAYA-based articles recorded in Scopus database.

Fig. 4

The number of JAYA-based publications published The top 15 authors (Source Scopus)

The National Institutes of Technology in India has the most interest in JAYA-based algorithms with 47 published articles in different domains. The second-highest interest institutions which published 14 articles in JAYA-based algorithms are the University of Science and Technology Beijing at China and the Ton-Duc-Thang University at Vietnam . Other interested institutions are bar-charted in Fig. 5.

Fig. 5

The number of JAYA-based publications published in the top 10 afflictions (Source Scopus)

In another perspective, the country of India has published JAYA-based algorithms and its variants more than 140 times while country of china utilized the JAYA-based algorithms and its versions more than 35 times. In Fig. 6, the usage of JAYA-based algorithms are bar-charted for 20 countries sorted in descending order based on the number of articles published. This data is extracted using Scopus database at 17-8-2020.

Fig. 6

The number of JAYA-based publications of each country (Source Scopus)

In order to provide a comprehensive overview for the growth of JAYA-based articles, the progression of the JAYA algorithms based on the number of articles published per year using most two popular databases, that are Scopus and Google Scholar, are bar-charted in Fig. 7a and b, consecutively. Apparently year after year, the interest growth of JAYA-based algorithm has gradually increased. This data is extracted using Scopus and Google Scholar database at 17-8-2020.

Fig. 7

The number of JAYA-based publications per year

Basic Concepts of JAYA Algorithm

JAYA algorithm is a recent population-based metaheuristic algorithm proposed by Rao [29]. This section presents and analyzes JAYA algorithm in different optimization perspectives. Initially the inspiration of JAYA algorithm is provided. Thereafter, the procedural steps of JAYA algorithm are given. Finally, the exploration and exploitation capabilities of such algorithm are discussed.

Inspiration of JAYA Algorithm

The JAYA algorithm was initially established to tackle constrained and unconstrained optimization functions. The JAYA term is Sanskrit in origin, it means “victory”. This algorithm is a population-based metaheuristic combining the features of evolutionary algorithms and Swarm-based Intelligence. It is inspired by the natural behaviour of the “survival of the fittest” principle. This means that solutions in the JAYA population are being attracted toward the global best solutions and at the same time neglecting the worst solutions. In other words, the search process of the JAYA algorithm tries to get closer to success by reaching the global best solutions, and attempts to escape from failure by running out from the worst solutions. JAYA algorithm has several advantages over other population-based algorithms such as being easy to implement with no algorithm-specific parameters dependence (i.e., the population size, and maximum number of iterations) [57, 79].

Procedural Steps of JAYA Algorithm

In this overview paper, a new presentation based on the six procedural steps are presented for JAYA algorithm. These procedural steps can help the researchers of the optimization algorithms to use this algorithm easily. The procedural steps of JAYA algorithm are shown in flowchart of Fig. 8. Furthermore, the pseudo-code of JAYA algorithm is provided in Algorithm 1. The procedure of JAYA algorithm is thoroughly discussed in following steps:

Fig. 8

The flowchart of the JAYA algorithm

Step:1 Initialize the parameters of both JAYA algorithm and optimization problem. Initially the parameters of JAYA Algorithm are set in the initial stage of run. Interestingly, the JAYA algorithm has no control parameters. It has only two algorithmic parameters which are population size N and iteration numbers T. Normally the constrained problem modeled in the optimization context is as follows:

where is the objective function used to calculate the fitness value of the solution where is a decision variable assigned by a value in the lower and upper bound range such that . is the equality constraints and is the k inequality constraints. The problem variables, dimensions and related data are normally extracted for a benchmark dataset.

Step : 2 Constructing the initial population for JAYA. The initial solutions (or population) of JAYA algorithm are constructed and retained in the JAYA Memory (JM). Note that the JM is an augmented matrix of size as shown in Eq. 2 where N is the number of solutions and D is the solution dimension. Conventionally, solution is randomly constructed: . rnd is a uniform function generates a random values between 0 and 1.

The objective function for each solution is also calculated and the JM solutions are sorted in a ascending order based on their objective function values. Therefore, the best solution is while the worst solution is .

Step: 3 JAYA Evolution process. Iteration by iteration, The decision variables of all solutions in the JM undergoes changes using JAYA operator formulated in Eq.3.

Note that is the new updated solution; is the current solution. is the modified value of the decision value . and are two uniform functions generates a random value in the range of [0,1]. These generated random numbers are used to achieve the right balance between the exploration and exploitation processes. Note that is the decision variable j in the best solution while is the decision variable j in the worst solution. The distance between the decision variables of the best solution and the current one and the distance between the decision variable of the wort solution and current one determine the diversity control of the JAYA algorithm. Closer distance means higher exploitation and higher distance means higher exploration.

Step4: Update JM . The JM solutions at every iteration will be updated. The objective function value of the new solution is calculated. The current solution will be replaced by the new solution , if . This process will be repeated as many as N.

Step: 5 Stop rule. The JAYA algorithm repeats Step 3 and Step 4 until the stopping rule which is sometimes the maximum number of iterations T is reached.

Exploration vs. Exploitation in JAYA Algorithm

It is worth to analyze the exploration and exploitation behavior of JAYA algorithm. Recall that the exploration and exploration are a common process in any metaheuristic-based algorithm. The success of any metaheuristic algorithm depends on its capability of achieving the right balance between wide range exploration of the search space regions and close near-by exploitation of the region to which explore. These two terms are contradictory in which the explorations refer to the ability of the algorithm to navigate not-visited search space regions while the exploitation refers to the ability of the algorithm to deeply search in the search space region to which it navigate. Normally, the exploration related to the random search while the exploitation related to the accumulative search.

In JAYA algorithm, there is only one operator called JAYA which is mathematically formulated in Eq. 3. The exploration and exploitation process are achieved through the distance between the current value of the decision variables and the corresponding variable in the best and worst solution. As far as the distance is large, the exploration is getting higher. Normally, because the random nature of the initial population is high, the distance will be also higher, thus the exploitation is lower. In the final stage of search, the distance is very minimal due to identical population situation. Thus the search is more concentrate on exploitation rather than exploration. In order to show a clear visualization plot to draw such concepts, Fig. 9 is an example of drawing the distance of the average value of the decision variables for 5 solutions in JM including best and worst. Each line represent the distance of one solution which is fluctuated in the initial search and all reach steady-state in the final course of runs. Note that the figure uses the Sphere mathematical function with .

Fig. 9

The Exploration and Exploitation of the JAYA algorithm

The convergence behaviour is also studied and analyzed using the chart of the Sphere function () shown in Fig 10. The trends in the plot represent the convergence behaviour (i.e., objective function value) of one solution over 60 iterations. As can be noticed, the fitness value of each solution begins with extremely high value and sharply reduced to reach equilibrium state where the optimal solution is located.

Fig. 10

The convergence of the JAYA algorithm

The hamming distance is normally calculated to show the distance between the JM solutions to measure the power of JAYA algorithm in controlling the diversity through the search process [80]. The Sphere function with is again used in JAYA algorithm with . The hamming distance is calculated over 60 iterations using 5 runs. Each run is a trend in the chart and the behaviour of hamming distance for all run are converged to the stagnation point in the final stage of search. This show that how the JAYA algorithm can control the diversity during the search (see Fig. 11).

Fig. 11

The Hamming Distance of the JAYA algorithm

Illustrative Example of JAYA Algorithm

In order to provide a clear picture of how the convergence behaviour of JAYA algorithm, HARTMANN 3-dimensional function is used. This function is as follows:where and the global optima is −3.86. As shown in Table 1, the population size is 5. The five solutions together with their objective function values are recorded in the 1st, 2nd, 10th, 20th , 30th , 39th iterations. As can be noticed, the distance between the decision variables of the initial population is large. Iteration by iteration, this distance is gradually reduced until the global optima is reached at iteration #39. This proves that the JAYA Algorithm is tending to be explorer in the initial search and tends to be exploiter at the final stage of run.

Table 1

Optimal results for Hartman test function using JAYA algorithm

	Initial population				Population after one iteration				Population after 10 iterations
#	x_1	x_2	x_3	f(x)	x_1	x_2	x_3	f(x)	x_1	x_2	x_3	f(x)
1	0.0878	0.0525	0.6876	-0.2965	0.3611	0.2095	0.8664	-1.2607	0.0496	0.5724	0.8302	-3.8014
2	0.8828	0.1017	0.6692	-0.3757	0.6904	0.0869	0.8196	-0.5361	0.2279	0.5303	0.8231	-3.7588
3	0.8194	0.5268	0.3575	-0.147	0.719	0.5221	0.4476	-0.306	0.3139	0.5789	0.8285	-3.7606
4	0.4542	0.4939	0.7534	-2.9553	0.4542	0.4939	0.7534	−2.9553	0.1556	0.5581	0.8275	-3.8034
5	0.7246	0.6125	0.3515	-0.1927	0.6633	0.5802	0.5685	-0.9269	0.1282	0.5823	0.8137	-3.7011

Bold font refers to the best results

Recent Variants of JAYA Algorithm

JAYA is a flexible algorithm that is simple in nature but very efficient in action [81]. It is a population-based search algorithm that is originally established for continuous search spaces. It has been modified to be workable as discrete or focuses on local search in addition to the global search. Many variants and hybridization of JAYA algorithm have been introduced to upgrade its efficiency and effectiveness. Some applications require new variants of JAYA algorithm to be used. In the following sections, several variants of JAYA are discussed for different problems.

Modified Versions of JAYA Algorithm

The modified versions of JAYA are introduced. The summarized variants concerns with modifying some of the parameters or operators of JAYA. Those modifications do not constitute major change in the JAYA algorithm mechanism rather that minor changes. This is to add more ability to JAYA to achieve better balance between exploration and exploitation for the complex search spaces of different applications. The modified variants of JAYA include binary JAYA algorithm, Discrete JAYA algorithm, Chaotic JAYA algorithm, Adaptive JAYA algorithm, multi-population JAYA algorithm, parallel JAYA algorithm, Fuzzy-based JAYA algorithm, and others.

Binary JAYA Algorithm

As aforementioned, the JAYA algorithm is produced for continuous search space. The JAYA algorithm is modified to work on optimization problems with binary search space. There are several examples in literature that presents binary JAYA in one way or another. The binary JAYA could be blended with some other transfer functions to achieve the required results based on the applications being tackled [59, 62, 82–84].

In [62], authors manged to produce a genuine versions of binary JAYA algorithm called ‘JAYAX’. The X-OR operator is used to discretize the decision variables into binary. The proposed method is evaluated against 15 benchmark functions established in IEEE-CEC2015. The results were better than those produced by other comparative methods. In another study [83], a new binary version of JAYA algorithm is proposed for feature selection problems. Naive Bayes and Support Vector Machine are used to evaluate the resulting feature subsets using different text corpus data sets. Their proposed method proved its efficiency against other existing works.

For feature selection, a new variant of binary JAYA algorithm is proposed [59]. The JAYA algorithm is modified by using S-shape transfer method to normalize the continuous values into elements with [0,1]. The proposed method is evaluated using 22 data sets extracted from UCI data repository. The binary JAYA algorithm produced very fruitful results. A new version for feature selection problem to predict transient stability assessment of power systems is also tackled using binary JAYA algorithm [82]. The phasor measurement units (PMUs) data is used to evaluate their proposed ‘binJAYA’ algorithm and yield a very promising results.

In [84], commitment to economic unit is a large-scale mix-integer optimization problem that calls for strong and effective instrumentation. At the other hand, the environmental effect of power dependent generation is rapidly gaining attention because of the global warming phenomenon and its urgency. This calls for the production of renewable resources. In this article, the twofold economic and commitment to the emissions unit are made into a single objective issue. To solve this, a new binary JAYA optimization is proposed and incorporated with the process of lambda iteration. The proposed binary JAYA method is inspired by the JAYA evolution and generates binary bits from a v-shape transfer function. Numerical study demonstrates the significant improvement of the binary JAYA in regarding the convergence speed for solving unit commitment problem.

Discrete JAYA Algorithm

The JAYA algorithm is also modified to manipulate the discrete search space of different constrained and unconstrained real world applications with discrete decision variables [54, 85, 86].

The flexible job shop re-scheduling problem is tackled using a discrete version of JAYA algorithm and called DJaya. Two heuristics are used to build efficient initial solutions [86]. Thereafter, five local search-based operators are used to improve the convergence behaviour of DJaya. For evaluation process, seven real-world experimented cases with various scales from pump re-manufacturing are used and the results are very competitive when compared with some state-of-the-art algorithms.

Another paper with modified JAYA algorithm for dealing with discrete search space is proposed by Degertek et. al. [85]. It has been modified to solve truss structures under stress and displacement constraints with huge search space including many local minima. Their proposed algorithm is denoted as ‘DAJA’. Instead of using the best and worst solution in JAYA algorithm, each candidate solution is updated using the descent directions in its neighborhood for evolution process. Their proposed method is measured using a collection of seven benchmark problems which showed the superiority of DAJA over other state-of-the-art metaheuristic algorithms.

In [54], another discrete version of JAYA algorithm is adapted for permutation flow-shop scheduling problem. The aim of this study was to minimize the make-span. The procedural steps of the solution method include: 1) a random priority is allocated to each job in a permutation sequence, and 2) the job priority vector is converted to job permutation vector using the Largest Order Value (LOV) concept. The performance of this JAYA algorithm is compared with other five algorithms using two benchmark datasets. The experimental results show that the JAYA algorithm is an efficient algorithm for solving permutation flow-shop scheduling problems.

Singh, Prem, and Himanshu Chaudhary [87] introduced a discreate version of JAYA algorithm for optimum two-plane balancing of the threshing drum. In their algorithm, the continuous solutions are converted to discrete solutions using discrete constraints of predefined values of design variables. The efficiency of their algorithm is tested using a model of the threshing drum supported on bearings. Simulation results showed that this algorithm is more efficient than GA and PSO in terms of solution quality and computational time.

A modified version of JAYA algorithm is presented by Singh, Prem, and Himanshu Chaudhary [88] for solving mixed-variable optimization problems. In their algorithm, the continuous variables remain in the continuous domains, while continues domains of discrete and integer variables are converted into discrete and integer domains. This is done by applying bound constraint of the middle point of corresponding two consecutive values of discrete and integer variables. The performance of the modified JAYA algorithm is evaluated using five data sets of mixed-variable optimization problems. Simulation results showed that the modified JAYA algorithm is more efficient and easier to use than other comparative methods.

Chaotic JAYA Algorithm

In chaotic map theory, the chaos is a random-orientation, deterministic strategy exists in dynamic systems with non-linear in nature. This dynamic system is non-converging, non-period and bounded. The chaos is normally utilized as the source of randomness which works in as a simple deterministic dynamical system. Chaos use different chaotic maps each with special mathematical equation to possess the sequence of elements regularly. By means of this, the chaos will help optimization methods to explore the problem search space more widely and dynamically. The theory of chaos is integrated in JAYA algorithm to improve its diversity control [64, 68, 89–91].

The authors in [91] introduces a novel chaotic JAYA algorithm for unconstrained numerical optimization, called C-Jaya algorithm. In C-Jaya, three new mutation strategies integrated with the original JAYA algorithm in order to enhance to the global and local search capabilities, and thus solving the problem of premature convergence. Experimentally, the performance of the C-Jaya is tested using sixteen benchmark functions with various dimensions. In comparison with the original JAYA algorithm, it can be seen that the performance of C-Jaya algorithm has faster global convergence, better solution quality, and most robust than the original JAYA algorithm. In comparison with other algorithms, the results show that the performance of the C-Jaya algorithm is superior than others in the convergence speed and solution quality in accordance to almost all the test functions.

Another chaotic JAYA algorithm is introduced by Yu et al. [89] for solving the economic load dispatch problems. Their algorithm is called multi-population based chaotic JAYA algorithm (MP-CJAYA). In, MP-CJAYA, the multi-population method and chaotic optimization algorithm are integrated with the original version of JAYA algorithm to guarantee the best solution of the problem. The population is divided into a set of sub-populations with the same size in order to enhance the exploration and exploitation abilities. The chaotic concept is adopted on each sub-population during the search to keep searching for the global optima. Five case studies are used for evaluation purposes. The experimental results show that the performance of the MP-CJAYA performs better than the original version of JAYA algorithm, as well as the chaotic version of JAYA algorithm in all case studies. In comparison with other algorithms in the literature, the performance of the MP-CJAYA algorithm outperforms the other algorithms in all case studies.

In [68], the authors presented a logistic chaotic JAYA algorithm (LCJAYA) for parameters identification of photovoltaic cell and module models. In LCJAYA algorithm, a logistic chaotic map strategy and a chaotic mutation strategy are introduced into the solution updating phase of JAYA algorithm. The aim of this modifications is to enhance the population diversity, as well as empower the balance of the exploration and exploitation abilities of the JAYA algorithm. The performance of the LCJAYA algorithm evaluated using two datasets with different PV models. The simulation results show that the performance of the LCJAYA algorithm outperforms the original version of the JAYA algorithm, and other four algorithms from the literature in terms optimization accuracy and reliability.

In another study by Ravipudi et al. [64], they applied three versions of JAYA algorithm for to synthesize linear antenna arrays. These versions are the original version of JAYA algorithm. Self-adaptive Jaya algorithm (SJaya) and Chaotic-Jaya (CJaya) algorithm. In, SJaya, the size of the population is adopted automatically during the search in order to manipulate diversity. In CJaya, the Chaotic rule is integrated with the JAYA algorithm in order to improve the convergence speed and to solve the problem of getting stuck in local optima. The three JAYA-based algorithms are tested using two datasets with different formulations. The simulation results show that the performance of the three JAYA-based algorithms perform better than the other optimization algorithms.

Adaptive JAYA Algorithm

The adaptive parameter concept in the optimization context refers to as the automatically tuning parameters during the search process by the algorithm. In JAYA algorithm, there is no control parameters while it has two algorithmic parameters which are population size N and maximum number of iterations. Therefore, the adaptive versions of JAYA algorithm are proposed to adapt the population size during the search.

A self-adaptive JAYA algorithm is presented in [92]. In this algorithm, the size of the population is automatically adapted in order to enhance the convergence rate of the JAYA algorithm. This algorithm is used for optimal design of cooling tower from economic facets. Six different cases of mechanical draft cooling tower are used to evaluate this algorithm. The performance of the self-adaptive JAYA algorithm is compared with the original version of JAYA and three other comparative methods. The results illustrate that the self-adaptive JAYA algorithm outperforms others in terms of the solution quality, convergence rate, and CPU time. The same authors applied the same self-adaptive JAYA algorithm for optimal design of thermal devices [63]. The simulated results demonstrated that the self-adaptive JAYA algorithm is efficient for solving such problems by getting results better than six of the other comparative methods. In another study, the same self-adaptive JAYA algorithm is used for the design and optimization of plate-fin heat exchanger with superior results[60].

In [64], the same self-adaptive JAYA algorithm is employed to synthesize linear antenna arrays. This algorithm is tested using five case studies of syntheses of linear antenna arrays. The results of the self-adaptive JAYA algorithm are compared with the original version of JAYA algorithm, chaotic JAYA algorithm, as well as eight other comparative methods. The simulation results show the performance of the self-adaptive JAYA algorithm is similar to the performance of chaotic JAYA algorithm in almost all cases. Furthermore, the self-adaptive JAYA algorithm obtained superior results in comparison with other comparative methods in terms of the solution quality and convergence speed.

Fuzzy-Based JAYA Algorithm

Many variants of Jaya are integrated with fuzzy controllers for the purpose of optimizing different parameters of those fuzzy controllers. That resulted in better performance of those controllers as demonstrated in works such as [93]. For example, in [76], one of the most popular and flexible control algorithms in the design of motion control is the fuzzy logic system. In certain instances, the design of the fuzzy controller is focused on individual and professional experience. Trial and error is used to establish the membership roles and the rule base itself . In recent years, there has been a growing interest in optimizing the fuzzy logic controller with numerous methods influenced by meta-heuristics. This paper focuses on the optimisation of a fuzzy controller applied to nonlinear structures. In certain instances, the problem is developed on the basis of the assumed linear behaviour, although objective functions and output parameters are interpreted in relation to the model have nonlinear responses. The optimisation algorithm is based on ant-lion optimizer implementation and JAYA algorithm as a hybrid process.

Elitism-Based JAYA Algorithm

In order to control the diversity behaviour of JAYA algorithm and utilize the survival of the fittest principle of natural selection in more proper manner, the JAYA algorithm is modified to elite some strong solutions to drive the search toward optimality.

Raut et al. [65] introduced an improved elitist-based JAYA algorithm for simultaneous network reconfiguration with distributed generation (DG) allocation. In their algorithm, the elitist-based concept is integrated with the JAYA algorithm by replacing the worst solutions with elites in order to avoid local trapping. The update equation is modified based on neighbourhood search and a linear decreasing inertia weight in order to better balance between the exploitation and the exploration abilities of JAYA algorithm. The effectiveness of their algorithm is tested using 33-bus and 69-bus distribution systems on four different case studies. Simulation results show the superiority of their algorithm in comparison with the original version of JAYA algorithm, bit-shift operator based particle swarm optimization, fireworks algorithm, genetic algorithm, and harmony search algorithm in terms of active power loss reduction, voltage profile improvement and loadability enhancement.

Rao et al. [94] presented an elitist version of JAYA algorithm for economic optimization of shell-and-tube heat exchanger (STHE) design. Their approach is named elitist-Jaya algorithm. In elitist-Jaya algorithm, the elitism concept is used during every loop iteration in which the worst solution is duplicated by the elite solution(s). The parameters of the elitist-Jaya algorithm are studied using different settings to find the best settings. The efficiency of their algorithm is evaluated using three different problems of STHE. The simulation results illustrated the efficiency of the elitist-Jaya algorithm against GA, PSO, ABC, ICA, CSA, FFA, ITHS, CI, and GSA algorithms in terms of the solution quality and the CPU time.

Another elitist version of JAYA algorithm is proposed in [95], named Elitist-Jaya algorithm.This algorithm is applied for design optimization of shell-and-tube and plate-fin heat exchangers. The Elitist-Jaya algorithm is designed to simultaneously optimize the total annual cost and effectiveness of the heat exchangers. This algorithm is evaluated using two case studies of heat exchange problem. The impact of the three parameters of the Elitist-Jaya algorithm (population size, maximum iterations, and elite size) are experimentally studied using different settings. The simulation results illustrated the power of this algorithm against the genetic algorithm, and the modified TLBO in getting the optimum solutions within few iterations.

Other Modified Versions of JAYA Algorithm

There are other trials for improving the performance of JAYA algorithm to be inline with the search space of the optimization problem on hand.

Rao et al. [96] introduced a new modified version of JAYA algorithm for wind farm layout optimization. This algorithm is called multi-team perturbation-guiding Jaya (MTPG-Jaya) algorithm. The MTPG-Jaya algorithm utilized multiple teams being guided by different perturbation equations on a single set of population in order to explore the problem search space. Each team is triggered to enhance the same set of the population. The perturbation equation of the worst performing team is modified using the knowledge of the best teams. This knowledge includes the solution fitness value and the boundary violations of solutions. The MTPG-Jaya algorithm is evaluated using optimization test functions and three cases of wind farm layout optimization. Simulation results showed that the performance of the MTPG-Jaya algorithm is better than or competitive to the original version of JAYA algorithm and other comparative algorithms. In another study, the adaptive version of the MTPG-Jaya algorithm is presented in [97, 98]. In this algorithm, the number of teams is adapted in order to efficiently explore the search space based on convergence performance.

Yu et al. [99] proposed a performance-guided JAYA (PGJAYA) algorithm to estimate the parameters of PV cell and module models. In PGJAYA, the solution performance in the population is qualified based on probability. Then, each solution self-adaptively select different evaluation mechanisms that are designed to strike the balance between exploration and exploitation abilities during the search process. The qualified performance is used to select the exemplar to establish the promising search direction. Finally, the self-adaptive chaotic perturbation mechanism is utilized to explore better solutions around the global best for replacing it with the worst ones. This is to improve the quality of the whole population. Simulated results showed that the PGJAYA algorithm is an efficient method for extracting model parameters of PV cell and module.

Another modified version of JAYA algorithm is designed for optimal power flow incorporating renewable energy sources as in [100]. This algorithm is named MJAYA. In this algorithm, each individual in the population is enhanced using the features of the fittest individual, while the features of the worst individual are ignored. This modification leads to modify the position of each individual in the population to a place near to the best individual. The efficiency of the MJAYA algorithm is evaluated using five case studies of IEEE 30-bus system and IEEE 118-bus system. The simulation results illustrated the superiority of the MJAYA algorithm against the moth swarm algorithm, artificial bee colony algorithm, cuckoo search algorithm, grey wolf optimizer, and backtracking search optimization algorithm in terms of the solution quality and the number of evaluations.

Mane et al. [101] introduced another improved version of JAYA algorithm, called semi-steady-state JAYA (SJaya) Algorithm. In SJaya algorithm, the authors presented a new update strategy for the best and the worst individuals in the population. This is done by using a new criterion to accept a new individual and eliminate the old one. The efficiency of the SJaya algorithm is tested using twelve classical benchmark functions, as well as fuel cell stack design optimization. The simulation results illustrated the superiority of the SJaya against the original version of JAYA algorithm in terms of solution quality and speed of finding a near-optimal solution.

In [102], the authors presented a new modified version of the JAYA algorithm to optimize many-objective optimization problems (MaOPs). Their approach is named a many-objective JAYA (MaOJaya) algorithm. In MaOJaya, the current population and the modified population are combined into one population. The tournament selection scheme is used to select the individuals for the next iteration. This modification is designed to guide the algorithm search process towards the best individual. Finally, the Tchebycheff as a decomposition method is used for solving the MaOPs. The MaOJaya algorithm is evaluated using DTLZ benchmark functions with three, five, eight and ten objectives. The experiment results showed that the MaOJaya algorithm obtained better results or compeitive results against the other comparative algorithms on solving the MaOPs.

a modified version of JAYA algorithm, called an oppositional Jaya (OJaya) algorithm is designed by Yu et al. [103]. In OJaya algorithm, the oppositional learning is integrated with the JAYA algorithm to expand the problem search space and enhance the population diversity. In addition, the distance-adaptive coefficient is utilized to determine the best and the worst individuals in order to guide the individuals in the populations towards the best solution and escaping from the worst solution. The efficiency of the OJaya algorithm is tested on 3-bus, 8-bus, 9-bus and 15-bus testing systems of directions over current relays coordination problem. The simulation results showed the superiority of the OJaya algorithm against the original version of JAYA algorithm and other comparative algorithms in terms of solution quality, convergence speed, robustness and computation efficiency.

Hybridized Versions of JAYA Algorithm

The other versions of JAYA algorithm depends on the hybridization concepts. JAYA is hybridized with deep learning algorithms, evolutionary based algorithms, swarm based algorithms and other components of different metaheuristic-based algorithms. The hybridization of JAYA algorithm with other algorithms is provided in this section.

Hybridization with Neural Network

The JAYA algorithm is combined with the neural network ensemble (NNE) for diagnosis of brain tumor using MRI images [104]. The NNE is used in classifications into normal and abnormal brains using MRI images. The JAYA algorithm is used for extraction of the abnormal portion of the brain. Finally, the NNE is used again for further classification into the possibility of having a benign or malignant tumor. Simulation results showed that the JAYA algorithm is performing better than the PSO and GA algorithms.

Ramesh et al. [70] combined deep neural network (DNN) with JAYA algorithm (JOA) for detecting the rice leaf diseases. Their algorithm is called DNN-JOA. In the acquisition of images phase, the images of rice plant are taken from the farm with different characteristics as normal, bacterial blight, brown spot, sheath rot and blast diseases. In the prepossessing phase, the background of images is removed, the RGB images are converted to HSV images, then the images are converted to binary images to create a mask. The output of this phase to split into the diseased and non-diseased parts in the images. In the segmentation phase, the DNN-JOA algorithm as a classifier is utilized in order to classify the rice plant diseases, while the best weights are selected by the JOA algorithm. The simulation results illustrated the superiority of the DNN-JOA algorithm against ANN, DAE and DNN classifiers in terms of accuracy, precision, F1-score, TNR, TPR, FPR, FNR, FDR and NPV.

Bansal et al. [105] presented a new technique based on the JAYA algorithm and the feed-forward neural network to determine the maintainability cost of the software. The significance of their algorithm is evaluated using user interface management system (UIMS) and quality evaluation system (UIMS) datasets in terms of the mean absolute error as the analysis parameter. The performance of their algorithm is compared with another version of JAYA algorithm, three different versions of the clonal selection algorithm, and traditional statistical approach. The experimental results demonstrated that their algorithm is able to reduce the mean absolute error in comparison with others.

Khatir et al. [106] integrated an improved artificial neural networks (ANN) with JAYA algorithm for crack identifications in plates. This algorithm is named ANN-Jaya. Six accelerometers are used for modal analysis for three scenarios based on different crack angles to collect the data and estimate the parameters of ANN. Dynamic and static datasets are introduced using eXtended IsoGeometric Analysis (XIGA) to improve the accuracy of the ANN-Jaya algorithm. Furthermore, the XIGA datasets of cracked plate are used to improve ANN technique for static and dynamic analyses. The crack length is predicated using XIGA model based on experimental analysis. Jaya algorithm is used to optimize the most important parameters of ANN. The simulation results showed that the ANN-Jaya algorithm is robust and accurate for crack identification in plates.

A new version of JAYA algorithm to train the artificial multilayer perceptron (MLP) neural NARX model is introduced in [69]. This algorithm is named Jaya-NNARX. This algorithm is utilized for nonlinear system identification. The efficiency of the Jaya-NNARX algorithm is tested using two typical nonlinear benchmark test functions, and the simulation results showed that the performance of the Jaya-NNARX algorithm is better than the BP-NNARX, DE-NNARX, and PSO-NNARX algorithms. In another study, the JAYA algorithm is integrated with the neural network model for wire electric discharge machining (WEDM) of machining maraging steel [107]. The neural network model is used to establish the correlation between parameters and machining characteristics. In addition, the JAYA algorithm is triggered in order to recommend the optimal settings of process parameters. This is to enhance the matching performance. Simulation results illustrated the power of this algorithm in solving such problem.

Hybridization with Evolutionary-Based Algorithms

Wu et al. [50] proposes a hybrid JAYA algorithm for solving set-union knapsack problems (SUKP), named DHJaya. In DHJaya algorithm, the JAYA algorithm is combined with the mutation and the crossover operators of the differential evolution algorithm to enhance the diversity of the population and the exploration ability. The performance of DHJaya algorithm is tested using three large-scale SUKP datasets. Experimentally, the DHJaya performs better than the original version of JAYA and the basic differential evolution algorithm in terms of solution quality and convergence speed. In addition, the DHJaya algorithm obtained superior results against those of five other comparative methods.

Similarly, the hybridization of the JAYA algorithm with the adaptive differential evolution to identify the Bouc–Wen hysteresis model of a piezoelectric actuator is introduced in [71]. This hybrid algorithm is called aDE-Jaya. In aDE-Jaya, the mutation operator of differential evolution and the JAYA operator are combined to control the balance between the exploration and exploitation abilities. The mutant factor, the crossover rate and the population size are adapted to enhance the convergence efficiency. The aDE-Jaya algorithm is evaluated using 8 classical benchmark functions. The simulation results show the efficiency of the aDE-Jaya algorithm against the DE, PSO, JAYA, and GA algorithms in terms of the solution quality and the speed of convergence. Finally, the aDE-Jaya algorithm is utilized to identify the Bouc–Wen hysteresis model of a piezoelectric actuator with good results.

Another hybridization algorithm between the JAYA algorithm and the self-adaptive differential evolution algorithm is introduced in [72]. This algorithm is named Jaya-jDE and it is used for addressing the problem of designing green LTE networks with the Internet of Things (IoT) nodes. The performance of the Jaya-jDE algorithm is compared with the original version of JAYA, the teaching-learning-optimization (TLBO), and the self-adaptive differential evolution algorithm. The simulation results show the efficiency of the Jaya-jDE algorithm by achieving a good trade-off even when it did not have the best performance.

In [73], the authors proposed a hybrid swarm intelligence algorithm to conduct structural damage identification by using vibration measurement data. In their algorithm, the JAYA algorithm is combined with the Tree Seeds Algorithm (TSA) and K-means clustering, named C-Jaya-TSA. The clustering strategy is used to replace solutions with low-quality objective values in the JAYA algorithm. Furthermore, the TSA is utilized in the C-Jaya-TSA algorithm in order to enhance the exploitation ability of the JAYA algorithm . The simulation results show the effectiveness of the C-Jaya-TSA algorithm when testing on classical mathematical benchmarks and benchmark structure.

The JAYA algorithm is integrated with the forest optimization algorithm (FOA) for gene selection [108]. This hybrid algorithm is known as EJFOA. Initially, the ANOVA as a statistical filter is used to select the relevant genes from the original dataset. Later on, the EJFOA algorithm is triggered to find the optimal set of genes from the previously selected genes, while the support vector machine is employed as a classifier to classify the micro-array data. Finally, the EJFOA algorithm is evaluated using seven data sets published in the Kent Ridge Biomedical Data set Repository. The EJFOA algorithm achieved competitive results with other algorithms in terms of selecting the minimum subset of genes with maximum accuracy rate.

Hybridization with Swarm-Based Algorithms

Azizi et al. [76] integrated the ant lion optimizer (ALO) with the JAYA algorithm to optimize a fuzzy logic controller. Their algorithm is called ALO–Jaya algorithm. In this algorithm, the JAYA algorithm is implemented in updating the position of ants and antlions in order to manipulate the exploration and exploitation abilities of ALO algorithm. The ALO–Jaya algorithm is evaluated using eight optimization functions. The results show that the performance of the ALO–Jaya algorithm performs better than the original version of JAYA and the original version ALO algorithms. For more validations, the ALO–Jaya algorithm is tested using two benchmark buildings with nonlinear behavior. The performance of the ALO–Jaya algorithm is compared with eight comparative algorithms using these data sets. The results show that the ALO–Jaya algorithm is more effective than others in reducing the building responses.

In another study, the authors in [74] introduced a new hybrid algorithm, called JAYA-IPSO algorithm. In this algorithm, the improved particle swarm optimization (IPSO) algorithm is combined with the JAYA algorithm in order to enhance the exploitation ability of the JAYA algorithm. The JAYA-IPSO algorithm is applied for solving the problem of synchronization control for chaotic maps based on parameter estimation. Their algorithm is evaluated using two classical chaotic maps and their fractional-order form. The experimental results show the effectiveness of the JAYA-IPSO algorithm compared to four other optimization algorithms.

In [109], the authors combined the JAYA algorithm with directed particle swarm optimization (DPSO) for delivering nano-robots to cancer areas. Their algorithm is named Directed Jaya (DJaya) algorithm. The aim of this combination is to speed up the process of Nano-robots delivery. In DJaya, the JAYA algorithm is triggered first, while the DPSO algorithm is triggered last during the process of Nano-robots delivery. The simulation results show that the DJaya algorithm is faster than JAYA and DPSO algorithms in the release of drugs, and thus destroying the cancer cells with relatively small numbers of Nano-robots.

Similarly, the JAYA algorithm is integrated with the firefly algorithm as a hybrid algorithm for video copyright protection in [75]. The JAYA algorithm is utilized in this hybrid algorithm to solve the problem of getting stuck in local optima for the firefly algorithm. This hybrid algorithm is tested using nine test data sets. The simulation results show the efficiency of the present hybrid algorithm in comparison with other algorithms.

Hybridization with Physical-Based Algorithms

In [55], the JAYA algorithm is hybridized with the learning operator of the teaching–learning-based optimization (TLBO) algorithm and time-varying acceleration coefficients (TVACs), called the LJaya-TVAC algorithm. This hybrid algorithm is applied for solving standard real-parameter test functions and various types of reliability–redundancy allocation problems (RRAPs) in two stages of experiments. In the first stage of experiments, the LJaya-TVAC algorithm is evaluated using six unimodal and multi-modal test functions. The simulation results show that the LJaya-TVAC algorithm is able to get better solutions with higher convergence rates than the original version of JAYA algorithm. In the second stage of experiments, the LJaya-TVAC algorithm is tested on RRAPs test problems with good results in comparison with the original JAYA algorithm and other algorithms.

Hybridization with Other Components

Luo et al. [77] they presented a hybrid JAYA algorithm by combining the JAYA algorithm and Nelder-Mead (NM) algorithm for identifying photovoltaic cell model parameters. This algorithm is called Jaya-NM algorithm. The NM algorithm is used as a local search component to enhance the exploitation capability of the JAYA algorithm. Jaya-NM algorithm is evaluated using a real dataset collected for this research. Experimentally, the performance of the Jaya-NM algorithm performs better than six other algorithms from the literature.

In [83], the binary JAYA algorithm as a wrapper-based technique is integrated with the filter-based normalized difference measure (NDM) for reducing the high-dimensional feature space of text classification problems. This algorithm is named NDM-BJO. In NDM-BJO algorithm, the digitization process is utilized to convert the continues values to binary. The Naive Bayes and Support Vector Machine classifiers are used to nominate the optimal subset of features which are generated by the NDM-BJO algorithm. This algorithm is tested using four well-known benchmark text corpus datasets. The performance of the NDM-BJO algorithm is compared with five filter-based algorithms and two wrapper-based algorithms. From experimental results, it can be seen that the NDM-BJO-algorithm performs better than the other algorithms in term of accuracy.

In another study, the Flight (LF) technique is integrated with the JAYA algorithm for the non-linear channel equalization problem in [78]. This algorithm is known as JAYALF algorithm. The Flight is used to solve the shortcomings of the JAYA algorithm like the weak exploration capability and trapping into local minima due to insufficient diversity of population. The JAYALF algorithm is tested using seventeen well-known unimodal and multimodal benchmark functions and three wireless communication channels with two different nonlinearities. Experimentally, the JAYALF algorithm outperforms the state-of-the-art algorithms in terms of solution quality, convergence speed, and robustness. The authors mentioned that JAYALF algorithm has a better exploration ability and converges quickly without getting stuck in local optima.

An improved version of the JAYA algorithm is presented for flexible job shop scheduling and rescheduling problems [110]. In this algorithm, the JAYA algorithm is integrated with two local search heuristics in order to improve the exploitation ability of JAYA algorithm. For evaluation purposes, this algorithm is tested using ten different-scale real-world datasets. This algorithm achieved superior results in comparison with evolutionary algorithms, tabu search, artificial bee colony, and ant colony optimization by stratifying the balance between instability and makespan in a rescheduling phase.

Li et al. [53] they proposed an improved JAYA (IJaya) algorithm for solving the flexible job shop scheduling problem. In the IJaya algorithm, seven local search heuristics are integrated with the JAYA algorithm in order to enhance the exploitation ability. Furthermore, the acceptance criteria of the simulated annealing algorithm is employed in order to enhance the exploration ability of the JAYA algorithm. Thirty instances with different scales as a benchmark dataset are used for evaluation purposes. The simulation results show the effectiveness of the IJaya algorithm on solving the considered problem.

Another improved JAYA algorithm called IJMSO is presented in [56]. The IJMSO algorithm is used for solving team formation problems. In IJMSO algorithm, the single-point crossover is combined within the Jaya algorithm to accelerate the search process, while the swap heuristic as a local search procedure is integrated with the JAYA algorithm to verify the consistency of the capabilities and the required skills to carry out the task. The IJMSO algorithm is tested using two real-world datasets and it is compared with four other algorithms. The experimental results show that the IJMSO algorithm is able to achieve better results faster than the other comparative algorithms.

An improved version of the JAYA algorithm for structural damage identification is introduced in [111], called I-Jaya algorithm. The low-quality objective values are replaced with a cluster strategy, while the solution update equation is modified using the best-so-far solution. The aim of these modifications to improve the global search ability. Furthermore, the sparse regularization and Bayesian inference are considered in the traditional objective function to perform the damage identification and enhance the robustness of the JAYA algorithm. Experimentally, the I-Jaya algorithm is able to provide accurate and reliable damage identification in comparison with other comparative algorithms.

Nayak et al. [112] developed a modified version of the JAYA algorithm to detect sensorial hearing loss through brain MR images. In their algorithm, the mutation operator is combined with the JAYA algorithm to enhance the global search ability of the JAYA algorithm. In addition, the extreme learning machine (ELM) is integrated with the JAYA algorithm to perform classification to ensure better generalization performance than its counterparts. Their algorithm is named MJaya-ELM. Their algorithm is tested using a well-studied hearing loss dataset. The performance of the MJaya-ELM is compared with the other comparative algorithms such as PSO-ELM, DE-ELM, and Jaya-ELM. The experimental results show the superiority of the MJaya-ELM algorithm in terms of accuracy and other performance measures. It should be noted that the authors mentioned that their algorithm was evaluated using a small dataset, and the performance of their algorithm may be affected when tested using large-scale dataset.

Multipupulation JAYA Algorithm

An elitism-based self-adaptive multipopulation JAYA algorithm for the design optimization of heat pipes is introduced in [67]. This algorithm is named SAMPE-Jaya algorithm. In SAMPE-Jaya, the population is divided into a set of subpopulations based on the quality of the solutions in order to manipulate the diversity of the JAYA search mechanism. Furthermore, the number of subpopulations is changeable during the search based on the change strength of the problem. The worst solutions in the inferior subpopulation are exchanged with the elite solutions in the superior subpopulation. The JAYA algorithm is triggered to update the solutions on each subpopulation separately. At the end of each iteration, the entire subpopulations are combined, and then check if the global best solution is enhanced or not. If the global best solution is enhanced then the number of subpopulations is increased by 1, otherwise the number of subpopulations will be decreased by 1. The performance of the SAMPE-Jaya is evaluated using the single- and multi-objective optimization cases of heat pipes problem. Experimentally, the SAMPE-Jaya algorithm achieved better results with less computational times compared to other comparative algorithms. It should be noted that the same SAMPE-Jaya algorithm is applied for solving the constrained economic optimization of shell-and-tube Heat exchangers in [113]. In addition, the same SAMPE-Jaya algorithm is used to solve CEC 2015 benchmark functions in [66, 114].

Another self-adaptive multipopulation JAYA algorithm is presented in [115]. This algorithm is called MO-SAMP-JAYA algorithm and it is implemented for optimization of thermal devices and cycles. In MO-SAMP-JAYA algorithm, the population is divided into a set of subpopulations based on the nondominance rank and crowding distance of solutions. The best solution in the population has the highest rank, while the worst solution has the lowest rank. If two or more solutions have the same rank, the solution with the highest value of crowding distance is selected as the best solution. The JAYA algorithm runs on each subpopulation separately. The number of subpopulations is adapted based on the improvements on the global best solution at each iteration. The simulation results show the superiority of the MO-SAMP-JAYA algorithm in comparison with the latest algorithms in the literature.

Parallel JAYA Algorithm

Migallon et al. [116, 117] introduced a modified version of the JAYA algorithm based on parallel structure. In their algorithm, the population is divided into a set of subpopulations. The number of the subpopulations is fixed during the search. Furthermore, the JAYA algorithm is running on each subpopulation at one of the processors separately. It should be noted that the migration process is not allowed between subpopulations. Their algorithm is evaluated using 30 unconstrained benchmark functions with good results. The same authors presented another parallel JAYA algorithm in [118]. In this algorithm, the chaotic 2D map is combined with the parallel JAYA algorithm in order to speed up the convergence. Their algorithm is tested using 18 classical benchmark functions and two real-world engineering design problems.

In another study, a parallel version of the JAYA algorithm is implemented. The graphics processing unit (GPU) is used to estimate parameters of the Li-ion battery model [61]. This algorithm is named GPU-Jaya. In this algorithm, the iterative update of solution candidates, the computation of the solution quality, and the selection of the globally best and worst solutions are all executed in parallel on the GPU. The global memory and the shared memory are employed in the GPU-Jaya algorithm. The global memory is utilized in the solution update and the computation of the solution quality, while the shared memory is applied to select the best and worst solutions. The simulation results show that the GPU-Jaya algorithm is able to estimate battery model parameters with less computational time opposed to the other comparative algorithms.

Multi-Objective JAYA algorithm

Rao et al. [119] introduced an efficient multi-objective JAYA algorithm for tackling the respective machining process optimization problems. Their algorithm is named MO-Jaya. The effectiveness of their algorithm is tested using four case studies including wire-electric discharge machining process, laser cutting process, electrochemical machining process and focused ion beam micro-milling process. The simulation results illustrated that the performance of the MO-Jaya algorithm is better than GA, NSGA, NSGA-II, BBO, NSTLBO, PSO, SQP and Monte Carlo simulations. The same authors applied the same MO-Jaya algorithm for solving the input process parameters optimization problems of abrasive waterjet machining process in [120, 121]. The experimental results showed the efficiency of the MO-Jaya algorithm against the simulated annealing, the particle swam optimization, the firefly algorithm, the cuckoo search algorithm, the black hole algorithm and the biogeography based optimization in terms of the solution quality and the computational time. Similarly, the MO-Jaya algorithm is applied for optimization of modern machining processes in [122]. The plasma arc machining, electro-discharge machining, and micro electro-discharge machining processes are case studies used to evaluate the MO-Jaya algorithm. Simulation results showed the efficiency of the MO-Jaya algorithm on real manufacturing environment.

Mishra et al. [123] presented a multi-objective JAYA algorithm for solving permutation flow shop scheduling problem. The minimization of the total tardiness cost and makespan are the two objectives considered when running their algorithm to solve such problem. Simulation results showed the efficiency of their algorithm compared with total enumeration method and simulated annealing algorithm in terms of solution quality and CPU time.

The efficiency of the multi-objective JAYA (MOJaya) algorithm for tackling optimal power flow in investigated in [124]. The MOJaya algorithm tries to satisfy different objectives like fuel cost minimization, voltage profile improvement, voltage stability enhancement, active power losses reduction and system security enhancement. The MOJaya algorithm is evaluated on IEEE 30-bus test system. Five cases as a single-objective and eleven cases, considered as multi-objectives, are used as case studies. Simulation results showed the superiority of the MOJaya algorithm compared to other methods in the literature in case studies with one, two, and three objectives.

Rao et al. [125] applied the JAYA algorithm for the single- and multi-objective design optimization of plate-fin heat exchangers (PFHEs). Their algorithm is applied for PFHEs in order to minimize the total surface area of heat transfer, total annual cost, and total pressure drop of the system and maximizing the effectiveness in four design case studies. Simulation results showed the superiority of their algorithm in comparison with GA, ICA PSO, BBO and TLBO algorithms in terms of the solution quality and computational time. In another study, the efficiency of the single- and multi-objectives JAYA algorithm is investigated on optimization of casting processes in [126]. These casting process such as squeeze casting process, continuous casting process, pressure die casting process and green sand casting process. This algorithm is named QO-Jaya. The performance of QO-Jaya algorithm is compared with SA, GA, PSO, TLBO and aguchi methods. It can be seen from the the experimental results that the QO-Jaya performs better or similar to other methods.

In [127], the authors presented a multi-objective JAYA algorithm for optimal scheduling of distributed generators in distribution system sectionalized into multi-microgrids. Their algorithm used to optimize multiple-objective cases such as i) minimizing the total operating cost, ii) minimizing the system loss, and iii) minimizing of voltage deviation. In addition, their algorithm is investigated to satisfy the multi-objectives such as: i) minimizing the total cost and system loss, ii) minimizing the total cost and voltage deviation, and iii) minimizing the system loss and voltage deviation. Their algorithm was evaluated using a dataset with 33 bus network distribution. Simulation results illustrated the effectiveness of their algorithm against with genetic algorithm.

Venkaiah et al. [128] introduced a multi-objective JAYA algorithm to find the optimal location and sizing of distributed generation in a radial distribution system. Their algorithm is known as MOJAYA. The MOJAYA is used to optimize multiple objectives such as reducing power loss, improving voltage profile and stability. The MOJAYA algorithm is tested on IEEE 33 bus radial distribution system. The MOJAYA algorithm outperforms the MOPSO algorithm in terms of solution quality and computational time.

Barakat et al. [129] presented an enhanced version of JAYA algorithm for solving multi-objective optimal reactive power dispatch (ORPD) problem. This algorithm is called EJOA. The EJOA is designed in order to minimize the power losses and voltage deviation in power system. The multi-objective concept is utilized by weighted sum method with fuzzy logic. The EJOA algorithm is tested using two standard datasets (IEEE 30-bus and WDRN). Experimentally, the EJOA algorithm perform better than PSO and GA in terms of the solution quality and speed of convergence.

Applications of JAYA Algorithms

The viability and efficiency of JAYA-based algorithms make it successfully applied in solving different real-world applications. These applications include mathematical functions [88, 101], feature selection [59, 82], image processing [130, 131], energy [99, 132], design proportional-integral-derivative (PID) controller [133, 134], economic dispatch [135, 136], communication [72, 137], electrical and power system [137, 138], fracture mechanics [139, 140], environmental engineering [96, 141] , manufacturing industries [120, 121], structural design [111, 142], truss structures [57, 85], planing and scheduling [50, 87], and others [105, 143].

The applications of JAYA algorithm and its variations are listed in Table 2. The applications are classified in terms of the application domain, the name of applied JAYA algorithm, the name of tackled problem, the variant of JAYA algorithm used (i.e., original, modified, hybrid, multi-objective, or parallel), and the type of data representation of the undertaken problem (e.g., continuous or binary).

Table 2

Application of JAYA algorithm on different domains

Domain	Algorithm	Problem	Variant	Type	Ref.
Mathematical function	SJaya	Engineering and benchmark functions	Modified	Continuous	[101]
	Parallel Jaya	Engineering and benchmark functions	Parallel	Continuous	[88]
	MaOJaya	Many-objective benchmark functions	Modified	Continuous	[102]
	Jaya	Mixed-variable problems	Modified	Mixed	[88]
	SAMP-Jaya	Numerical unconstrained and constraint problems	Multi-population	Continuous	[114]
	Jaya GPU	Unconstrained functions	Parallel	Continuous	[158]
Feature selection	BJAM	Feature selection	Modified	Binary	[59]
	BinJaya	Real-Time Transient Stability Assessment Using PMU Data	Modified	Binary	[82]
	FSJaya	Supervised classification	Modified	Binary	[144]
Image Processing	TS-Jaya	Identification of Alcoholism using MRI scans	Modified	Binary	[130]
	Jaya	Segment Tumor from Brain MRI	Original	Continuous	[131]
	MJaya	Multiple sclerosis identification from Brain MRI	Modified	Binary	[145]
	Jaya	Intelligent facial emotion recognition	Original	Binary	[58]
	Jaya	Fetal head periphery extraction from ultrasound image	Original	Binary	[147]
	FF-Jaya	Video copyright protection	Hybrid	Binary	[147]
	NN-Jaya	Diagnosis of Brain Tumor Using MRI Images	Hybrid	Binary	[104]
	ML-Jaya	Smart pathological brain detection Using MRI Images	Hybrid	Binary	[146]
	NN-Jaya	Recognition and classification of paddy leaf diseases	Hybrid	Binary	[70]
	Jaya	Tea category identification	Original	Binary	[148]
Energy	PGJAYA	Parameter estimation of photovoltaic cell models	Modified	Continuous	[99]
	EO-Jaya	Parameter estimation of photovoltaic cell models	Modified	Continuous	[132]
	H-Jaya-NM	Parameter estimation of photovoltaic cell models	Modified	Continuous	[77]
	Jaya	Parameter estimation of photovoltaic cell models	Original	Continuous	[149]
	IJAYA	Parameter estimation of photovoltaic cell models	Modified	Continuous	[150]
	GPU-Jaya	Li-ion batteries optimization	Parallel	Continuous	[61]
	MJAYA	Parameters extraction of solar cells	Modified	Continuous	[49]
	Jaya	Power sharing between the battery and the UC	Original	Continuous	[151]
	MJaya	Optimal power flow incorporating renewable energy sources	Modified	Continuous	[100]
Design PID controller	Jaya	optimized PID controller for Auto-matic Voltage Regulator	Original	Continuous	[133]
	Jaya	Optimization of FUZZY controller	Original	Continuous	[134]
	Jaya	2-DOF FOPID controller design for maglev system	Original	Continuous	[159]
	Jaya	Design and performance analysis of PID	Original	Continuous	[160]
	Jaya	Fuzzy-PID controller with derivative filter	Original	Continuous	[161]
	Jaya	Optimized Integral-Proportional Derivative (I-PD)	Original	Continuous	[162]
Economic dispatch	Jaya	Economic emission dispatch	Original	Continuous	[135]
	Jaya	Optimal reactive power dispatch	Original	Continuous	[136]
	Jaya	Economic Dispatch of Wind-Thermal Power	Original	Continuous	[153]
	ES-JAYA	estimation of proton exchange membrane fuel cells	Modified	Continuous	[154]
	Jaya	Optimization of Plate-Fin Heat Exchanger	Original	Continuous	[60]
	JAYA-IPSO	Economic emission dispatch	Modified	Continuous	[74]
	Chaotic JAYA	Economic emission dispatch	Original	Continuous	[89]
	Improved Jaya	Proton Exchange Membrane Fuel Cell Stack Design Optimization	Modified	Continuous	[163]
Communication	Jaya	Load Balancing in Cloud Computing	Original	Continuous	[137]
	HJaya-DE	5G Massive MIMO and NB-IoT GreenNetworks	Hybrid	Continuous	[72]
	Jaya	Synthesis of linear antenna arrays	Original	Continuous	[64]
	Jaya	Non-linear Channel Equalization	Original	Continuous	[78]
	IEJAYA	Simultaneous network reconfiguration and distributed generation (dg) allocation	Modified	Continuous	[65]
	MO-Jaya	Scheduling of distributed generators in Distribution System	Multi-Objective	Continuous	[127]
	Jaya, SJaya, and CJaya	Synthesize linear antenna arrays	Hybrid	Continuous	[64]
Electrical and Power System	Q-O M-Jaya	Multi-objective optimal power flow solution	Modified	Continuous	[138]
	EJOA	Reactive Power Dispatch	Multi-objective	Continuous	[129]
	OJaya	Directional over current relays coordination problem	Modified	Continuous	[103]
	Jaya	Power flow	Original	Continuous	[47]
	Jaya	Coordination of Overcurrent Relays in Single-and Multi-Loop Distribution System	Original	Continuous	[152]
	MJaya	Thermal performance optimization of the underground power cable system	Modified	Continuous	[164]
	Jaya	Automatic Generation Control Scheme for Interconnected Solar-Thermal Power System	Original	Continuous	[165]
	Jaya	Automatic Generation Control of Two-Area Thermal Power System	Original	Continuous	[166]
	SA-Jaya	Optimum configuration of chosen thermal equipment	Modified	Continuous	[63]
	MOSAMP	Dimensions of three thermal systems optimisation	Multi-objective	Continuous	[115]
	AMTPG-Jaya	Optimal power flow	Original	Continuous	[48]
	Jaya	Transient response and stability enhancement of regulator system	Original	Continuous	[167]
Fracture Mechanics	POD-RBF-Jaya	Fracture mechanics inverse problems	Hybrid	Continuous	[139]
	FEM-Jaya	Crack identification in plate structures	Hybrid	Discrete	[140]
Environmental Engineering	Jaya	Estimation of the soil water retention	Original	Continuous	[141]
	MTP-Jaya	Optimization of wind farm layout	Original	Continuous	[96]
	Jaya	Optimal points of PV-based DG injection	Original	Continuous	[168]
	MJaya	Optimal design and analysis of mechanical draft cooling tower	Modified	Continuous	[92]
Manufacturing industries	MO-Jaya	Optimization of Abrasive Waterjet Machining Process	Multi-objective	Continuous	[120]
	MO-Jaya	Optimization of Abrasive Waterjet Machining Process	Multi-objective	Continuous	[121]
	Hybrid Jaya	Optimization of proton exchange membrane fuel cells	Hybrid	Continuous	[154]
	Jaya	Crack identification in plates	Original	Continuous	[106]
	aDE-Jaya	Parameters identification of Bouc–Wen hysteresis model for piezoelectric actuators	Hybrid	Continuous	[71]
	Hybrid Jaya	Optimization of radioactive sources	Hybrid	Continuous	[169]
	QO-Jaya	Optimization of Selected Casting Processes	Modified	Continuous	[170]
	JA	Optimization of magnetic abrasive finishing	Original	Continuous	[171]
	MJA	Intelligent identification of permanent magnet synchronous machine parameters	Modified	Continuous	[155]
	Jaya	Maintenance of the multi-unit series system	Modified	Discrete	[172]
	Hybrid JAYA	Carbon fiber-reinforced polymer	Hybrid	Continuous	[156]
	Modified JAYA	Glass fiber reinforced polymer	Modified	Continuous	[93]
	QO-Jaya	Optimization of submerged arc welding process parameters	Modified	Continuous	[170]
	QO-Jaya	Optimisation of welding processes	Modified	Continuous	[173]
	QO-Jaya	Optimization of Casting Processes	Multi-objective	Continuous	[126]
	Hybrid JAYA	Wire electric discharge machining	Hybrid	Continuous	[107]
Structural Design	I-Jaya	Structural damage identification	Modified	Continuous	[111]
	Jaya	Structural damage identification	Modified	Continuous	[142]
	Jaya	Optimum design of a reinforced concrete counterfort retaining wall	Modified	Continuous	[174]
	ALO–Jaya	Optimum design of fuzzy logic controller	Hybrid	Continuous	[76]
Truss Structures	JA	Sizing and layout optimization of truss structures	Modified	Continuous	[57]
	DAJA	Sizing and layout optimization of truss structures	Modified	Discrete	[85]
	JAYA	Braced dome structures	Original	Continuous	[175]
	Hybrid JAYA	Optimization of squeeze casting process parameters	Hybrid	Continuous	[176]
Planing and scheduling	DHJaya	Set-union knapsack problem	Hybrid	Binary	[50]
	Modified Jaya	Threshing drum	Modified	Discrete	[87]
	JA	Optimization of Reservoir Operation	Modified	Discrete	[157]
	JAYA	Job shop scheduling	Modified	Discrete	[52]
	JAYA	Virtual Machine Placement	Modified	Discrete	[51]
	JAYA	Permutation flow-shop scheduling problem	Modified	Discrete	[54]
	JAYA	Permutation flow shop scheduling problem	Modified	Discrete	[123]
	LJaya-TVAC	Reliability–redundancy allocation problems	Hybrid	Discrete	[55]
	Improved Jaya	Flexible Job Shop Rescheduling Problems	Modified	Discrete	[110]
	DJaya	Flexible Job-Shop Rescheduling Problems	Modified	Discrete	[86]
	IJaya	Flexible Job-Shop Rescheduling Problems	Modified	Discrete	[53]
	IJMSO	Team formation problem	Hybrid	Discrete	[56]
	JAYA	Damage assessment in plate-like structures	Modified	Discrete	[177]
Other	NN-Jaya	Object-Oriented Software Quality Analysis	Hybrid	Continuous	[105]
	MS-Jaya	Software Module Clustering Problem	Modified	Continuous	[143]
	ELM-Jaya	Estimating currency exchange value	Hybrid	Continuous	[178]
	Jaya-ELM	Hearing loss detection	Hybrid	Continuous	[112]
	Jaya	Nano-robots deliver drugs to cancer area	Original	Continuous	[109]
	Jaya-BF	Gene selection for cancer classification	Modified	Binary	[108]

The following is a summary of some of the main applications that are solved by JAYA algorithm and its variations. Feature selection is a problem of selecting the most promising features to represent the whole data. The feature selection is used to solve a wide variety of real-world applications such as bioinformatics, pattern recognition, and classifications. JAYA algorithm and its variations [59, 82, 144] have been used for feature selection applications.

Image processing means recognizing images for classification purposes. JAYA algorithm and its variations have been used for image processing of MRI scans [104, 130, 131, 145, 146], ultrasound image [147], and emotion recognition [58], and other tasks [70, 147, 148].

Energy optimization means using available resources efficiently. JAYA algorithm has been used widely to tackle such problems. Photovolatic cells optimization is a crucial application due to its importance in providing clean energy. Several researchers used JAYA algorithm [77, 99, 132, 149, 150] for parameter estimation of photovoltaic cell models. Other state-of-the-art JAYA algorithms are used for li-ion batteries optimization [61] and optimal power flow sharing [100, 151].

The communication domain includes different types of problems that are tackled by JAYA algorithm such as load balancing in cloud computing [137], synthesis of linear antenna arrays [64, 64], non-linear Channel equalization [78], and simultaneous network reconfiguration and distributed generation (dg) allocation [65].

Electrical and power system optimization problems are tackled by JAYA algorithm and its modifications. This includes optimal power flow solution [47, 48, 138], reactive power dispatch [129], directional over current relays coordination problem [103, 152], and thermal systems optimisation.

Solving combined economic emission dispatch means scheduling generation at various interconnected generating plants to meet the required load demand while keeping the operating cost at a minimum level. JAYA algorithm has been used to solve such problem by different researchers such as [60, 74, 89, 135, 136, 153, 154].

Manufacturing has diverse kinds of optimization problems that are tackled by JAYA algorithm such as optimization of abrasive waterjet machining process [120, 121], crack identification in plates [106], parameters identification of Bouc–Wen hysteresis model for piezoelectric actuators [71], intelligent identification of permanent magnet synchronous machine parameters [155], carbon fiber-reinforced polymer [156], and glass fiber reinforced polymer [93].

Planning and scheduling tasks are combinatorial NP problems in which a set of resources are arranged within a set of constraints to reach to a specific goal. Several researchers are motivated to tackle scheduling problems such as optimization of reservoir operation [157], job shop scheduling [52], virtual machine placement [51], permutation flow-shop scheduling problem [54, 123], flexible job shop rescheduling problem [53, 86, 110], and team formation problem [56].

Open Source Software of JAYA Algorithm

In order to provide a comprehensive review of JAYA algorithm, open source software available to the JAYA research communities is discussed. Due to simplicity of the optimization framework, JAYA received a tremendous interest and became popular in a very short time. Since JAYA is parameter-free and one operator drives the search process, JAYA is implemented in few lines of code. Therefore, there are many trials that provide the code of JAYA algorithm to be available for the researchers in interest.

Since the first inception, the JAYA algorithm is coded in Matlab which is released as a public code1[29]. The code tackled some standard benchmark functions which contributed in the JAYA popularity. This code is also uploaded in the GitHub Integration Platform to increase its publicity.2

There are some researchers tackled their optimization problems using JAYA algorithm and their code is made publicly available. In power systems, minimization of active power losses is one the main interest which is implemented by Orlando Ramirez Barron and the source code is provided3. Furthermore, JAYA algorithm is programmed in Java language to be incorporated with WEKA software, the workbench for machine learning4. The multi objective version of JAYA algoithm is also coded in Python programming language. The source code is made publicly available5 by Berrouk et. al. [124]. Another open source of JAYA is coded in Python programming language6. Finally, the Matlab source code of JAYA algoirhm is released for unconstrained Rosenbrock7 and constrained Himmelblaw8 benchmark functions

Critical Analysis of JAYA Algorithm Theory

As summarized in the variants and applications of JAYA algorithm, JAYA has gained considerable attentions geared toward a vast variations of optimization problems. This is due to its impressive characteristics: Simple in concepts, easy-to-use, parameter-less, derivative-free, and sound-and-complete. This is the main reason of success and why the research communities are boosted to adopt this algorithm. However, as other metaheuristic algorithms, JAYA algorithm suffers from few limitations and inescapable drawbacks.

The main drawback of this algorithm is related to the No Free Lunch (NFL) Theorem of optimization [179]. In NFL, there is no Superior optimization algorithm that can excel over all competitors for the entire variants of optimization problems or even for all instances of the same optimization problem. Therefore, the convergence behaviour of JAYA algorithm has tight connection with the nature of the problem search space on hand. Therefore, the JAYA algorithm need to be modified or hybridized to cope with the problem search space nature.

The second drawback is related to the problem domain to be manipulated. As aforementioned, the first proposal of JAYA is established for optimization problems with single-objectives, unconstrained objective functions and continuous domains [29]. However, JAYA needs to expand its applicability to be efficient for other problem domains and nature such as discrete, binary, combinatorial, dynamic, many objective and multi objective.

The third drawback of JAYA algorithm is related to its population-based behaviour. During the search process, JAYA algorithm is able to explore a wide range of search space regions through its unique operator which is able to evolve the search based on the inherited values attracted to the global best solution and move closely to better areas in the search space by expanding the distance with worse solutions. By means of this way, the search has a maneuver behaviour in its navigation. However, its operator, does not focus on each search space region to which it converge, thus degrading the exploitation process especially for the problems with multi-modal landscape. As a result, JAYA algorithm should be hybridized with other local search-based algorithm to enrich its exploitation capability. The hybridization of JAYA with local search techniques enables it to stay focused on potential regions of the search space.

As other optimization methods, the performance of JAYA algorithm is tightly related to the problem of dimensionality. As the number of the problem variables grows , the performance of the algorithm is degenerated. Therefore, dimensionality reduction in machine learning is a proper solution for some problem to yield more efficient results. Other scaling and transformation mechanisms should be considered. That is why in some applications, as stated in the previous sections, the GWO algorithm outperformed JAYA. The GWO is less susceptible to the dimensionality problem and may outperform JAYA in problems with high dimensionality.

Other common problem is the dependence of JAYA on stochastic operators that are really pseudo random. The pseudo randomness has an artificial cyclic nature which means, in the long run, some patterns will be repeating itself and consequently the search pattern will adapt also a cyclic behavior that might end up in an endless loop of search. However, the behavior of JAYA which is somewhat similar to Nelder-Mead and Simplex algorithms except that JAYA has stochastic components, that hinder its ability to span multi dimensional search spaces without any cyclic behavior.

Finally, there is a concur dilemma in JAYA algorithm related to the control of the diversity. The convergence behaviour of JAYA algorithm tends to be stagnated to the local minima quickly due to the lose of diversity in the initial course of run. This is because the unique operator of JAYA algorithm considers only two solutions (i.e., the best and the worst) at each generation and do not considered the other attributes of other solutions in the population. It will be attracted to the best solution and escape the features of the worst solution. In optimization, it is conventionally known that the search direction to the global optima is not necessarily the strike to the best solution. Therefore, the loss of diversity exists due to neglecting the majority of other solutions in the population and immaturity occurs. Some works suggest dividing the population into sub-populations and dealing with each sub-population with isolated JAYA to control the diversity. It is also fond that using parallel JAYA can help is speeding up its convergence dramatically without much affecting the quality of solutions.

Conclusion and Future Trends

JAYA algorithm in its simple form and in its variants have demonstrated outstanding ability to solve multi-objective, multi-variable, and complex optimization problems. The majority of successful applications were engineering applications due to the ability of JAYA algorithm to handle numerical, continuous, and binary search spaces with well defined objective functions that could come either with constraints or without constraints. In many cases there was a need to add variants to the standard JAYA algorithm to increase the capability of JAYA for solving the problems under scope. As a matter of fact, there are three ways to increase the effectiveness of JAYA; adding variants, hybridization with other optimization techniques, or integrating it with other AI paradigms. Adding the variants to utilize a the other components of the standard JAYA algorithm proved to be very efficient in upgrading its performance and enabling it to solve the multi-objective optimization problems being tackled. The variants did not change the general shape of JAYA but made some of its operations much more efficient and rewarding. Those variants could be implemented on the parameter level, the population level, and/or operators level. Some of those variants are simply heuristics that are added to the algorithm, others constituted minor changes to the steps of the algorithm. However, they were all necessary to meet the demands of the problems being optimized. Those problems are sometimes multi-objective with abnormal nature of inputs and specific requirement for the output.

On the other hand, hybridization could be implemented in conjunction with some local search techniques, or with others global search techniques that have different nature than JAYA. Hybridization has been proposed to enhance the exploitation capability that JAYA has in its quest to find optimum solutions. As a matter of fact, JAYA is integrated with other AI paradigms in an attempt to increase the efficiency of those paradigms. Its worth noting that, in general, the hybridization did not add considerable complexity to those paradigms due to JAYA natural simplicity, at the same time, it elevated the quality of the outcomes of those paradigms. Examples of those paradigms are neural networks, fuzzy controllers, features selection mechanisms, pattern recognition, and many other methods.

JAYA algorithm also was incorporated with other intelligent paradigms such as neural networks, it has a multipurpose capabilities including training the neural networks, input groups selection, activation functions tuning and optimizing neural networks structures. In fuzzy systems it is used in tuning the fuzzy membership functions and other parameters of fuzzy controllers. In features selection, JAYA and its variants proved to be efficient in features optimization. The simplicity of JAYA and its variants made it preferable to be integrated with other much more complex systems.

As the JAYA algorithm provide a successful outcomes for different research domains, there are other venues of future enhancements that can be suggested. These possibilities can be summarized as follows:

Structured population The JAYA algorithm tends to lose diversity during its search due the fast convergence problem. One of the best ways to deal with controlling the diversity is the structured population. The population is divided into several sub-population and each sub-population is used as an initial input to independent JAYA version. The sub-populations exchange their solution periodically. The most structured population can be used for JAYA algorithm is Island model [180-182], Cellular Automata [183, 184], hierarchical model [185], and other reported in [186].

Selection mechanisms The JAYA algorithm only focus on the best and the worst solutions in the evolution loop. This can lead the algorithm to neglect several important directions which can lead to the global optimal solution. Therefore, instead of using only best and worst solution, the selection mechanisms such as proportional selection, tournament selection, linear and exponential rank selection can be utilized in to improve its diversity control and thus improve performance.

Adaptive Parameters The process of adapting parameters during the search helps the algorithm to find the optimal parameter configurations for the better performance [187]. Although the JAYA algorithm is parameter-free, the algorithmic parameters such as number of solutions in the initial population and the number of iterations are in many cases sufficient to reach local or global optima. Adaptive parameters can be used to autonomously tune those parameters during evolution.

Memetic Strategy As conventionally known, the population based algorithms such as JAYA algorithm are very powerful in exploring a different regions of search space at the same time. However, they are poor in exploiting each region to which they converge. On the other hand, local search-based algorithms are very powerful in exploiting each region and finding the local optima in that region, yet their disadvantage is in the exploration part. Consequently, hybridizing a local search-based within the evolution step of population-based algorithm can complement the powerful feature of both types of algorithms. This type of hybridization methods is called memetic strategy. Ultimately, JAYA algorithm can be hybridized with a local search to enrich its exploitation capabilities.

Dynamic Optimization The dynamic optimization concern where dynamic problems optimal solution is changing over the time. There is very few work that tackle dynamic algorithms using JAYA-based algorithm. This is indeed a very challenging type of problems that require special capability in navigating several search space regions with dynamic behaviour.

Combinatorics optimization Normally, the real-world optimization problems are not trivial since they have a combinatorial optimization nature. This type of problems is constrained and the search space is not smooth and rugged. Therefore, the best constraint handling technique should be investigated to deal with the combinatorial optimization problems such as scheduling and planning domains. Normally, this type of problems can work only on feasible search space regions.