| Literature DB >> 26462528 |
Baris Yuce1, Michael S Packianather2, Ernesto Mastrocinque3, Duc Truong Pham4, Alfredo Lambiase5.
Abstract
Optimization algorithms are search methods where the goal is to find an optimal solution to a problem, in order to satisfy one or more objective functions, possibly subject to a set of constraints. Studies of social animals and social insects have resulted in a number of computational models of swarm intelligence. Within these swarms their collective behavior is usually very complex. The collective behavior of a swarm of social organisms emerges from the behaviors of the individuals of that swarm. Researchers have developed computational optimization methods based on biology such as Genetic Algorithms, Particle Swarm Optimization, and Ant Colony. The aim of this paper is to describe an optimization algorithm called the Bees Algorithm, inspired from the natural foraging behavior of honey bees, to find the optimal solution. The algorithm performs both an exploitative neighborhood search combined with random explorative search. In this paper, after an explanation of the natural foraging behavior of honey bees, the basic Bees Algorithm and its improved versions are described and are implemented in order to optimize several benchmark functions, and the results are compared with those obtained with different optimization algorithms. The results show that the Bees Algorithm offering some advantage over other optimization methods according to the nature of the problem.Entities:
Keywords: adaptive neighborhood search; bees algorithm; foraging behavior; honey bee; random search; site abandonment; swarm intelligence; swarm-based optimization; waggle dance
Year: 2013 PMID: 26462528 PMCID: PMC4553508 DOI: 10.3390/insects4040646
Source DB: PubMed Journal: Insects ISSN: 2075-4450 Impact factor: 2.769
Figure 1(a) Orientation of waggle dance with respect to the sun; (b) Orientation of waggle dance with respect to the food source, hive and sun; (c) The Waggle Dance and followers.
Basic parameters of the Bees Algorithm.
| Parameter | Symbols |
|---|---|
| Number of scout bees in the selected patches |
|
| Number of best patches in the selected patches |
|
| Number of elite patches in the selected best patches |
|
| Number of recruited bees in the elite patches |
|
| Number of recruited bees in the non-elite best patches |
|
| The size of neighborhood for each patch |
|
| Number of iterations |
|
| Difference between value of the first and last iterations |
|
Figure 2Pseudo-code of the basic Bees Algorithm.
Figure 3Flowchart of the basic Bees Algorithm.
Figure 4(a) The initially selected n patches and their evaluated fitness values; (b) Selection of elite and non-elite best patches; (c) Recruitment of forager bees to the elite and non-elite best locations; (d) Results from basic Bees-inspired Algorithm (BA) after local and global search.
The selected benchmark functions [38,39].
| No | Function Name | Interval | Function | Global Optimum |
|---|---|---|---|---|
| 1 | Goldstein &Price (2D) | [−2, 2] | X = [0,−1] F (X) = 3 | |
| 2 | Schwefel (2D) | [−500, 500] | X = [0,0] F(X) = −837.658 | |
| 3 | Schaffer (2D) | [−100, 100] | X = (0, 0) F(X) = 0 | |
| 4 | Rosenbrock (10D) | [−1.2, 1.2] | X = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1] F(X) = 0 | |
| 5 | Sphere (10D) | [−5.12, 5.12] | X = [0, 0, 0, 0, 0, 0, 0, 0, 0, 0] F(X) = 0 | |
| 6 | Ackley (10D) | [−32, 32] | X = [0, 0, 0, 0, 0, 0, 0, 0, 0, 0] F(X) = 0 | |
| 7 | Rastrigin (10D) | [−5.12, 5.12] | X = [0, 0, 0, 0, 0, 0, 0, 0, 0, 0] F(X) = 0 | |
| 8 | Martin & Gaddy (2D) | [0, 10] | X = [5, 5] F(X) = 0 | |
| 9 | Easom (2D) | [−100, 100] | X = [π, π] F(X) = -1 | |
| 10 | Griewank (10D) | [−600, 600] | X = [100, 100, 100, 100, 100, 100, 100, 100, 100, 100] F(X) = 0 |
The best test parameters for the BA after parameter tuning.
| Parameters | Value |
|---|---|
| Number of Scout Bees in the Selected Patches ( | 50 |
| Number of Best Patches in the Selected Patches ( | 15 |
| Number of Elite Patches in the Selected Best Patches ( | 3 |
| Number of Recruited Bees in the Elite Patches ( | 12 |
| Number of Recruited Bees in the Non-Elite Best Patches ( | 8 |
| The Size of neighborhood for Each Patches ( | 1 |
| Number of Iterations ( | 5000 |
| Difference between the First Iteration Value and the Last Iteration ( | 0.001 |
| Shrinking Constant ( | 2 |
| Number of Repetitions for Shrinking Process ( | 10 |
| Number of Repetitions for Enhancement Process ( | 25 |
| Number of Repetitions for Site Abandonment ( | 100 |
The test parameters for the Evolutionary Algorithms (EA) [38].
| Parameters | Crossover | No crossover |
|---|---|---|
| Population size | 100 | |
| Evaluation cycles (max number) | 5000 | |
| Children per generation | 99 | |
| Crossover rate | 1 | 0 |
| Mutation rate (variables) | 0.05 | 0.8 |
| Mutation rate (mutation width) | 0.05 | 0.8 |
| Initial mutation interval width α (variables) | 0.1 | |
| Initial mutation interval width ρ (mutation width) | 0.1 | |
The test parameters for the Particle Swarm Optimization (PSO) [38].
| Parameters | Value |
|---|---|
| Population size | 100 |
| PSO cycles (max number) | 5000 |
| Connectivity | See |
| Maximum velocity | See |
| C1 | 2 |
| C2 | 2 |
|
| 0.9 |
|
| 0.4 |
The test parameters for the PSO [38].
| Velocity of the each connectivity (Connectivity, | Max particle velocity | |||
|---|---|---|---|---|
| Connectivity (number of neigbourhood) | (2, 0.005) | (2, 0.001) | (2, 0.05) | (2, 0.1) |
| (10, 0.005) | (10, 0.001) | (10, 0.05) | (10, 0.1) | |
| (20, 0.005) | (20, 0.001) | (20, 0.05) | (20, 0.1) | |
| (100, 0.005) | (100, 0.001) | (100, 0.05) | (100, 0.1) | |
The test parameters for the Artificial Bee Colony (ABC) [38].
| Parameters | Value |
|---|---|
| Population size | 100 |
| ABC cycles (max number) | 5000 |
| Employed bees ne | 50 |
| Onlooker bees ne | 49 |
| Random scouts | 1 |
| Stagnation limit for site abandonment | 50xDimenstion |
Accuracy of the proposed algorithm compared with other well-known optimization techniques.
| No. | PSO | EA | ABC | BA | ANSSA-BA | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| Avg. Abs. Dif. | Std. Dev. | Avg. Abs. Dif. | Std. Dev. | Avg. Abs. Dif. | Std. Dev. | Avg. Abs. Dif. | Std. Dev. | Avg. Abs. Dif. | Std. Dev. | |
| 1 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0001 | 0.0000 | 0.0003 | 0.0000 | 0.0001 |
| 2 | 4.7376 | 23.4448 | 4.7379 | 23.4448 | 0.0000 | 0.0000 | 0.0000 | 0.0005 | 0.0003 | 0.0007 |
| 3 | 0.0000 | 0.0000 | 0.0009 | 0.0025 | 0.0000 | 0.0000 | 0.0000 | 0.0003 | 0.0001 | 0.0005 |
| 4 | 0.5998 | 1.0436 | 61.5213 | 132.6307 | 0.0965 | 0.0880 | 44.3210 | 112.2900 | 0.0000 | 0.0003 |
| 5 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0003 | 0.0000 | 0.0000 |
| 6 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 1.2345 | 0.3135 | 0.0063 | 0.0249 |
| 7 | 0.1990 | 0.4924 | 2.9616 | 1.4881 | 0.0000 | 0.0000 | 24.8499 | 8.3306 | 0.0002 | 0.0064 |
| 8 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0003 | 0.0000 | 0.0000 |
| 9 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 0.0000 | 2.0096 | 0.0000 | 0.0003 | 0.0000 | 0.0002 |
| 10 | 0.0008 | 0.0026 | 0.0210 | 0.0130 | 0.0052 | 0.0078 | 0.3158 | 0.1786 | 0.0728 | 0.0202 |
ANNSA: adaptive neighborhood sizes and site abandonment
Average evaluation of proposed algorithm compared with other well-known optimization techniques.
| No. | PSO | EA | ABC | BA | ANSSA-BA | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| Avg. evaluations | Std. Dev. | Avg. evaluations | Std. Dev. | Avg. evaluations | Std. Dev. | Avg. evaluations | Std. Dev. | Avg. evaluations | Std. Dev. | |
| 1 | 3,262 | 822 | 2,002 | 390 | 2,082 | 435 | 504 | 211 | 250,049 | 0 |
| 2 | 84,572 | 90,373 | 298,058 | 149,638 | 4,750 | 1,197 | 1,140 | 680 | 250,049 | 0 |
| 3 | 28,072 | 21,717 | 219,376 | 183,373 | 21,156 | 13,714 | 121,088 | 174,779 | 250,049 | 0 |
| 4 | 492,912 | 29,381 | 500,000 | 0 | 497,728 | 16,065 | 935,000 | 0 | 30,893.2 | 48,267.4 |
| 5 | 171,754 | 7,732 | 36,376 | 2,736 | 13,114 | 480 | 285,039 | 277,778 | 25,098.3 | 36,483.4 |
| 6 | 236,562 | 9,119 | 50,344 | 3,949 | 18,664 | 627 | 910,000 | 0 | 234,190.7 | 54.086.8 |
| 7 | 412,440 | 67,814 | 500,000 | 0 | 207,486 | 57,568 | 885,000 | 0 | 93,580 | 97,429.1 |
| 8 | 1,778 | 612 | 1,512 | 385 | 1,498 | 329 | 600 | 259 | 53,005.7 | 66,284.5 |
| 9 | 16,124 | 15,942 | 36,440 | 28,121 | 1,542 | 201 | 5,280 | 6,303 | 250,049 | 0 |
| 10 | 290,466 | 74,501 | 490,792 | 65,110 | 357,438 | 149,129 | 4,300,000 | 0 | 122,713.17 | 99,163.3 |
The statistically significant difference between the adaptive neighborhood sizes and site abandonment in (ANSSA)-based BA and the basic BA.
| No. | Function | Significance between the basic BA and the improved BA | |
|---|---|---|---|
| Significant ( α < 0.05) | α | ||
| 1 | Goldstein & Price (2D) | No | 0.200 |
| 2 | Schwefel (2D) | No | 0.468 |
| 3 | Schaffer (2D) | No | 0.801 |
| 4 | Rosenbrock (10D) | No | 0.358 |
| 5 | Sphere (10D) | No | 0.433 |
| 6 | Ackley (10D) | Yes | 0.020 |
| 7 | Rastrigin (10D) | Yes | 0.007 |
| 8 | Martin & Gaddy (2D) | No | 0.358 |
| 9 | Easom (2D) | No | 0.563 |
| 10 | Griewank (10D) | Yes | 0.020 |