| Literature DB >> 28630619 |
Tao Sun1,2, Ming-Hai Xu1.
Abstract
Quantum-behaved particle swarm optimization (QPSO) algorithm is a variant of the traditional particle swarm optimization (PSO). The QPSO that was originally developed for continuous search spaces outperforms the traditional PSO in search ability. This paper analyzes the main factors that impact the search ability of QPSO and converts the particle movement formula to the mutation condition by introducing the rejection region, thus proposing a new binary algorithm, named swarm optimization genetic algorithm (SOGA), because it is more like genetic algorithm (GA) than PSO in form. SOGA has crossover and mutation operator as GA but does not need to set the crossover and mutation probability, so it has fewer parameters to control. The proposed algorithm was tested with several nonlinear high-dimension functions in the binary search space, and the results were compared with those from BPSO, BQPSO, and GA. The experimental results show that SOGA is distinctly superior to the other three algorithms in terms of solution accuracy and convergence.Entities:
Mesh:
Year: 2017 PMID: 28630619 PMCID: PMC5463199 DOI: 10.1155/2017/2782679
Source DB: PubMed Journal: Comput Intell Neurosci
Figure 1Probability density function of double exponential distribution.
Figure 2Refused domain of probability density function.
Figure 3Figure of equation (16).
Figure 4Figures of mutation probability.
Parameters of algorithms applied in the experiments.
| Algorithm | Parameter settings |
|---|---|
| SOGA |
|
| BPSO |
|
| BQPSO |
|
| GA |
|
Minimization results for BPSO, BQPSO, and SOGA.
| Function | Algorithm | The best | Mean | SD | The worst | Median |
|---|---|---|---|---|---|---|
|
| BPSO | 65.1674 | 278.1128 | 160.0441 | 702.2221 | 244.4259 |
| BQPSO | 1.4096 | 3.3647 | 1.4272 | 6.5327 | 3.1107 | |
| SOGA | 7.4510 | 1.6641 | 4.8945 | 0.0028 | 7.4510 | |
|
| ||||||
|
| BPSO | 1.5918 | 3.0268 | 0.9300 | 5.3401 | 2.9463 |
| BQPSO | 0.2155 | 0.4080 | 0.1226 | 0.7025 | 0.4025 | |
| SOGA | 0.0024 | 0.0026 | 0.0005 | 0.0049 | 0.0024 | |
|
| ||||||
|
| BPSO | 121.8395 | 1171.3480 | 911.2165 | 3261.0044 | 860.7055 |
| BQPSO | 8.2112 | 30.8752 | 25.8621 | 120.6034 | 21.4084 | |
| SOGA | 263.9170 | 1919.6076 | 1078.9650 | 3782.1623 | 2175.0068 | |
|
| ||||||
|
| BPSO | 56 | 312.7667 | 248.9619 | 1154 | 250.5 |
| BQPSO | 1 | 4.8667 | 2.4174 | 11 | 5 | |
| SOGA | 0 | 0.1000 | 0.4026 | 2 | 0 | |
|
| ||||||
|
| BPSO | 9.0243 | 16.3089 | 5.5677 | 27.5491 | 14.3406 |
| BQPSO | 0.9430 | 1.8437 | 0.5141 | 3.3296 | 1.8342 | |
| SOGA | 0.0031 | 0.2228 | 0.6241 | 3.1281 | 0.0275 | |
|
| ||||||
|
| BPSO | −77.5179 | −74.5146 | 1.8144 | −70.6644 | −74.5941 |
| BQPSO | −72.7114 | −69.3385 | 1.7327 | −66.4601 | −68.9703 | |
| SOGA | −77.7357 | −76.2789 | 0.6355 | −75.1676 | −76.2048 | |
|
| ||||||
|
| BPSO | −3136.9403 | −2724.3377 | 194.8185 | −2263.5189 | −2752.3562 |
| BQPSO | −1810.3356 | −1498.0555 | 157.2211 | −1272.7048 | −1454.7974 | |
| SOGA | −3248.4725 | −2913.3245 | 218.1944 | −2467.9053 | −2952.6730 | |
|
| ||||||
|
| BPSO | 4.5456 | 7.6315 | 2.0230 | 15.5215 | 7.8838 |
| BQPSO | 0.9446 | 1.9230 | 0.3842 | 2.5818 | 1.9273 | |
| SOGA | 0.0040 | 1.3614 | 1.1703 | 3.1276 | 1.8407 | |
|
| ||||||
|
| BPSO | 2.6925 | 12.6817 | 7.3535 | 31.3502 | 10.9785 |
| BQPSO | 0.7294 | 1.7635 | 0.5748 | 2.9455 | 1.7687 | |
| SOGA | 0.0742 | 1.4639 | 1.4386 | 5.2594 | 0.9397 | |
|
| ||||||
|
| BPSO | 1.5798 | 3.6606 | 1.5582 | 7.7680 | 3.4519 |
| BQPSO | 0.3552 | 0.8360 | 0.2063 | 1.1561 | 0.8923 | |
| SOGA | 0.0546 | 0.3702 | 0.1933 | 0.6738 | 0.4183 | |
Minimization results for SOGA and GA.
| Function | Algorithm | The best | Mean | SD | The worst | Median |
|---|---|---|---|---|---|---|
|
| SOGA | 7.4510 | 1.6641 | 4.8945 | 0.0028 | 7.4510 |
| GA | 0.0013 | 76.0248 | 166.2636 | 664.4937 | 2.5246 | |
| SOGA | 7.4510 | 0.0074 | 0.0189 | 0.0773 | 0.0007 | |
| GA | 0.0016 | 1.1302 | 2.3717 | 11.0953 | 0.2626 | |
|
| ||||||
|
| SOGA | 0.0024 | 0.0026 | 0.0005 | 0.0049 | 0.0024 |
| GA | 0.0031 | 0.3220 | 0.4294 | 1.3587 | 0.1172 | |
| SOGA | 0.0031 | 0.0069 | 0.0076 | 0.0433 | 0.1059 | |
| GA | 0.0220 | 0.1423 | 0.1452 | 0.7703 | 2.5471 | |
|
| ||||||
|
| SOGA | 263.9170 | 1919.6076 | 1078.9650 | 3782.1623 | 2175.0068 |
| GA | 823.0982 | 3805.95462 | 1587.4665 | 8753.2186 | 3602.7854 | |
| SOGA | 0.0238 | 27.5765 | 95.7945 | 434.9900 | 0.5557 | |
| GA | 482.1519 | 4922.3981 | 2417.1198 | 10470.9239 | 4705.2068 | |
|
| ||||||
|
| SOGA | 0 | 0.1000 | 0.4026 | 2 | 0 |
| GA | 0 | 94.3667 | 457.2142 | 2509 | 1 | |
| SOGA | 0 | 0 | 0 | 0 | 0 | |
| GA | 0 | 3.6333 | 7.5177 | 36 | 2 | |
|
| ||||||
|
| SOGA | 0.0031 | 0.2228 | 0.6241 | 3.1281 | 0.0275 |
| GA | 9.3783 | 27.0193 | 11.2953 | 53.1297 | 27.1523 | |
| SOGA | 0.0458 | 0.1908 | 0.0952 | 0.4913 | 0.1831 | |
| GA | 6.4913 | 20.0783 | 10.5937 | 49.6017 | 18.9795 | |
|
| ||||||
|
| SOGA | −77.7357 | −76.2789 | 0.6355 | −75.1676 | −76.2048 |
| GA | −77.9857 | −75.2636 | 1.8587 | −69.1535 | −75.5698 | |
| SOGA | −78.3316 | −77.2289 | 0.6240 | −75.8823 | −77.1074 | |
| GA | −77.5952 | −74.8886 | 1.902 | −70.5101 | −75.457 | |
|
| ||||||
|
| SOGA | −3248.4725 | −2642.8652 | 256.1202 | −2001.7012 | −2952.6730 |
| GA | −3113.4015 | −2088.3848 | 342.5752 | −1355.6609 | −2692.5141 | |
| SOGA | −3351.7352 | −3111.4602 | 154.6330 | −2736.5711 | −3114.6197 | |
| GA | −3150.5510 | −2733.6038 | 180.6351 | −2424.3367 | −2726.4449 | |
|
| ||||||
|
| SOGA | 0.0040 | 1.3614 | 1.1703 | 3.1276 | 1.8407 |
| GA | 1.8409 | 3.3475 | 1.8626 | 10.2185 | 2.6024 | |
| SOGA | 0.0040 | 0.0223 | 0.0216 | 0.0911 | 0.0141 | |
| GA | 0.3384 | 2.7764 | 0.9262 | 4.3458 | 2.7676 | |
|
| ||||||
|
| SOGA | 0.0742 | 1.4639 | 1.4386 | 5.2594 | 0.9397 |
| GA | 1.5468 | 10.2883 | 7.6703 | 34.3495 | 8.7194 | |
| SOGA | 0.0348 | 0.6195 | 0.5317 | 1.9344 | 0.4575 | |
| GA | 0.6679 | 6.0007 | 4.0074 | 13.6647 | 5.7359 | |
|
| ||||||
|
| SOGA | 0.0546 | 0.3702 | 0.1933 | 0.6738 | 0.4183 |
| GA | 0.1600 | 0.9633 | 1.3811 | 7.9350 | 0.6882 | |
| SOGA | 0.2550 | 0.4715 | 0.1208 | 0.7548 | 0.4758 | |
| GA | 0.1805 | 0.7492 | 0.2431 | 1.2999 | 0.7741 | |
The crossover and mutation operation act on substring.
Comparison of SOGA with other algorithms and GA with GA.
| Function | Test | SOGA | GA | |||
|---|---|---|---|---|---|---|
| BPSO | BQPSO | GA | GA | GA | ||
|
|
| <0.0001 | <0.0001 | 0.0151 | 0.0115 | 0.0166 |
|
| 1 | 1 | 1 | 1 | 1 | |
|
|
| <0.0001 | <0.0001 | 0.0001 | <0.0001 | 0.0340 |
|
| 1 | 1 | 1 | 1 | 1 | |
|
|
| 0.0724 | <0.0001 | <0.0001 | <0.0001 | 0.4280 |
|
| −1 | −1 | 1 | 1 | 0 | |
|
|
| <0.0001 | <0.0001 | 0.2633 | 0.0119 | 0.2816 |
|
| 1 | 1 | 0 | 1 | 0 | |
|
|
| <0.0001 | <0.0001 | <0.0001 | <0.0001 | 0.0171 |
|
| 1 | 1 | 1 | 1 | 1 | |
|
|
| <0.0001 | <0.0001 | 0.0006 | <0.0001 | 0.4430 |
|
| 1 | 1 | 1 | 1 | 0 | |
|
|
| 0.0081 | <0.0001 | 0.0004 | 0.0080 | 0.2582 |
|
| 1 | 1 | 1 | 1 | 0 | |
|
|
| <0.0001 | 0.0002 | <0.0001 | <0.0001 | 0.2063 |
|
| 1 | 1 | 1 | 1 | 0 | |
|
|
| <0.0001 | 0.3884 | <0.0001 | <0.0001 | 0.0043 |
|
| 1 | 0 | 1 | 1 | 1 | |
|
|
| <0.0001 | <0.0001 | 0.0291 | <0.0001 | 0.4065 |
|
| 1 | 1 | 1 | 1 | 0 | |
The crossover and mutation operation act on substring.
Comparison of SOGA with other algorithms.
| Function | Test | SOGA | ||||
|---|---|---|---|---|---|---|
| BPSO | BQPSO | GA | GA | SOGA | ||
|
|
| <0.0001 | <0.0001 | 0.0151 | 0.0120 | 0.0409 |
|
| 1 | 1 | 1 | 1 | −1 | |
|
|
| <0.0001 | <0.0001 | 0.0002 | <0.0001 | 0.0308 |
|
| 1 | 1 | 1 | 1 | −1 | |
|
|
| <0.0001 | 0.8561 | <0.0001 | <0.0001 | <0.0001 |
|
| 1 | 0 | 1 | 1 | 1 | |
|
|
| <0.0001 | <0.0001 | 0.2629 | 0.0104 | 0.1555 |
|
| 1 | 1 | 0 | 1 | 0 | |
|
|
| <0.0001 | <0.0001 | <0.0001 | <0.0001 | 0.2768 |
|
| 1 | 1 | 1 | 1 | 0 | |
|
|
| <0.0001 | <0.0001 | 0.0002 | <0.0001 | 0.3923 |
|
| 1 | 1 | 1 | 1 | 0 | |
|
|
| <0.0001 | <0.0001 | <0.0001 | <0.0001 | <0.0001 |
|
| 1 | 1 | 1 | 1 | 1 | |
|
|
| <0.0001 | <0.0001 | <0.0001 | <0.0001 | <0.0001 |
|
| 1 | 1 | 1 | 1 | 1 | |
|
|
| <0.0001 | <0.0001 | <0.0001 | <0.0001 | 0.0044 |
|
| 1 | 1 | 1 | 1 | 1 | |
|
|
| <0.0001 | <0.0001 | 0.0435 | <0.0001 | 0.1231 |
|
| 1 | 1 | 1 | 1 | 0 | |
The crossover and mutation operation act on substring.
Figure 5Figures of the convergence processes of BPSO, BQPSO, and SOGA.
Figure 6Figures of the convergence processes of SOGA and GA when the crossover and mutation operation act on substring.